Testing Frameworks & Open-Source Repos

E2E, API, and performance automation — each backed by CI/CD pipelines and live reports.

AI & LLM Testing

LLM evaluation frameworks, RAG benchmarks, and Promptfoo security red-teaming

LLM Evaluation Framework

Automated evaluation for LLM outputs, RAG accuracy, and hallucination scoring

Eval SuiteRAG & LLMPromptfoo / Custom
psychologyRAG Accuracy
analyticsHallucination Check
fact_checkCustom Benchmarks
sync_altCI/CD Eval Pipeline
auto_awesomeAutomated Scoring
securityModel Comparison

Promptfoo Security Testing

LLM vulnerability scanning, jailbreak testing, and red teaming with Promptfoo

Red TeamingJailbreak ScansPromptfoo
securityRed Teaming
bug_reportJailbreak Defense
shieldPII & Leak Checks
sync_altCI/CD Guardrails
gavelVulnerability Scan
assessmentSecurity Reports

Modern E2E Testing

Cross-browser automation with Playwright and Cypress BDD

E2E Automation with Playwright

TypeScript-first, cross-browser test suite targeting saucedemo.com

29 tests2 browsers58 CI runs
blur_onTrue Parallelism
replayTrace Capture
storageCentralised Fixtures
sync_altCI/CD on Push & PR
assessmentHTML Reports
devicesChromium + Firefox

Cypress · TypeScript

Typed spec files with reusable commands and Mochawesome reports

28 tests5 specsCypress 14
codeTypeScript Specs
lockcy.login() Command
assessmentMochawesome Reports
sync_altGitHub Actions CI
videocamVideo Recording
photo_cameraFailure Screenshots

Cypress · Cucumber BDD

Gherkin feature files with JavaScript step definitions

27 scenariosGherkinAllure
descriptionFeature Files
ecoStep Definitions
insert_chartAllure Reports
sync_altCI/CD Pipeline
shopping_cartCart & Checkout
fact_checkGherkin Scenarios

Contract Testing

OpenAPI schema validation and Pact consumer-driven contract testing

OpenAPI Contract Testing

Automated schema & API contract validation against OpenAPI / Swagger specs

OpenAPI 3.0Schema ValidationDredd / Spectral
schemaOpenAPI Specs
descriptionSchema Validation
verified_userBreaking Change Alert
sync_altCI/CD Automation
ruleLinting & Rules
assessmentContract Reports

Pact Contract Testing

Consumer-driven contract testing for microservices using Pact

Pact BrokerConsumer/ProviderMicroservices
handshakeConsumer Contracts
hubProvider Verification
receipt_longPact Broker Sync
sync_altCI/CD Gates
compare_arrowsMicroservice Guard
check_circleMock Service Provider

API & Performance Testing

k6 load testing, Supertest API validation, and Postman collections

Legacy E2E Testing Examples

Selenium Java test suites built with JUnit 5 and TestNG data providers

Selenium · JUnit 5

Clean POM architecture with JUnit 5 runner and Allure reporting

12 testsJava 17Allure
layersClean POM
fact_checkJUnit 5 Runner
assessmentAllure Reports
sync_altGitHub Actions CI
lockLogin Flows
shopping_cartCheckout E2E

Selenium · TestNG

@DataProvider matrix covering all 5 saucedemo accounts

7+ runs@DataProviderAllure
grid_view@DataProvider Matrix
group5 User Accounts
assessmentAllure Reports
sync_altGitHub Actions CI
visibility_offHeadless Chrome
settingsWebDriverManager