Skip to content

Testing Frameworks & Open-Source Repos

E2E, API, and performance automation — each backed by CI/CD pipelines and live reports.

LLM Evaluation Framework

Automated evaluation for LLM outputs, RAG accuracy, and hallucination scoring

Eval SuiteRAG & LLMPromptfoo / Custom
RAG Accuracy
Hallucination Check
Custom Benchmarks
CI/CD Eval Pipeline
Automated Scoring
Model Comparison
Repositoryllm-evaluation-framework-example

Promptfoo Security Testing

LLM vulnerability scanning, jailbreak testing, and red teaming with Promptfoo

Red TeamingJailbreak ScansPromptfoo
Red Teaming
Jailbreak Defense
PII & Leak Checks
CI/CD Guardrails
Vulnerability Scan
Security Reports
Repositorypromptfoo-security-testing-example

E2E Automation with Playwright

TypeScript-first, cross-browser test suite targeting saucedemo.com

29 tests2 browsers58 CI runs
True Parallelism
Trace Capture
Centralised Fixtures
CI/CD on Push & PR
HTML Reports
Chromium + Firefox
Repositoryplaywright-example

Cypress · TypeScript

Typed spec files with reusable commands and Mochawesome reports

28 tests5 specsCypress 14
TypeScript Specs
cy.login() Command
Mochawesome Reports
GitHub Actions CI
Video Recording
Failure Screenshots
Repositorycypress-typescript-example

Cypress · Cucumber BDD

Gherkin feature files with JavaScript step definitions

27 scenariosGherkinAllure
Feature Files
Step Definitions
Allure Reports
CI/CD Pipeline
Cart & Checkout
Gherkin Scenarios
Repositorycypress-with-cucumber-example

OpenAPI Contract Testing

Automated schema & API contract validation against OpenAPI / Swagger specs

OpenAPI 3.0Schema ValidationDredd / Spectral
OpenAPI Specs
Schema Validation
Breaking Change Alert
CI/CD Automation
Linting & Rules
Contract Reports
Repositoryopenapi-contract-testing-example

Pact Contract Testing

Consumer-driven contract testing for microservices using Pact

Pact BrokerConsumer/ProviderMicroservices
Consumer Contracts
Provider Verification
Pact Broker Sync
CI/CD Gates
Microservice Guard
Mock Service Provider
Repositorypact-contract-testing-example

Selenium · JUnit 5

Clean POM architecture with JUnit 5 runner and Allure reporting

12 testsJava 17Allure
Clean POM
JUnit 5 Runner
Allure Reports
GitHub Actions CI
Login Flows
Checkout E2E
Repositoryselenium-java-example

Selenium · TestNG

@DataProvider matrix covering all 5 saucedemo accounts

7+ runs@DataProviderAllure
@DataProvider Matrix
5 User Accounts
Allure Reports
GitHub Actions CI
Headless Chrome
WebDriverManager
Repositoryselenium-java-testng-example