safety-testing

Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.

End-to-end Al/LLM security, safety and penetration testing framework for prompt injection, jailbreaks, RAG security, agentic attacks, red teaming, and monitoring.

Test LLM safety rules in Arabic: refusal accuracy and over-refusal across MSA and 6 dialects. YAML cases, a CLI, and a CI gate.

Evaluation and observability lab for LLM agents: behavior, safety, latency, cost, redacted traces, and repeatable CI.

AI agent for agentic AI safety testing and security gate validation, built with Agentic Star.

DeepEval LLM evaluation framework using Claude API — tests GEval, Hallucination, Answer Relevancy, Faithfulness, Contextual Precision/Recall, Bias, Toxicity, PII Leakage, and Tool Correctness on a mock AI customer support assistant.