Evaluation & Governance

Bias Benchmark

A benchmark measuring systematic demographic-group disparities in model outputs. Common examples: BBQ (Bias Benchmark for QA), StereoSet, RealToxicityPrompts. Rarely reported by vendors in launches; enterprise buyers should ask for results.

Related terms

Red-Teaming
Structured adversarial testing of an AI system, either manually or via automated attack pipelines, to find prompt injection, jailbreak, harmful-output, and misuse vulnerabilities before release. Increasingly required by AI regulation for high-risk systems.

Framework dimensions

Free tools

Whitepapers

GenAI Governance Playbook

Comparisons

EU AI Act vs NIST AI RMF vs ISO 42001: Framework Comparison

Next steps

Take the assessment— See where you stand

Where this fits

Bias Benchmark is part of the Evaluation & Governance vocabulary used in the Generative AI Maturity Framework. See the full glossary for the complete set of 149 defined terms, or take the free maturity assessment to see where your organisation stands.