Evaluation — Advanced
How large should a golden evaluation dataset be?
Start with 50-100 examples covering the input distribution (typical, edge, adversarial). Grow to 300-500 for a production system. Beyond ~1,000 the marginal value drops sharply unless you have distinct sub-populations you need to measure separately. Quality of examples matters much more than quantity.
More on Evaluation — Advanced
Related on this site
Framework dimensions
Free tools
Whitepapers
Browse the full FAQ for 164 answers, or start a free GenAI maturity assessment to see where your organisation stands.