A quality gate is an automated check that compares evaluation scores against a threshold and blocks the release when quality regresses. Run offline against a frozen dataset in CI/CD, or online against sampled production traffic, gates turn evaluation from a report into a control.

Why it matters

A quality gate converts evaluation from a report someone might read into a control that stops a bad change from shipping.

How it works

Evaluation scores are compared against a threshold. In CI/CD, a failing score blocks the deploy; online, a failing score flags the sampled request. Either way the decision is automated and consistent.

Example

Block the merge when the golden-set pass rate drops below 0.90, or flag any production request whose judge score falls under 3.

← Back to the full glossary

Put the platform behind the terms

Route, evaluate, and monitor every AI request from one OpenAI-compatible platform.

Start Free → Explore the Features