Glossary / meta-judge

Meta-Judge

A higher-capability LLM judge that resolves disagreement between primary judges in a multi-judge consensus pipeline.

Methodology

← All terms

A meta-judge is a higher-capability LLM that resolves disagreement between the primary judges in a multi-judge consensus pipeline. After three independent judges score a finding, the meta-judge sees their verdicts, confidences, and rationales, and produces a final verdict.

Meta-judges typically use a stronger reasoning model than the primary judges, because the meta-judge's job is to weigh competing rationales rather than to evaluate the raw finding. Low-confidence meta-judge outputs are routed to a human review queue.

This pattern is documented in the Penaxtra architecture page and underpins the cost-per-finding economics: meta-judge invocations are the most expensive but also the rarest call in the pipeline.

See Meta-Judge in production.

The Penaxtra platform implements the controls and assessments described above as part of its AI-SPM programme.

AI-SPM platform overview