Enable javascript in your browser for better experience. Need to know to enable it? Go here.

Harness quality evaluation

Published : Nov 04, 2026
Nov 2026
Assess ?

Nowadays, organizations and teams come up with custom harnesses tailored to their projects, including agent skills, plugins, AGENTS.md and deterministic guardrails. Harness quality evaluation has become an important technique. Guardrails and harnesses help a coding agent course-correct and improve overall quality, but only if they actually work.

A harness usually includes both deterministic and non-deterministic components. For non-deterministic harnesses, our teams use PluginEval to evaluate coding agent plugins or skills. For deterministic harnesses, we introduce a test suite to enable TDD-style development of any guardrails, ensuring each one actually works and providing evidence of its effectiveness. We recommend running evaluations on a scheduled basis (such as nightly or alongside CI).

Download the PDF

 

 

 

English | Português 

Sign up for the Technology Radar newsletter

 

 

Subscribe now

Download the PDF

 

 

 

English | Português 

Sign up for the Technology Radar newsletter

 

 

Subscribe now

Visit our archive to read previous volumes