Technology Radar
A self-improving harness uses agents to analyze execution traces and evaluation feedback, then propose or implement improvements to the system surrounding the model, including prompts, context strategies, workflows, skills, tools, memory and middleware. The idea isn’t new: techniques such as the feedback flywheel use successes and failures from coding-agent sessions to improve the harness but still rely on humans to interpret the feedback, decide what to change and update the system. Recent research explores a more self-directed approach. Meta-Harness and VERSE use execution traces and evaluation results to improve harness code; VERSE also evolves the optimizer’s own tools and procedures. Lilian Weng’s overview traces this progression from prompt optimization to harness evolution.
Observability and programmability are essential to this transition. Observability helps agents diagnose failures from execution traces and connect changes to measurable outcomes, while programmability gives agents access to components they can inspect, modify and test, expanding the scope for self-improvement. Pi’s extensions, Claude Code Mods and DeepSeek Harness (DSH) illustrate this direction through extensible context, workflows, tools and harness components.
Greater openness creates more opportunities for improvement, but gains still require validation. We recommend bounded experiments with regression testing, while humans define objectives, set modification boundaries and assess whether improvements generalize to new tasks.
