Technology Radar
Risk-tiered human oversight aligns review depth with what a change could break. Reviewing everything with the same intensity ends in human-in-the-loop theater. We suggest systematically triaging changes. The riskiest or hardest-to-reverse changes are reserved for humans to apply. Intermediate-risk changes go through human review. Low-risk changes can be auto-merged by coding agents through a continuous integration pipeline.
Two strategies can help us decide which changes need more review. Zones in the codebase require elevated review with particular files or directories, while LLM-based change classification analyzes the impact of changes but is fallible. Meta's published process combines these two approaches. Our teams find risk-tiered human oversight an effective way to make the best use of scarce human attention.
