← AI glossary

AI glossary · Basic · Agents · Language models · Efficiency & infra

HarnessPro

HarnessPro is a research method in which an AI agent analyzes its own execution records and revises the harness (the bundle of prompts, tools and execution rules) that wraps it. It aims to improve performance while reducing execution cost.

About this term
Level
Basic · Technical terms you often meet in AI news
Added
2026-11-01
In plain words It is similar to a chef who reviews the kitchen layout and recipe notes every day and makes adjustments, while preparing three menus at once — a 'fast and cheap menu', a 'balanced menu' and a 'carefully prepared menu' — to match each customer's budget. The thing actually being changed, however, is not the chef's skill (the model weights) but the kitchen environment (the harness).

What it is

HarnessPro is a method reportedly published by researchers from Tsinghua University and Zhipu, with the paper posted to arXiv in October 2026. A harness is the outer framework that wraps a model and makes it perform tasks, including prompts, tools and execution procedures. Recursive self-improvement approaches, in which agents improve their own harness, existed before, but the paper points out that such approaches often raise execution cost along with performance. The core of HarnessPro is revising the harness while weighing performance and cost together.

How it works

First, the agent runs tasks with the harness and records the execution process (Trajectory). Agents assigned specialist roles diagnose these records, draw up improvement plans with different priorities such as performance-first or cost-first, and create new candidate harnesses. Candidates are evaluated with LLM-generated tests rather than ground-truth answers or official tests; this is called a label-free approach because no ground-truth labels are needed. Then three harnesses are selected — cost-focused (lite), balanced (medium) and performance-focused (heavy) — and passed to the next iteration, continuing a loop of revising based on execution results.

HarnessPro's improvement loop

  1. 1. Run tasks Record Trajectory
  2. 2. Diagnose records Analyzed by specialist agents
  3. 3. Create candidate harnesses Improvement plans by priority
  4. 4. Evaluate with LLM tests Without ground truth
  5. 5. Select three lite·medium·heavy
The process repeats: run, diagnose the records, create and evaluate candidates, then select and run again.

Why it matters

Because it improves agents by revising only the harness without retraining model weights, it is a relatively lightweight direction to try. Rather than a single 'best' harness, it offers three for different budgets, so cost-sensitive services and performance-sensitive services can each choose. The paper states that on Terminal-Bench 2, SWE-Bench Pro and ProgramBench, using GPT-5.5 with Codex, heavy mode raised the pass rate by an average of 2.0 percentage points over the comparison method (RHO) and cut cost per task by an average of 26.1%. It said these advantages also held for GLM-5.2 used with Claude Code.

Three harnesses chosen by budget

← Cost-focusedPerformance-focused →
123
  1. lite
  2. medium
  3. heavy
Further left saves more cost; further right prioritizes performance. Choose according to the budget where it is used.

Things to know

As of `today`, HarnessPro is a research paper under review, not a finished commercial product. The performance and cost figures are results reported by the researchers themselves and are based on specific benchmarks and comparison methods, so whether the same effect holds in real work environments needs to be checked separately. Because evaluation uses LLM-generated tests, there is also a risk that the harness could be 'improved' in the wrong direction if those tests are weak. Since the agent changes its own execution environment, it is safer in practice to also have a mechanism for humans to review the changed harness.

Example

This site's news item 'Tsinghua University and Zhipu's HarnessPro: agents revise their harness by reviewing their own execution records… "26.1% lower cost per task" (reported)' covered this term. For example, a team running a coding agent could picture using this approach to split the work: a cost-saving lite harness for large-scale internal automation tasks, and a performance-focused heavy harness for difficult bug fixes.

Where it came up on this site

Related terms

References