Lilian Weng highlights harness engineering as a path to recursive self-improvement in AI systems
A new synthesis of 35 papers argues that harnesses—goal-setting and scaffolding systems—will be central to AI self-improvement, not direct weight updates.
2 sources · cross-referenced
- Lilian Weng published a synthesis of 35 papers on harness engineering for recursive self-improvement (RSI).
- She argues harnesses will evolve toward self-improvement and auto-research, making them central to RSI.
- The post recaps design trends and recent literature, including the ACE paper and Meta-Harnesses.
- Industry product moves this week reflect the same shift: Anthropic’s background agent UX, Google’s managed agents, and new agent infra from LangChain and others.
- Meta previewed Muse Video alongside Muse Image, emphasizing agentic generation loops and scaled test-time compute.
Lilian Weng, cofounder at Thinky, published a synthesis of 35 papers on harness engineering for recursive self-improvement (RSI), arguing that harnesses—not direct weight updates—are likely to be the dominant mechanism for future AI self-improvement. In her post, she frames RSI as a feedback loop where models improve the training pipeline and deployment systems that, in turn, enable better successor models. She also emphasizes that even as improvements are internalized into core models, the need to specify goals and context will persist.
The synthesis recaps proven design trends in harnesses and surveys recent literature, highlighting the ACE paper and newer work such as Meta-Harnesses. Weng suggests harness engineering will evolve toward self-improvement and enable auto-research, positioning harnesses as a foundational layer for smarter systems.
Industry product announcements this week reflect the same shift. Anthropic expanded its "background agent" user experience across mobile and web with Claude Cowork, positioning Claude as a task-running background teammate rather than a foreground chat interface. Google added background execution, remote MCP servers, custom function calling, and credential refresh to the Gemini API Managed Agents. LangChain launched a Deep Agents course and an open-source harness project, while Hermes Agent added pluggable secrets managers and native 1Password integration.
Meta previewed Muse Video alongside the earlier Muse Image release, emphasizing an explicitly agentic generation loop: planning, web search, tool use, code execution, and self-refinement before rendering. Meta reports that performance improves with scaled test-time compute and that self-refinement behavior emerged during reinforcement learning rather than being hand-scripted.
NVIDIA and Cohere also shipped audio releases. NVIDIA released Audex, a 30B parameter/3B active MoE with 1M context for unified text+audio work, claiming preservation of text intelligence alongside broad audio generation and understanding via a single MoE backbone. Cohere launched Cohere Transcribe Arabic as an Apache 2.0–licensed ASR model focused on dialects, code-switching, and Arabic-accented English.
- Jul 7, 2026 · TechCrunch — AI
Claude Cowork agent expands to mobile and web with cross-device task continuity
Trust79 - Jul 7, 2026 · Latent Space — swyx
Latent Space highlights Fable 5’s agentic lead and Tencent’s Hy3 as open frontier shifts to deployment robustness
Trust72 - Jul 3, 2026 · Simon Willison — weblog
Developer documents workflow to let coding agents exercise their own judgment
Trust79