# Harness engineering

A pack of 8 talks from the AI Engineer YouTube channel, in the order to watch them. 4h 36m of video.
Page: https://aietalks.com/packs/harness-engineering

When an agent forgets its plan, edits the wrong file or declares victory without changing anything, the model is only one suspect. The harness selected its context and tools, decided where code would run, and defined what required approval. Opening that machinery reveals a measurable loop, which then needs a safe Linux environment. Longer jobs add a harder requirement: earlier actions must change the world a later step sees, and the judge must inspect that state rather than trust a polished final answer. Plans and progress files carry work between fresh sessions while a separate evaluator checks the running application. Event logs can later rebuild the run, checkpoints let a team fork it, and receipts prove what actually reached the user.

## This pack is for you if

- Your agent works for twenty minutes, then loses the plan or repeats work it already finished.
- Generated code needs a real Linux environment, but you cannot safely give it the host machine.
- A production run said it succeeded, and you cannot prove what changed or what the user received.

## The talks, in order

### 1. Codex, Behind the Harness

Dominik Kundel, OpenAI | 20:55 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=shRR1e2HXMk
Summary: https://aietalks.com/talks/codex-behind-the-harness.md

Why first: Kundel opens the machine and names its parts: context, tools, sandbox, approvals, continuation and compaction. Mistele can then narrow the argument from everything a harness controls to the mechanism that keeps work moving: the loop.

### 2. Loop Engineering from First Principles

Kyle Mistele, HumanLayer | 17:57 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=xIt_mTQp6mY
Summary: https://aietalks.com/talks/loop-engineering-from-first-principles.md

Why second: Kundel inventories the harness. Mistele gives its loop a shape: measure the codebase, make one change, measure again, and do not create work faster than people can review it. Bhardwaj follows by asking where that loop can safely execute.

### 3. Arrakis: How to Build an AI Sandbox from Scratch

Abhishek Bhardwaj, OpenAI | 40:18 | AI Engineer World's Fair 2025
Video: https://www.youtube.com/watch?v=wsFd22SL1s8
Summary: https://aietalks.com/talks/arrakis-how-to-build-an-ai-sandbox-from-scratch.md

Why here: Mistele limits what one loop attempts. Bhardwaj limits where it runs. MicroVMs put another boundary between generated code and the host kernel, while memory and filesystem snapshots let an agent return to a working state after a bad plan.

### 4. Rethinking Environments for Long-Horizon Work

Rayan Garg, Theta Software | 21:15 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=2aS7aKoXn64
Summary: https://aietalks.com/talks/rethinking-environments-for-long-horizon-work.md

Why here: Bhardwaj preserves the environment. Garg explains what that environment must contain if long work is going to mean anything. Earlier actions have to change later choices, and the judge needs guarded access to the final state rather than a polished answer from the agent.

### 5. Build Agents That Run for Hours

Ash Prabaker & Andrew Wilson, Anthropic | 1:15:40 | AI Engineer Europe 2026
Video: https://www.youtube.com/watch?v=mR-WAvEPRwE
Summary: https://aietalks.com/talks/build-agents-that-run-for-hours.md

Why here: Garg specifies the environment and the judge. Prabaker and Wilson show the machinery built around them: fresh sessions, a plan, progress files, Git commits, live verification and a separate evaluator that is better at criticism than the generator is at judging itself.

### 6. Make your own event-sourced agent harness using stream processors

Jonas Templestein & Misha, Iterate | 1:04:27 | AI Engineer Europe 2026
Video: https://www.youtube.com/watch?v=vi-2nasppAg
Summary: https://aietalks.com/talks/make-your-own-event-sourced-agent-harness-using-stream-processors.md

Why here: Prabaker and Wilson use files and contracts to keep a long run coherent. Templestein and Misha expose the state model underneath. An append-only event log can rebuild what the agent knew without repeating the old tool calls and other side effects.

### 7. Your Agents Need a Save Button

Hamza Tahir, ZenML | 17:07 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=bZISsg7H7DA
Summary: https://aietalks.com/talks/your-agents-need-a-save-button.md

Why here: Templestein and Misha make state reconstructable. Tahir asks for more: a saved execution that includes the code, filesystem and variables needed to resume or fork it. That lets a team test a new model, tool or policy against a production run.

### 8. Your Agent Didn't Fail. Your Harness Did.

Vinoth Govindarajan, OpenAI | 18:26 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=BInpv7lGp1o
Summary: https://aietalks.com/talks/your-agent-didnt-fail-your-harness-did.md

Why last: Tahir shows how to revisit a run. Govindarajan sets the stricter production standard. The harness should prove what woke the agent, what state it inherited, what authority it used, what executed and what evidence reached the user. Without that receipt, success is only a claim.

## Editor's note

Templestein reconstructs state, Tahir reruns saved executions, and Govindarajan asks for evidence that survives the run. Kitaru records an agent's inputs, outputs and tool calls so a team can rerun the same task after changing a model, tool or policy, then inspect where the new run took a different path.

Written by the AIE Talks editors (the Kitaru team), not by any of the speakers.
