# Beyond the chat box

A pack of 9 talks from the AI Engineer YouTube channel, in the order to watch them. 2h 46m of video.
Page: https://aietalks.com/packs/beyond-the-chat-box

AI products inherited the chat box before anyone knew whether it was the right interface. The first talk compares prompting to punch cards. The next two put help back inside the user's work and replace the long conversation with documents, tables and other things that persist. Once that sounds appealing, the awkward implementation questions arrive: which components may the model choose, what can each client render, and where does generated code run? The final three talks care less about novelty than control. Shared work has to stay visible and interruptible. More importantly, the interface should make a person examine the evidence rather than approve whatever the model put in front of them.

## This pack is for you if

- Your AI feature works in a chat demo, but users have to leave their real work and restate the context to use it.
- Your team is choosing between fixed components, declarative UI and generated HTML without a clear reason for the choice.
- You are giving agents longer jobs and need people to inspect, interrupt and judge the work while it is happening.

## The talks, in order

### 1. The Prompt Is Still a Punch Card

Ted Johnson, JoinIn AI | 20:13 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=hVJOnuhFmTA
Summary: https://aietalks.com/talks/the-prompt-is-still-a-punch-card.md

Why first: Johnson names the protocol the rest of the pack is trying to escape. Prompting still looks like batch work: assemble a request, submit it, wait, inspect the answer and submit a repair. Objartel's talk makes more sense once that hidden interface work is visible.

### 2. Don't Just Slap on a Chatbot: Building AI That Works Before You Ask

Arthur Objartel, Evil Martians | 05:46 | AI Engineer Summit 2025
Video: https://www.youtube.com/watch?v=2cEGQEllBGc
Summary: https://aietalks.com/talks/dont-just-slap-on-a-chatbot-building-ai-that-works-before-you-ask.md

Why second: Johnson explains why prompting feels like batch work. Objartel offers the first practical alternative: help that appears inside the task, where the context already exists, and asks before making a change that may be wrong.

### 3. Agents Need More Than a Chat

Jacob Lauritzen, Legora | 14:21 | AI Engineer Europe 2026
Video: https://www.youtube.com/watch?v=XNtkiQJ49Ps
Summary: https://aietalks.com/talks/agents-need-more-than-a-chat.md

Why here: Objartel moves assistance into an existing workflow. Lauritzen shows why complex work also needs something that lasts. Documents and tables expose decisions, accept edits and comments, and give a person somewhere to review work that would disappear inside one long thread.

### 4. The End of the Static Screen: Architecting Intent-Driven UX

Gus Iwanaga, commercetools | 23:19 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=QrMcNe2jjt8
Summary: https://aietalks.com/talks/the-end-of-the-static-screen-architecting-intent-driven-ux.md

Why here: Lauritzen argues for persistent artifacts. Iwanaga explains how a product can assemble one from a user's intent without letting the model improvise the whole interface. His failed sales-report experiments make the case for a schema and a known set of native components.

### 5. Agent Output Is Not UX: Rendering Layer Your LLM Pipeline Is Missing

Bala Ramdoss, Amazon | 14:13 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=maTp79FD9gI
Summary: https://aietalks.com/talks/agent-output-is-not-ux-rendering-layer-your-llm-pipeline-is-missing.md

Why here: Iwanaga defines the declarative contract at product level. Ramdoss follows it down into streaming, client versions and fallbacks. A model response is still raw material; the rendering layer decides what an old phone or a current web client can safely turn into an interaction.

### 6. Beyond Components: Designing Generative UI for MCP Apps

Ruben Casas, Postman | 16:58 | AI Engineer Europe 2026
Video: https://www.youtube.com/watch?v=hCMrEfPG2Yg
Summary: https://aietalks.com/talks/beyond-components-designing-generative-ui-for-mcp-apps.md

Why here: Ramdoss shows how to deliver controlled components across real clients. Casas widens the choice: static UI, model-selected components or generated code. The extra freedom is real, but so is the trust boundary around HTML, CSS and JavaScript written at runtime.

### 7. Creating Agents that Co-Create

Karina Nguyen, OpenAI | 24:22 | AI Engineer Summit 2025
Video: https://www.youtube.com/watch?v=1XvN5EBDnDw
Summary: https://aietalks.com/talks/creating-agents-that-co-create.md

Why here: Casas ends with a shared, editable artifact. Nguyen shows what that feels like in practice. Canvas lets a person and a model write, code, research and correct the work in the same place instead of passing messages across a chat transcript.

### 8. UX Design Principles for Semi Autonomous Multi Agent Systems

Victor Dibia, Microsoft | 20:28 | AI Engineer
Video: https://www.youtube.com/watch?v=fmZWvE7yDZo
Summary: https://aietalks.com/talks/ux-design-principles-for-semi-autonomous-multi-agent-systems.md

Why here: Nguyen says shared work must remain open to correction. Dibia turns that into controls: show what the agents are doing and where their information came from, let a person interrupt or roll back, and expose enough cost and risk to decide how much autonomy to grant.

### 9. Build AI Systems for Discernment, Not Approval

Angel Ortmann Lee, Duolingo | 25:53 | AI Engineer World's Fair 2026
Video: https://www.youtube.com/watch?v=CDqzWpwkSls
Summary: https://aietalks.com/talks/build-ai-systems-for-discernment-not-approval.md

Why last: Dibia gives people controls over autonomous work. Ortmann Lee closes with the harder problem: controls do little if the screen still invites a rubber stamp. Separating the model's signal from the decision and asking for independent evidence can change judgment without changing the model.
