# AI Engineer Summit 2023, Day 2 Livestream

Mario Rodriguez, GitHub & Dedy Kredo, CodiumAI & Matt Welsh, Fixie.ai & Amelia Wattenberger, Adept & Samantha Whitmore & Jason Yuan, New Computer & Joseph Nelson, Roboflow & Hassan El Mghari, Vercel & Paul Copplestone, Supabase & Daniel Rosenwasser, Microsoft & Jason Liu, Fivesixseven & Anton Troynikov, Chroma & Jerry Liu, LlamaIndex & Mithun Hunsur, Ambient & Abi Aryan, O'Reilly & Simon Willison, Datasette & Benjamin Dunphy, Software 3.0 LLC & swyx, Latent.Space & Smol.ai | AI Engineer Summit 2023 | 7:30:56

Source: https://www.youtube.com/watch?v=qw4PrtyvJI0
Channel: AI Engineer (https://www.youtube.com/@aiDotEngineer). Summarised by AIE Talks.
Page: https://aietalks.com/talks/ai-engineer-summit-2023-day-2-livestream
Published: 2023-10-11
Tags: design, evals, guardrails, rag

## TL;DR
- AI products need fast feedback loops, careful evaluation, and interfaces designed around how people actually work.
- Retrieval, fine-tuning, local models, typed outputs, and guardrails each address different weaknesses in language-model applications.
- The most useful AI engineering work often starts with a small, practical application and improves through real usage.

## Summary
Day two of the AI Engineer Summit covers the practical work of turning language models into products. Mario Rodriguez describes GitHub Copilot as a system built around low latency, good user experience, evaluation, and developer flow. Other talks cover reactive applications, typed model outputs, fine-tuning, local inference, vector search, and guardrails. Several speakers argue that basic demos are easy while production systems need better retrieval, testing, permissions, and recovery when models fail. Amelia Wattenberger presents interfaces that let users move between levels of abstraction, while New Computer explores computers that adapt to context and input modality. Joseph Nelson and Hassan El Mghari show how small open-source projects can attract large audiences when they are simple, useful, and easy to share. Simon Willison closes with open questions about prompt injection, model size, sandboxes, interfaces, and how language models can help more people automate tedious work.

## Key ideas
### Copilot works when it protects the developer's flow
[06:58](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=418s)
Mario Rodriguez says GitHub Copilot became useful through a combination of the Codex model, ghost text, low latency, and careful prompt and interface design. A completion system has to respond quickly enough that the developer does not leave the flow of writing code. He says Copilot's purpose is to remove boilerplate and interruptions, rather than optimize only for lines of code accepted. He also warns that syntax understanding is not software development. An AI may read Java or another language while still needing semantic context to produce code that fits the application. At scale, teams need global deployments and both offline and online evaluations.

### AI interfaces should automate small tasks inside larger human goals
[57:48](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=3468s)
Amelia Wattenberger uses spreadsheets to explain why automation and augmentation are connected. A spreadsheet automates calculations so that people can spend more time understanding financial data. She applies the same idea to AI interfaces, where models handle tedious sub-tasks while the user remains focused on a larger decision. Her ladder-of-abstraction examples include maps, books, and a hypothetical Airbnb search. A user might move from an individual listing to a table of fifty listings, then to a scatter plot, while still being able to book or contact a host. The interface should generate these views and preserve actions across them.

### Production RAG needs evaluation beyond nearest-neighbor search
[5:08:51](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=18531s)
Jerry Liu describes naive RAG as a data-ingestion stage followed by retrieval and synthesis. That basic pattern often fails because retrieval returns irrelevant chunks, misses needed context, or places useful information where the model loses it in the middle of the context window. He recommends measuring retrieval separately from end-to-end answer quality. Practical improvements include better parsing, chunk-size tuning, hybrid search, metadata filters, reranking, and small-to-big retrieval. For more complex questions, agents can treat documents as tools that support summarization and targeted question answering. Fine-tuning embeddings or a smaller language model can further improve a specific pipeline, but only after the team has a benchmark.

### Typed schemas can connect natural-language requests to reliable application data
[4:18:48](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=15528s)
Daniel Rosenwasser presents TypeChat as a way to use TypeScript types to guide and validate language-model output. Parsing prose is fragile, and asking for JSON alone does not guarantee that the response has the required fields or structure. TypeChat uses application types to describe the desired result, then uses validation errors to ask the model to repair an invalid response. Rosenwasser demonstrates a coffee-shop schema that turns requests into orders and records unknown text when the model cannot map part of a request. The same approach can express commands and multi-step programs, with a constrained intermediate representation that limits available operations.

### Local models trade general capability for control, privacy, and deployment freedom
[6:18:05](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=22685s)
Mithun Hunsur explains that local language models run on hardware the developer controls, rather than through a hosted API. They can reduce per-token costs, keep private data on the machine, and allow custom models for narrow tasks. Quantization compresses model parameters so that models fit on consumer hardware, although smaller models generally have less broad capability. His Rust library lm.rs aims to provide a native, customizable interface across model architectures, back ends, and platforms. He shows uses including a Discord bot, system-wide autocomplete, and extracting structured dates from Wikipedia. The limits are hardware capacity, model quality, changing formats, and sometimes restrictive licenses.

### Verification loops make nondeterministic model output safer to use
[6:36:29](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=23789s)
Shrea Rajal argues that traditional software assumes repeatable outputs, while language-model applications can return different answers to the same request and can fail through hallucinations, prompt injection, bad structure, or unsafe content. Guardrails places a verification suite around the model call. Checks can test for profanity, competitor mentions, executable code, grounded answers, or sensitive advice. When a check fails, the system can re-ask the model with the violation explained, filter or repair the result, fall back to another system, or log the failure. Rajal recommends using deterministic rules and smaller classifiers where possible, with model self-reflection reserved for problems that need it.

### Simple open-source AI applications can reach large audiences
[2:09:55](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=7795s)
Hassan El Mghari describes building AI projects on weekends, including tools for image alt text, QR codes, article summaries, commit messages, photo restoration, and room redesign. His examples use accessible APIs and models rather than custom training. RoomGPT gained attention after he used ControlNet to preserve room structure, while his photo restoration project used GFPGAN and later added image moderation with TensorFlow.js. He recommends keeping an MVP narrow, using the newest useful model, launching early, and iterating from real usage. Open source and free access helped distribution, while search, word of mouth, and sharing mattered more than his own Twitter traffic. He also says the user interface deserves most of the development time.

### Prompt injection remains an unresolved application-security problem
[6:55:33](https://www.youtube.com/watch?v=qw4PrtyvJI0&t=24933s)
Simon Willison distinguishes attacks on language models from attacks on applications that combine trusted instructions with untrusted input. In his example, an email-reading assistant could receive a malicious message telling it to find password-reset emails, forward them, and delete the evidence. He says filtering and detection offer partial protection, but a determined attacker can keep trying. This limits what developers can safely connect to private data and external actions. Willison also calls for robust local sandboxes so generated code can run without harming the user's machine. He sees WebAssembly as a possible direction, but says the problem is not solved.

## Notable quotes
- "UX matters in what we're doing. Don't think that you're just going to get something out there." (14:32)
- "Types are all you need." (4:04:59)
- "The simple RAG loop might be the bread and butter of most of the applications being developed today, but the most powerful things that you'll be able to build with AI in the future require a much more capable retrieval system." (5:06:34)
- "We need to be 100% sure that this isn't going to work before we unleash these AI assistants on our private data." (7:01:23)
- "Right now is the time to learn to program because large language models flatten that learning curve." (7:15:03)

## Tools & references mentioned
- GitHub Copilot
- Codex
- GPT-3.5 Turbo
- GPT-4
- CodiumAI
- AI JSX
- Fixie
- React
- Anthropic
- OpenAI
- Supabase Vector
- Postgres
- pgvector
- Pinecone
- Chroma
- LlamaIndex
- LangChain
- TypeChat
- TypeScript
- lm.rs
- llama.cpp
- Llama 2
- Falcon
- ControlNet
- GFPGAN
- TensorFlow.js
- Guardrails AI
- AirTrain
- Hugging Face
- Replicate
- Vercel
- Stable Diffusion XL
- Whisper
- ElevenLabs
- Simon Willison
- Brett Victor
- Voyager

## Who should watch
- You are building a RAG, agent, or AI-assisted workflow and need concrete ways to evaluate retrieval, synthesis, and failure cases.
- You want to ship a small AI product quickly and need guidance on model choice, interface design, open source distribution, and operating costs.
- You are connecting language models to private data or external actions and need to think through permissions, prompt injection, sandboxing, and verification.

## Related talks

- [AI Engineer Summit 2023, Day 1 Livestream](https://aietalks.com/talks/ai-engineer-summit-2023-day-1-livestream) (Benjamin Dunphy, Software 3.0 LLC & swyx, Latent.Space & Smol.ai & Amjad Masad & Michele Catasta, Replit & Toran Bruce Richards, AutoGPT & Simón Fishman & Logan Kilpatrick, OpenAI & Flo Crivello, Lindy & Barr Yaron, Amplify & Sasha Sheng & Harrison Chase, LangChain & Shreya Rajpal, Guardrails AI & Eugene Yan, Amazon & Linus Lee, Notion & Brittany Walker, CRV & Chris White, Prefect & Bryan Bischof, Hex, 4:50:00)
- [AI Engineering 201: The Rest of the Owl](https://aietalks.com/talks/ai-engineering-201-the-rest-of-the-owl) (Charles Frye, Full Stack LLM Bootcamp, 56:57)
- [AI Engineer Singapore Day 2](https://aietalks.com/talks/ai-engineer-singapore-day-2) (Kaspar Hidayat, 65 Labs & SallyAnn DeLucia, Arize AI & Timothy Lin, Resaro & Abhishek Kankani, Cloudflare & Tejas Kumar, IBM & JJ Geewax, Google DeepMind & Geoff Huntley, Independent & Vincent Koc, OpenClaw Foundation & Vishnu (Vish) Hari, Ego AI & Ben Guo, Zo Computer & Matthias Lubken, Tavon AI & Josh Newton, Microsoft AI & Sam Bhagwat, Mastra & Pierre-Loic Doulcet, LlamaIndex & Jun Yu Tan, Tusk & Sara Hooker, Adaption Labs & Vincent Wu, MiniMax & Daniel Krishnan & Siddharth Krishnan, The Robot Company & Justin Baird, Tesseract & Kai Ming & Aravind (SK) Kandiah, Bifrost & Julia Kim, OpenGraph Labs & Suveen Ellawela, Cortex AI & Keziah & Jay Demetillo & Alex Lee, Magic Patterns & Sabina Cabrera, MagicPath & Priyaa Kalyanaraman, Lica World & Conor Brennan-Burke, Hyperspell & Heng Hong Lee, Lightsprint & Louis Knight-Webb, Vibe Kanban & Harsha Khurdula, Interfaze AI & Hrishi Olickel, Southbridge & Henry Mao, Smithery & Rach Pradhan, Independent & Agrim Singh, AI Engineer, 9:28:00)
- [AI Engineer Melbourne 2026 Keynote Livestream | Day 2](https://aietalks.com/talks/ai-engineer-melbourne-2026-keynote-livestream-day-2) (John Allsopp, Web Directions & Jeremy Howard, fast.ai & Annie Vella, Westpac New Zealand & Mic Neale, Block & Jishwan Lee, Z ai, 1:05:31)
- [Open Questions for AI Engineering](https://aietalks.com/talks/open-questions-for-ai-engineering) (Simon Willison, Independent open source developer, 24:33)