Anant Srivastava, Oracle · 20:12 · AI Engineer World's Fair 2026
Stop Fine-Tuning to Fix Retrieval ProblemsWhy here: Morris compares context, RAG and weight updates without naming a winner. Srivastava gives a rule based on how fast information changes: small, stable behavior goes in the prompt, current or citable knowledge goes in memory, and only stable reflexes go into weights. His support assistant shows the cost of getting it wrong: after a fine-tune on old tickets, it kept inventing product names from a replaced catalog. Asawa then asks how we would know whether the resulting system learns.