# What We Learned Deploying AI within Bloomberg's Engineering Organization Lei Zhang, Bloomberg | AI Engineer CODE 2025 | 18:21 Source: https://www.youtube.com/watch?v=Q81AzlA-VE8 Channel: AI Engineer (https://www.youtube.com/@aiDotEngineer). Summarised by AIE Talks. Page: https://aietalks.com/talks/what-we-learned-deploying-ai-within-bloombergs-engineering-organization Published: 2025-12-16 Tags: agents, deployment, mcp, team-adoption ## TL;DR - AI coding tools helped Bloomberg with prototypes, tests, and one-off scripts, but their measured impact fell quickly on existing codebases. - Bloomberg found stronger returns in agents that handle maintenance, refactoring, and incident response across large software systems. - A shared platform, training program, engineering community, and leadership workshops are needed to deploy AI across 9,000-plus engineers. ## Summary Lei Zhang describes Bloomberg's attempt to introduce AI into the workflows of more than 9,000 engineers. Early coding tools made proofs of concept and tests faster, but their impact dropped when teams moved beyond greenfield work. Bloomberg then focused on maintenance tasks, such as software patches and migrations, and on incident response agents that can inspect code, telemetry, topology, alarms, and service dependencies. At this scale, separate teams building overlapping tools would create duplication, so Bloomberg created a paved path with a model gateway, an MCP discovery hub, and a standard way to create and deploy tools. Adoption also depended on existing onboarding programs, cross-company communities, and inner-source work. Zhang says individual contributors adopted the tools more strongly than leaders, which led Bloomberg to add leadership workshops. He closes by arguing that AI changes which engineering work is affordable, so teams need to reconsider what high-quality software engineering should involve. ## Key ideas ### Bloomberg's scale makes AI deployment an engineering systems problem [00:13](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=13s) Lei Zhang places the AI effort inside Bloomberg's broader engineering organization. The company has more than 9,000 engineers, a large private network, and a very large JavaScript codebase. The Bloomberg Terminal supports many applications and functions, including email, news, fixed-income calculations, and trading workflows. Zhang's technology infrastructure group covers global infrastructure, connectivity, developer productivity, source-control tooling, telemetry, and incident response. Bloomberg also has more than 500 employees focused on AI products. That combination means AI tools must work across many technologies, teams, and software assets rather than a single small application. ### Coding assistants lose much of their early impact outside greenfield work [03:22](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=202s) Bloomberg began trying AI coding tools about two years before the talk. The first step was to release capabilities quickly and measure how engineers used them. Surveys showed faster proofs of concept, quicker test creation, and many one-time scripts. The measurements dropped quickly when engineers moved beyond greenfield work. Zhang says the organization then had to ask where these tools could make a real difference. Bloomberg also became cautious about applying fast-generating tools to a codebase with hundreds of millions of lines, since changes are harder to verify as system complexity grows. ### Uplift agents target maintenance work that engineers often avoid [06:14](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=374s) Bloomberg began exploring uplift agents that scan the codebase for applicable patches and create a pull request when software needs an update. The proposed workflow includes the patch and an explanation of why it was made. Zhang contrasts this with an earlier regular-expression refactoring tool, which worked only to a limited extent. Large language models and related tooling produced better results for these changes. The approach still depends on deterministic verification. Weak tests, linters, or other checks make it difficult to apply patches safely. Bloomberg also saw average open pull requests and time to merge increase because generated code still needed human review. ### Incident response agents can inspect systems faster and with fewer assumptions [08:40](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=520s) Bloomberg is developing agents for incident response. Zhang says these systems can move quickly through a codebase, telemetry, feature flags, traces, and other operational data. They may also reduce the bias that can affect human troubleshooting, such as assuming that a suspected component must be responsible before checking the evidence. An incident response agent needs access to metrics and log dashboards, network or service topology, alarms, triggers, and service-level objectives. These connections require many MCP servers, which created a need for a common way to build and deploy them. ### A paved path prevents teams from rebuilding the same AI infrastructure [09:37](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=577s) With thousands of engineers and many teams building pull-request bots or incident response agents, Bloomberg saw a risk of duplicated and conflicting work. Its platform approach is a middle ground between complete team autonomy and a tightly controlled central platform. Zhang describes the goal as making the right thing extremely easy and the wrong thing very hard. The paved path includes a gateway for experimenting with models and tracking their use, an MCP discovery hub where teams can find existing servers, and a standard platform for creating and deploying MCP servers. The platform provides runtime infrastructure and handles authentication. ### Production quality needs stronger controls than experimentation [11:51](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=711s) Bloomberg wants engineers to try ideas and build proofs of concept with low friction. Zhang connects that freedom to creativity and experimentation. Production systems have a different standard because stability and reliability are central to Bloomberg's business. The paved path therefore separates easy experimentation from controlled production deployment. It gives teams a place to test different models, helps them choose a model for a problem, and reduces the effort needed to deploy an MCP server. This structure lets teams explore while keeping production systems subject to quality controls. ### Existing training and communities can move AI adoption through the organization [13:34](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=814s) Bloomberg added AI coding to an established onboarding program that has existed for more than 20 years. New engineers learn how to use the tools with Bloomberg's principles and technologies, then bring those practices back to their teams. Zhang says this can push more experienced engineers to consider new ways of working. Bloomberg also used its existing cross-organization champion and guild programs to build an AI productivity community. The community helped reduce duplicated effort, spread lessons, support inner-source contributions, and move engineers between teams when a project needed focused help. ### AI adoption exposes a leadership gap and changes engineering trade-offs [16:15](https://www.youtube.com/watch?v=Q81AzlA-VE8&t=975s) Bloomberg's data showed stronger AI adoption among individual contributors than among leaders. Zhang says some technical leads and managers do not yet have enough direct experience with AI-assisted software work to guide their teams effectively. Bloomberg is responding with leadership workshops. He also argues that AI changes the cost function of engineering. Some work becomes much cheaper, while other work becomes more expensive. That change affects decisions about whether to build something at all. Zhang uses it as a reason for engineers and leaders to reconsider what high-quality software engineering means and how AI tools should support it. ## Notable quotes - "Unless we deploy and try, we wouldn't know what's the best way to benefit from all the awesome work." (03:22) - "The measurements dropped actually pretty quickly when you go beyond all the green field type of thing." (05:00) - "We want to make easy things extremely easy to do, and we want to make sure the wrong thing is ridiculous hard to do." (11:39) - "The trade-off decision of whether we do something versus we don't do something actually changed." (17:33) ## Tools & references mentioned - Bloomberg Terminal - Envoy AI gateways - MCP - MCP servers ## Who should watch - You are introducing AI coding tools across a large engineering organization and need examples beyond code generation demos. - Your teams are building overlapping agents and need a shared path for model access, tool discovery, deployment, and production controls. - You lead engineers who use AI more actively than the managers guiding them, and need ideas for training and leadership support. ## Related talks - [How do you diffuse AI into the real world?](https://aietalks.com/talks/how-do-you-diffuse-ai-into-the-real-world) (Varun Shenoy, Long Lake, 17:46) - [Unlocking AI-Powered DevOps Within Your Organization](https://aietalks.com/talks/unlocking-ai-powered-devops-within-your-organization) (Jon Peck, GitHub, 22:13) - [Building an Autonomous Engineering Org](https://aietalks.com/talks/building-an-autonomous-engineering-org) (Angie Jones, Agentic AI Foundation, 17:36) - [Leadership in AI Assisted Engineering](https://aietalks.com/talks/leadership-in-ai-assisted-engineering) (Justin Reock, DX, 18:11) - [AI Leadership](https://aietalks.com/talks/ai-leadership) (Alex Lieberman, Morning Brew and 10X & Kath Korevec, Google Labs & Katelyn Lesse, Anthropic & Michele Catasta, Replit & Lisa Orr, Zapier & Steve Yegge, Sourcegraph and AMP & Gene Kim, IT Revolution & Bill Chen & Brian Fioca, OpenAI & Martin Harrysson & Natasha Maniar, McKinsey & Yegor Denisov-Blanch, Stanford & Itamar Friedman, Qodo & Olive Song, MiniMax & Asaf Bord, Northwestern Mutual & Lei Zhang, Bloomberg & Samir Mody, The Browser Company & Max Kanat-Alexander, Capital One & Arman Hezarkhani, 10X & Justin Reock, DX & Dan Shipper, Every & Mel Lutzky, Graphite, 8:16:05)