The Model Is Only 10%: The Real Lesson of the New SDLC

📊 Full opportunity report: The Model Is Only 10%: The Real Lesson of the New SDLC on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

TL;DR

A recent whitepaper by Google highlights that in AI-driven software development, the AI model itself accounts for only 10% of system behavior. The remaining 90% depends on how developers configure, verify, and engineer context around the model, shifting focus from model improvements to system design.

A new whitepaper from Google, authored by Addy Osmani, Shubham Saboo, and Sokratis Kartakis, states that the AI model accounts for only about 10% of the behavior in AI-assisted systems. The report emphasizes that the majority of system performance depends on how developers design, configure, and verify the surrounding infrastructure, shifting the industry’s focus from model improvements to system engineering.

The whitepaper, titled The New SDLC With Vibe Coding, underscores that the real shift in software engineering is moving from writing code to expressing intent and trusting machines to interpret that intent. It highlights that currently, 85% of professional developers use AI coding agents, with over half using them daily, and approximately 41% of new code being AI-generated.

Crucially, the authors argue that the model itself constitutes only about 10% of the system’s behavior. The remaining 90% is determined by the harness — including prompts, tools, rules, context policies, and observability layers. Evidence from benchmark tests shows that changing the harness can significantly improve AI agent performance even when using the same underlying model.

The paper advocates for a focus on configuration, verification, and context engineering as the key skills for AI development, rather than solely chasing the latest model advancements. It also discusses the economics of AI, noting that ad-hoc prompting can be more expensive over time than disciplined, structured approaches.

At a glance
reportWhen: published early 2026
The developmentGoogle’s new whitepaper reveals that the core of effective AI systems lies in harnessing and configuring the surrounding infrastructure, not just the AI model itself.
Crypto market snapshot
Fear & Greed Index
19/100 — Extreme Fear
Bitcoin BTC$60,412▲ 2.9%
Ethereum ETH$1,624▲ 2.9%
Tether USDT$0.9987▲ 0.0%
BNB BNB$550.55▲ 0.6%
USDC USDC$0.9997▲ 0.0%
XRP XRP$1.06▲ 1.2%
Solana SOL$78.2▲ 4.8%
TRON TRX$0.3155▼ 0.3%
Live data · CoinGecko · alternative.me (24h change)
The Model Is Only 10% — The New SDLC With Vibe Coding
AI Dispatch · Field Notes
Google · Osmani, Saboo & Kartakis · May 2026

The model is only 10%

A Google whitepaper argues software’s biggest shift is from writing code to expressing intent. Its sharpest claim: the model you obsess over is the smallest part of the system — the scaffolding around it does the real work.

A spectrum, not a binary — the differentiator is how outputs get verified
Vibe Coding
Casual prompts · “does it seem to work?” · disposable code · high risk
Structured AI-Assisted
Detailed prompts + constraints · manual testing · features in real codebases
Agentic Engineering
Formal specs · automated tests + evals + CI gates · production scale · low risk
Tests verify the deterministic; evals verify the rest. Without both, it’s vibe coding — however clever the prompt.
The idea worth building your strategy around
Agent = Model + Harness
~10%
HARNESS — prompts · tools · context · hooks · sandboxes · observability
MODEL~90% IS YOUR SURFACE AREA, NOT THE PROVIDER’S
Outside Top 30 → Top 5 on Terminal Bench 2.0 by changing only the harness — same model.
“Most agent failures, examined honestly, are configuration failures” — a missing tool, a vague rule, a noisy context.
The economics: it’s a token-cost problem (CapEx vs OpEx)
Vibe Coding
Low CapEx · High OpEx
Looks free, hides debt: token burn (fix-it loops), maintenance tax (AI spaghetti), security remediation. Crosses over to 3–10× more per feature.
Agentic Engineering
High CapEx · Low OpEx
Pay upfront (specs, evals, context), then ship cheaply. Levers: context engineering for first-pass success + intelligent model routing — cheap models for the easy work.
85%
of devs use AI coding agents (51% daily)
41%
of all new code is AI-generated
~90%
of agent behavior is the harness, not the model
+19%
longer on some tasks (METR) — verification is the cost
The read

The clearest map yet of how serious AI development works — and mostly tool-agnostic. But it’s a Google funnel: the concepts are neutral, the on-ramps point to Gemini, Jules & the ADK. If the harness is 90% and it’s yours, your moat and your costs both live there — so own your scaffolding, route across models, and remember: AI amplifies whatever engineering culture it lands in.

Source: Osmani, Saboo & Kartakis, “The New SDLC With Vibe Coding,” Google (May 2026). Figures are the paper’s own, incl. METR & LangChain. Analysis is the author’s.
thorstenmeyerai.com

Implications for AI Development Strategies

This shift in understanding has major implications for how organizations invest in AI. By recognizing that most system performance hinges on configuration and system design, companies can prioritize building robust harnesses and context management over constantly upgrading models. This approach can lead to more reliable, secure, and cost-effective AI systems, especially as the token economy makes unstructured prompting increasingly expensive.

Furthermore, the emphasis on verification, judgment, and structured context aligns AI development more closely with traditional engineering disciplines, fostering a more disciplined and sustainable approach to deploying AI at scale.

MUCAR 892BT AI Bi-Directional OBD2 Scanner, Full System OBD2 Scanner Diagnostic Tool,35 Services,ECU Coding,FCA Autoauth,CANFD&DOIP,for Car Owners, DIYer, Technicians, Inspectors, Trainees and Others

MUCAR 892BT AI Bi-Directional OBD2 Scanner, Full System OBD2 Scanner Diagnostic Tool,35 Services,ECU Coding,FCA Autoauth,CANFD&DOIP,for Car Owners, DIYer, Technicians, Inspectors, Trainees and Others

Powerful Performance for busy days in the shop or your home garage: an 8-inch ultra-large display paired with…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on the Shift to Intent-Based AI Engineering

Since early 2026, the industry has observed a rapid increase in AI adoption, with more developers integrating AI agents into their workflows. The whitepaper builds on this trend, arguing that the focus has historically been on improving models—such as GPT, Claude, or Codex—but that these models are only a small part of the overall system. Recent experiments, including benchmark tests, demonstrate that improvements in the harness can outperform raw model upgrades.

This perspective marks a departure from the earlier emphasis on model size and capabilities, emphasizing instead the importance of system configuration, context, and verification processes. The authors cite examples where tuning prompts and adding tools raised agent performance significantly without changing the underlying model.

“The biggest shift in software engineering isn’t a new language or framework—it’s the move from writing code to expressing intent and trusting machines to interpret it.”

— Addy Osmani

Verification and Validation of AI Software

Verification and Validation of AI Software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unresolved Questions About Practical Implementation

While the whitepaper emphasizes the importance of harness and configuration, it does not specify concrete best practices or standardized methods for system design at scale. The extent to which these insights will be adopted across different industries or organizations remains uncertain, as does how quickly companies will shift their investments from model development to system engineering.

AI Context Engineering: Architecting Intelligence Through Prompt Structures, Tools, and Memory

AI Context Engineering: Architecting Intelligence Through Prompt Structures, Tools, and Memory

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps for AI System Optimization

Organizations are likely to reevaluate their AI development priorities, investing more in system configuration, context management, and verification tools. Future research and industry discussions may focus on establishing standards and frameworks for harness design and context engineering, aiming to make AI systems more reliable and cost-effective. Monitoring how these shifts influence AI performance and economics will be key in the coming months.

Observability in the AI-Native Era: Leveraging AIOps to build, observe, and operate resilient systems

Observability in the AI-Native Era: Leveraging AIOps to build, observe, and operate resilient systems

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Why is the model only 10% of system behavior?

The whitepaper states that the behavior of AI systems is mostly determined by how they are configured, tested, and integrated. The model provides the core capabilities, but the surrounding harness, prompts, tools, and verification layers shape the actual output and reliability.

Does this mean model improvements are no longer important?

Not necessarily. The whitepaper emphasizes that model development remains valuable, but system design and configuration are now equally, if not more, critical for effective AI deployment and cost management.

How can companies apply these insights practically?

Organizations should focus on building robust harnesses, refining context management, and implementing verification processes. Investing in system architecture and tooling can yield better performance and lower costs than solely upgrading models.

What are the risks of focusing too much on system configuration?

Overemphasizing configuration without proper oversight could lead to security vulnerabilities or inconsistent behavior. Balancing system robustness with security and compliance is essential.

Will this shift affect AI development costs?

Yes. While initial investments in system design may be higher, the whitepaper suggests that disciplined, structured approaches will reduce long-term costs by minimizing token waste and improving reliability.

Source: ThorstenMeyerAI.com

Nothing in this article is financial or investment advice. Cryptocurrency and precious-metal investments carry significant risk — do your own research and consider a licensed advisor.
You May Also Like

Candor as a Moat: A Critical Reading of Dario Amodei and Anthropic

Examining how Dario Amodei’s transparency and safety proposals shape Anthropic’s competitive edge amid regulatory tensions and AI advancements.

The Classified Role Of AI Benchmarks In National Security Post-August 1

The US government will implement a classified benchmarking process for AI models by August 1, 2026, raising questions about transparency and oversight in AI security.

Évian and the Fallout: What Europe Actually Wants From Amodei, Hassabis, and Altman

Europe pushes for reliable access, sovereignty, and safety in AI, demanding guarantees from Amodei, Hassabis, and Alt after US export controls.

7 Best Wireless Smartwatches for Prime Day Deals in 2026

Discover the best wireless smartwatches on Prime Day 2026, including Apple, Garmin, and budget options, with details on features, deals, and buying tips.