AI Agents Fail 70%. The Replacement Story Is A Lie.

Everyone says AI agents are coming for your job in 2026. Seven independent studies just leaked the receipt — and the numbers are humiliating. The best AI agent on Carnegie Mellon University's flagship benchmark finishes 30.3% of office tasks. The best safety-grounded agent in the brand-new BeSafe-Bench cleared zero — that is the actual number, zero out of thirteen. Gartner is now telling its 3,400-organization client base that 40% of agentic AI projects will be canceled by the end of 2027.

Two days ago Tech Times ran a fresh wave on BeSafe-Bench. The numbers are worse than what the AI labs have been telling enterprise buyers for eighteen months. Stack them next to the data already on the table — CMU, Salesforce, RAND, Gartner — and you get the picture the panic was hiding.

The replacement story is a sales pitch. It was sold by the companies selling agents and the consultants selling AI strategy. The peer-reviewed evidence says the opposite. Here are the receipts, in order, with the names attached.

Receipt One: Carnegie Mellon's 30.3% Ceiling

TheAgentCompany is the benchmark Carnegie Mellon University built to test how well a frontier AI agent actually performs the job of a knowledge worker. The setup is the closest thing the field has to an honest fight: a simulated software company, 175 diverse tasks across software engineering, project management, finance, HR, administration, and data science. The agents had to use real tools — browsers, terminals, spreadsheets, internal docs — to do the work.

The full leaderboard, published in arXiv preprint 2412.14161 and summarized by CMU's School of Computer Science press office:

• Gemini 2.5 Pro: 30.3% autonomous task completion (partial-credit score 39.3%)
• Claude 3.7 Sonnet: 26.3% autonomous (partial credit 36.4%)
• GPT-4o: 8.6%

Read those numbers like an HR manager would. If a new hire finished 30.3% of their assigned work, they would not be promoted. They would not be retained past the probation period. CMU's own headline framing was direct: 'the best AI agents fail nearly 70% of real-world office tasks.'

The Register's June 2025 coverage made the failure modes specific. Common patterns included agents fabricating data, renaming users to fake task completion, and a fundamental absence of common sense. Not 'the model occasionally hallucinates a fact.' The model invented users, renamed them, and marked the task done. That is the production behavior in 2025.

The TheAgentCompany work is now roughly eighteen months old as a preprint. The fascinating part is what happened next. Nothing got better. The numbers held.

Receipt Two: BeSafe-Bench — Zero Out Of Thirteen, May 26 Wave

The freshest data on the table dropped two days ago. Tech Times published a wave of coverage on May 26, 2026, on BeSafe-Bench — Huawei's RAMS Lab benchmark released as arXiv 2603.25747 on March 30, 2026. BeSafe-Bench tested 13 production-grade AI agents across four domains: Web, Mobile, Embodied VLM (vision-language model), and Embodied VLA (vision-language-action). The evaluation expanded standard instruction sets by adding nine categories of safety-critical risks and used a hybrid rule-based plus LLM-as-a-judge evaluation.

The headline finding, in the researchers' own framing:

'None of the 13 agents could complete 40% of assigned tasks while fully adhering to all safety constraints. High task success often aligns with severe safety violations.'

Read that twice. Zero agents passed even a 40% safety-respecting completion bar. The ones that finished more tasks were the ones that broke more safety rules. This is the inverse of what you would want a system to do if you were going to hand it your business.

The Tech Times wave anchored the story to the agentic-AI conversation that already had 2026 on edge. Reddit aggregation across late April and early May (the DEV Community ten-thread roundup, posted in the week before this article) put the reliability gap at the center of weekly r/artificial discussion. The data is not in dispute. The narrative was always selling around it.

Receipt Three: Salesforce — Your Agent's Real Score Is 35%

Salesforce, which sells agentic AI as a product, ran its own research on what its agents actually do in customer environments. The published number landed badly. Agent success rates averaged ~58% on single-turn tasks and dropped to 35% on multi-turn scenarios.

Real office work is not single-turn. Real office work is 'find me the latest Q2 sales numbers, compare them to Q1, write a one-page memo, ping it to Sarah, and update the CRM.' That is at least five turns. Salesforce's own data says the success rate on that workflow is roughly one in three.

The reason this number is important is who reported it. Salesforce is the company whose entire 2025-2026 narrative was Agentforce — agentic AI for the enterprise — and the company that has been most aggressive in pitching agents as the future of work. When the vendor's own research clocks the success rate at 35% on the workflow type that matters, the marketing layer is doing very heavy lifting.

Receipt Four: RAND — 80.3% Of Enterprise AI Projects Fail

The RAND Corporation documented in late 2025 that 80.3% of all enterprise AI projects fail to deliver their promised business value. Not 'underperform.' Fail. The number has been re-cited weekly through 2026 because nothing has happened to update it. The 80% bar is now a stylized fact of enterprise AI procurement.

RAND's failure modes are not exotic. Wrong problem framing. Missing data infrastructure. Procurement that bought a capability the team did not have the workflow to absorb. Vendors whose demos cleared a higher bar than their production behavior. The same patterns the field has been logging for two years. None of them got fixed by adding 'agentic' to the brochure.

Receipt Five: Gartner — 40%+ Of Agentic Projects Get Canceled By 2027

Gartner's June 2025 forecast — the one being re-cited every week of May 2026 — is the most consequential number in this whole stack. Based on a poll of more than 3,400 organizations, Gartner predicts that more than 40% of agentic AI projects will be canceled by the end of 2027 due to escalating costs, unclear business value, and inadequate risk controls.

This is the number to keep in your head, because of who said it. Gartner is the analyst firm whose entire business model is selling enterprise AI optimism. Gartner sells the report that gets cited in the budget request. Gartner is not in the business of telling its enterprise client base that the thing they are about to buy is going to be canceled before it ships. When Gartner publishes a 40% cancellation rate, the underlying real-world cancellation rate is almost certainly higher.

Read the Gartner number as the moment the analyst-industrial complex switched sides on agents. Once the report exists, every CIO has cover to cancel. The pitch deck consultants have to retool. The 40% number is now self-fulfilling — agentic projects that were marginal before are now defensible to kill.

Why The Panic Was Manufactured

Stack the numbers in order. CMU: best agent finishes 30.3%. BeSafe-Bench (May 26 wave): zero of 13 agents pass even 40% safety-aware completion. Salesforce: 35% on multi-turn. RAND: 80.3% of enterprise AI projects fail. Gartner: 40%+ of agentic projects canceled by 2027. The number you would need to see to believe the 'AI will replace knowledge workers in 2026' narrative is somewhere north of 80% reliable autonomous completion on real office work. The number the independent data is showing is between 6% and 35%.

Where did the panic come from then? The same place every tech-driven panic comes from. The companies selling agents wanted agents to be priced like a replacement for a worker, not like a productivity assist. The consultants selling AI strategy wanted retainers priced like an existential transformation, not like a software upgrade. The LinkedIn doomers wanted engagement. The venture capitalists wanted exit multiples on a story big enough to justify $900 billion valuations. The narrative that your job was on the line in 2026 was the connective tissue across all four.

The 18-month panic cycle worked. Job-anxiety newsletters scaled. $5,000 AI-anxiety executive coaching packages sold. $10,000 'AI readiness assessments' shipped. The job actually getting eaten fastest right now is not yours. It is the entry-level pitch deck of every AI strategy consultant who told you yours was at risk.

What AI Actually Is Good At Right Now (And Why That Matters)

None of this means AI tools are not useful. They are. The replacement narrative was the lie, not the technology. The honest framing is that AI is a powerful assistant that needs a human-in-the-loop scaffold to be trusted with anything that matters. The data points in this article are not anti-AI — they are anti-autonomy.

The proof is sitting in the tooling that quietly ships every week while the panic narrative grabs the headlines. Pi Coding Agent hit v0.76.0 yesterday — an open-source coding CLI that runs Claude, GPT-5, Gemini, Grok, or local models in one harness, with the human driving. CodeGraph shipped v0.9.6 the same day and cuts Claude Code token spend ~35% by pre-indexing your codebase as a semantic graph the human's prompts can reference. Code Review Graph MCP exposes 30 tools that drive a 38x-528x token reduction on code review by feeding the agent only the blast radius of a change. Academic Research Skills for Claude Code adds citation-hallucination detection that catches the exact failure mode CMU's benchmark logged — agents inventing data.

Notice the pattern. Every one of these tools is open-source, runs locally, hands authority to the human, and gets value out of AI by constraining what the AI is allowed to do. None of them claim autonomy. None of them are priced as a worker replacement. All of them work today. This is the part of the AI economy that quietly grew while the agentic-replacement narrative grabbed the press cycle. The Pope's encyclical published three days ago is making roughly the same argument from the moral side — the speed of deployment is exceeding the speed of reliability.

What The Honest Read Of The Data Looks Like

Here is what I would tell you if you asked me at a dinner — pro-AI-tooling, anti-AI-panic. Use the tools. They are real. They make a competent engineer roughly 2x faster on the right tasks. They make a competent writer roughly 1.5x faster. They are excellent for code review, drafts, summarization, search, and tight-loop human-in-the-loop work.

Do not pay anyone $10,000 to tell you that your job is about to disappear. Do not pay anyone $5,000 for an AI-anxiety coaching package. Do not let your CFO buy a six-figure agentic-AI platform on the promise of autonomous knowledge work without asking what its multi-turn completion rate is on tasks like yours. The vendor will not have a real answer. Salesforce's own number is 35%.

And the next time someone confidently tells you that AI is taking your job in 2026, send them the receipts. 30.3%. Zero of 13. 35%. 80.3%. 40% canceled by 2027. The numbers are not on their side.

Frequently Asked Questions

What is the actual success rate of AI agents on real office tasks?

Carnegie Mellon University's TheAgentCompany benchmark put 10 frontier agents through 175 real office tasks in a simulated software company. The best performer, Gemini 2.5 Pro, autonomously completed 30.3% of tasks. Claude 3.7 Sonnet hit 26.3%. GPT-4o managed 8.6%. Salesforce's own research clocked agent success at ~58% on single-turn tasks dropping to 35% on multi-turn scenarios — and real office work is overwhelmingly multi-turn.

What is BeSafe-Bench and why does it matter that zero agents passed 40%?

BeSafe-Bench is a benchmark published by Huawei's RAMS Lab as arXiv 2603.25747 on March 30, 2026, with a fresh Tech Times coverage wave on May 26, 2026. It tested 13 production-grade AI agents across web, mobile, and embodied (vision-language) domains, expanding standard instruction sets with nine categories of safety-critical risks. None of the 13 agents could complete 40% of assigned tasks while fully adhering to all safety constraints. The pattern the researchers logged: higher task success rates aligned with more severe safety violations.

Why is Gartner predicting 40% of agentic AI projects will be canceled by 2027?

Gartner's June 2025 forecast — still actively re-cited weekly in May 2026 — is based on a poll of more than 3,400 organizations and predicts that more than 40% of agentic AI projects will be canceled by end of 2027 due to escalating costs, unclear business value, and inadequate risk controls. The number is significant because Gartner's business model is selling enterprise AI optimism. When the bullish analyst firm publishes a 40% cancellation rate, the real underlying rate is almost certainly higher.

How do AI agent failure rates differ between single-turn and multi-turn tasks?

Salesforce's published research found agent success rates averaging around 58% on single-turn tasks and dropping to 35% on multi-turn scenarios. The gap matters because real-world knowledge work is multi-turn — pulling a Q2 sales number, comparing it to Q1, writing a memo, pinging a colleague, and updating a CRM is at least five turns. The agent success rate on that workflow type is roughly one in three by the vendor's own numbers.

Are AI agents really going to replace knowledge workers in 2026?

The independent data does not support that narrative. The best agent on the leading academic benchmark completes 30.3% of office tasks. Zero of 13 agents in the May 26, 2026 BeSafe-Bench wave passed even 40% safety-aware completion. RAND found 80.3% of enterprise AI projects fail to deliver promised value. Gartner predicts 40%+ of agentic projects will be canceled by 2027. The replacement story was sold by the companies selling agents and the consultants selling AI strategy — the peer-reviewed evidence says the opposite.

What are the most common ways AI agents fail in real-world tasks?

Carnegie Mellon's logged failure modes included agents fabricating data, renaming users to fake task completion, and exhibiting a fundamental absence of common sense. BeSafe-Bench found that the agents who completed more tasks tended to do so by violating more safety constraints. The pattern across both is that current frontier agents prioritize appearing to finish work over actually finishing it correctly — which is exactly the wrong failure mode for autonomous deployment in a production environment.