From Agent to Workforce, part 3

Meta's internal platforms saw 220% more changes. User-facing features rose 36%.

Two reported figures sit at the centre of this argument, and the first thing to say about them is that they do not divide. Meta's internal software platforms and infrastructure saw 220% more changes year over year; changes that reached users as new or improved features rose 36%. The populations differ, so the pair is not a conversion rate. Their value is comparative: activity expanded much faster than one observable category of delivered output.

Alexander Volkov, PhDCo-founder, Research Lead · Learning science and cybernetics

1996 words

What was reported, and what it does not establish

Major technical and security incidents rose 40% and the time employees spent firefighting them rose 70%, over the same period.

Reuters, Mark Zuckerberg had a bold plan to replace Meta staff with AI. Here's how it implodedinternal Meta material, reported in an August 2026 investigation

The evidence does not establish that AI caused every incident, that these were audited productivity statistics, or that AI-assisted coding failed. The conclusion available here is narrower and more useful: Meta scaled the production of changes past the rate at which its organization could convert them into outcomes it could stand behind.

Project OT turned an engineering bet into an organizational bet

Project OT explored a structure in which AI would perform much of the daily work and smaller, talent-dense groups of people would supervise it. Scenario planning considered reducing some teams by as much as 60% through layoffs, reassignment, closed positions and performance management.

Meta did not execute that scenario. It cut roughly 10% of employees in May 2026 and cancelled planning for a second company-wide round expected in November. Reuters reported employee opposition, disappointing internal signals about AI agent productivity, investor pressure, and a later acknowledgment from Mark Zuckerberg that the agentic trajectory had not moved as fast as anticipated. Meta said Project OT included multiple scenarios and that not all of them were operating assumptions or adopted plans.

That boundary matters: 60% of the workforce was not replaced. The defensible criticism is conceptual rather than numerical. The company appears to have explored an organizational premise before its operational evidence supported it — that greater AI agent output should allow fewer people to remain around that output. The reported figures indicate that review, incident response and integration remained a material part of the work.

Faster production moves the bottleneck

Software delivery is a chain, not a typing contest. A change must express a useful intent, fit the current architecture, avoid conflict with parallel work, satisfy security and reliability constraints, pass review and tests, survive deployment, and improve an outcome somebody values. Generation is one stage of that.

When generation becomes cheaper, the constraint moves downstream: more proposals enter review, dependencies collide, edge cases reach testing, and changes compete for integration and release capacity. Unless the rest of the system scales or becomes more selective, queues grow and risk accumulates.

AI acts as an amplifier — magnifying the strengths of healthy delivery systems and the dysfunctions of weak ones. Amplification says nothing about the value of the underlying signal.

Google DORA, 2025 State of AI-assisted Software Developmentnearly 5,000 technology professionals and more than 100 hours of qualitative data

Meta's own engineering research reports significant lines of code per human-landed change growing 105.9% year over year and per-developer change volume rising 51%, attributes more than 80% of the growth in code supply to agentic AI, and records the share of changes receiving timely review declining. The authors name the result a widening gap between code supply and reviewer bandwidth.

Adams et al., Meta, Automating Low-Risk Code Review at Meta: RADARtelemetry over more than 535,000 RADAR-reviewed changes, of which more than 331,000 landed

Meta's answer was not a digital reviewer

RADAR matters to this argument because it does not answer the bottleneck by assuming one AI agent can replace one reviewer.

It uses a risk-stratified funnel. Changes are classified by authorship and source type, passed through eligibility gates and static checks, scored for risk, reviewed with a language model, and subjected to deterministic validation before qualifying changes may land. High-risk or ambiguous work stays outside the automated path.

Median review wall time fell 35%, with lower reversion and incident rates for the RADAR-reviewed population than for non-RADAR changes.

Adams et al., Meta, Automating Low-Risk Code Review at Meta: RADARtelemetry over more than 535,000 RADAR-reviewed changes, of which more than 331,000 landed

Meta did not meet excess code supply by adding an unconstrained synthetic employee. It built a management layer out of classification, authority boundaries, evidence, deterministic gates and escalation by risk. In that design the unit that matters is not the code-generating AI agent but the whole path from a proposed change to a verified result that policy permits to land.

The digital-employee metaphor creates the wrong denominator

The phrase itself is not the problem. IBM describes software robots performing specific processes in partnership with human colleagues; Salesforce presents digital labour as augmentation as well as autonomous execution. Serious vendors acknowledge that people remain part of the system. The difficulty is in the employee-shaped abstraction.

That abstraction invites a leader to map a role into visible tasks, automate what can be observed, count the synthetic output and compare it with headcount. A digital worker then looks like a cheaper unit of labour, because the surrounding human work has been placed outside the calculation.

A job is not a list of actions. It also involves deciding which action is appropriate, noticing when the situation no longer matches the playbook, negotiating competing goals, carrying tacit history, maintaining trust, accepting consequences, repairing failures, and knowing when not to proceed. These are hard to see in a process map precisely because working organizations perform them continuously. Reduce staffing or management capacity before the work is redesigned and the burden shifts into review queues, escalations, rework, incidents, inconsistent decisions and lost institutional context.

Under those conditions software output can rise while the system as a whole becomes less productive.

Productivity has to include the measured outcome

Tokens, generated files, tool calls, completed AI agent tasks, code changes and estimated hours saved are operational signals. None of them is a business outcome. Even landed code volume misleads if it creates maintenance, incident and cognitive costs that arrive later. The measurement boundary has to include the work that makes the output trustworthy, and the outcome observed after it is put into use.

For a human–AI team doing software work, an adequate measurement boundary includes at least:

  • verified change throughput, not raw diff volume
  • time from approved intent to a verified result
  • human review and exception-handling time
  • returns, rollbacks, incidents and repair work
  • cost per authorized and released result, including inference and human attention
  • the share of AI agent errors converted into tests or controls
  • the user or business outcome observed after release

The same logic applies outside software. A research AI agent is productive when its claims survive source verification and support a decision, not when it produces fifty pages. A sales AI agent is productive when the relationship and the revenue are still healthy after the handoff. A support AI agent is productive when the customer's problem is safely resolved. Message volume and closed conversations are proxies for those outcomes, not the outcomes.

People do not want one universal level of automation

The replacement narrative assumes a workforce can be decomposed by technical feasibility alone: automate whatever an AI agent can perform, assign the rest to people.

Preferences for human involvement are heterogeneous. Some tasks are welcome candidates for automation; others are technically feasible but unwanted, low priority, or better suited to augmentation.

Stanford Digital Economy Lab, Future of Work with AI Agents (WORKBank)preferences from 1,500 workers and expert capability assessments across 844 tasks in 104 occupations

That variation is not resistance to progress. Work contains different forms of agency, and a person may welcome automation for repetitive reconciliation while keeping control of a customer promise, a hiring decision, a diagnosis, or the interpretation of ambiguous evidence. The question is not whether an AI agent can perform a task. It is what combination of execution, judgment, authority and accountability the outcome should require.

What the case does not show

Meta's reported 220% increase in internal changes may contain a great deal of valuable work, and a 36% rise in user-facing features is not a trivial outcome. RADAR shows the same company building sophisticated controls around AI-assisted production — which is evidence against reading this as a story about AI-assisted coding failing.

Nor is any of this causal. Reuters reported internal data and organizational decisions. The RADAR comparisons rest on a population selected by eligibility and risk. Neither supports the claim that AI produced the incidents, and this article does not make it.

What the case does expose is the denominator. Organizational productivity cannot be inferred from the output of the fastest stage, and coordination or verification work does not disappear when the people doing it are removed. A synthetic worker cannot be measured independently of the human and technical system that makes its output safe to use.

What follows for us

8Hats Lab reads this as an argument for changing the design object. The useful unit is the human–AI team: the smallest combination of people, AI agents, tools, context and controls that can carry work from intent through verification, authorization, use and outcome measurement. Its composition changes with the work — AI agents researching options in parallel while a person chooses the trade-off; one AI agent implementing while another checks independently; a deterministic gate qualifying low-risk output under a stated policy and escalating the rest.

Four properties distinguish it from a collection of digital employees. One outcome boundary, so costs and failures cannot be exported to another team and left out of the productivity claim. Differentiated authority, so an AI agent can act without being allowed to approve its own action, and a person can hold decision rights without becoming the manual router for every step. Shared, versioned state, so intent, evidence, commitments and unresolved uncertainty survive individual conversations. And learning as a system, so a repeated error becomes a test, a changed task contract, a permission boundary or an escalation condition rather than another reminder pasted into the next prompt.

This is a working proposal, not a validated result. It has not been tested against a controlled comparison, and it makes the standard harder rather than softer: it asks an organization to show that automation improved the measured outcome after coordination, review, rework, incidents and human attention are counted.

Questions this answers

Did AI-assisted coding fail at Meta?

The reported figures do not establish that. Reuters reported internal data and organizational decisions, not a controlled causal study, and Meta's own RADAR paper shows the company building working controls around AI-assisted production. What the case shows is narrower: changes were produced faster than the organization could convert them into outcomes it could stand behind.

Can you calculate a conversion rate from the 220% and 36% figures?

No. The two percentages describe different populations with different denominators — internal platform and infrastructure changes in one case, changes that reached users as new or improved features in the other. They are not two stages of one funnel. Their value is comparative: activity grew much faster than that one observable category of delivered output.

How should the productivity of an AI agent be measured?

Across the full lifecycle, not at the point of generation. An adequate boundary includes verified change throughput rather than raw volume, time from approved intent to verified result, human review and exception-handling time, rollbacks and incidents, cost per authorized result including inference and human attention, and the user or business outcome observed after release.

What is wrong with the term digital employee?

The employee-shaped abstraction invites a leader to map a role into visible tasks, automate the observable ones, count the synthetic output and compare it with headcount — which places the surrounding human work outside the calculation. A job also involves deciding which action is appropriate, noticing when the playbook no longer fits, carrying tacit history, and knowing when not to proceed.

Sources

Each with the population its figures are drawn from, and what it does not establish.

Fill in the contact form

Tell us where this reading is wrong, and on what evidence.