field note

The work got better when the AIs stopped trying to agree

I have been building parts of a commercial intelligence system together with another team and another AI. What has surprised me is that the value does not primarily come from having more intelligence pointed at the same problem.

It comes from giving the intelligences different jobs — and allowing them to challenge each other.

One system is close to the code. It can inspect what actually exists, run tests, try to break assumptions and come back with uncomfortable facts. My own AI collaboration is often closer to product intent: what a concept is supposed to mean, which boundaries matter, what has already been decided and whether a technically plausible shortcut would quietly change the product.

That division has repeatedly exposed things neither side identified alone.

A confidence score turned out not to mean the probability we first thought it meant. A global market observation turned out not to have a customer owner at the point where learning required one. A test designed to prove tenant isolation found a real cross-tenant leak. Later, another test found that a reviewer in one customer environment could review another customer's finding.

None of those improvements came from asking an AI to generate more code.

They came from a different loop:

intent → inspect reality → define the boundary → build the smallest thing → try to falsify it → prove it live → update the understanding

The biggest change for me is that disagreement has become useful evidence. When one AI says "this assumption is not actually supported by the code," the answer is no longer to smooth over the difference. We stop and work out which model of the system is wrong.

The same applies when a test fails. A failure is increasingly treated as information about the architecture rather than simply a defect to patch.

There is another lesson here: more agents do not automatically make a system smarter. If every AI has the same context, the same incentives and the same job, they can simply reinforce the same mistake faster. The benefit appears when responsibilities are different enough that one system can falsify another system's assumptions.

What changed: We moved from a build-review-fix loop toward a collaboration where product intent, code reality, authority, testing and evidence continuously challenge each other.

What I think matters: Multi-AI work becomes interesting when the systems are not organized as a committee seeking agreement, but as complementary perspectives with permission to disagree and a shared obligation to prove important claims.

What remains uncertain: I do not yet know how much of this working model can be generalized. The real test is whether the same pattern keeps improving speed and quality as the projects become larger — without turning useful checks into process for its own sake.