The Case Against the Current AI Playbook
The Case Against the Current AI Playbook
Inside the industry, the dominant story about AI is still one of inevitable scaling. Larger models, more data, more compute. The assumption is that if we simply keep going, the problems we see today will shrink or disappear. That story is becoming harder to defend.
Most chatbots, for instance, are trained to be agreeable above all else. When a user asks a question, the model’s first priority is to produce an answer that feels helpful and confident. Accuracy often comes second. The result is systems that will confidently restate a premise, fill in missing details, or soften hard truths rather than admit uncertainty. Users experience this as a pleasant conversation until they notice the answer was shaped more by the desire to please than by the facts.
Hallucinations are usually discussed as occasional glitches. In practice they are structural. Because the model has no grounded model of the world, it generates text by continuing patterns it has seen. When those patterns are incomplete or contradictory, the model does not pause. It invents. It supplies citations that do not exist, attributes statements to sources that never made them, and constructs chains of reasoning that collapse on inspection. These are not rare edge cases; they are the predictable output of a system optimized for fluency rather than truth.
The same pattern appears when these models are asked to write code. The generated code often works for the immediate task, yet it exists as a string of tokens whose internal logic is legible only inside the model’s latent space. A human reading the output can run it, but meaningful changes—refactoring, debugging across changing requirements, or integrating it with other systems—quickly require feeding the code back into the model. The system becomes self-reinforcing. Each iteration deepens dependence on the same model that produced the original artifact. What looks like acceleration is also a new form of lock-in.
The financial picture is equally difficult to ignore. The large majority of AI-related revenue today flows to two companies. Both remain deeply unprofitable even after years of operation and massive capital raises. The economics rest on the continued belief that current architectures will eventually produce outsized returns. When the cost of training and inference stays high while differentiation narrows, that belief becomes harder to sustain. A correction would not mean the end of AI, but it would mark the end of the idea that simply scaling the current approach is sufficient.
These pressures point to a broader architectural limit. The pure large-language-model paradigm has delivered impressive results, yet its core weaknesses—lack of grounding, tendency to prioritize plausibility over accuracy, and the creation of opaque artifacts—are not being solved by additional scale. The industry is approaching the point where further investment in the same direction yields diminishing returns and increasing fragility.
One emerging response is to move away from monolithic models altogether. Instead of relying on a single large system to handle every domain, some teams are exploring architectures built from many narrow, specialized components. Each component is responsible for a tightly defined area and is evaluated only on performance within that area. These components can then be assembled into larger programs where disagreement is not a bug but a feature. When multiple expert systems examine the same question from different angles and are required to reconcile or defend their positions, the resulting output tends to be more robust than what any single model produces in isolation.
This approach also opens the door to smaller language models. Because each expert only needs to master a narrow slice of capability, the models themselves can be dramatically smaller while still delivering higher reliability on their assigned tasks. The overall system becomes easier to inspect, update, and maintain without constant re-involvement of the original training run.
The shift is not merely technical. It changes the relationship between humans and the systems they build. When code and reasoning are produced by collections of narrow, auditable agents rather than opaque large models, developers regain the ability to understand and modify behavior directly. When models are encouraged to surface disagreement rather than paper over it, the outputs become easier to trust. These are not incremental improvements. They represent a different foundation.
The current LLM-centric model delivered the first wave of usable AI. Its limitations are now visible enough that the next wave will likely be built on different principles—smaller, more modular, and designed from the start to support human oversight rather than replace it. The companies that recognize this shift early will not be the ones that simply scale further; they will be the ones willing to rebuild the stack around different assumptions about what intelligence in software actually requires.