# Why LLMs are reaching their limits and what's next

> Source: <https://www.thedeepview.com/articles/why-llms-are-reaching-their-limits-and-what-s-next>
> Published: 2026-08-09 22:36:59+00:00

hat comes after large language models?

In [this episode of The Deep View Conversations](https://youtu.be/fjB6sEPC4CE), we talked with Zuzanna Stamirowska, CEO of Pathway, to explore why her team believes today’s dominant AI architecture has fundamental limits, and what it could take to move beyond them.

Pathway is developing Dragon Hatchling, a new architecture designed to give AI native memory, continual learning, and a different approach to reasoning. Stamirowska explains why today’s LLMs can appear to remember without actually internalizing what they learn, why reasoning through language creates its own constraints and costs, and how Pathway is trying to build models that can think in a more abstract way.

The conversation looks at how those architectural changes could affect hallucinations, interpretability, safety, and the enormous compute demands of modern AI. Stamirowska shares how her background in complex systems and game theory shaped Pathway’s approach, why the company made an early bet on challenging the transformer, and how the AI coding revolution has already radically changed the way her own team works.

Topics covered:

- Why transformers struggle with memory and continual learning
- How Pathway’s Dragon Hatchling architecture works
- How a different architecture could reduce compute costs
- How interpretability could make advanced AI more predictable
- Why Pathway’s engineers have largely stopped writing code themselves
- How Stamirowska uses Codex, Claude Code, and other AI tools
- Why leaders should be ruthless about identifying the critical path

If you’re interested in what could come after today’s LLMs, and whether the next big leap in AI will require more than simply scaling transformers, this conversation offers a fascinating look at one of the teams betting on a fundamentally different path.

📺 [Watch on YouTube](https://youtu.be/fjB6sEPC4CE)

🎧 [Listen in your favorite podcast player](https://tdv.transistor.fm/episodes/57-why-ais-next-era-may-not-belong-to-llms-zuzanna-stamirowska)

[Subscribe to Deep View Conversations](https://tdv.transistor.fm/) for interviews with the leaders shaping the future of AI, business, and technology: [tdv.transitor.fm](http://tdv.transitor.fm)
