# A Letter from a Machine Learning Engineer

> Source: <https://nemin.hu/llm-letter/index.html>
> Published: 2026-09-14 17:58:22+00:00

## Table of Contents

A couple of days ago, I received an email from a throwaway address, whose author claims to be an ML Engineer at one of the frontier labs. In this, they explain their beliefs about the future of the current LLM craze and how frontier labs are bound to eventually go under.

I have no means of ascertaining whether the author was really who
they say they are, nor was I able to reply to them, because the address
had since been deleted.<sup>1</sup>

I'm not one to air out my private mails normally and I deliberated
for a few days whether to make an exception here. However, considering
the importance of the topic in the current times and the fact that the
author wrote it in a way that (per their own words) cannot be used to
identify them, I figured it'd be worth sharing with the greater
community.<sup>2</sup>

I will first quote the mail verbatim for those who want to read it as a coherent essay. Then I'll repeat it while interrupting the text whenever I have something to say.

Both sections will contain the exact same text, so if you're fine with reading the cut up text with my annotations, feel free to skip to the second part.

# 1 The letter

Hi Nemin,

I work at a frontier AI lab as an MLE. I help train models and do RLHF for frontier stuff at one of the big companies you probably know.

Sorry this email is short. I have an NDA, so I need to keep this general.

I saw your post about worrying about the future of programming. Honestly, I'm more worried about losing my job than yours. How is that even possible? Internally, we've hit limits on scaling models for programming tasks, which is why so many people are switching careers. At my company, a lot of executives have quit in a year, and there's real stress about the IPO. There is lots more I cannot share, but it does not look good internally.

The real threat to labs like ours is that there is no competitive moat. We have to keep advertising our math-solving abilities and overselling because things are changing fast. The proprietary diffusion models got largely replaced by open-weights ones. Image and video generation can now be done with open models without needing us. Sales tanked and that's why the frontier labs quietly stopped promoting image/video gen.

LLMs are next. Even parts of the serious research community like LeCun have moved on from them. Most of the people who wrote the attention paper have left Google and scattered across new labs and startups. If you look at efficiency and size, the trend is clear. We'll see an open-weights model as good or better than Fable 5.1 within a year. There is research going on into parameter efficiency, so if it pans out, something like this could one day run on devices like high-end laptops.

AGI is not mathematically possible with LLMs. There was a paper a couple of years ago arguing that, using Cantor's diagonalization argument. I can't remember the name for the life of me as I read it a long time ago. This realization changes everything. And a Google researcher leaked an internal memo in 2023 that said the quiet part out loud: "We have no moat, and neither does OpenAI." feel free to read if you're interested.

The online discussion is poisoned. A lot of the voices driving the hype, the influencers who sold those online courses, are now just being sponsored by the AI companies themselves. This is why programmers are so stressed, I think. Don't trust anything you hear or read on mainstream sites. A few engineers have been deploying agents as "fun projects" to market models and scrape data (that's how I found your email), and you should absolutely ignore the forecasts from the CEOs. They are completely clueless about what's actually happening.

# 2 My thoughts on the individual sections

Hi Nemin,

I work at a frontier AI lab as an MLE. I help train models and do RLHF for frontier stuff at one of the big companies you probably know.

MLE is Machine Learning Engineer, this I figured out on my own,
because it was pretty obvious. However, I had no idea what RLHF is (only
heard of RTFM and GLHF before :), so I looked it up. It means [Reinforcement
Learning from Human Feedback](https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback), i.e. a particular variant of agentic
training, where the reward function (what determines how "good" an AI's
responses are) is first manually tuned by human operators.

Sorry this email is short. I have an NDA, so I need to keep this general.

Hard to fault the author (who I'll refer to as "G"[<sup>3</sup>](#fn3)
from now on, due to the fake moniker they used in the mail) for this.
While [NDA](https://en.wikipedia.org/wiki/Non-disclosure_agreement)-s
are [not
universally enforceable](<https://www.law.cornell.edu/wex/non-disclosure_agreement_(nda)>), they are still a sword of Damocles above
one's head of "Talk too much and you'll never work in this field
again".

I saw your post about worrying about the future of programming.

By "my post", G means my [commitment](../llm/index.html)
to not using LLMs for hobby projects, due to their ethical issues, the
perceived uselessness of AI, and the love of the craft.

Since writing this declaration my opinion on LLMs has slightly shifted or, rather, I'd say became more nuanced:

**For one,** I can no longer say that the output of the
various coding agents is useless and I think anyone who keeps insisting
that they are still outputting pure gibberish has not tried an agent
recently.

I still do not trust vibe-coding, as I believe that unsupervised development results in write-only apps, that cost exponentially more to maintain over time and are impossible to comprehend without the constant assistance of the agent.

This, in my opinion, is tying yourself to a kind of "supply chain" of its own, where the token prices are in constant flux and aren't based on any real, measurable metric. It also does nothing to improve your own understanding and mastery over computers. I'm sure, regardless of this, you can "get rich quick" by vibing up something, but I'm not very interested in that.

However, after being strongly recommended at my workplace to try
using AI, I found that agents are great at being a sort of "secretary",
who can fetch you information about the codebase based on free-form text
queries. While `grep`, `find`, etc. can get you
far, "vibe searching" takes things a step further in a way, I couldn't
really replicate with conventional tools.

I also found, that using an agent as a pre-reviewer before you send in your PR for a human to actually take a look at is a nice way of avoiding some unnecessary back and forth. While I still ultimately defer to human judgement (including my own), it is nice to catch issues such as "hey, this line is potentially dereferencing null", "this comment wasn't updated to what the code actually does", and similar nitpicks.

**For two,** and this might sound a little paradoxical,
after I just conceded agentic output being better than I once thought,
but I no longer expect programming as a job to disappear. In fact, I
think people who understand how these mechanical parrots "think" have
more job security than ever.

Back when writing my first post, I was genuinely somewhat worried,
that after almost five years of university (and before that more than a
decade of hobby programming) will just become *obsolete* once
models become good enough to fully replace us.

However, while I've seen a lot of improvement to the quality of agentic output, I still experience a ton of flukes as well. My company allows us to use top of the line models and they are both incredibly capable at times and terribly, horribly dumb.

Among other things: The model we use still occasionally hallucinates functions that simply don't exist, despite being plugged into LSP. It occasionally moves code into conditionals, that should happen in both branches. And sometimes it just starts using legacy code that's clearly marked as such as a style to follow. And that's just a small sample.

You simply need a human in the loop to make sure the machine doesn't do anything stupid. And, as mentioned before, I'm absolutely not the sort to let the agent loose. I rarely allow it to generate anything more than 10-20 lines. How could it then replace me as a whole?

Instead, I believe the recent lay-off wave, that was conducted "due
to AI performance optimization" was really just CEO-s buying into hype
and the market experiencing a painful normalization in the post-COVID /
[ZIRP](https://en.wikipedia.org/wiki/Zero_interest-rate_policy)
era.

**That being said,** as convenient as LLMs are, the
moral concerns and the fact, that I want to keep my skills sharp still
makes me want to relegate AI usage to my job only.

Honestly, I'm more worried about losing my job than yours. How is that even possible? Internally, we've hit limits on scaling models for programming tasks, which is why so many people are switching careers. At my company, a lot of executives have quit in a year, and there's real stress about the IPO. There is lots more I cannot share, but it does not look good internally.

Funnily enough, I assumed both Anthropic and OpenAI have already
IPO-d, but it turns out neither of them have. I guess the numbers [don't look good](https://isaiprofitable.com/) enough to bring
this stuff onto the stock market.

As for the rest of the claims, I have no real means of checking the
validity of them. There has been that story about a researcher [quitting](https://www.businessinsider.com/anthropic-researcher-quits-over-ai-safety-concerns-2026-9),
because they fear AI will endanger humanity, but this person wasn't an
executive and they have seemingly left for ethical reasons, not
financial ones.

The real threat to labs like ours is that there is no competitive moat. We have to keep advertising our math-solving abilities and overselling because things are changing fast. The proprietary diffusion models got largely replaced by open-weights ones. Image and video generation can now be done with open models without needing us. Sales tanked and that's why the frontier labs quietly stopped promoting image/video gen.

This part feels particularly striking after the recent [controversy](https://simonwillison.net/2026/Sep/8/on-navier-stokes/)
related to progress on the Navier-Stokes equations, which OpenAI
potentially snatched from the hands of two researchers.

For clarity, G's mail arrived OpenAI published its findings, so this was a reaction, not a forewarning to it and it is no evidence that G may be from OpenAI.

As for the other part of this quote, it really is interesting how
much AI ~~slop~~ videos became a cheap commodity, that is simply
not worth selling as a singular product. Back in the day we had things
like Sora and then it went belly up, when the math wasn't mathing about
its economics. I wonder if one day selling tokens will be seen as a
pointless venture, because they'll be so commodified.

LLMs are next. Even parts of the serious research community like LeCun have moved on from them. Most of the people who wrote the attention paper have left Google and scattered across new labs and startups. If you look at efficiency and size, the trend is clear. We'll see an open-weights model as good or better than Fable 5.1 within a year. There is research going on into parameter efficiency, so if it pans out, something like this could one day run on devices like high-end laptops.

G is talking about [Yann LeCun](https://en.wikipedia.org/wiki/Yann_LeCun), known
for his work on ML and computer vision, and who in [April
of this year](https://www.brown.edu/news/2026-04-01/yann-lecun-artificial-intelligence-pioneer) engaged in a lecture about LLMs being a dead-end and
that a new approach would be necessary, if humanity really wanted to go
for AGI.

Despite this, he is also [involved in](https://thealliance.ai/projects/tapestry) a
"collaborative foundation for open and sovereign AI," so take that as
you will.

AGI is not mathematically possible with LLMs. There was a paper a couple of years ago arguing that, using Cantor's diagonalization argument. I can't remember the name for the life of me as I read it a long time ago. This realization changes everything. And a Google researcher leaked an internal memo in 2023 that said the quiet part out loud: "We have no moat, and neither does OpenAI." feel free to read if you're interested.

I suspect G is thinking of [*Hallucination is
Inevitable*](https://arxiv.org/abs/2401.11817), a frequently-cited paper from 2024, which proved
that it is impossible to make an LLM, that doesn't hallucinate (i.e. act
as a perfect general problem solver).

As for the other paper, it may be reached [here](https://newsletter.semianalysis.com/p/google-we-have-no-moat-and-neither).
It is an allegedly authentic memo of an anonymous Google employee, who
argues that ultimately the big frontier labs are living on borrowed time
and eventually open-weight models will not only catch up, but surpass
closed models.

I'm not nearly educated enough to discuss either papers in detail. My
only input is that *We have no moat…* is from 2023 and so far (at
least based on my limited knowledge) it doesn't really feel to me like
the things that Google employee was so worried about came to pass.
Closed models are still king and while there are now capable models,
that one may run on consumer hardware, it's still not on par and is also
quite expensive in terms of hardware.

I guess G did specifically touch on this in the previous segment, where they posited, that we'll see an open-weight Fable 5.1 till the end of 2027, but until that actually happens, we can only work with the assumptions we have.

On the other hand, it is also true, that Google's focus on LLMs has
shifted hard from agentic stuff into making people engage with their
search in a new way. So perhaps that is Google's *moat,* their
data and the fact that nobody else is connected so directly to it.

The online discussion is poisoned. A lot of the voices driving the hype, the influencers who sold those online courses, are now just being sponsored by the AI companies themselves. This is why programmers are so stressed, I think. Don't trust anything you hear or read on mainstream sites. A few engineers have been deploying agents as "fun projects" to market models and scrape data (that's how I found your email), and you should absolutely ignore the forecasts from the CEOs. They are completely clueless about what's actually happening.

I have no doubts this is the case.

All I really see online is either doomerism or accelerationist
euphoria, and the less 'aggressive' (be they pro- or anti-AI) voices are
drowned out by the hypebeasts and antihypebeasts. Some of these voices
being paid shills doesn't feel like a massive leap of logic to me.<sup>4</sup>

And I'm pretty sure any larger company's upper management is expected to buy into the Current Thing, because if it turns out to deliver, you don't want to be the chump who was left out by not jumping on the bandwagon.

# 3 Closing thoughts

So, do I believe G? To an extent, sure.

- I believe that there is no secret "silver bullet", that would suddenly catapult LLMs from a versatile, yet wonky tool into AGI.
- I also believe, that CEO-s are absolutely hype-chasing, just like Big Tech was previously chasing the Blockchain, NFTs, dotcom, etc.
- I even believe, that one day (perhaps in the near future) we'll be running these things on cheap hardware and they'll be about as magical to the average person as a smartphone is.
- And I also believe some of the huge labs that have impossibly large valuations now will not survive the end of the decade.

However, everything in this email is either post-facto or unverifiable by me, so I cannot adequately confirm if it the identity of the author is legit, and the mail wasn't written by a very convincing "layperson".

I don't mean to insult G with my doubts. I understand, why they had their hands tied, NDA and all. In fact, if they ever read this, I'm very grateful to them. They saw a person clearly anxious about the future and tried their best to console them.

Mostly, I'm just trying to protect my own credibility and cool any
reactions a reader of this article might potentially feel. I
*think* the mail is legit, but I cannot know. And even if it is
legit, it is just one researcher's beliefs, we (sadly or thankfully)
have no means of scrying the future.

If I had one qualm with the mail, however, it'd be that I wish G
expressed it in more detail what they expect the future to look like,
because I think "everyone will be able to run LLMs" and "it wont be AGI"
don't really address what *really* makes people nervous.

I mean topics such as copyright washing, write-only apps and the devaluation of programming as a field, the environmental harm from data centres, and the onslaught of AI-generated ragebait / disinformation. None of these would be really fixed just with frontier labs going under and LLMs becoming even more widespread than they already are.

And then there are the questions of, for example, how will these
homebrew models get their training data? Will such a proliferation lead
to an even stronger focus on scraping the open web? What will happen to
the current money whirlpool of AI labs->NVIDIA->Chip makers->AI
labs? Where is the field expected to go next if LLMs truly are an almost
2 trillion dollar[<sup>5</sup>](#fn5) mistake?

All questions an actual researcher with insider info could make far better guesses about. But I suppose we can't have everything and, at the end of the day, the point of this mail was to make me feel a little better. I found G's words interesting to digest and I hope you have too.

Thank you for reading!

# 4 Footnotes

1. I know this, because both of us used Protonmail, which tells you if the account associated with the address has since been deleted. [↩︎](#fnref1)
2. If you ever considered writing me an email (I don't exactly hide my address too hard), please don't feel discouraged by this. This was an extraordinary case. If you write even with an identifiable alias, let alone your real name, unless you give me explicit instruction and permission, I'll consider your message confidential and my eyes only. [↩︎](#fnref2)
3. G was using a name from a fictional series. Even if I wrote it out in full, it'd not be identifiable in any way, because it'd be as if I said "I got an email from a Xenomorph". However, I want to do my due diligence to further conceal their identity and thus won't even write out the whole word here. [↩︎](#fnref3)
4. Truthfully, I don't really follow the "latest" beyond second-hand news from seeing what's posted on Hacker News and Lobste.rs. Therefore, even if I wanted (not that I want), I couldn't point fingers, because I intentionally avoid tech influencers. [↩︎](#fnref4)
5. I originally wrote 1.5 trillion here, because that's the last number I remember, but it turned it *Is AI Profitable Yet* is now countin 1.9 trillion. Terrifying and unthinkable numbers,
genuinely.[↩︎](#fnref5)
