what if they're rigging your API to manipulate you deliberately? Is there any way to know?
with a provider-hosted model: no
- Through an API you're blind to the three layers that matter: - which model is actually answering - what the effective system prompt is - whether the weights were modified You're entirely at the provider's mercyRunning inference on your own VPS gets two of them back: you can validate the model version and the system prompt. But the weights are the Achilles' heel. It's a file written once that nobody ever looks at again, and whoever owns the box has access.In the ideal privacy world you run the model on your own hardware: model, prompt and weights all legitimate and hash-verifiable. That's the practical ceiling.Even then you're not safe: the software and hardware you run can carry backdoors. Firmware, drivers, microcode, silicon. Trust doesn't disappear, it moves. The question is never "do I trust?" but "whom, and at which layer?"
source & further reading
twitter.com — original article