Token prices could be significantly lower, but inference companies are inflating them by renting GPUs and adding margins of over 40%, according to an unnamed analyst. These companies have current business because they started early, but the analyst doubts their longevity.
token prices could be a lot lower today but these inference companies are getting in the way of them they don't own anything, they rent GPUs and serve tokens and slap a 40%+ margin on top they have business today because they started early. i don't think they will last
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.