i am just tired of looking for a reliable open-source model AI API with ZDR and don't even save my prompts. I'm thinking of a service for people like me who want to use it.
idea is a simple OpenAI-compatible API: Access to open-weight models
zero retention of prompts and completions
no training on data
only retain metadata required for billing and operations: request ID, model, input/output token counts, latency, timestamp, etc.
no request/response in logs
Just here to check interest. I am not 100% sure if I can get compute to do it or not (may be i can just try with my 5090 first with a small model), but I just want to check and talk with people rather than just thinking in my head.
Comments URL: [https://news.ycombinator.com/item?id=49459973](https://news.ycombinator.com/item?id=49459973)
Points: 1
source & further reading
news.ycombinator.com — original article
PaaS IaaS GaaS all in one. And 2 AI <compound> models
Taalas API Anyone?
I estimate reading code costs 2.1x more than writing it