Leiolai runs inference across devices people already own instead of data centers. It saves water with inference and pays users for the computation their devices provide.
The app is free to use on iPhone and Android, with no card required. Users can contribute compute, earn money, and level up their chip system to unlock more computation at no additional cost.
leiolai-1 has an 11-million-token context window. Developers can use it through an OpenAI-compatible API starting at $0.01 per million input tokens and $0.02 per million output tokens. It supports continuous generation with no output limit.
Try it here: https://leiolai.com/download/ I'm happy to answer questions about the product and technology here!
Comments URL: [https://news.ycombinator.com/item?id=49485913](https://news.ycombinator.com/item?id=49485913)
Points: 1
source & further reading
leiolai.com — original article