We have built Tarit as a hypervisor built from ground up for running AI agent and RL environments. It is based on rust-vmm and can be used as a replacement for firecracker. Firecracker was built to serve a different need of primarily serverless compute and hence does not have primitives like live snapshots without pausing the VM operations.
We also provide a basic orchestrator that handles placement of the microVMs, creating clusters with HA, maintaining a warm pool of VMs, and takes care of setting up networking and monitoring.
Our benchmarks on a metal instance shows an acquire VM from pool and execute code p99 of 35ms which places it as one of the fastest VM based sandboxes you can get right now. You could also snapshot a small sandbox and resume in ~80ms.
You can easily self-host a multi-node cluster of this right now on your cloud with nested-virt enabled machines or better on bare metal by providing the docs to your coding agent.
Tarit - https://github.com/instavm/tarit Quickstart - https://github.com/instavm/tarit/blob/main/orch/docs/QUICKST...
Comments URL: [https://news.ycombinator.com/item?id=48829512](https://news.ycombinator.com/item?id=48829512)
Points: 3