# Halo: Post-train LLMs 3x faster than TRL and Megatron

> Source: <https://twitter.com/whitecircle/status/2102087563913609534>
> Published: 2026-09-21 17:59:52+00:00

White Circle on X: "Introducing Halo, the best framework for post-training of open-source models.
Halo delivers up to 2.8x the throughput of stock TRL with less peak memory, while models stay in their native HuggingFace format.
Star us on GitHub: https://t.co/3mAiUljdrN" / X

White Circle on X: "Introducing Halo, the best framework for post-training of open-source models.
Halo delivers up to 2.8x the throughput of stock TRL with less peak memory, while models stay in their native HuggingFace format.
Star us on GitHub: https://t.co/3mAiUljdrN"

Introducing Halo, the best framework for post-training of open-source models.
Halo delivers up to 2.8x the throughput of stock TRL with less peak memory, while models stay in their native HuggingFace format.
Star us on GitHub: github.com/whitecircle/ha…

Introducing Halo, the best framework for post-training of open-source models.
Halo delivers up to 2.8x the throughput of stock TRL with less peak memory, while models stay in their native HuggingFace format.
Star us on GitHub: github.com/whitecircle/ha…

Every model we train at White Circle now uses Halo.
The same codebase runs LoRA on a 24 GB GPU, multi-node training on B300s, and async RL.
Technical blog:

Other training frameworks often require a separate implementation for each model family.
In Halo, adding a new model family takes just 100 lines of connecting a wrapper instead of rewriting the model.

Halo is not limited to supervised fine-tuning. It supports async RL and training with external environments.
We are excited to partner with the @sgl_project team to make it the primary engine for rollouts.

On @OpenAI gpt-oss-20b, Halo delivered 2.3–2.8x the throughput of stock TRL with less peak memory.
Both runs used the same FlashAttention, Liger, fused cross-entropy and grouped-GEMM optimizations.

We also used Halo to fine-tune @Zai_org GLM-4.7-Flash on 177M tokens of agentic traces.
The resulting model improved SWE-rebench-V2 by @nebiusai from 33% to 42%. Halo reached up to 1.63× TRL throughput on the same model precision and data.
Model and write-up:Show more

Scaling an AI model shouldn't require rewriting half your codebase
But that's exactly what happens when you outgrow your training framework
@whitecircle just launched Halo:
- Up to 2.8x faster than TRL
-- Distributed training
--- Native Hugging Face models
---- One stack fromShow more
