Foundational ternary-model inference and training – CUDA, CPU, BitNet/TQ

Quitetall released Tritium 1.1.0-rc.0, an Apache-2.0 infrastructure for converting dense neural networks into compact additive-ternary models with weights in {-1, 0, +1}, supporting training, inference, and auditable artifact lifecycles. The release candidate is not yet a public v1.1, with gates open for package, browser, flagship-model, deployment, and second-machine validation; the compatibility matrix is authoritative, and no public registry artifact is claimed before activation. Tritium supports additive PTQ with up to three ternary planes, differentiable PyTorch QAT, packed inference kernels for CPU, CUDA, Metal, ROCm, wgpu, WASI/WASM, browser WebGPU, C, Candle, Burn, and ONNX, plus OpenAI-compatible serving and receipt-backed release tooling.

Tritium is Apache-2.0 infrastructure for converting dense neural networks into compact additive-ternary models, refining or training them with PyTorch, and executing their packed weights across native and portable runtimes. Weights use {-1, 0, +1} planes. One plane is the compact base model; additional residual planes trade physical bytes for quality. Tritium treats the recipe, calibration evidence, ancestry, packed bytes, runtime memory, and measured model quality as one auditable artifact lifecycle—not as an informal bits=2 label. Release status:the repository uses the 1.1.0-rc.0 candidate version. It is neither LOCAL RC READY nor a public v1.1 release. Package, browser, flagship-model, deployment, and second-machine gates remain open. The generated compatibility matrix is authoritative: pending is not support, and no public registry artifact is claimed before activation. | Tier | Role | Frozen model | Admission rule | |---|---|---|---| accessible | tutorial | HuggingFaceTB/SmolLM2-135M-Instruct | candidate artifact + admitted receipt ancestry | accessible | recipe | HuggingFaceTB/SmolLM2-1.7B | candidate artifact + admitted receipt ancestry | native-reference | native | microsoft/bitnet-b1.58-2B-4T | candidate artifact + admitted receipt ancestry | flagship | language+mtp | Qwen/Qwen3.6-27B | candidate artifact + admitted receipt ancestry | This table is an admission inventory, not a support or SOTA claim. A row becomes releasable only when its exact candidate artifact, immutable source and tokenizer identity, model card, and required evidence ancestry validate. - Additive PTQ with one to three ternary planes, calibration receipts, strict physical-byte accounting, packed artifacts, scale-only refinement, and hard-PV refinement. - Differentiable PyTorch QAT with STE estimators, tied-weight preservation, hard conversion, optimizer-compatible latent masters, strict checkpointing, Hugging Face integration, and ternary diagnostics. - Packed inference kernels and runtime adapters for CPU, CUDA, Metal, ROCm, wgpu, WASI/WASM, browser WebGPU, C, Candle, Burn, and ONNX at different qualification levels. - Native SALT formats plus compact B3 packing, sparse/additive layouts, seek-backed payloads, canonical manifests, digests, and bounded readers. - OpenAI-compatible serving with bounded requests, rotating bearer authentication for exposed binds, per-principal admission, readiness, metrics, hardened OCI/Kubernetes assets, and evidence-gated deployment. - Receipt-backed release tooling for wheels, crates, npm archives, OCI images, SBOMs, provenance, compatibility, model evidence, and local-RC sign-off. Implementation is not the same as release qualification. See the release ADR and execution plan in the research repository https://github.com/Quitetall/tritium-research for the gates see docs/RESEARCH.md /Quitetall/tritium/blob/main/docs/RESEARCH.md . The backend guide /Quitetall/tritium/blob/main/docs/book/src/backends.md describes source capabilities; an implementation without a generated compatibility cell and admitted receipt remains unqualified. The public API exposes preparation, calibration, conversion, refinement, export, load, and inspection as distinct typed phases: python from pathlib import Path import torch from tritium.torch import TernaryConfig, calibrate, convert, inspect, load quantized module, prepare, dense = torch.nn.Linear 128, 64 .eval recipe = TernaryConfig.ptq profile="compact-v1", target modules= "Linear", , prepared = prepare dense, recipe, inplace=False calibration = calibrate prepared, torch.randn 4, 128 for in range 4 , evidence dir=Path "work/calibration" , result = convert prepared, calibration, work dir=Path "work/conversion" ternary = load quantized module dense, result, inplace=False .eval print result.artifact id print inspect prepared print ternary torch.randn 2, 128 .shape For QAT, Hugging Face, refinement, ONNX, and browser workflows, use the book /Quitetall/tritium/blob/main/docs/book/src/SUMMARY.md . The pinned SmolLM2 tutorial is generated and headless-testable, but its clean candidate-wheel/Colab receipt is still a release gate rather than a published quick-start claim. The default workspace build is CPU-only and uses Cargo—no CMake: cargo build --locked cargo test --locked -p tritium-core -p tritium-format -p tritium-cpu cargo run --locked -p tritium-cli -- list-backends CUDA and other accelerator adapters are feature-gated because their toolchains and physical device receipts are target-specific. Portable targets use their own target-build and package gates. The source-level CLI and server tutorial is in the quickstart /Quitetall/tritium/blob/main/docs/book/src/quickstart.md . Release users should install only exact artifacts admitted by the candidate manifest once those artifacts are authorized and published. Dependencies point inward: foundation core · format · spec · testkit ↑ backends cpu · cuda · metal · rocm · wgpu · wasm · mcu ↑ runtime runtime · quantize · salt · nn · train ↑ frontends ffi · python · onnx · candle · burn · cli · serve · web A frontend does not own a concrete backend, and one backend does not depend on another. Shared schemas and conformance vectors define semantic portability; physical device claims additionally require target receipts. The v1.0 codebase has real BitNet b1.58 2B4T CPU/CUDA evidence recorded in the changelog /Quitetall/tritium/blob/main/CHANGELOG.md . The v1.1 flagship target is a separately labeled Qwen3.6-27B language-plus-MTP additive-PTQ/refinement campaign. It is not a completed SOTA claim until its frozen quality, retention, runtime, memory, and reproduction gates pass. The scripts/release-status validator consumes an explicit candidate manifest and evidence registry and refuses incomplete gates. This working tree does not yet contain a sign-off candidate/registry. Current work-order blockers include: - whole-model Qwen/MTP quality and performance evidence is not yet admitted; - public wheel/crate/npm/container artifacts are not activated; - browser support awaits physical Chrome, Firefox, and Safari receipts; - whole-model Qwen/MTP inference and clean-wheel ONNX Runtime generation receipts remain open; - trainable whole-model ONNX is intentionally deferred to v1.3; - vision/multimodal tensors are identity-bound but deferred from v1.1; - public links and community channels remain inactive while the repository is private, and an independent conduct adjudicator must be designated first. Tritium is licensed under Apache-2.0 /Quitetall/tritium/blob/main/LICENSE . Vendored upstream work is attributed in NOTICE /Quitetall/tritium/blob/main/NOTICE .