Netflix wiz creates app to slash AI bills, then open sources it

A Netflix engineer developed Project Headroom, an open-source application designed to reduce the cost of running large language models by optimizing GPU memory usage. The tool, which the creator released publicly, aims to help organizations slash their AI infrastructure bills without sacrificing performance.

MOST POPULAR EVENTS - Overcoming the trade-offs in data sovereignty What does data sovereignty actually mean for your network, which trade-offs are unavoidable? Learn more. - From Prompt to Exploit: How LLMs Are Changing API Attacks Modern applications are API-driven, interconnected, and often over-permissioned, making them an ideal target for AI-assisted attacks. - Architecting the Future: Unlocking Enterprise Data Services for Kubernetes Join us to discover how to eliminate infrastructure silos and establish a standardized, enterprise-grade cloud-native platform. - Catch the Advanced Attacks Microsoft 365 Misses with Behavioral AI Security Microsoft 365 is the backbone of enterprise communication, and its native security filters out the known and the noisy. - Virtual Cyber Recovery Sim Step into the chaos of a live ransomware breach, test your response skills, and team up with other IT and security pros to outsmart cybercriminals - Virtual Cyber Recovery Simulation Ransomware attacks aren’t slowing down, and neither are we. Druva’s hit event, Escape Ransomware, is now fully virtual. - Agentic AI at Scale: From Pilot to Production Join us to learn how to unlock real ROI by driving adoption of AI at scale. AI https://beta.theregister.com/tag/ai - AI + ML Netflix wiz creates app to slash AI bills, then open sources it Project Headroom could save you big money, too - Software Wikipedia editors plot strike and banner sabotage after Wikimedia layoffs Foundation sparks revolt after disbanding team responsible for many community-requested fixes and moderation tools - Offbeat Rocket exhibit at National Space Centre pulls off unintentional NASA SLS impression 5, 4, 3, 2, 1... pfft - AI + ML AWS reportedly to tuck Elon Musk's Grok into Bedrock, despite zero enterprise demand The energy drink of frontier models - Security Lone attacker published 14 malicious npm packages mimicking popular OpenSearch, Elasticsearch libraries And then Microsoft busted them all Infosec https://beta.theregister.com/security - AI + ML Netflix wiz creates app to slash AI bills, then open sources it Project Headroom could save you big money, too - Software Wikipedia editors plot strike and banner sabotage after Wikimedia layoffs Foundation sparks revolt after disbanding team responsible for many community-requested fixes and moderation tools - Offbeat Rocket exhibit at National Space Centre pulls off unintentional NASA SLS impression 5, 4, 3, 2, 1... pfft - AI + ML AWS reportedly to tuck Elon Musk's Grok into Bedrock, despite zero enterprise demand The energy drink of frontier models - Security Lone attacker published 14 malicious npm packages mimicking popular OpenSearch, Elasticsearch libraries And then Microsoft busted them all FOSS https://beta.theregister.com/tag/FOSS - Netflix wiz creates app to slash AI bills, then open sources it Project Headroom could save you big money, too - Wikipedia editors plot strike and banner sabotage after Wikimedia layoffs Foundation sparks revolt after disbanding team responsible for many community-requested fixes and moderation tools - Rocket exhibit at National Space Centre pulls off unintentional NASA SLS impression 5, 4, 3, 2, 1... pfft - AWS reportedly to tuck Elon Musk's Grok into Bedrock, despite zero enterprise demand The energy drink of frontier models - Lone attacker published 14 malicious npm packages mimicking popular OpenSearch, Elasticsearch libraries And then Microsoft busted them all - Okta writes its own license to kill rogue AI agents CEO Todd McKinnon says customers including ServiceNow want an off switch FEATURES https://www.theregister.com/tag/features? gl=1 esekfm ga NzgyNjE4NzEwLjE3NzExNzQ4MjA. ga JXW44Y23NM czE3NzY3NTY3MjIkbzEwNSRnMSR0MTc3Njc1Njg5NCRqOCRsMCRoMA.. - Europe built sovereign clouds to escape US control. Then forgot about the processors - Nobody believes the 'criminals and scumbags' who hacked Canvas really deleted stolen student data - Europe wants out from under US tech – but first it has to find the exits - GNOME may rule Ubuntu Resolute Raccoon, but X.org isn't roadkill yet - OpenClaw, but in containers: Meet NanoClaw - Open source registries don't have enough money to implement basic security - Contain your Windows apps inside Linux Windows - The Linux mid-life crisis that's an opportunity for Tux-led transformation - Too much AI for some, too little for others: Why AMD can't win with investors - How agentic AI can strain modern memory hierarchies