South Korean startup Rebellions to use open source software for carriers to quickly build AI stacks with its AI inferencing chips

South Korean chip startup Rebellions is adopting an open source-first software strategy, including vLLM, OpenShift, and PyTorch, to help telecom carriers quickly build AI stacks with its AI inferencing chips, which include the Rebel100 with 2.7TB/s effective bandwidth. The company, which has deployed its systems at SK Telecom for nearly three years, is in talks with 10 to 20 operators worldwide, according to Chief Business Officer Marshall Choy.

South Korean startup Rebellions to use open source software for carriers to quickly build AI stacks with its AI inferencing chips South Korean chip startup Rebellions https://rebellions.ai/company/about/ builds purpose-engineered Al accelerators to redefine energy-efficiency and scale in the age of large-scale Al. It aims to deliver the best performance per dollar per watt possible for inferencing and lower both capex and opex associated with running AI infrastructure. The company has been very selective about where it has established office locations and staffing: Korea, Japan, Singapore, Saudi Arabia and the United States. Their flagship semiconductor product is the Rebel100 , which uses a predictive, software-controlled DMA engine tightly coupled with an on-chip mesh to prefetch KV data proactively. This enbales 2.7TB/s effective bandwidth and reduces token-level latency in 32K+ context LLMs. Image Credit: Rebellions ……………………………………………………………………………………………………………………………………………………………………………………………………… Gaining valuable experience in building an AI stack with SK Telecom, https://www.fierce-network.com/cloud/heres-why-sk-telecom-building-its-own-ai-stack it’s pairing its field experience with an open source-first software strategy it said can help carriers move faster without locking scarce engineering talent into yet another proprietary AI stack. The company says it’s dedicated to using open-source software – everything from vLLM and OpenShift to PyTorch – with a “no forks” rule. The rule is designed to help customers avoid skills issues and ensure engineers don’t have to learn non-transferrable skills just to use its equipment. Rebellions’ work with SK Telecom SKT has served as a foundational pillar of its engagement with other operators, according to Marshall Choy, Rebellions’ Chief Business Officer CBO . The company is in conversations with between 10 and 20 operators around the world. “Our systems have been deployed at SKT for nearly three years ,” Choy said. “What does that mean? It means three years of lessons learned, institutional knowledge gain, product improvement and deep engagement with an end user customer working on real problems… It’s three years of blood sweat and tears that has become institutional knowledge,” he added. The network operators in its pipeline are in “different stages of engagement and deployment” with Rebellions, Choy said, saying there will be “more to come on that.” While SK Telecom has been its most publicized partner to date, Choy said over the next 12 months Rebellions plans to highlight more of what has been going on under cover. That includes work with other telecom operators as well as neocloud operators, enterprises and governments. Groq and SambaNova see References below are similarly working on chips to reduce the cost of inferencing. OpenAI appears to be moving in a similar direction with its Jalapeño chip. In conclusion, Choy opined, “Let’s be honest, the telcos don’t necessarily have all the right skills in place. So, being able to spread that across more of an open-source ecosystem means they can be in service and productive faster.” ………………………………………………………………………………………………………………………………………………………………….. References: https://rebellions.ai/company/about/ https://rebellions.ai/company/about/ https://rebellions.ai/category/blogs/ https://rebellions.ai/category/blogs/ https://rebellions.ai/rebellions-product/rebel100/ https://rebellions.ai/rebellions-product/rebel100/ SambaNova targets AI inference boom with chips built for existing data centers