{"slug": "hccl-collective-communication-for-meta-training-and-inference-accelerators", "title": "HCCL: Collective Communication for Meta Training and Inference Accelerators", "summary": "Meta's HCCL collective communication library, co-designed with its MTIA 300 accelerator, achieves up to 940 GB/s on intra-rack collectives for training while introducing less than 0.5% degradation to concurrent compute throughput, according to a paper submitted to arXiv on August 1, 2026. The library leverages MTIA 300's dedicated message engines with near-memory compute to fully offload collective execution, and for inference it uses one-sided communication primitives to minimize latency.", "body_md": "# Computer Science > Networking and Internet Architecture\n\n[Submitted on 1 Aug 2026]\n\n# Title:HCCL: Collective Communication for Meta Training and Inference Accelerators\n\n[View PDF](/pdf/2608.00358)\n\n[HTML (experimental)](https://arxiv.org/html/2608.00358v1)\n\nAbstract:We present HCCL, a collective communication library co-designed with Meta's MTIA 300 accelerator, the first Meta chip to integrate backend networking directly on chip package. MTIA 300 includes dedicated message engines (MEs) with near-memory compute (NMC) that fully offload collective execution from the compute grid, enabling large overlap between computation and communication. HCCL uses a compiled communication model in which the host generates a complete description of each collective including dependencies. We describe the control and data path architecture, topology-aware algorithm selection across MTIA 300's asymmetric scale-up and scale-out network, and optimizations for both training and inference workloads. For training, HCCL achieves up to 940 GB/s on intra-rack collectives while introducing less than 0.5% degradation to concurrent compute throughput. For inference, we leverage one-sided communication primitives that bypass the scheduling path to minimize collective latency and describe collective designs that improve compute-communication pipelining for latency-sensitive workloads.\n\n### References & Citations\n\nLoading...\n\n# Bibliographic and Citation Tools\n\nBibliographic Explorer\n\n*(*[What is the Explorer?](https://info.arxiv.org/labs/showcase.html#arxiv-bibliographic-explorer))\nConnected Papers\n\n*(*[What is Connected Papers?](https://www.connectedpapers.com/about))\nLitmaps\n\n*(*[What is Litmaps?](https://www.litmaps.co/))\nscite Smart Citations\n\n*(*[What are Smart Citations?](https://www.scite.ai/))# Code, Data and Media Associated with this Article\n\nalphaXiv\n\n*(*[What is alphaXiv?](https://alphaxiv.org/))\nCatalyzeX Code Finder for Papers\n\n*(*[What is CatalyzeX?](https://www.catalyzex.com))\nDagsHub\n\n*(*[What is DagsHub?](https://dagshub.com/))\nGotit.pub\n\n*(*[What is GotitPub?](http://gotit.pub/faq))\nHugging Face\n\n*(*[What is Huggingface?](https://huggingface.co/huggingface))\nScienceCast\n\n*(*[What is ScienceCast?](https://sciencecast.org/welcome))# Demos\n\n# Recommenders and Search Tools\n\nInfluence Flower\n\n*(*[What are Influence Flowers?](https://influencemap.cmlab.dev/))\nCORE Recommender\n\n*(*[What is CORE?](https://core.ac.uk/services/recommender))# arXivLabs: experimental projects with community collaborators\n\narXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.\n\nBoth individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.\n\nHave an idea for a project that will add value for arXiv's community? [ Learn more about arXivLabs](https://info.arxiv.org/labs/index.html).", "url": "https://wpnews.pro/news/hccl-collective-communication-for-meta-training-and-inference-accelerators", "canonical_source": "https://arxiv.org/abs/2608.00358", "published_at": "2026-08-10 04:42:32+00:00", "updated_at": "2026-08-10 05:05:56.064917+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-research"], "entities": ["Meta", "MTIA 300", "HCCL"], "alternates": {"html": "https://wpnews.pro/news/hccl-collective-communication-for-meta-training-and-inference-accelerators", "markdown": "https://wpnews.pro/news/hccl-collective-communication-for-meta-training-and-inference-accelerators.md", "text": "https://wpnews.pro/news/hccl-collective-communication-for-meta-training-and-inference-accelerators.txt", "jsonld": "https://wpnews.pro/news/hccl-collective-communication-for-meta-training-and-inference-accelerators.jsonld"}}