{"slug": "ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical", "title": "AI at the edge: simplifying infrastructure with Cisco and Canonical", "summary": "Cisco and Canonical have released a new Cisco Validated Design (CVD) that combines Canonical's open-source software stack with Cisco's Unified Edge hardware to simplify AI deployment at the network edge. The joint solution addresses key challenges including hardware limitations, scaling inefficiency, and software fragmentation by providing a unified infrastructure for running AI inference workloads on Ubuntu-certified Cisco UCS systems with NVIDIA GPUs. The validated design aims to reduce manual complexity and security vulnerabilities for enterprises shifting AI workloads from centralized data centers to distributed edge locations.", "body_md": "# AI at the edge: simplifying infrastructure with Cisco and Canonical\n\n###\n[Pedro Lazzarotto](/blog/author/pedro-lazzarotto)\n\non 11 June 2026\n\n**Tags:**\n[AI](/blog/tag/ai)\n,\n[AI/ML Infrastructure](/blog/tag/ai-ml-infrastructure)\n,\n[Cisco](/blog/tag/cisco)\n,\n[Edge AI](/blog/tag/edge-ai-2)\n,\n[Partner](/blog/tag/partner)\n\nLegacy infrastructure was not designed for the requirements of the AI era. While large-scale model training remains centralized in data centers, test-time inference is rapidly shifting to the edge to reduce latency and bandwidth consumption. This shift creates a new frontier for enterprise AI, but deploying at the edge introduces significant manual complexity, interoperability issues, and security vulnerabilities.\n\nTo address these challenges, Cisco and Canonical have developed a new Cisco Validated Design (CVD). This guide details how to leverage the Canonical portfolio on the Cisco Unified Edge system to deliver scalable, secure, and cost-efficient AI-ready infrastructure. In this article, we’ll whet your appetite by highlighting the key challenges, technologies, and solutions explored in the guide.\n\n### The challenges of legacy infrastructure for AI\n\nEnterprises attempting to deploy AI use cases on traditional edge infrastructure typically face five critical bottlenecks:\n\n**Hardware Limitations:** Lack of specialized acceleration (GPUs) and high-density compute in small form factors.**Architectural Rigidity:** Static environments that cannot easily pivot between virtualized and containerized workloads.**Scaling Inefficiency:** Difficulty in managing thousands of geographically dispersed sites consistently.**Cost Prohibitions:** High CapEx for “rip-and-replace” cycles and high OpEx for manual site maintenance.**Software Fragmentation:** Version lag, lack of security patching (CVEs), and vendor lock-in.\n\nLet’s dig into how our joint solution with Cisco addresses these challenges.\n\n### The software layer: A unified open source stack\n\nThe solution begins with a hardened software foundation provided by Canonical. By decoupling the application layer from the underlying hardware, enterprises can modernize legacy operations without manual rebuilds.\n\n**Ubuntu Pro:** Provides a stable, 15-year security maintenance lifecycle, backporting of critical fixes, and seamless public cloud integration.**Data Science Stack (DSS):** A ready-to-use environment for data scientists to develop and deploy models without worrying about underlying library dependencies.**Charmed Operators:** Automated operations for popular AI/ML toolkits (e.g., Kubeflow, MLflow), enabling consistent deployment and “Day 2” operations across the fleet.\n\n### The hardware layer: Converged infrastructure for AI\n\nAI at the edge requires hardware that is both rugged and high-performing. The Cisco Unified Edge is a purpose-built system that converges compute, networking, storage, and security into a compact footprint.\n\n#### Hardware certification\n\nA key advantage of this partnership is the Canonical certification program. The Cisco UCS hardware is Ubuntu Certified, meaning Canonical works directly with Cisco to ensure the OS kernel is optimized for this specific platform. Running on this hardware, Ubuntu Server 24.04.3 LTS provides a stable, trusted open source foundation for edge applications.\n\nThe design guide we’ve developed with Cisco utilizes the Cisco UCS XE9305 chassis, which provides a variety of features to support inference at the edge:\n\n**Form Factor:** A 3-Rack-Unit (3RU) short-depth platform designed for space-constrained edge environments.**Compute Nodes:** Hosts up to five Cisco UCS XE130c nodes.**Processing:** 6th Gen Intel Xeon SoC processors (up to 32 cores per node).**Memory:** Up to 768GB DDR5 for high-throughput data processing.**Acceleration:** Dedicated NVIDIA L4 Tensor Core GPUs, providing energy-efficient AI inference.\n\n### Deployment flexibility: From VMs to Kubernetes\n\nEdge environments often require a mix of legacy and modern workloads. The Cisco and Canonical solution supports multiple deployment models on a single platform, solving the architectural rigidity challenge:\n\n- System containers and VMs with\n[LXD](https://canonical.com/lxd): LXD treats containers like lightweight virtual machines, offering a VM-like experience with the efficiency of containers. It is ideal for hosting full Linux distributions or infrastructure services with minimal overhead. [Canonical Kubernetes](https://ubuntu.com/kubernetes): For orchestrated, cloud-native applications, Canonical Kubernetes delivers an enterprise-grade distribution that is fully upstream-aligned.[Canonical MicroCloud](https://canonical.com/microcloud): This lightweight, automated private cloud solution is purpose-built for resource-constrained environments. It combines LXD, MicroCeph for storage, and MicroOVN for networking into a self-managing stack.\n\n### Zero-Touch operations and security\n\nManaging thousands of edge locations is an operational bottleneck. This solution utilizes Cisco Intersight, a cloud-based management platform, to enable Zero-Touch Provisioning (ZTP).\n\nBy using curated Blueprints, administrators can automate the deployment of the entire stack, from hardware firmware to the OS and Kubernetes layers. This eliminates manual configuration errors and ensures site-to-site consistency.\n\nThis foundation is reinforced by multi-layered protection, utilizing Ubuntu Pro for continuous CVE patching and MicroOVN to ensure network isolation for sensitive AI models and data.\n\n### Conclusion\n\nThe shift to edge AI demands a departure from traditional infrastructure silos. By combining Cisco’s modular, high-performance hardware with Canonical’s automated open source software stack, enterprises can build a future-ready platform that scales without the need for constant “rip-and-replace” cycles.\n\nWould you like to explore the full technical specifications and deployment steps?\n\n[Read the full Cisco Unified Edge and Canonical Design Guide](https://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/UCS_CVDs/Cisco_Unified_Edge_and_Canonical_Ubuntu_for_Edge_Deployments_Design.html)\n\nIf you have any questions, you can contact us directly:\n\nEnrico Panetta, Alliance Field Engineer – enrico.panetta@canonical.com\n\nFurther reading:\n\n###\n[Enterprise AI, simplified](https://canonical.com/solutions/ai)\n\nAI doesn’t have to be difficult. Accelerate innovation with an end-to-end stack that delivers all the open source tooling you need for the entire AI/ML lifecycle.\n\n##### Newsletter signup\n\n### Related posts\n\n####\n[What is RDMA over Converged Ethernet (RoCE)?](/blog/what-is-rdma-over-converged-ethernet-roce)\n\nPrevious articles walked through RDMA (Remote Direct Memory Access) as a programming model and InfiniBand as the fabric that was built around it. Both led to...\n\n####\n[Beyond tokens per watt – using Ubuntu 26.04 LTS for AI](/blog/beyond-tokens-per-watt)\n\nTokens per watt (TpW) – the measure of useful AI work produced per watt of energy consumed – is the metric at top of mind for CEOs, heads of AI, and...\n\n####\n[A look into Ubuntu Core 26: Deploying AI models on Renesas RZ/V series for production](/blog/ubuntu-core-26-ai-renesas)\n\nWelcome to this blog series which explores innovative uses of Ubuntu Core. Throughout this series, Canonical’s Engineers will show what you can build with our...", "url": "https://wpnews.pro/news/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical", "canonical_source": "https://ubuntu.com//blog/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical", "published_at": "2026-06-11 19:25:22+00:00", "updated_at": "2026-06-11 19:59:10.590736+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-infrastructure", "ai-products"], "entities": ["Cisco", "Canonical", "Cisco Validated Design", "Cisco Unified Edge system"], "alternates": {"html": "https://wpnews.pro/news/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical", "markdown": "https://wpnews.pro/news/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical.md", "text": "https://wpnews.pro/news/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical.txt", "jsonld": "https://wpnews.pro/news/ai-at-the-edge-simplifying-infrastructure-with-cisco-and-canonical.jsonld"}}