A developer benchmarked six AWS LLM inference backends — Amazon Bedrock, a SageMaker real-time endpoint, vLLM on two EC2 GPU families, and a hand-ported Gemma 4 build on Inferentia2 and Trainium — all…
Cohere released Embed 5, an embedding model family in two tiers — Embed 5 Pro and Embed 5 Fast — that share one embedding space so users can index with Pro and query with Fast, with both generally ava…
A developer benchmarked the same Gemma 4 E2B build served from an Amazon SageMaker endpoint and from a plain EC2 instance with an identical NVIDIA T4 or L4 GPU, finding decode speed and answers match …
A developer deployed Gemma 4 (E2B, E4B, 12B and 26B A4B) to Amazon SageMaker on a single NVIDIA T4 (ml.g4dn.xlarge), measuring decode throughput at 0.77x to 0.82x of an L4 while producing identical an…
A developer benchmarked Google's Gemma 4 E2B quantization-aware trained (QAT) checkpoint against the full bf16 release on a single NVIDIA L4 SageMaker endpoint, finding the 4-bit QAT model decodes at …
A developer published a step-by-step guide and open-source repository for deploying Google's Gemma 4 E2B model to an Amazon SageMaker real-time endpoint on a single NVIDIA L4 GPU using AWS's vLLM cont…
The Biological Computing Company (TBC) struck a multi-pronged partnership with Amazon Web Services to deploy its brain-cell-derived algorithms for data center AI, with TBC cofounder Alex Ksendzovsky s…
Alation announced six new products for its enterprise AI operating system AIOS, including AI Governance with agent lineage tracing and six native connectors — Amazon Bedrock, Amazon SageMaker, Databri…
Amazon Web Services published a walkthrough for building an AI-powered product tagging system that customizes Qwen3-8B with supervised fine-tuning (SFT) and then optimizes it with reinforcement learni…
Amazon SageMaker Inference launched prefix-aware routing, a routing strategy that directs requests sharing the same prompt prefix to the same instance so cached key-value pairs are reused. Benchmarks …
AWS has launched Ray Serve Deep Learning Containers (DLCs), pre-built Docker images for model inference that bundle PyTorch, Ray Serve, and the GPU stack, addressing the maintenance gap left by TorchS…
A developer detailed a production-grade MLOps pipeline architecture on AWS, using native services such as SageMaker, Step Functions, and CodeCommit to automate continuous training, governance, and can…
Atos partnered with AWS to run an agentic AI League event that upskilled 400 engineers over three days, moving them from limited hands-on experience to building multi-agent systems with pathfinding, g…
ZS Associates built a security-hardened Amazon SageMaker environment that now serves 1,000+ daily active users across 200+ SageMaker domains, enabling compliant ad-hoc analytics in the healthcare sect…
AWS has been named a Leader in The Forrester Wave: AI Infrastructure Solutions, Q4 2025, receiving the highest score in the Strategy category among 13 providers evaluated. The report highlights AWS's …
AWS announced it will deploy 2 million additional NVIDIA GPUs (Blackwell Ultra, Rubin, Rubin Ultra) across its global infrastructure in 2027-2028, bringing total NVIDIA GPU capacity on AWS past 3 mill…
Panasonic Avionics Corporation, in collaboration with AWS and the AWS Generative AI Innovation Center, has built an agentic AI system on Amazon Bedrock, Amazon SageMaker, and AWS Glue to reduce aircra…
Amazon Web Services (AWS) outlines architectural patterns for scaling agentic AI across enterprises in a multi-framework, multi-model, multi-provider environment, emphasizing standardization below the…
Amazon SageMaker Python SDK v3.17.0 now integrates generative AI inference recommendations, allowing users to benchmark endpoints, generate deployment recommendations, and deploy optimized configurati…
Amazon Web Services is moving Amazon Q Business, Amazon Kendra, Bedrock Agents Classic, and nine SageMaker AI capabilities into maintenance mode, stopping new customer access as of July 30 while conti…