NVIDIA and AWS announced a collaboration to bring AI to production scale, introducing Amazon EC2 G7 instances with NVIDIA RTX PRO 4500 Blackwell GPUs that deliver up to 4.6x AI inference performance, …
Amazon Web Services announced support for running ComfyUI workflows on Amazon SageMaker AI processing jobs, enabling enterprises to automate content generation at scale. The integration allows users t…
Amazon SageMaker AI now emits over 100 detailed inference metrics and provides a built-in Insights dashboard in Amazon CloudWatch, enabling teams to monitor and debug generative AI inference endpoints…
Amazon Web Services announced container image caching for Amazon SageMaker AI inference, reducing end-to-end latency by up to 2x for generative AI models during scale-out events by eliminating contain…
Amazon has introduced a method for running machine learning inference on Amazon SageMaker AI using fully homomorphic encryption (FHE), which keeps data encrypted throughout the entire process—includin…
Fundamental’s NEXUS large tabular model is now available on Amazon SageMaker JumpStart, enabling enterprises to deploy a foundation model purpose-built for structured data prediction. The model genera…
Amazon Web Services announced a new method for improving AI agent tool-calling accuracy using Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO) on Amazon SageMaker AI. The approach…
Amazon Web Services has introduced a comprehensive observability solution for large language model inference on Amazon SageMaker AI, addressing both infrastructure performance and output quality monit…
Azercell Telecom LLC, Azerbaijan's leading telecommunications provider, trained an Azerbaijani large language model on Amazon SageMaker AI in collaboration with the AWS Generative AI Innovation Center…
Amazon SageMaker AI now supports OpenAI-compatible API for real-time inference endpoints, allowing users to invoke models by changing only the endpoint URL without custom clients or code rewrites. The…
Amazon SageMaker AI now supports bidirectional streaming for real-time inference, enabling developers to build voice applications that process audio and return transcriptions simultaneously over a sin…