Deploy and evaluate models with Amazon SageMaker JumpStart

Amazon SageMaker JumpStart added two capabilities in 2026: pre-configured endpoint deployment options optimized for low cost, low latency, or general-purpose workloads across generative AI models including Neuron-optimized configurations, and a one-click deep link integration that moves a model from Hugging Face discovery to SageMaker AI deployment. AWS detailed a reusable Python workflow using SageMaker Python SDK v3 (pip install "sagemaker>=3,<4") that discovers and deploys a JumpStart model, runs model-specific sample prompts while measuring latency, approximate output length, and single-request generation rate, then deletes the endpoint. AWS noted deployment time varies by model, instance type, quota, and AWS Region, and that payload formats, required instance types, EULA requirements, and response schemas may need model-specific adjustments.

Artificial Intelligence https://aws.amazon.com/blogs/machine-learning/ Deploy and evaluate models with Amazon SageMaker JumpStart Choosing the right model for a specific application requires a practical way to test it with representative inputs. Amazon SageMaker JumpStart provides access to a broad catalog of already pretrained models. In this post, we show how to deploy an available model from SageMaker JumpStart, run a lightweight and repeatable performance test using the SageMaker Python SDK, and delete the endpoint when testing is complete. For supported models and available capacity, this workflow provides a repeatable evaluation path, although deployment time varies by model, instance type, quota, and AWS Region. In 2026, SageMaker JumpStart introduced two improvements that simplify model discovery and deployment. In the Model Hub section of the Amazon SageMaker AI console, you can browse the SageMaker JumpStart catalog, view sample notebooks, and open them directly in SageMaker Studio. Pre-configured endpoint deployment options provide named configurations optimized for priorities such as low cost, low latency, or general-purpose workloads across a range of generative AI models, including Neuron-optimized configurations. Additionally, you can now go from Hugging Face model discovery to SageMaker AI deployment in a single click using the new deep link integration. Solution overview Our approach uses a reusable Python script that performs three steps: - Discover and deploy a model from SageMaker JumpStart. - Run model-specific sample prompts and measure latency, approximate output length, and single-request generation rate. - Clean up the endpoint. This pattern works for many compatible SageMaker JumpStart models, although payload formats, required instance types, end-user license agreement EULA requirements, and response schemas may require model-specific adjustments. Prerequisites - An AWS account with SageMaker AI permissions. - Python 3+ with SageMaker Python SDK v3 installed pip install "sagemaker =3,<4" . - Sufficient GPU instance quota for the model you want to test or request a quota increase https://docs.aws.amazon.com/sagemaker/latest/dg/studio-updated-launch.html studio-updated-launch-quotas . Step 1.a: Discover available models UI path to find models in SageMaker JumpStart: Code path using SageMaker Python SDK: Or search by model name: Step 1.b: Deploy the model UI path to deploy models from SageMaker JumpStart: Code path using SageMaker Python SDK: Step 2: Run sample prompts and measure performance Result: Step 3: Cleanup Conclusion This pattern works for many available SageMaker JumpStart models, but the payload format, required instance type, EULA, and response parsing may require model-specific adjustments. By using consistent test prompts and measuring latency, throughput, and output quality across models, you can compare options and select the right fit for your workload. Try this approach with different models from Amazon SageMaker JumpStart to find the right balance of quality, speed, and cost for your applications. References - SageMaker Python SDK Documentation https://sagemaker.readthedocs.io/en/stable/overview.html - Benchmark and Optimize SageMaker JumpStart Deployment blog post https://aws.amazon.com/blogs/machine-learning/benchmark-and-optimize-endpoint-deployment-in-amazon-sagemaker-jumpstart/ - From Hugging Face to SageMaker Studio in One Click blog post https://aws.amazon.com/blogs/machine-learning/from-hugging-face-to-amazon-sagemaker-studio-in-one-click-2/ - Amazon SageMaker JumpStart https://aws.amazon.com/sagemaker/ai/jumpstart/