Best practices - Amazon SageMaker AI (original) (raw)

DocumentationAmazon SageMakerDeveloper Guide

The following topics provide guidance on best practices for deploying machine learning models in Amazon SageMaker AI.

Topics

• Best practices for deploying models on SageMaker AI Hosting Services
• Monitor Security Best Practices
• Low latency real-time inference with AWS PrivateLink
• Migrate inference workload from x86 to AWS Graviton
• Troubleshoot Amazon SageMaker AI model deployments
• Inference cost optimization best practices
• Best practices to minimize interruptions during GPU driver upgrades
• Best practices for endpoint security and health with Amazon SageMaker AI
• Updating inference containers to comply with the NVIDIA Container Toolkit

Document Conventions

Stateful sessions

Best practices for deploying models on SageMaker AI Hosting Services

Did this page help you? - Yes

Thanks for letting us know we're doing a good job!

If you've got a moment, please tell us what we did right so we can do more of it.

Did this page help you? - No

Thanks for letting us know this page needs work. We're sorry we let you down.

If you've got a moment, please tell us how we can make the documentation better.