AWS CDK construct automates SageMaker endpoint auto-scaling updates to avoid deployment failures
A new AWS CDK construct uses CloudFormation custom resources to deregister and re-register Application Auto Scaling targets during SageMaker endpoint updates, preventing CloudFormation/CDK deployment failures.
1 source · cross-referenced
- AWS describes a CDK construct that automates deregistration and re-registration of SageMaker endpoint auto-scaling targets during endpoint updates.
- The construct prevents CloudFormation/CDK deployment failures that occur when updating SageMaker endpoint configurations with auto scaling registered.
- It replaces native CloudFormation auto-scaling resources with custom resources to orchestrate the process in a single deployment.
AWS describes a failure mode when updating an Amazon SageMaker real-time endpoint configuration—such as changing instance type, instance count, or environment variables—using AWS CloudFormation or the AWS Cloud Development Kit (AWS CDK). According to the post, SageMaker requires deregistering the scalable target before updating the endpoint, but doing so causes CloudFormation to lose track of the AWS Application Auto Scaling resources, leading to deployment failures or silent loss of auto scaling.
The post outlines three failure scenarios: CloudFormation attempting to update the endpoint while the scalable target is still registered (blocked by SageMaker), manually deregistering auto scaling then changing only endpoint configuration (deployment succeeds but auto scaling is not re-applied), and manually deregistering then changing auto scaling parameters (causing a non-recoverable stack failure).
To address these issues, the AWS Machine Learning Blog introduces a reusable AWS CDK construct that replaces native CloudFormation Application Auto Scaling resources with three custom resources. These custom resources orchestrate the deregistration and re-registration of auto scaling targets automatically during endpoint updates, allowing endpoint configuration and auto scaling parameters to be updated in a single deployment without manual steps.
The solution is positioned as a workaround for a limitation in SageMaker’s integration with CloudFormation/CDK when auto scaling is registered, aiming to prevent deployment failures and ensure auto scaling policies are consistently applied after updates.
- Nov 11, 2026 · Hugging Face
Hugging Face proposes token pooling-aware training to improve compressed multi-vector retrieval
Trust79 - Nov 11, 2026 · TechCrunch — AI
Fractile raises $720M Series C to develop AI chips and compiler stack
Trust79 - Nov 11, 2026 · The Verge — AI
Google’s Tabletop AI experiment lets users build custom collaborative apps via waitlist
Trust79