Class: Aws::SageMaker::Types::ProductionVariantManagedInstanceScalingScaleInPolicy

Inherits:

Struct

• Object
• Struct
• Aws::SageMaker::Types::ProductionVariantManagedInstanceScalingScaleInPolicy

Includes:

Aws::Structure

Defined in:

lib/aws-sdk-sagemaker/types.rb

Overview

Configures the scale-in behavior for managed instance scaling.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #cooldown_in_minutes ⇒ Integer

  The cooldown period, in minutes, after the last endpoint operation before the endpoint evaluates consolidation scale-in opportunities.

• #maximum_step_size ⇒ Integer

  The maximum number of instances that the endpoint can terminate at a time during a consolidation scale-in operation.

• #strategy ⇒ String

  The strategy for scaling in instances.

Instance Attribute Details

#cooldown_in_minutes ⇒ Integer

The cooldown period, in minutes, after the last endpoint operation before the endpoint evaluates consolidation scale-in opportunities.

Default value: 20.

# File 'lib/aws-sdk-sagemaker/types.rb', line 47608

class ProductionVariantManagedInstanceScalingScaleInPolicy < Struct.new(
  :strategy,
  :maximum_step_size,
  :cooldown_in_minutes)
  SENSITIVE = []
  include Aws::Structure
end

#maximum_step_size ⇒ Integer

The maximum number of instances that the endpoint can terminate at a time during a consolidation scale-in operation.

Default value: 1.

# File 'lib/aws-sdk-sagemaker/types.rb', line 47608

class ProductionVariantManagedInstanceScalingScaleInPolicy < Struct.new(
  :strategy,
  :maximum_step_size,
  :cooldown_in_minutes)
  SENSITIVE = []
  include Aws::Structure
end

#strategy ⇒ String

The strategy for scaling in instances.

IDLE_RELEASE

: Releases instances that have no hosted inference component copies.

CONSOLIDATION

: Consolidates inference component copies onto fewer instances to release more instances. Consolidation honors the scheduling configuration of each inference component. For example, if an inference component specifies Availability Zone balance, consolidation only proceeds when the resulting distribution does not increase the imbalance.

# File 'lib/aws-sdk-sagemaker/types.rb', line 47608

class ProductionVariantManagedInstanceScalingScaleInPolicy < Struct.new(
  :strategy,
  :maximum_step_size,
  :cooldown_in_minutes)
  SENSITIVE = []
  include Aws::Structure
end