Class: Aws::SageMaker::Types::InferenceComponentComputeResourceRequirements

Inherits:

Struct

• Object
• Struct
• Aws::SageMaker::Types::InferenceComponentComputeResourceRequirements

Includes:

Aws::Structure

Defined in:

lib/aws-sdk-sagemaker/types.rb

Overview

Defines the compute resources to allocate to run a model that you assign to an inference component. These resources include CPU cores, accelerators, and memory.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #max_memory_required_in_mb ⇒ Integer

  The maximum MB of memory to allocate to run a model that you assign to an inference component.

• #min_memory_required_in_mb ⇒ Integer

  The minimum MB of memory to allocate to run a model that you assign to an inference component.

• #number_of_accelerator_devices_required ⇒ Float

  The number of accelerators to allocate to run a model that you assign to an inference component.

• #number_of_cpu_cores_required ⇒ Float

  The number of CPU cores to allocate to run a model that you assign to an inference component.

Instance Attribute Details

#max_memory_required_in_mb ⇒ Integer

The maximum MB of memory to allocate to run a model that you assign to an inference component.

Returns:

• (Integer)

# File 'lib/aws-sdk-sagemaker/types.rb', line 22864

class InferenceComponentComputeResourceRequirements < Struct.new(
  :number_of_cpu_cores_required,
  :number_of_accelerator_devices_required,
  :min_memory_required_in_mb,
  :max_memory_required_in_mb)
  SENSITIVE = []
  include Aws::Structure
end

#min_memory_required_in_mb ⇒ Integer

The minimum MB of memory to allocate to run a model that you assign to an inference component.

Returns:

• (Integer)

# File 'lib/aws-sdk-sagemaker/types.rb', line 22864

class InferenceComponentComputeResourceRequirements < Struct.new(
  :number_of_cpu_cores_required,
  :number_of_accelerator_devices_required,
  :min_memory_required_in_mb,
  :max_memory_required_in_mb)
  SENSITIVE = []
  include Aws::Structure
end

#number_of_accelerator_devices_required ⇒ Float

The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and Amazon Web Services Inferentia.

Returns:

• (Float)

# File 'lib/aws-sdk-sagemaker/types.rb', line 22864

class InferenceComponentComputeResourceRequirements < Struct.new(
  :number_of_cpu_cores_required,
  :number_of_accelerator_devices_required,
  :min_memory_required_in_mb,
  :max_memory_required_in_mb)
  SENSITIVE = []
  include Aws::Structure
end

#number_of_cpu_cores_required ⇒ Float

The number of CPU cores to allocate to run a model that you assign to an inference component.

Returns:

• (Float)

# File 'lib/aws-sdk-sagemaker/types.rb', line 22864

class InferenceComponentComputeResourceRequirements < Struct.new(
  :number_of_cpu_cores_required,
  :number_of_accelerator_devices_required,
  :min_memory_required_in_mb,
  :max_memory_required_in_mb)
  SENSITIVE = []
  include Aws::Structure
end