Class: Aws::SageMaker::Types::InferenceComponentComputeResourceRequirements
- Inherits:
-
Struct
- Object
- Struct
- Aws::SageMaker::Types::InferenceComponentComputeResourceRequirements
- Includes:
- Aws::Structure
- Defined in:
- lib/aws-sdk-sagemaker/types.rb
Overview
Defines the compute resources to allocate to run a model that you assign to an inference component. These resources include CPU cores, accelerators, and memory.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#max_memory_required_in_mb ⇒ Integer
The maximum MB of memory to allocate to run a model that you assign to an inference component.
-
#min_memory_required_in_mb ⇒ Integer
The minimum MB of memory to allocate to run a model that you assign to an inference component.
-
#number_of_accelerator_devices_required ⇒ Float
The number of accelerators to allocate to run a model that you assign to an inference component.
-
#number_of_cpu_cores_required ⇒ Float
The number of CPU cores to allocate to run a model that you assign to an inference component.
Instance Attribute Details
#max_memory_required_in_mb ⇒ Integer
The maximum MB of memory to allocate to run a model that you assign to an inference component.
24232 24233 24234 24235 24236 24237 24238 24239 |
# File 'lib/aws-sdk-sagemaker/types.rb', line 24232 class InferenceComponentComputeResourceRequirements < Struct.new( :number_of_cpu_cores_required, :number_of_accelerator_devices_required, :min_memory_required_in_mb, :max_memory_required_in_mb) SENSITIVE = [] include Aws::Structure end |
#min_memory_required_in_mb ⇒ Integer
The minimum MB of memory to allocate to run a model that you assign to an inference component.
24232 24233 24234 24235 24236 24237 24238 24239 |
# File 'lib/aws-sdk-sagemaker/types.rb', line 24232 class InferenceComponentComputeResourceRequirements < Struct.new( :number_of_cpu_cores_required, :number_of_accelerator_devices_required, :min_memory_required_in_mb, :max_memory_required_in_mb) SENSITIVE = [] include Aws::Structure end |
#number_of_accelerator_devices_required ⇒ Float
The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and Amazon Web Services Inferentia.
24232 24233 24234 24235 24236 24237 24238 24239 |
# File 'lib/aws-sdk-sagemaker/types.rb', line 24232 class InferenceComponentComputeResourceRequirements < Struct.new( :number_of_cpu_cores_required, :number_of_accelerator_devices_required, :min_memory_required_in_mb, :max_memory_required_in_mb) SENSITIVE = [] include Aws::Structure end |
#number_of_cpu_cores_required ⇒ Float
The number of CPU cores to allocate to run a model that you assign to an inference component.
24232 24233 24234 24235 24236 24237 24238 24239 |
# File 'lib/aws-sdk-sagemaker/types.rb', line 24232 class InferenceComponentComputeResourceRequirements < Struct.new( :number_of_cpu_cores_required, :number_of_accelerator_devices_required, :min_memory_required_in_mb, :max_memory_required_in_mb) SENSITIVE = [] include Aws::Structure end |