Class: Aws::SageMaker::Types::ProcessingS3Input

Inherits:
Struct
  • Object
show all
Includes:
Aws::Structure
Defined in:
lib/aws-sdk-sagemaker/types.rb

Overview

Note:

When making an API call, you may pass ProcessingS3Input data as a hash:

{
  s3_uri: "S3Uri", # required
  local_path: "ProcessingLocalPath", # required
  s3_data_type: "ManifestFile", # required, accepts ManifestFile, S3Prefix
  s3_input_mode: "Pipe", # required, accepts Pipe, File
  s3_data_distribution_type: "FullyReplicated", # accepts FullyReplicated, ShardedByS3Key
  s3_compression_type: "None", # accepts None, Gzip
}

Information about where and how you want to obtain the inputs for an processing job.

See Also:

Instance Attribute Summary collapse

Instance Attribute Details

#local_path ⇒ String

The local path to the Amazon S3 bucket where you want Amazon SageMaker to download the inputs to run a processing job. ‘LocalPath` is an absolute path to the input data.

Returns:

  • (String) 


16123
16124
16125
16126
16127
16128
16129
16130
16131
 
# File 'lib/aws-sdk-sagemaker/types.rb', line 16123

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  include Aws::Structure
end

#s3_compression_type ⇒ String

Whether to use ‘Gzip` compresion for Amazon S3 storage.

Returns:

  • (String) 


16123
16124
16125
16126
16127
16128
16129
16130
16131
 
# File 'lib/aws-sdk-sagemaker/types.rb', line 16123

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  include Aws::Structure
end

#s3_data_distribution_type ⇒ String

Whether the data stored in Amazon S3 is ‘FullyReplicated` or `ShardedByS3Key`.

Returns:

  • (String) 


16123
16124
16125
16126
16127
16128
16129
16130
16131
 
# File 'lib/aws-sdk-sagemaker/types.rb', line 16123

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  include Aws::Structure
end

#s3_data_type ⇒ String

Whether you use an ‘S3Prefix` or a `ManifestFile` for the data type. If you choose `S3Prefix`, `S3Uri` identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose `ManifestFile`, `S3Uri` identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.

Returns:

  • (String) 


16123
16124
16125
16126
16127
16128
16129
16130
16131
 
# File 'lib/aws-sdk-sagemaker/types.rb', line 16123

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  include Aws::Structure
end

#s3_input_mode ⇒ String

Wether to use ‘File` or `Pipe` input mode. In `File` mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode. In `Pipe` mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.

Returns:

  • (String) 


16123
16124
16125
16126
16127
16128
16129
16130
16131
 
# File 'lib/aws-sdk-sagemaker/types.rb', line 16123

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  include Aws::Structure
end

#s3_uri ⇒ String

The URI for the Amazon S3 storage where you want Amazon SageMaker to download the artifacts needed to run a processing job.

Returns:

  • (String) 


16123
16124
16125
16126
16127
16128
16129
16130
16131
 
# File 'lib/aws-sdk-sagemaker/types.rb', line 16123

class ProcessingS3Input < Struct.new(
  :s3_uri,
  :local_path,
  :s3_data_type,
  :s3_input_mode,
  :s3_data_distribution_type,
  :s3_compression_type)
  include Aws::Structure
end