Class: Aws::BedrockAgent::Types::PromptModelInferenceConfiguration

Inherits:

Struct

• Object
• Struct
• Aws::BedrockAgent::Types::PromptModelInferenceConfiguration

Includes:

Structure

Defined in:

lib/aws-sdk-bedrockagent/types.rb

Overview

Contains inference configurations related to model inference for a prompt. For more information, see [Inference parameters].

[1]: docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #max_tokens ⇒ Integer

  The maximum number of tokens to return in the response.

• #stop_sequences ⇒ Array<String>

  A list of strings that define sequences after which the model will stop generating.

• #temperature ⇒ Float

  Controls the randomness of the response.

• #top_p ⇒ Float

  The percentage of most-likely candidates that the model considers for the next token.

Instance Attribute Details

#max_tokens ⇒ Integer

The maximum number of tokens to return in the response.

# File 'lib/aws-sdk-bedrockagent/types.rb', line 8605

class PromptModelInferenceConfiguration < Struct.new(
  :temperature,
  :top_p,
  :max_tokens,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end

#stop_sequences ⇒ Array<String>

A list of strings that define sequences after which the model will stop generating.

# File 'lib/aws-sdk-bedrockagent/types.rb', line 8605

class PromptModelInferenceConfiguration < Struct.new(
  :temperature,
  :top_p,
  :max_tokens,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end

#temperature ⇒ Float

Controls the randomness of the response. Choose a lower value for more predictable outputs and a higher value for more surprising outputs.

# File 'lib/aws-sdk-bedrockagent/types.rb', line 8605

class PromptModelInferenceConfiguration < Struct.new(
  :temperature,
  :top_p,
  :max_tokens,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end

#top_p ⇒ Float

The percentage of most-likely candidates that the model considers for the next token.

# File 'lib/aws-sdk-bedrockagent/types.rb', line 8605

class PromptModelInferenceConfiguration < Struct.new(
  :temperature,
  :top_p,
  :max_tokens,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end