Class: Aws::Bedrock::Types::AutomatedEvaluationCustomMetricConfig

Inherits:
Struct
  • Object
show all
Includes:
Structure
Defined in:
lib/aws-sdk-bedrock/types.rb

Overview

Defines the configuration of custom metrics to be used in an evaluation job. To learn more about using custom metrics in Amazon Bedrock evaluation jobs, see [Create a prompt for a custom metrics (LLM-as-a-judge model evaluations)] and [Create a prompt for a custom metrics (RAG evaluations)].

[1]: docs.aws.amazon.com/bedrock/latest/userguide/model-evaluation-custom-metrics-prompt-formats.html [2]: docs.aws.amazon.com/bedrock/latest/userguide/kb-evaluation-custom-metrics-prompt-formats.html

See Also:

Constant Summary collapse

SENSITIVE = 
[]

Instance Attribute Summary collapse

Instance Attribute Details

#custom_metrics ⇒ Array<Types::AutomatedEvaluationCustomMetricSource>

Defines a list of custom metrics to be used in an Amazon Bedrock evaluation job.

Returns:



99
100
101
102
103
104
 
# File 'lib/aws-sdk-bedrock/types.rb', line 99

class AutomatedEvaluationCustomMetricConfig < Struct.new(
  :custom_metrics,
  :evaluator_model_config)
  SENSITIVE = []
  include Aws::Structure
end

#evaluator_model_config ⇒ Types::CustomMetricEvaluatorModelConfig

Configuration of the evaluator model you want to use to evaluate custom metrics in an Amazon Bedrock evaluation job.

Returns:



99
100
101
102
103
104
 
# File 'lib/aws-sdk-bedrock/types.rb', line 99

class AutomatedEvaluationCustomMetricConfig < Struct.new(
  :custom_metrics,
  :evaluator_model_config)
  SENSITIVE = []
  include Aws::Structure
end