Class: Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest

Inherits:
Object
  • Object
show all
Extended by:
Protobuf::MessageExts::ClassMethods
Includes:
Protobuf::MessageExts
Defined in:
proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb

Overview

Request message for EvaluationService.EvaluateInstances.

Instance Attribute Summary collapse

Instance Attribute Details

#bleu_input::Google::Cloud::AIPlatform::V1::BleuInput

Returns Instances and metric spec for bleu metric.

Note: The following fields are mutually exclusive: bleu_input, exact_match_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::BleuInput)

    Instances and metric spec for bleu metric.

    Note: The following fields are mutually exclusive: bleu_input, exact_match_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#coherence_input::Google::Cloud::AIPlatform::V1::CoherenceInput

Returns Input for coherence metric.

Note: The following fields are mutually exclusive: coherence_input, exact_match_input, bleu_input, rouge_input, fluency_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::CoherenceInput)

    Input for coherence metric.

    Note: The following fields are mutually exclusive: coherence_input, exact_match_input, bleu_input, rouge_input, fluency_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#comet_input::Google::Cloud::AIPlatform::V1::CometInput

Returns Translation metrics. Input for Comet metric.

Note: The following fields are mutually exclusive: comet_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::CometInput)

    Translation metrics. Input for Comet metric.

    Note: The following fields are mutually exclusive: comet_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#exact_match_input::Google::Cloud::AIPlatform::V1::ExactMatchInput

Returns Auto metric instances. Instances and metric spec for exact match metric.

Note: The following fields are mutually exclusive: exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::ExactMatchInput)

    Auto metric instances. Instances and metric spec for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#fluency_input::Google::Cloud::AIPlatform::V1::FluencyInput

Returns LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

Note: The following fields are mutually exclusive: fluency_input, exact_match_input, bleu_input, rouge_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::FluencyInput)

    LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

    Note: The following fields are mutually exclusive: fluency_input, exact_match_input, bleu_input, rouge_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#fulfillment_input::Google::Cloud::AIPlatform::V1::FulfillmentInput

Returns Input for fulfillment metric.

Note: The following fields are mutually exclusive: fulfillment_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::FulfillmentInput)

    Input for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#groundedness_input::Google::Cloud::AIPlatform::V1::GroundednessInput

Returns Input for groundedness metric.

Note: The following fields are mutually exclusive: groundedness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::GroundednessInput)

    Input for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#location::String

Returns Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}.

Returns:

  • (::String)

    Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#metricx_input::Google::Cloud::AIPlatform::V1::MetricxInput

Returns Input for Metricx metric.

Note: The following fields are mutually exclusive: metricx_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::MetricxInput)

    Input for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pairwise_metric_input::Google::Cloud::AIPlatform::V1::PairwiseMetricInput

Returns Input for pairwise metric.

Note: The following fields are mutually exclusive: pairwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput)

    Input for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pairwise_question_answering_quality_input::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput

Returns Input for pairwise question answering quality metric.

Note: The following fields are mutually exclusive: pairwise_question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput)

    Input for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pairwise_summarization_quality_input::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput

Returns Input for pairwise summarization quality metric.

Note: The following fields are mutually exclusive: pairwise_summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput)

    Input for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#pointwise_metric_input::Google::Cloud::AIPlatform::V1::PointwiseMetricInput

Returns Input for pointwise metric.

Note: The following fields are mutually exclusive: pointwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput)

    Input for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_correctness_input::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput

Returns Input for question answering correctness metric.

Note: The following fields are mutually exclusive: question_answering_correctness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput)

    Input for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_helpfulness_input::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput

Returns Input for question answering helpfulness metric.

Note: The following fields are mutually exclusive: question_answering_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput)

    Input for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_quality_input::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput

Returns Input for question answering quality metric.

Note: The following fields are mutually exclusive: question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput)

    Input for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#question_answering_relevance_input::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput

Returns Input for question answering relevance metric.

Note: The following fields are mutually exclusive: question_answering_relevance_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput)

    Input for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#rouge_input::Google::Cloud::AIPlatform::V1::RougeInput

Returns Instances and metric spec for rouge metric.

Note: The following fields are mutually exclusive: rouge_input, exact_match_input, bleu_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::RougeInput)

    Instances and metric spec for rouge metric.

    Note: The following fields are mutually exclusive: rouge_input, exact_match_input, bleu_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#safety_input::Google::Cloud::AIPlatform::V1::SafetyInput

Returns Input for safety metric.

Note: The following fields are mutually exclusive: safety_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::SafetyInput)

    Input for safety metric.

    Note: The following fields are mutually exclusive: safety_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#summarization_helpfulness_input::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput

Returns Input for summarization helpfulness metric.

Note: The following fields are mutually exclusive: summarization_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput)

    Input for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#summarization_quality_input::Google::Cloud::AIPlatform::V1::SummarizationQualityInput

Returns Input for summarization quality metric.

Note: The following fields are mutually exclusive: summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput)

    Input for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#summarization_verbosity_input::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput

Returns Input for summarization verbosity metric.

Note: The following fields are mutually exclusive: summarization_verbosity_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput)

    Input for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_call_valid_input::Google::Cloud::AIPlatform::V1::ToolCallValidInput

Returns Tool call metric instances. Input for tool call valid metric.

Note: The following fields are mutually exclusive: tool_call_valid_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::ToolCallValidInput)

    Tool call metric instances. Input for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_name_match_input::Google::Cloud::AIPlatform::V1::ToolNameMatchInput

Returns Input for tool name match metric.

Note: The following fields are mutually exclusive: tool_name_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput)

    Input for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_parameter_key_match_input::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput

Returns Input for tool parameter key match metric.

Note: The following fields are mutually exclusive: tool_parameter_key_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput)

    Input for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#tool_parameter_kv_match_input::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput

Returns Input for tool parameter key value match metric.

Note: The following fields are mutually exclusive: tool_parameter_kv_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns:

  • (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput)

    Input for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.



161
162
163
164
# File 'proto_docs/google/cloud/aiplatform/v1/evaluation_service.rb', line 161

class EvaluateInstancesRequest
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end