Class: Google::Cloud::AIPlatform::V1::SpeculativeDecodingSpec::DraftModelSpeculation

Inherits:
Object
  • Object
show all
Extended by:
Protobuf::MessageExts::ClassMethods
Includes:
Protobuf::MessageExts
Defined in:
proto_docs/google/cloud/aiplatform/v1/endpoint.rb

Overview

Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Instance Attribute Summary collapse

Instance Attribute Details

#draft_model ⇒ ::String

Returns Required. The resource name of the draft model.

Returns:

  • (::String) —

    Required. The resource name of the draft model.



436
437
438
439
 
# File 'proto_docs/google/cloud/aiplatform/v1/endpoint.rb', line 436

class DraftModelSpeculation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end