Class: Google::Cloud::AIPlatform::V1::SpeculativeDecodingSpec::DraftModelSpeculation

Inherits:
Object
  • Object
show all
Extended by:
Protobuf::MessageExts::ClassMethods
Includes:
Protobuf::MessageExts
Defined in:
proto_docs/google/cloud/aiplatform/v1/endpoint.rb

Overview

Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Instance Attribute Summary collapse

Instance Attribute Details

#draft_model ⇒ ::String 



405
406
407
408
 
# File 'proto_docs/google/cloud/aiplatform/v1/endpoint.rb', line 405

class DraftModelSpeculation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end