Class: Rails::Nl2sql::Providers::LlamaProvider

Inherits:
Base
  • Object
show all
Defined in:
lib/rails/nl2sql/providers/llama_provider.rb

Instance Method Summary collapse

Constructor Details

#initialize(endpoint:, model: nil) ⇒ LlamaProvider

Returns a new instance of LlamaProvider.



9
10
11
12
 
# File 'lib/rails/nl2sql/providers/llama_provider.rb', line 9

def initialize(endpoint:, model: nil)
  @uri = URI.parse(endpoint)
  @model = model
end

Instance Method Details

#complete(prompt:, **_params) ⇒ Object 



14
15
16
17
18
19
 
# File 'lib/rails/nl2sql/providers/llama_provider.rb', line 14

def complete(prompt:, **_params)
  http = Net::HTTP.new(@uri.host, @uri.port)
  http.use_ssl = @uri.scheme == 'https'
  response = http.post(@uri.path, {prompt: prompt, model: @model}.to_json, 'Content-Type' => 'application/json')
  JSON.parse(response.body)
end