Module: Riktoken::Encodings::ClassMethods

Defined in:
lib/riktoken/encodings.rb

Instance Method Summary collapse

Instance Method Details

#find_tiktoken_file(name:, base_dir:) ⇒ Object

Look for .tiktoken file in common locations



18
19
20
21
22
23
24
25
 
# File 'lib/riktoken/encodings.rb', line 18

def find_tiktoken_file(name:, base_dir:)
  path = File.join(base_dir, "#{name}.tiktoken")
  if File.exist?(path)
    path
  else
    raise FileNotFoundError, "tiktoken file not found: #{path}"
  end
end