Class: Roseflow::Text::Splitter

Inherits:
Object
  • Object
show all
Defined in:
lib/roseflow/text/splitter.rb

Direct Known Subclasses

RecursiveCharacterSplitter, SentenceSplitter

Instance Method Summary collapse

Constructor Details

#initialize(chunk_size:, chunk_overlap:) ⇒ Splitter

Returns a new instance of Splitter.

Raises:

  • (ArgumentError) 


6
7
8
9
10
11
 
# File 'lib/roseflow/text/splitter.rb', line 6

def initialize(chunk_size:, chunk_overlap:)
  raise ArgumentError, "chunk overlap cannot exceed chunk size" if chunk_overlap > chunk_size

  @chunk_size = chunk_size
  @chunk_overlap = chunk_overlap
end

Instance Method Details

#split(text) ⇒ Object

Raises:

  • (NotImplementedError) 


13
14
15
 
# File 'lib/roseflow/text/splitter.rb', line 13

def split(text)
  raise NotImplementedError, "this class must be extended and the #split method implemented"
end