Module: Tokenizers::Trainers

Defined in:

lib/tokenizers/trainers/bpe_trainer.rb,
lib/tokenizers/trainers/unigram_trainer.rb,
lib/tokenizers/trainers/word_level_trainer.rb,
lib/tokenizers/trainers/word_piece_trainer.rb

Defined Under Namespace

Classes: BpeTrainer, UnigramTrainer, WordLevelTrainer, WordPieceTrainer