Class: NanoGPT::BenchConfig

Inherits:
BaseConfig show all
Defined in:
lib/nano_gpt/train_config.rb

Overview

Configuration for benchmarking

Constant Summary collapse

DEFAULTS = 
{
  batch_size: 12,
  block_size: 1024,
  n_layer: 12,
  n_head: 12,
  n_embd: 768,
  dropout: 0.0,
  bias: false,
  real_data: true,
  dataset: "openwebtext",
  seed: 1337,
  device: "auto"
}.freeze

Instance Attribute Summary

Attributes inherited from BaseConfig

#values

Class Method Summary collapse

Methods inherited from BaseConfig

#[], #[]=, #initialize, load, #load_json, #save_json, #to_h

Constructor Details

This class inherits a constructor from NanoGPT::BaseConfig

Class Method Details

.defaults ⇒ Object 



189
190
191
 
# File 'lib/nano_gpt/train_config.rb', line 189

def self.defaults
  DEFAULTS
end