Module: EasyML
- Defined in:
- lib/easy_ml/data/dataset.rb,
lib/easy_ml.rb,
lib/easy_ml/core.rb,
lib/easy_ml/data.rb,
lib/easy_ml/engine.rb,
lib/easy_ml/logging.rb,
lib/easy_ml/support.rb,
lib/easy_ml/version.rb,
lib/easy_ml/core_ext.rb,
lib/easy_ml/core/model.rb,
lib/easy_ml/core/tuner.rb,
lib/easy_ml/data/utils.rb,
lib/easy_ml/deployment.rb,
lib/easy_ml/core/models.rb,
lib/easy_ml/support/age.rb,
app/models/easy_ml/model.rb,
app/models/easy_ml/models.rb,
lib/easy_ml/core/uploaders.rb,
lib/easy_ml/core/model_core.rb,
lib/easy_ml/core/models/xgboost.rb,
lib/easy_ml/core/tuner/adapters.rb,
lib/easy_ml/data/dataset/splits.rb,
lib/easy_ml/support/file_rotate.rb,
lib/easy_ml/core/model_evaluator.rb,
app/models/easy_ml/models/xgboost.rb,
lib/easy_ml/support/git_ignorable.rb,
lib/easy_ml/data/dataset/splitters.rb,
lib/easy_ml/core/models/xgboost_core.rb,
lib/easy_ml/support/synced_directory.rb,
lib/easy_ml/data/dataset/splits/split.rb,
lib/easy_ml/core/models/hyperparameters.rb,
lib/easy_ml/core/uploaders/model_uploader.rb,
lib/easy_ml/data/dataset/splits/file_split.rb,
lib/easy_ml/core/models/hyperparameters/base.rb,
lib/easy_ml/core/tuner/adapters/base_adapter.rb,
lib/easy_ml/data/preprocessor/simple_imputer.rb,
lib/easy_ml/data/datasource/datasource_factory.rb,
lib/easy_ml/core/models/hyperparameters/xgboost.rb,
lib/easy_ml/core/tuner/adapters/xgboost_adapter.rb,
lib/easy_ml/data/dataset/splits/in_memory_split.rb,
lib/easy_ml/railtie/generators/migration/migration_generator.rb
Overview
Dataset is responsible for:
- Ensuring data is synced from its source (e.g. S3 — delegates to datasource)
- Ensuring the data is properly split into train, test, and validation data (delegates to splitter)
- Knowing where data is stored on disk, and pulling batches of data into memory
- Knowing where to save updated data (after preprocessing steps)
Defined Under Namespace
Modules: Core, CoreExt, Data, Deployment, Generators, Logging, Models, Support, Transforms Classes: Engine, Error, FileRotate, Model
Constant Summary collapse
- VERSION =
"0.1.4"