Module: EasyML
- Defined in:
- lib/easy_ml/data/dataset.rb,
lib/easy_ml.rb,
lib/easy_ml/core.rb,
lib/easy_ml/data.rb,
lib/easy_ml/engine.rb,
lib/easy_ml/logging.rb,
lib/easy_ml/support.rb,
lib/easy_ml/version.rb,
lib/easy_ml/core_ext.rb,
lib/easy_ml/core/model.rb,
lib/easy_ml/core/tuner.rb,
lib/easy_ml/data/utils.rb,
lib/easy_ml/deployment.rb,
lib/easy_ml/core/models.rb,
lib/easy_ml/support/age.rb,
app/models/easy_ml/model.rb,
app/models/easy_ml/models.rb,
lib/easy_ml/core/uploaders.rb,
lib/easy_ml/core/model_core.rb,
lib/easy_ml/core/models/xgboost.rb,
lib/easy_ml/core/tuner/adapters.rb,
lib/easy_ml/data/dataset/splits.rb,
lib/easy_ml/support/file_rotate.rb,
lib/easy_ml/core/model_evaluator.rb,
app/models/easy_ml/models/xgboost.rb,
lib/easy_ml/support/git_ignorable.rb,
lib/easy_ml/data/dataset/splitters.rb,
lib/easy_ml/core/models/xgboost_core.rb,
lib/easy_ml/support/synced_directory.rb,
lib/easy_ml/data/dataset/splits/split.rb,
lib/easy_ml/core/models/hyperparameters.rb,
lib/easy_ml/core/uploaders/model_uploader.rb,
lib/easy_ml/data/dataset/splits/file_split.rb,
lib/easy_ml/core/models/hyperparameters/base.rb,
lib/easy_ml/core/tuner/adapters/base_adapter.rb,
lib/easy_ml/data/preprocessor/simple_imputer.rb,
lib/easy_ml/data/datasource/datasource_factory.rb,
lib/easy_ml/core/models/hyperparameters/xgboost.rb,
lib/easy_ml/core/tuner/adapters/xgboost_adapter.rb,
lib/easy_ml/data/dataset/splits/in_memory_split.rb,
lib/easy_ml/railtie/generators/migration/migration_generator.rb
Overview
Dataset is responsible for:
1) Ensuring data is synced from its source (e.g. S3 — delegates to datasource) 2) Ensuring the data is properly split into train, test, and validation data (delegates to splitter) 3) Knowing where data is stored on disk, and pulling batches of data into memory 4) Knowing where to save updated data (after preprocessing steps)
Defined Under Namespace
Modules: Core, CoreExt, Data, Deployment, Generators, Logging, Models, Support, Transforms Classes: Engine, Error, FileRotate, Model
Constant Summary collapse
- VERSION =
"0.1.4"