Skip to content

Scheduling, Execution, Storage and Dependency Manager for Data Jobs

License

Notifications You must be signed in to change notification settings

darkclouder/distiller

Repository files navigation

The Distiller

The distiller is a dependency management, data management, job scheduling and job distribution system for data scientists. Its aim is to automate and manage the execution of data-focused batch jobs and keep its data up-to-date while keeping the batch execution to a minimum with lazy execution.

Documentation

To see the documentation install Sphinx (pip install sphinx), run (cd doc && make html), then go to doc/build/html/index.html.

About

Scheduling, Execution, Storage and Dependency Manager for Data Jobs

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages