hamilton
hamilton copied to clipboard
stitchfix
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
**Is your feature request related to a problem? Please describe.** I would like to avoid if-else statements by using the config.when decorator on columns with numeric data, e.g. being able...
Goal of this PR is to provide more extensive examples. Inspiration is from: https://github.com/Netflix/metaflow/blob/master/metaflow/tutorials/01-playlist/playlist.py Two interesting things to note here: 1. We could have the driver do the loading of...
**Is your feature request related to a problem? Please describe.** Hamilton has a small footprint. It can be run inside existing ETLs very easily. We should have documentation to reflect...
[slack conversation](https://stitchfix.slack.com/archives/CGHH4922X/p1629823936000900) Current issue: 1. model_p_something (“model” node) and prob_something (“metric” node) being a complement pair, 2. create_database driver (and therefore its crawler) contain both nodes 3. simulate driver (and...
[Short description explaining the high-level reason for the pull request] ## Changes - ## Testing 1. ## Notes ## Checklist - [ ] PR has an informative and human-readable title...
This makes it backwards compatible -- we previously had two files: 1. function_modifiers.py 2. function_modfiers_base.py We now create a module `function_modifiers.py` which enables us to separate out decorators, as the...
**Is your feature request related to a problem? Please describe.** When my code runs into errors in the `execute()` stage, the traceback just goes to the `execute()` function, and doesn't...
[Short description explaining the high-level reason for the pull request] ## Changes - Adds documentation on duckdb integration - Adds documentation on data-loaders as adaptable modules ## Testing 1. ##...
**Is your feature request related to a problem? Please describe.** When using Hamilton to create lots of new columns using `@parameterize`, an explicitly tabular approach could make things cleaner and...
See design here: https://docs.google.com/document/d/1-xVPX7PqyENOk31bXdcAVVPYSHaGMokeFiR85d_zoOo/edit.