hamilton
hamilton copied to clipboard
stitchfix
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
Consolidates logic behind all `parametrized` decorators ## Changes - adds `full_parametrized` decorator - changes others to use it ## Testing 1. ## Notes ## Checklist - [x] PR has an...
**Is your feature request related to a problem? Please describe.** It is conceivable to want to write Hamilton functions in an async based way. For example, the data loading functions...
**Is your feature request related to a problem? Please describe.** I am looking for a decorator to specify both value and dag node inputs. `parameterized` allows for value inputs, `parameterized_inputs`...
This should fix #170. If an input function was annotated with a union, we would barf. Now it wont. This still means downstream nodes need to have the same type...
**Is your feature request related to a problem? Please describe.** The project does not currently have any automatic protections against some classes of issue that can be detected by `flake8`,...
Logging an issue so people can depend/reference it more easily. Prototype PR is up from a while ago -- #119 that needs to be redone.
`hamilton` raises a `ValueError` when using `typing.Union`, even if the type signature has the input type. # Current behavior Error when using `typing.Union` types. ## Stack Traces ``` ValueError: 1...
**Is your feature request related to a problem? Please describe.** A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] **Describe the solution you'd...
# Current behavior Creating a DAG with 100K+ nodes is slow. It took 1117.1986498832703 seconds for it to complete for the first example below. Execution time was then 450 seconds...
**Is your feature request related to a problem? Please describe.** Can we help users bootstrap the `check_output()` decorator? **Describe the solution you'd like** Setting up data quality is possible to...