Stefan Krawczyk
Stefan Krawczyk
With #169 -- I see: ``` Creating DAG Created DAG in: 6.1067540645599365 seconds Total Hamilton time: 66.15090799331665 seconds ``` !
Vanilla Hamilton is fixed. Now need to figure out Ray and Dask.
Closing this issue for now -- punting on Ray & Dask until it crops up again.
> Hi ! can I work on this issue? Sure, yes please. Feel free to submit a Pull Request when you have something for us to review.
@wangkev thanks for posting. Do you mind providing a bit more information around your use case? Otherwise we've talked about this possibility -- we just haven't had the use case...
@wangkev in case it's helpful, you can either checkout the branch and do `pip install -e .`, or install the branch directly from github. I believe this should work `pip...
🤔 I think this is a power user feature, so `node` is probably better than `source`? Though `node` will clash with the package & class name we have... hmm. We...
@elijahbenizzy should this issue be closed? Or an updated added?
Adding a custom source for Datahub: - https://datahubproject.io/docs/metadata-ingestion/developing/ - https://datahubproject.io/docs/metadata-ingestion/adding-source/
@devin-petersohn In my ideal world, we could we enable people to maintain https://github.com/stitchfix/hamilton/blob/main/examples/hello_world/my_functions.py without touching it. Reasoning: 1. that code is reusable in different contexts very easily. 2. if someone...