Elijah ben Izzy
Elijah ben Izzy
Thank you! This is great -- I've been meaning to make this change to everywhere in the codebase and new spots keep popping up in which it's needed. Just checking...
So I see the value here but the cynic in me wonders what the value of making it polymorphic in terms of the type being parallelized? E.G. we have two...
> Perhaps a compromise for the decorator would be to add it, but for now, internally, when Hamilton identifies it, it will internally change the function's annotation to use Parallelize/Collect,...
@EltonCN -- this looks good. Very sorry it took a bit to get back to you, this slipped my mind. Happy to ship it -- mind rebasing/ensuring the tests work?...
> **Is your feature request related to a problem? Please describe.** Instead of creating a new application every time, what if we could reset some "state" and "application-y" things about...
Adding on this -- get the `HamiltonGraph` object from the driver as well
OK, I want to mirror the way burr does this: https://burr.dagworks.io/reference/application/#burr.core.application.ApplicationContext Any node can declare `__context` and have it passed in as the current context variable. Currently I'm thinking of...
Yep! I think we can explore that as well (a little bit of odd stuff around parallelism/async, but I need to scope it out).
> looks like the same could be said about pandas? it does pop up in more places, but none look core Yes! It's only left there for legacy reasons. One...
It *should* work with threading, in theory, but it will usually provide a really annoying experience.