Elijah ben Izzy
Elijah ben Izzy
From an internal slack discussions (thanks @zilto): Desired behavior: - .with_modules() is the main entrypoint, users pass code that's stored in versionable file - .allow_module_overrides() (current behavior) allows .with_modules(module_a, module_b)...
> Yeah, I've implemented parallelization as well and it works. But I feel that it makes code less clear. Conceptually, I am trying to run some document through text-only and...
> Agree. I think implementing the async decorator might be a good solution for my use case. I did play with parllelism in burr. It's pretty nice. It's just in...
Thanks @sT0v for the clean repro! An update -- if I run `all_kinds` it works, but *only* if I remove `extract_fields`. Hmm. ```python Task failed concurrent.futures.process._RemoteTraceback: """ Traceback (most recent...
This diff gets it to work -- problem is `extract_fields` (as suggested initially) ```diff < df = _load_full_dataset() < species = df.species.unique().tolist() < < 26c22 < # @extract_fields(dict(raw_df=pd.DataFrame, agg_df=pd.DataFrame)) ---...