Stefan Krawczyk
Stefan Krawczyk
Leaving some API thoughts here: 1. One could just use Hamilton within hamilton. ```python @extract_columns(*["video_title", "title_length", "title_word_count"]) def load_df(path: str) -> pd.DataFrame: _df = pd.read_csv(path) dr = driver.Driver(_df.to_dict(orient="series"), inner_transforms) df...
@elijahbenizzy can you put the current API in here too?
maybe this is a better API: ```python @parameterized_subdag(sub_dag, # functions or modules config={"loader": "source_3"}, inputs={"source_3_path": source("source_3_path")}) def source_3_combined_data(combined_data: pd.DataFrame, something_not_in_inner: pd.Series) -> pd.DataFrame: # function name as namespace return combined_data...
Closing this in favor of #295 and #297 given that #270 just merged.
@frenchfrywpepper awesome thanks! `skrawcz`.
Closing this because most of it is done, with follow up tasks of #295 and #297.
@shrey231 if you're still interested, let me know and we can assign it to you.
#195 did this.
Oops. Definitely forgot about this one. Will figure out it's priority next sprint.
So circling back to this. We're looking to schedule this for sometime in November/December.