pygama icon indicating copy to clipboard operation
pygama copied to clipboard

Published 20 hours ago • verified publisher icon legend-exp

Switching the dataloader build_entry_list from pandas to polars

Open ggmarshall opened this issue 2 years ago • 3 comments

seems to give a decent speedup in testing, definitely more optimisation possible as well with using Lazy dataframes. have left the cut query as pandas as this needs a parser to work with polars

ggmarshall avatar Nov 08 '23 17:11 ggmarshall

Jesus... what's this commit history?

gipert avatar Nov 08 '23 19:11 gipert

I see no problem.....

ggmarshall avatar Nov 08 '23 19:11 ggmarshall

It's because of the rebasing, will leave as this is just an exemplar

ggmarshall avatar Nov 08 '23 19:11 ggmarshall