plot icon indicating copy to clipboard operation
plot copied to clipboard

lazily materialize the groups

Open Fil opened this issue 1 year ago • 1 comments

Makes lazy calls to take (which is expensive on arrow tables). The total # of calls to take in the tests goes from 34068 to 11778 (differenceY and differenceYVariable are the main consumers of this function). This should give better performance to the group transform on large datasets.

Related: #2030

Fil avatar Mar 22 '24 08:03 Fil

More experimentation: I've pushed another strategy, even though I'm not convinced it's better. Maybe it will give us new ideas.

Fil avatar Mar 22 '24 17:03 Fil