lux icon indicating copy to clipboard operation
lux copied to clipboard

[Feature Request] RAPIDS cuDF GPU option in addition to pandas

Open exactlyallan opened this issue 2 years ago • 2 comments

@dorisjlee would you be open to adding cuDF backed functionality as an option? I believe there could be several places where GPU acceleration would help over pandas with larger datasets.

We currently have several other visualization projects that integrate with cuDF, such as datashader, and our own cuxfilter.

exactlyallan avatar May 12 '22 21:05 exactlyallan

Hey @exactlyallan, Thanks for the suggestions! We're open to contributions and areas of improvement with a cuDF backend. This would likely involve extending a new plotting backend for Lux that uses cuDF. The plotting backends we currently support are Altair and matplotlib. I think this will help quite a bit with rendering large scatterplots (which is currently plotted as binned heatmap). You can find some of the past performance benchmarks that we've done in this VLDB paper: https://arxiv.org/pdf/2105.00121.pdf

dorisjlee avatar May 13 '22 23:05 dorisjlee

@dorisjlee We are starting to work on this - could you suggest any profiling tools or techniques you are using that work with lux?

exactlyallan avatar Jun 29 '22 23:06 exactlyallan