jax icon indicating copy to clipboard operation
jax copied to clipboard

Published 20 hours ago • verified publisher icon google

Using JAX with Pandas

Open harshit-2115 opened this issue 4 years ago • 5 comments

Hey, Is there any way to use JAX to speed up and reduce memory-usage of data processing pipelines in pandas ?

harshit-2115 avatar May 08 '20 12:05 harshit-2115

Hi - Jax does not have any built-in support yet for a pandas-like API, but it is an interesting idea. I'll leave this as an open issue!

jakevdp avatar May 08 '20 17:05 jakevdp

In the meantime, you can also read pandas dataframes directly as a tf.data.Dataset (which would be compatible with JAX).

Thank you for the feature request!

dynamicwebpaige avatar May 20 '20 05:05 dynamicwebpaige

@jakevdp @mattjj @dynamicwebpaige - any updates on this enhancement? thanks,

99snowleopards avatar Dec 28 '20 01:12 99snowleopards

This is a great idea!

TheAustinator avatar Sep 11 '22 02:09 TheAustinator

I've been playing with this idea a bit; I pushed my current work-in-progress to https://github.com/google/jax/pull/12329

jakevdp avatar Sep 12 '22 18:09 jakevdp

Very interested! Would be a major feature to bolster JAX's already incredible advantage.

vitalNohj avatar Jan 31 '23 00:01 vitalNohj

@jakevdp Is there any progress on that? Do you need open-source contributors to help?

adendek avatar Apr 23 '23 21:04 adendek

I would like jax to replace pandas in my stack. pandas is just too slow. I know they are working to address this, but it would still be nice to have a competitor to pandas

openspaceranger avatar Jun 09 '23 22:06 openspaceranger

I'm not actively working on this, and I don't know of anybody who is.

jakevdp avatar Jun 14 '23 04:06 jakevdp