machine-learning-articles
machine-learning-articles copied to clipboard
How to speed up your pandas code
TL;DR
Different techniques and tools to speed up pandas code
Article Link
https://medium.com/towards-artificial-intelligence/comprehensive-guide-to-optimize-your-pandas-code-62980f8c0e64
Key Takeaways
- Pick the right types
- Load needed columns only
Useful Tools
- numexpr
- cython
- numba
- cudf
- modin
- pyspark