papermill icon indicating copy to clipboard operation
papermill copied to clipboard

Deprecation warning when running on Python 3.9

Open malcolmbovey opened this issue 4 years ago • 3 comments

When running Papermill on Python 3.9 in an environment with pyarrow v4.0.1 installed, I see the following FutureWarning

/opt/conda/lib/python3.9/site-packages/papermill/iorw.py:50: FutureWarning: pyarrow.HadoopFileSystem is deprecated as of 2.0.0, please use pyarrow.fs.HadoopFileSystem instead.

  | 2021-06-30T07:38:40.859Z | from pyarrow import HadoopFileSystem

malcolmbovey avatar Jun 30 '21 09:06 malcolmbovey

Thanks for the heads up. I'll look at getting that patched for future packages if no one else gets to it first.

MSeal avatar Jul 29 '21 05:07 MSeal

To add some more context, seeing this with

python: 3.8 papermill: 2.3.3 pyarrow: 4.0.1

matteosantama avatar Aug 14 '21 19:08 matteosantama

Is this a duplicate of https://github.com/nteract/papermill/issues/600?

dhimmel avatar Dec 02 '21 22:12 dhimmel