mlflow-docker icon indicating copy to clipboard operation
mlflow-docker copied to clipboard

Jupyter notebook fails storing artifacts

Open NuwanCW opened this issue 3 years ago • 3 comments

Hi, Artefacts storing fails in the jupyter notebook, but testing scripts working fine when run in the terminal. It says access denied. Do you know how to fix this? Thanks

NuwanCW avatar Mar 05 '22 05:03 NuwanCW

  1. Did you use the environment variables?
  2. How do you run the app? Does the environment differe vs running the test scripts? Are you running everything on the local machine or somewhere else?
  3. Please provide a Minimal, Reproducible Example

Toumash avatar Mar 07 '22 17:03 Toumash

Thanks, I used to start the Jupyter server from remote machine. Server is configured properly with environment variables. I used to start the Jupyter by terminal command 'nohup ssh -f user@ip "python3 -m notebook --user=user --no-browser --port=port --NotebookApp.token='' --NotebookApp.password=''"; port_forward'

Fo some reason it seems that it wont get variables properly. However if I start the Jupyter by login to the server then every thing works fine. I think this is no an issue with mlflow but something to do we with Jupyter. Even I load the env variables from Jupyter it does not work. Strange thing is all the other stuff updated to mlflow except artifacts.

NuwanCW avatar Mar 08 '22 23:03 NuwanCW

@NuwanCW 25 days ago the mlflow posted the news about a feature that you could stream artifacts through mlflow into the s3. That would eliminate this problem. Let me know if this helps! And if so i could create a PR to even simplify this project architecture/configuration! Source thread: https://github.com/mlflow/mlflow/issues/629 Docs: https://mlflow.org/docs/latest/tracking.html#using-the-tracking-server-exclusively-for-proxied-artifact-access

Toumash avatar Mar 13 '22 18:03 Toumash

Closing for now. No activity for ~6 months

Toumash avatar Aug 22 '22 18:08 Toumash