atari-agents icon indicating copy to clipboard operation
atari-agents copied to clipboard

Hosting model checkpoints on the Hugging Face hub

Open edbeeching opened this issue 3 years ago • 6 comments

Hello, thank you for sharing these checkpoints with the community.

Would you be interested in hosting these checkpoints on the Hugging Face Model Hub?

In addition, we could also collaborate on the creation of a tool to visualize the agents live in the browser, similar to our proof of concept example.

edbeeching avatar May 12 '22 13:05 edbeeching

Hi! Yes, that would be great. I'll take a look at what's required as I don't have much experience working with the Hugging Face hub api.

floringogianu avatar May 16 '22 05:05 floringogianu

We have tutorials on the HF hub here.

If you are able to convert the checkpoints to StableBaselines3 models, we include a a push_to_hub() function in our hugging_face_sb3 fork.

I would be happy to provide any assitance if you need it.

edbeeching avatar May 17 '22 14:05 edbeeching

Hi, @floringogianu. Do you have any updates on that? I'm trying to download the checkpoints from the link provided, and they keep failing for me. If there is any other source I could use, I'd love to help with this issue 😄

NathanGavenski avatar Jun 10 '22 18:06 NathanGavenski

Hi @NathanGavenski, thanks for raising this up. I’ll be able to check if there are any issues with the storage later today.

Starting tomorrow I’ll also start uploading the models on Hugging Face. This should improve things.

floringogianu avatar Jun 11 '22 05:06 floringogianu

For those trying to download the checkpoints and failing. I've managed to do so by using curl:

curl 'https://share.bitdefender.com/s/qCF7jFxkgx2qJeT/download?path=%2FMDQN_modern&files=Asteroids&downloadStartSecret=nyhw5aird3t' \
  -H 'authority: share.bitdefender.com' \
  -H 'accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9' \
  -H 'accept-language: en-US,en;q=0.9,pt-BR;q=0.8,pt;q=0.7' \
  -H 'cookie: __Host-nc_sameSiteCookielax=true; __Host-nc_sameSiteCookiestrict=true; oc_sessionPassphrase=4DsVVvG78%2BgdsXA6BXv5go9jgL3VFkh6BSz4ZOxkns4%2Frg1nkBk6U85UWa7Wfl4oqSTdfi85BjiLaXPBMS26RSxeVkpgKHu%2Fh6OhkwWpHfqKhFzScgPq0AmYiqo9HdCY; oc27vvt0q0o7=h8umj9gld7rin1cgseair121e3; __cflb=02DiuJPy8DgWkB3KaGVJ2zozpakTBtvjpjxJbwgDWBYcU; cp%3A5232029519211759d9b92a624e88df97%3Asession%3Aid=e96ad929650f3118f8d1dd78bfc7fab9; cp%3Amanual%3Acb-fv%3Aclose=Yes' \
  -H 'cp-extension-installed: Yes' \
  -H 'referer: https://share.bitdefender.com/s/qCF7jFxkgx2qJeT?path=%2FMDQN_modern' \
  -H 'sec-ch-ua: " Not A;Brand";v="99", "Chromium";v="102", "Google Chrome";v="102"' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'sec-ch-ua-platform: "Windows"' \
  -H 'sec-fetch-dest: document' \
  -H 'sec-fetch-mode: navigate' \
  -H 'sec-fetch-site: same-origin' \
  -H 'sec-fetch-user: ?1' \
  -H 'upgrade-insecure-requests: 1' \
  -H 'user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.0.0 Safari/537.36' \
  --compressed \
  --output asteroids.zip

This command is an example of the asteroids checkpoint. For other checkpoints, it needs to change the File parameter, or the path has to change for the whole folder.

NathanGavenski avatar Jun 22 '22 21:06 NathanGavenski