evalai-cli icon indicating copy to clipboard operation
evalai-cli copied to clipboard

Can not push leaderboard test docker to EvalAI platform

Open rb93dett opened this issue 1 year ago • 1 comments

Hi, I‘m trying to test my CARLA agent on the CARLA leaderboard 1.0 (CARLA Autonomous Driving Challenge 2.0), for which I have obtained permission from the organizers to compete. I have installed the latest version of the EvalAI package (1.3.16) and completed the "set token" operation.

However, when attempting to use the "evalai push" command to submit the required Docker image to the leaderboard, I encountered an error message "Error: None". Additionally, I tried other commands such as "evalai challenges," but received a "404 Client Error: Not Found for url: https://eval.ai/api/challenges/challenge/all" error.

I have attempted these operations on both a Linux machine and my personal Mac, and encountered the same issues on both platforms. Upon searching the EvalAI forum, I discovered that other users have also encountered similar problems, which can be found here: https://evalai-forum.cloudcv.org/t/evalai-push-error-or-am-i-just-a-noob-with-docker/1773

I tried to send an email to the EvalAI team but got no response, so I wonder if you could give me any advice, I would be very appreciate!

My commands for push the docker to the platform:

pip install evalai evalai set_token {MY_EVALAI_TOKEN} evalai push {MY_DOCKER_IMAGE} --phase carla-leaderboard-10-sensors-2098

image

rb93dett avatar Jan 25 '24 02:01 rb93dett

Commenting here to let you know -- I got around this by making a brand new account with a brand new email. The CLI worked with the new token. Maybe old tokens lurking around the system are incompatible

joel99 avatar Mar 28 '24 18:03 joel99