EvalAI
EvalAI copied to clipboard
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
Fixes #3495. Running eval.ai with docker-compose and trying to connect with a remote worker does not work. It seems the remote worker script is a bit out of date with...
Hi! I have two proposed feature requests for submission metadata: 1. The "View Metadata" bubble on the leaderboard currently only displays the `submission_meta_attributes` from the config and not `default_submission_meta_attributes`. I...
Hello I am new to evalAI and I have reviewed its features. Thanks for the great platform. I have installed it on a server using docker and I want to...
## Issues to be fixed - [ ] When a user tries to create a challenge, if he uploads an invalid file ( zip without YAML) or any other format,...
**Current Scenario**: Whenever a challenge hosts updates an evaluation script or the test annotation file then the email for reloading is sent to them immediately after the upload of annotations...
Context: Github Bi-directional Sync Related Pull Request: https://github.com/Cloud-CV/EvalAI-Starters/pull/52 Models Considered: - [x] Challenge - [x] Challenge Phase Deliverables: - [x] Add github_token - [x] Add sync for non-file fields -...
Complete details for the error: https://sentry.io/share/issue/1c744d1830cd4ead8f1f234be5524920/
### Description Currently, when a challenge link from EvalAI is shared users see a generic view of EvalAI homepage. We want the details specific to a challenge to be shown...
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.1 to 5.4. Changelog Sourced from pyyaml's changelog. 5.4 (2021-01-19) yaml/pyyaml#407 -- Build modernization, remove distutils, fix metadata, build wheels, CI to GHA yaml/pyyaml#472 -- Fix for...