agents-course
agents-course copied to clipboard
Many "cheating" solutions on the leaderboard
Hi,
First of all, thanks for the great course! I personally enjoyed the final assignment, and I am still making some improvements. I was curious to explore how others did it, but if you check the top scores on the student leaderboard, it looks like many are using a "fake" retriever agent that just connect to a Supabase db to map the question to an expected answer...
This is sad! Just want to bring this to your attention, it may not be too hard to block these... Here is an example: https://huggingface.co/spaces/baixianger/RobotPai/blob/main/agent.py
Cheers,
Thomas