AI-Scientist icon indicating copy to clipboard operation
AI-Scientist copied to clipboard

https://www.semanticscholar.org/product/api#api-key-form", "code": "429"

Open gao106 opened this issue 1 year ago • 22 comments

when i try to run this command:python launch_scientist.py --model "deepseek-coder-v2-0724" --experiment nanoGPT --num-ideas 1**

Response Status Code: 429 Response Content: {"message": "Too Many Requests. Please wait and try again or apply for a key for higher rate limits. https://www.semanticscholar.org/product/api#api-key-form", "code": "429"} Backing off 6.5 seconds after 4 tries calling function search_for_papers at 04:14:52 Response Status Code: 429 Response Content: {"message": "Too Many Requests. Please wait and try again or apply for a key for higher rate limits. https://www.semanticscholar.org/product/api#api-key-form", "code": "429"} Backing off 12.0 seconds after 5 tries calling function search_for_papers at 04:14:59 Response Status Code: 429 Response Content: {"message": "Too Many Requests. Please wait and try again or apply for a key for higher rate limits. https://www.semanticscholar.org/product/api#api-key-form", "code": "429"} Backing off 15.8 seconds after 6 tries calling function search_for_papers at 04:15:11 Response Status Code: 429

what should i do?

gao106 avatar Aug 30 '24 04:08 gao106

Please see: https://github.com/SakanaAI/AI-Scientist/issues/78 Try see if the API works at all, and you have no firewall.

conglu1997 avatar Aug 30 '24 06:08 conglu1997

It seems the issue isn't related to the firewall. It appears that the program is accessing https://www.semanticscholar.org/product/api#api-key-form too frequently. Do you know where to change this address or adjust the strategy?

gao106 avatar Sep 01 '24 00:09 gao106

Requesting an API key would be the best strategy, alternatively one could consider other open scholarly archives such as DBLP! I believe Google Scholar can be challenging to access properly and can often block access.

conglu1997 avatar Sep 01 '24 00:09 conglu1997

Where can I make changes to switch to DBLP? Please let me know.

gao106 avatar Sep 01 '24 00:09 gao106

I also need help for switching DBLP

Isaadahmed2 avatar Sep 01 '24 07:09 Isaadahmed2

The code for semantic scholar is here: https://github.com/SakanaAI/AI-Scientist/blob/ed798a0af6e2d9d9ad619a861e80ae1726c97fab/ai_scientist/generate_ideas.py#L284. I should say, the easiest option is to just request a key.

conglu1997 avatar Sep 01 '24 07:09 conglu1997

Yeah,i konw .but it very hard to get a key.

gao106 avatar Sep 01 '24 07:09 gao106

I'm using Ubuntu 24.4, I run export S2_API_KEY="MY KEY" in the terminal, opened another terminal to run launch_scientist.py. Still got 429.

jli113 avatar Sep 02 '24 01:09 jli113

export doesn't last between different terminal sessions.

conglu1997 avatar Sep 02 '24 01:09 conglu1997

@jli113 how do you get a key?

Isaadahmed2 avatar Sep 02 '24 06:09 Isaadahmed2

https://www.semanticscholar.org/product/api#api-key-form

conglu1997 avatar Sep 02 '24 06:09 conglu1997

Has anyone been successful in their application? how long does it take, I submitted my application 3 days ago and still no response

https://www.semanticscholar.org/product/api#api-key-form

micelvrice avatar Sep 02 '24 06:09 micelvrice

@micelvrice same I have submitted the request like 3 days ago

Isaadahmed2 avatar Sep 02 '24 07:09 Isaadahmed2

Perhaps 1-2 weeks. Feel free to run without novelty checking or citations in the writeup in the meantime! Just comment out the necessary lines.

conglu1997 avatar Sep 02 '24 07:09 conglu1997

@conglu1997 I have tried that but i am getting error ../../data path for train.bin is not there.

Isaadahmed2 avatar Sep 02 '24 07:09 Isaadahmed2

Have you run the prepare steps?

conglu1997 avatar Sep 02 '24 07:09 conglu1997

@conglu1997 yes I have done all of them and the file is present there.

Isaadahmed2 avatar Sep 02 '24 07:09 Isaadahmed2

Can you try pull the most recent version of the code? We recently fixed a related issue.

conglu1997 avatar Sep 02 '24 07:09 conglu1997

Can you try pull the most recent version of the code? We recently fixed a related issue.

i tried the most recent version of the code. same problem. image

jobschang7 avatar Sep 09 '24 09:09 jobschang7

@jobschang7 Requesting an API key would be the best strategy, HAHAHAHAHAH

gao106 avatar Sep 14 '24 01:09 gao106

@gao106 registration can be a bit of a pain sometimes, if only there are tutorials that are more straightforward

BradKML avatar Dec 27 '24 02:12 BradKML

Please see https://github.com/SakanaAI/AI-Scientist/pull/135

conglu1997 avatar Jan 14 '25 15:01 conglu1997