SakanaAI
how long will take to generate a paper?
how long will it take to generate a paper and does this project work on documents outside of the IT fields?
I only know that I have been unable to use him, and the program has been stuck here
You are probably getting stuck on needing a Semantic Scholar key. See https://github.com/SakanaAI/AI-Scientist/pull/135
how long will it take to generate a paper and does this project work on documents outside of the IT fields?
A few hours, and this code is for simulated experiments only. It will not be able to carry out experiments in a wet lab ;)
@conglu1997 thinking software, econ, and math are the ones under the AI scientist umbrella. Like material sciences and biology is definitely out of the picture. Thinking how things can work with sociology and psychology tho (e.g. Survey making with APIs, using pre-established data).
@BradKML @NathanaelTamirat
Maybe we can approach this by focusing on a simpler task to gain momentum: literature reviews. From what I see, the issues with references and the Semantic Scholar API could be partially bypassed. Most participants likely have institutional credentials or their own methods to access papers via DOI. Once the papers are downloaded, citation and referencing tasks become manageable.
We could modularize and segment tasks based on complexity and assign them to models/APIs that perform best under specific conditions. For example:
- Low-cost APIs could handle metadata parsing and early-stage paper categorization.
- Higher-performing models could manage summarization and thematic clustering.
Partial automation might suffice as a starting point, reducing costs while allowing users to adapt workflows manually when necessary. This approach could make the project more accessible to those with limited resources while building a framework for broader automation later.
@Krakaur thanks for linking this up with other ideas like WilmerAI and RouteLLM, but that belongs to another repo https://github.com/SomeOddCodeGuy/WilmerAI/discussions/26#discussioncomment-11694230 Also when it comes to adapting to new workflow, would vouch for OpenHands/Kevin for faster and easier refactoring (templating work is still very WIP though) https://github.com/SmartManoj/Kevin
My first one is working on a quantum mechanics concept that I used claude code to help create a custom template for and it is at 25 hours and still going...
