AI-Scientist why model compiling?

does there any usage of the models (nanogpt, nanogpt_lite ...) in later time in launch_scientist.py or is it just for comparing with the baseline results?

in this image we are compiling the model, & upon later analysis or the code in launch_scientist.py we are just comparing with the baseline results

Sep 01 '24 08:09 xprabhudayal

Yes these are the baseline runs to compare any future ideas or proposals against.

Sep 01 '24 17:09 conglu1997

Can't we just distribute the cached baseline results, to avoid the heavy task of compiling 🤔

On Sun, Sep 1, 2024, 11:16 PM Cong Lu @.***> wrote:

Yes these are the baseline runs to compare any future ideas or proposals against.

— Reply to this email directly, view it on GitHub https://github.com/SakanaAI/AI-Scientist/issues/91#issuecomment-2323439366, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6UFP3B4NHDAWLPYW5WDHJTZUNHI5AVCNFSM6AAAAABNOUCO46VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRTGQZTSMZWGY . You are receiving this because you authored the thread.Message ID: @.***>

Sep 02 '24 03:09 xprabhudayal

See the FAQ, no because things like runtime comparisons are machine dependent :)

Sep 02 '24 03:09 conglu1997

@conglu1997 i've been using cloud instance to run this ai scientist, it works fine. i just wanna know that if all these work in COLAB PRO with A100? as many of the code were TERMINAL based../?

Oct 08 '24 14:10 xprabhudayal