AI-Scientist icon indicating copy to clipboard operation
AI-Scientist copied to clipboard

nanoGPT_lite sanity check...RuntimeWarning: Mean of empty slice.

Open MrEdwards007 opened this issue 1 year ago • 6 comments

Good day, I ran the following code as part of the instructions for the sanity check but receive the error "Mean of empty slice" along with a follow-on error of "RuntimeWarning: invalid value encountered in scalar divide"

OS : Ubuntu 22.04.4 LTS Driver Version : 535.183.01 CUDA Version : 12.2 Attached GPUs : 1 Product Name : NVIDIA RTX A4500 Laptop GPU Product Brand : NVIDIA RTX

cd templates/nanoGPT_lite && python experiment.py --out_dir run_0 && python plot.py

I would like to know how to address this. I havent seen anyone else encounter this error. This comes directly after performing the installation and following the instructions on https://github.com/SakanaAI/AI-Scientist

image

MrEdwards007 avatar Aug 30 '24 20:08 MrEdwards007

That's our bad! Can't calculate the std when there's just one seed.

https://github.com/SakanaAI/AI-Scientist/blob/b30cf8aedd0834d97b581f8c6ec8bb9cb8ccd380/templates/nanoGPT_lite/experiment.py#L703

luchris429 avatar Sep 01 '24 02:09 luchris429

That's our bad! Can't calculate the std when there's just one seed.

https://github.com/SakanaAI/AI-Scientist/blob/b30cf8aedd0834d97b581f8c6ec8bb9cb8ccd380/templates/nanoGPT_lite/experiment.py#L703

Update templates folder is only thing to do ? I did that but issue still when I run nanoGTP_lite baseline

Hanochhu avatar Sep 01 '24 05:09 Hanochhu

Can you check if the .json and .npy files are still valid and contain results? This error is a bit hard to reproduce (only happens a small amount of the time) and when it occurs for me, the files are still fine.

conglu1997 avatar Sep 01 '24 19:09 conglu1997

I have the same problem, how can I solve it? 1725242584994

LMJOK avatar Sep 02 '24 02:09 LMJOK

I think this is just a warning, you can check all your .json and .npy, and verify there is no problem.

conglu1997 avatar Sep 02 '24 02:09 conglu1997

Is this problem solved? I also encountered the same error.

gaoshaojie0708 avatar Sep 04 '24 09:09 gaoshaojie0708