AI-Scientist icon indicating copy to clipboard operation
AI-Scientist copied to clipboard

FileNotFoundError: [Errno 2] No such file or directory: '../../data/shakespeare_char/train.bin'

Open biaocmd opened this issue 1 year ago • 6 comments

When I run this command“python launch_scientist.py --model "deepseek-coder-v2-0724" --experiment nanoGPT_lite --num-ideas 2”, the following error occurs。 FileNotFoundError: [Errno 2] No such file or directory: '../../data/shakespeare_char/train.bin'

what's the problem?

biaocmd avatar Aug 21 '24 15:08 biaocmd

When I run this command“python launch_scientist.py --model "deepseek-coder-v2-0724" --experiment nanoGPT_lite --num-ideas 2”, the following error occurs。 FileNotFoundError: [Errno 2] No such file or directory: '../../data/shakespeare_char/train.bin'

what's the problem?

I am certain that within this folder“.../.../ Data/shakespeare_char/"contains the file "train.bin".

biaocmd avatar Aug 21 '24 15:08 biaocmd

Same here, even rerun the preparations.

jli113 avatar Aug 24 '24 09:08 jli113

same error

python experiment.py --data_dir /path/to/your/data

culture-ota avatar Aug 26 '24 05:08 culture-ota

if out_dir == "run_0": data_dir = os.path.join("../../data", dataset) else: data_dir = os.path.join("../../../data", dataset)

dimentox avatar Aug 26 '24 23:08 dimentox

if out_dir == "run_0": data_dir = os.path.join("../../data", dataset) else: data_dir = os.path.join("../../../data", dataset)

Thank you for your response. However, I'm not sure where exactly to place the code you mentioned. If I'm using nanoGPT_lite, should I define it within one of the "def train" functions in the experiment.py file?

def train(dataset="shakespeare_char", out_dir="run_0", seed_offset=0): # poor man's data loader data_dir = os.path.join("../../data", dataset)

culture-ota avatar Aug 27 '24 05:08 culture-ota

try absolute path for your data directory, like as per the code : line 386 image ive modified experiment.py as im using nanogpt_lite yours maybe different image

xprabhudayal avatar Sep 10 '24 15:09 xprabhudayal