CatTimson
CatTimson
I have exactly the same issue. "Created a PretokDataset with rng seed 42" and then nothing
> @CatTimson @madroidmaq can you try setting `pin_memory=False` in this [line](https://github.com/karpathy/llama2.c/blob/bd182289c596fa6059eb7b3b7c8ccd04b5c90fc3/tinystories.py#L238C40-L238C50) ? No, it did not resolve my issue. I was still observing ""Created a PretokDataset with rng seed 42""...
My original configuration was: nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Wed_Jun__8_16:49:14_PDT_2022 Cuda compilation tools, release 11.7, V11.7.99 Build cuda_11.7.r11.7/compiler.31442593_0 2.0.0+cu117 Then...
I have discovered another bug: If I only use a single json file (data00.json) the train fail, if i use at least two json files (data00.json + data01.json), it works...