GM Harshvardhan
GM Harshvardhan
### Feature request Is it possible to have two new modules, `Embedding4bit` and `StableEmbedding4bit`, at `nn/modules.py`? This would help enable quantizing embedding lookup tables as well. ### Motivation I was...
Hi, Love the repo for the self-explanatory code and fun comments! I would appreciate it if you could explain how the next batch is asynchronously being fetched in train.py: https://github.com/karpathy/nanoGPT/blob/325be85d9be8c81b436728a420e85796c57dba7e/train.py#L299-L305...