Benjamin

Results 12 comments of Benjamin

@amaurym I'm getting this: ``` Failed to compile src/Login/Login.tsx Syntax error: Unexpected token, expected ";" (40:32) 38 | }) => { 39 | try { > 40 | const signature...

Just to clarify, this happens when more than one image is used for a person. So the replay.py script doesn't work if you have constructed a face/person using more than...

@maisonam were you able to get around it somehow?

@tomeck Weird, I'm getting 300ms on M2 (Macbook Air 16GB): ``` python3 train.py --dataset=shakespeare --n_layer=4 --n_head=4 --n_embd=64 --device='mps' --compile=False --eval_iters=1 --block_size=64 --batch_size=8 Overriding: dataset = shakespeare Overriding: n_layer = 4...

Yep the README documentation doesn't make sense in terms of ms calculations on A100. It states: "Training on an 8 x A100 40GB node for ~500,000 iters (~1 day) atm...

Well it's not because I prepared it using a different Pytorch version. It just fails. Any thoughts?

I distilled the issue to the fact that I tried running the training on 1 GPU. It works with more GPU's for some reason.

Macbook Air M2 16GB gives ~300ms with `mps` using Shakespeare: ``` iter 23: loss 10.7863, time 305.73ms iter 24: loss 10.8073, time 298.21ms iter 25: loss 10.7988, time 308.87ms iter...

That is fine. It should produce samples after that line...

> > That is fine. It should produce samples after that line... > > yes, it rollback to GPT2 , does it equals to chatgpt's ? Nope. ChatGPT is like...