ng-video-lecture icon indicating copy to clipboard operation
ng-video-lecture copied to clipboard

Published 20 hours ago • verified publisher icon karpathy

can be windows OS with only CPU used ?

Open Sandy4321 opened this issue 1 year ago • 4 comments

can be windows OS with only CPU used ?

Sandy4321 avatar Jan 21 '24 20:01 Sandy4321

Yes, but it will take a very long time to complete one iteration.

fasterinnerlooper avatar Feb 04 '24 04:02 fasterinnerlooper

FOE EXAMPLE , 20 SECONDS?

Sandy4321 avatar Feb 06 '24 14:02 Sandy4321

Longer than that, depends on your system hardware.

AdityaKulshrestha avatar Jul 12 '24 10:07 AdityaKulshrestha

I have rewritten gpt.py to run it on my laptop with CPU only. By keeping the numbers of layers, n_embd and block_size, I only managed to have 500 iters done per day (my laptop doesn’t work at night) and I don’t know if it works on PC. I’m also not sure if I did it right because I don’t know much about Shakespeare. The output looks much like more.txt, but not much like input.txt. Here a sample: The top in a world. You virt, the ban't, Wallr most us, he hath as from all nock, The cheke my son me queet, give me in! For Juwe'le: Be Lord Cancion just and kind. If Petter for of death; Slay of world he while not a beling the sheep; The Warwick, the sweares pake shall not.

If after reading this, you still want to give it a try, here is the direct link to the Python file on GitHub: https://github.com/gyllila/DemoLLMDownsizing/blob/main/gpt_embedding_only_s.py

gyllila avatar Jul 26 '24 01:07 gyllila