Jonas Zhou issues

Repositories
Issues
Comments

Results 2 issues of


                                            Jonas Zhou

Problems of reproducing the MEND result of ngram-entropy using gpt-j-6B in counterfact dataset

I tried to reproduce the result of MEND in gpt-j-6B and Llama-2-7b, but the ngram-entropy of gpt-j-6B is far below Llama-2-7b(gpt-j-6B around 350 vs Llama-2-7b around 550). Do you have...

question

Numerical precision differences in tensors across PyTorch, Triton, and CUDA

Hello, your tutorial is very inspiring and helpful to me. Thanks for your nice work. However, when I run final.py, I met the numerical precision differences in outputs among the...