pipilia comments

Repositories
Issues
Comments

Results 3 comments of


                                            pipilia

[MiniLLM] roberta dataset differences between llama version and opt version

And I use the following code to view the content of the .bin file: ``` import` numpy as np with open("train_0.bin", "rb") as f: data = np.frombuffer(f.read(), dtype=np.uint16) print("Token IDs:",...

[MiniLLM] roberta dataset differences between llama version and opt version

Hello.May I ask when will you upload the full version?I am doing a research about your work and I am really looking forward to getting the full dataset to continue...

assert all((~torch.isinf(scores.view(-1))) & (~torch.isnan(scores.view(-1)))) [rank0]: AssertionError

@t1101675 请问您是否搞清楚这个问题出现的原因了呢？我在进行llama 7B-13B的无LM DATASET的MiniLLM蒸馏时同样遇到了这个问题