huyongan

[Question]GLM-130B模型有vocab文件吗？

1

请教一个问题：我在本仓库中貌似没有找到一个词典的文件（vocab.json），请教以下glm是怎么将输入文字处理成input_ids的？ ---------------- 这个问题找到答案了，使用icetk进行tokenizer，不需要vocab_file， icetk中有一个15w的词典。

**question** @jon-barker hello, jon, I have some questions on the embedding, can you help explain? Why replace F.embedding(masked_input, self.weight) with self.weight[masked_input] in forward() function of class VocabParallelEmbedding? What is the...

**Describe the bug** If i repeat runing test/unit_tests/dist-checkpoing/test_serialization.py many times, there is a small chance that it will get stuck **To Reproduce** step1: cd tests/unit_tests step2: bash ut.sh the following...