fxnie

Results 8 comments of fxnie

How are multiple datasets loaded?

How should I set up using only the training set and not the test and validation sets?

How are multiple datasets loaded?

Is there a way to load only the data from these two files as described by you? "/cramch/project-465001281/IP/tokenized/gpt_neox/en3_text.dideo" and "/cramch/project-465001281/IP/tokenized/gpt_neox/lv3_text.dideo"

安装完longbench后，运行报错

@zZzZ9zZ9 Maybe it is network problem ，Is your environment connected to the internet. 你可以尝试把数据集下载到本地进行加载

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb5 in position 1: invalid start byte

mark

task load return error

same

在加载bookcorpus的过程中，builder_cls为None

@pennyLuo-hub May I ask where the same error can be obtained for this dataset in PPL? traindata = load_dataset('ptb_text_only', 'penn_treebank', split='train') valdata = load_dataset('ptb_text_only', 'penn_treebank', split='validation')

langgraph.errors.GraphRecursionError: Recursion limit of 25 reached without hitting a stop condition.

same ![Image](https://github.com/user-attachments/assets/556edb34-ee0a-4137-9c82-8b73e6999804)

如何使输出内容更加详实？

请问有好的reporter.md的建议吗，使报告更丰富