glyce icon indicating copy to clipboard operation
glyce copied to clipboard

bq 数据集没有找到

Open Li-rr opened this issue 5 years ago • 2 comments

您好,我下载了bq数据集,设置了数据集路径,为什么会报这样的错,是需要数据预处理吗

input_file /home/lrr/workspace/glyce_datset/sent_pair/bq/train.json
Traceback (most recent call last):
  File "/home/lrr/workspace/glyce/glyce/bin/run_bert_glyce_classifier.py", line 388, in <module>
    main()
  File "/home/lrr/workspace/glyce/glyce/bin/run_bert_glyce_classifier.py", line 380, in main
    train_loader, dev_loader, test_loader, num_train_steps, label_list = load_data(config)
  File "/home/lrr/workspace/glyce/glyce/bin/run_bert_glyce_classifier.py", line 133, in load_data
    train_examples = data_processor.get_train_examples(config.data_dir)
  File "/home/lrr/workspace/glyce/glyce/dataset_readers/bert_sent_pair.py", line 132, in get_train_examples
    self._read_tsv(os.path.join(data_dir, "train.json")), "train")
  File "/home/lrr/workspace/glyce/glyce/dataset_readers/bert_data_utils.py", line 78, in _read_tsv
    with open(input_file, "r") as f:
FileNotFoundError: [Errno 2] No such file or directory: '/home/lrr/workspace/glyce_datset/sent_pair/bq/train.json'

这是我的数据集设置:

echo "data_sign: $data_sign"
#data_dir=/data/nfsdata/nlp/datasets/sentence_pair/bq_corpus
data_dir=/home/lrr/workspace/glyce_datset/sent_pair/bq
output_dir=../export-model # change save_path !!!

这是文件夹内容

image

Li-rr avatar Oct 24 '20 03:10 Li-rr

我也遇到了一样的问题,改一下数据加载的函数可能就可以了。( Issue #38 )

okcd00 avatar Apr 22 '21 09:04 okcd00

我也遇到了一样的问题,改一下数据加载的函数可能就可以了。( Issue #38 )

谢谢您,我去试试

Li-rr avatar Apr 23 '21 12:04 Li-rr