OpenGVLab
Other Task
I have run main.py, --tasks piqa,arc_easy,arc_challenge,boolq,hellaswag,winogrande
Due to the inability of the dataset to be loaded, I can only download the dataset from Hugging and load it locally. Then I found that there was no boolq file in im_eval.tasks.
What I was thinking was to find the. py file containing the dataset in im_eval. tasks and change the variable: DATASET-PATH to an absolute path. But it does not include the boolq file. Dear author, how do I need to change the settings for locally loading other tasks for Selected Tasks: ['winogrande ',' boolq ',' hellaswag ',' arc_challenge ',' piqa ',' arc_easy '].
Selected Tasks: ['winogrande', 'boolq', 'hellaswag', 'arc_challenge', 'piqa', 'arc_easy']
Downloading data: 100%|██████████| 2.06M/2.06M [00:02<00:00, 978kB/s]
Downloading data: 100%|██████████| 118k/118k [00:00<00:00, 145kB/s]
Downloading data: 100%|██████████| 85.9k/85.9k [00:00<00:00, 144kB/s]
Generating train split: 100%|██████████| 40398/40398 [00:00<00:00, 378782.41 examples/s]
Generating test split: 100%|██████████| 1767/1767 [00:00<00:00, 269885.84 examples/s]
Generating validation split: 100%|██████████| 1267/1267 [00:00<00:00, 234611.42 examples/s]
Downloading data: 100%|██████████| 3.85M/3.85M [00:01<00:00, 2.43MB/s]
Downloading data: 100%|██████████| 1.31M/1.31M [00:00<00:00, 2.21MB/s]
Downloading data: 100%|██████████| 1.31M/1.31M [00:00<00:00, 2.04MB/s]
Generating train split: 100%|██████████| 9427/9427 [00:00<00:00, 121299.71 examples/s]
Generating validation split: 100%|██████████| 3270/3270 [00:00<00:00, 136654.95 examples/s]
Generating test split: 100%|██████████| 3245/3245 [00:00<00:00, 133984.19 examples/s]
/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/datasets/load.py:1478: FutureWarning: The repository for hellaswag contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at https://hf.co/datasets/hellaswag
You can avoid this message in future by passing the argument trust_remote_code=True.
Passing trust_remote_code=True will be mandatory to load this dataset from the next major release of datasets.
warnings.warn(
Downloading builder script: 100%|██████████| 4.36k/4.36k [00:00<00:00, 15.3MB/s]
Downloading metadata: 100%|██████████| 2.53k/2.53k [00:00<00:00, 8.71MB/s]
Downloading readme: 100%|██████████| 6.84k/6.84k [00:00<00:00, 12.7MB/s]
Downloading data: 47.5MB [00:03, 12.6MB/s]
Traceback (most recent call last):
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connection.py", line 653, in connect
sock_and_verified = _ssl_wrap_socket_and_match_hostname(
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connection.py", line 806, in ssl_wrap_socket_and_match_hostname
ssl_sock = ssl_wrap_socket(
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/util/ssl.py", line 465, in ssl_wrap_socket
ssl_sock = ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/util/ssl.py", line 509, in _ssl_wrap_socket_impl
return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/ssl.py", line 513, in wrap_socket
return self.sslsocket_class._create(
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/ssl.py", line 1104, in _create
self.do_handshake()
File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/ssl.py", line 1375, in do_handshake
self._sslobj.do_handshake()
ssl.SSLEOFError: [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connectionpool.py", line 793, in urlopen response = self._make_request( File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connectionpool.py", line 491, in _make_request raise new_e urllib3.exceptions.SSLError: [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)
The above exception was the direct cause of the following exception:
Traceback (most recent call last): File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/requests/adapters.py", line 486, in send resp = conn.urlopen( File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/connectionpool.py", line 847, in urlopen retries = retries.increment( File "/home/sam/anaconda3/envs/omniquant/lib/python3.10/site-packages/urllib3/util/retry.py", line 515, in increment raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type] urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /rowanz/hellaswag/master/data/hellaswag_test.jsonl (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)')))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/sam/Doctorproject/OmniQuant-main/main.py", line 384, in
