modelscope icon indicating copy to clipboard operation
modelscope copied to clipboard

modelscope upload 报错 requests.exceptions.JSONDecodeError

Open mengcius opened this issue 11 months ago • 1 comments

上传几千个数据(tar, json)时报错:

modelscope upload user/data /path/to/your_folder --repo-type dataset

Processing 8854 items: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8.65k/8.65k [10:50<00:00, 13.6it/s] Committing folder to user/data ... Traceback (most recent call last): File "/mnt/train_data/.../miniconda3/envs/.../lib/python3.8/site-packages/requests/models.py", line 974, in json return complexjson.loads(self.text, **kwargs) File "/mnt/train_data/../miniconda3/envs/.../lib/python3.8/json/init.py", line 357, in loads return _default_decoder.decode(s) File "/mnt/train_data/../miniconda3/envs/.../lib/python3.8/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/mnt/train_data/.../miniconda3/envs/../lib/python3.8/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/mnt/train_data/.../miniconda3/envs/.../bin/modelscope", line 8, in sys.exit(run_cmd()) File "/mnt/train_data/..../miniconda3/envs/.../lib/python3.8/site-packages/modelscope/cli/cli.py", line 44, in run_cmd cmd.execute() File "/mnt/train_data/..../miniconda3/envs/.../lib/python3.8/site-packages/modelscope/cli/upload.py", line 165, in execute api.upload_folder( File "/mnt/train_data/.../miniconda3/envs/.../lib/python3.8/site-packages/modelscope/hub/api.py", line 1744, in upload_folder commit_info: CommitInfo = self.create_commit( File "/mnt/train_data/.../miniconda3/envs/.../lib/python3.8/site-packages/modelscope/hub/api.py", line 1536, in create_commit resp = response.json() File "/mnt/train_data/.../miniconda3/envs/.../lib/python3.8/site-packages/requests/models.py", line 978, in json raise RequestsJSONDecodeError(e.msg, e.doc, e.pos) requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Dataset releated: @wangxingjun778

mengcius avatar Apr 23 '25 04:04 mengcius

modelscope/hub/api.py create_commit()

response = requests.post( url, headers=self.builder_headers(self.headers), data=json.dumps(payload), cookies=cookies ) print('response', response) print('response.text', response.text)

response <Response [504]>

response.text <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr/>Powered by Tengine<hr><center>nginx</center>
</body>
</html>

mengcius avatar Apr 23 '25 04:04 mengcius

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar May 24 '25 02:05 github-actions[bot]

This issue was closed because it has been stalled for 5 days with no activity.

github-actions[bot] avatar May 29 '25 02:05 github-actions[bot]