modelscope icon indicating copy to clipboard operation
modelscope copied to clipboard

integrity check failed, the download may be incomplete, please try again

Open aisensiy opened this issue 1 year ago • 3 comments

Thanks for your error report and we appreciate it a lot.

Describe the bug

Downloading big file failed all the time.

from modelscope import snapshot_download
   ...: model_dir = snapshot_download('qwen/Qwen1.5-72B-Chat-GGUF', cache_dir='.', ignore_file_pattern='q2_k.gguf')
2024-02-10 09:58:06,095 - modelscope - WARNING - Authentication has expired, please re-login if you need to access private models or datasets.
Downloading: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▉| 23.9G/23.9G [07:09<00:00, 59.7MB/s]
2024-02-10 10:05:42,800 - modelscope - ERROR - File ./temp/tmpyhge8o3g/qwen1.5-72b-chat-q5_k_m.gguf.a integrity check failed, the download may be incomplete, please try again.
---------------------------------------------------------------------------
FileIntegrityError                        Traceback (most recent call last)
<ipython-input-3-aa0f52d914d7> in <module>
      1 #模型下载
      2 from modelscope import snapshot_download
----> 3 model_dir = snapshot_download('qwen/Qwen1.5-72B-Chat-GGUF', cache_dir='.', ignore_file_pattern='q2_k.gguf')

~/miniconda3/lib/python3.8/site-packages/modelscope/hub/snapshot_download.py in snapshot_download(model_id, revision, cache_dir, user_agent, local_files_only, cookies, ignore_file_pattern)
    183                 temp_file = os.path.join(temp_cache_dir, model_file['Name'])
    184                 if FILE_HASH in model_file:
--> 185                     file_integrity_validation(temp_file, model_file[FILE_HASH])
    186                 # put file into to cache
    187                 cache.put_file(model_file, temp_file)

~/miniconda3/lib/python3.8/site-packages/modelscope/hub/utils/utils.py in file_integrity_validation(file_path, expected_sha256)
     92         msg = 'File %s integrity check failed, the download may be incomplete, please try again.' % file_path
     93         logger.error(msg)
---> 94         raise FileIntegrityError(msg)

FileIntegrityError: File ./temp/tmpyhge8o3g/qwen1.5-72b-chat-q5_k_m.gguf.a integrity check failed, the download may be incomplete, please try again.

To Reproduce

  • What command or script did you run?
#模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('qwen/Qwen1.5-72B-Chat-GGUF')
  • Did you make any modifications on the code or config? Did you understand what you have modified?

Noop.

  • What dataset did you use?

https://modelscope.cn/models/qwen/Qwen1.5-72B-Chat-GGUF/files

Your Environments (required)

  • OS: uname -a
Darwin 23.1.0 Darwin Kernel Version 23.1.0: Mon Oct  9 21:27:24 PDT 2023; root:xnu-10002.41.9~6/RELEASE_ARM64_T6000 arm64
  • CPU: lscpu
Mac M1 Max
  • Commit id (e.g. a3ffc7d8)
1.12.0
  • You may add addition that may be helpful for locating the problem, such as
    • How you installed PyTorch [e.g., pip, conda, source]
    • Other environment variables that may be related (such as $PATH, $LD_LIBRARY_PATH, $PYTHONPATH, etc.)

Model hub related: @liuyhwangyh

aisensiy avatar Feb 10 '24 02:02 aisensiy

You can also download model files from the model card

slin000111 avatar Feb 22 '24 08:02 slin000111

这个没有好的解决办法吗?

fangxin2github avatar Apr 08 '24 14:04 fangxin2github

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar May 22 '24 01:05 github-actions[bot]

This issue was closed because it has been stalled for 5 days with no activity.

github-actions[bot] avatar May 27 '24 01:05 github-actions[bot]

这个问题有解决办法了吗?

verigle avatar Aug 24 '24 03:08 verigle

@verigle 我这里版本降级成1.12.0 可以了

ShomyLiu avatar Aug 28 '24 03:08 ShomyLiu

@verigle 我这里版本降级成1.12.0 可以了 请问是什么库要降级?

wangxihao avatar Aug 30 '24 12:08 wangxihao

这个问题应该和库的版本没有什么关联。把报错信息里提示的临时文件删掉重试一下。

yingdachen avatar Aug 31 '24 08:08 yingdachen

这个问题应该和库的版本没有什么关联。把报错信息里提示的临时文件删掉重试一下。

删除临时文件再次尝试还是这个问题。

wangxihao avatar Sep 02 '24 06:09 wangxihao