Calling csghub-sdk's upload_file cannot upload large files (all display success, small files can be uploaded normally)
Describe the bug Calling csghub-sdk's upload_file cannot upload large files (all display success, small files can be uploaded normally)
Environment CSGHub Version: v1.7.0 OS: Linux Hardware: 32c128G Launch: docker compose
To Reproduce Steps to reproduce the behavior:
- Go to csghub-docker-compose/csghub
- sudo ./configure (with CSGHUB_WITH_K8S=0)
- Go to csghub-sdk/
- python examples/upload_file_local.py file './test.mp4' upload successfully. it show successfully,but it didn't actually work.
the code is shown below: from pycsghub.file_upload import http_upload_file token = "1a1faxxxxxxxxxd3eebfca17b3b" endpoint = "http://csghub.example.com" repo_id = "root/test_m01" repo_type = "model" file_path = "./test.mp4" result = http_upload_file(repo_id, endpoint=endpoint, token=token, repo_type='model', file_path=file_path)
If you use the official address(endpoint = "https://hub.opencsg.com"), it will work.
Propose use the following way to upload large files in folder.
# upload local large folder '/Users/hhwang/temp/abc' to model repo 'wanghh2000/model05'
csghub-cli upload-large-folder wanghh2000/model05 /Users/hhwang/temp/abc
It also support local deployment with parameter -e
# upload local large folder '/Users/hhwang/temp/abc' to model repo 'wanghh2000/model05' to local csghub
csghub-cli upload-large-folder wanghh2000/model05 /Users/hhwang/temp/abc -e http://csghub.example.com -k my_token
Please use csghub 1.8.0 for csghub-cli upload-large-folder
Please update docker-compose.yml as following if you run csghub-cli on another hosts.
Update server.s3.endpoint to <server_ip>:9000 and make sure connect to <server_ip>:9000 successfully from client.
@Nikola-JK Have you tried newer verison, like v1.8.0, v1.9.0 (the latest)?
根据检索到的内容,我无法回答您的问题。检索到的文档主要涉及开源行为准则和StarShip版本的更新说明,没有包含关于项目维护状态、运营重点或相关账号活动的信息。
您可以在 https://opencsg.com/docs 查找更多信息,如有技术问题,技术支持团队将会介入处理。