IT is very difficult for Chinese researchers download ego4d-data

command line: python -m ego4d.cli.cli --yes --datasets clips --benchmarks FHO --metadata --output_directory ~/ego4d_data/ when I run this command,I met this problem(showing in figures)

I meet the same problem, it is really hard to download this dataset in china. Did you find a way to solve it ? @lihuinian

Try proxychain if you can find a good proxy.

I meet the same problem, it is really hard to download this dataset in china. Did you find a way to solve it ? @lihuinian

any solution about this? @NNNNAI

I meet the same problem, it is really hard to download this dataset in china. Did you find a way to solve it ? @lihuinian

Me too! Did you find any solution? @NNNNAI @lihuinian

Hey folks, thanks for your patience. Ego4D should now be fully accessible from China without VPN. We've moved some files around, made updates to the CLI to make downloads more reliable, and tested the fixes with a few researchers in China.

Please make sure you're on the latest version of the CLI by running pip install --upgrade ego4d before downloading, and feel free to comment or open new issues if you have any problems!

您好，已收到您的邮件，我会尽快处理。（I have received your e-mail. Thank you!）

@devanshk Hi, I try to download Ego4D dataset with latest version CLI but the download process is quite unstable. Frequently (4 out of 5), I got error below and the download will be interrupted

...  

ConnectionResetError: [Errno 104] Connection reset by peer   
During handling of the above exception, another exception occurred:   
...  
botocore.exceptions.ConnectionClosedError: Connection was closed before we received a valid response from endpoint URL: "https://ego4d-iiith.s3.ap-south-1.amazonaws.com/"

I meet the same problem. It seems if I enable proxy, I cannot pass SSL verification. If I disable proxy, then I meet the "botocore.exceptions.ConnectionClosedError: Connection was closed before we received a valid response from endpoint URL: 'https://ego4d-iiith.s3.ap-south-1.amazonaws.com/'". Chinese researchers are so tough. Have you found any ways to tackle this problem? If so, can you do me a favour by giving me some suggestions? Thanks!

您好，已收到您的邮件，我会尽快处理。（I have received your e-mail. Thank you!）

same problem with @MiraclesinWang, any solution please?

Well, after several days' debugging, I think I have found the problem. Servers in the region 'ap-south-1' seem to block China's IPs. That's why when you try to download any file on those servers, you will receive

botocore.exceptions.ConnectionClosedError: Connection was closed before we received a valid response from endpoint URL: "https://ego4d-iiith.s3.ap-south-1.amazonaws.com/"

The solution is to use VPN, clash-linux as an example, to modify your IP and pass the verification of servers in the region 'ap-south-1', then you can download files. I have succeeded, may this solution work for others. Finally, I have to agree with this post's title, 'It is very difficult for Chinese researchers'. BTW, if possible, can you help move the files on servers in the region 'ap-south-1' to other regions' servers? If so, Chinese researchers will face fewer problems. Thanks a lot. @devanshk

Thanks for your reply. I have installed the clash-linux as you recommended. Could you tell me how to modify the IP to pass the verification? Many thanks anyway. @MiraclesinWang

Thanks for your reply. I have installed the clash-linux as you recommended. Could you tell me how to modify the IP to pass the verification? Many thanks anyway. @MiraclesinWang

Actually, clash-linux is like a plane. You also need a ticket before you can fly anywhere. You need to buy VPN service in China, then you can ask the service provider for config.yaml (your ticket). After adding the config.yaml to your clash-linux setting, you can use the VPN as your proxy, with which you can confuse the servers in the region 'ap-south-1' about your ip.

Hi, bro, i use the shadowsocks in Clash-linux, but i have to face a new issues: limited network flow：100G per month. Do you meet this problem? how to solve it? Thanks a lot!!!(The dataset almost 7 TB, limited flow cannot download completely.)

I meet the same problem. It seems if I enable proxy, I cannot pass SSL verification. If I disable proxy, then I meet the "botocore.exceptions.ConnectionClosedError: Connection was closed before we received a valid response from endpoint URL: 'https://ego4d-iiith.s3.ap-south-1.amazonaws.com/'". Chinese researchers are so tough. Have you found any ways to tackle this problem? If so, can you do me a favour by giving me some suggestions? Thanks!

方便加您微信吗？想咨询一下解决方式，我目前在国内，也遇到这个问题，开启VPN有流量限制，无法完整下载某些任务的数据集，我的联系方式：微信：CYFNUCBJTUDUT