sign-language-processing
dgs_corpus/holistic: 403 forbidden on file
After getting #90 , I tried "dgs_corpus/holistic" instead to at least get the poses, and got a 403 error on a specific file, https://firebasestorage.googleapis.com/v0/b/sign-language-datasets/o/poses%2Fholistic%2Fdgs_c orpus%2F1176340_a.pose?alt=media
Full traceback:
l Size...: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████| 520043792/520043792 [00:30<00:00, 17078592.30 MiB/s]
Dl Completed...: 68%|███████████████████████████████████████████████████████████████████████████▊ | 1536/2250 [00:30<00:14, 50.44 url/s]
Traceback (most recent call last):
File "sldata_download.py", line 20, in <module>
dataset = tfds.load(name=str(args.dataset_name), data_dir=args.data_dir)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/logging/__init__.py", line 166, in __call__
return function(*args, **kwargs)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 639, in load
_download_and_prepare_builder(dbuilder, download, download_and_prepare_kwargs)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 498, in _download_and_prepare_builder
dbuilder.download_and_prepare(**download_and_prepare_kwargs)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/logging/__init__.py", line 166, in __call__
return function(*args, **kwargs)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/dataset_builder.py", line 691, in download_and_prepare
self._download_and_prepare(
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/dataset_builder.py", line 1546, in _download_and_prepare
split_generators = self._split_generators( # pylint: disable=unexpected-keyword-arg
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/sign_language_datasets/datasets/dgs_corpus/dgs_corpus.py", line 310, in _split_generators
local_paths = dl_manager.download(urls)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/download/download_manager.py", line 601, in download
return _map_promise(self._download, url_or_urls)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/download/download_manager.py", line 831, in _map_promise
res = tree_utils.map_structure(
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tree/__init__.py", line 435, in map_structure
[func(*args) for args in zip(*map(flatten, structures))])
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tree/__init__.py", line 435, in <listcomp>
[func(*args) for args in zip(*map(flatten, structures))])
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/download/download_manager.py", line 832, in <lambda>
lambda p: p.get(), all_promises
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/promise/promise.py", line 512, in get
return self._target_settled_value(_raise=True)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/promise/promise.py", line 516, in _target_settled_value
return self._target()._settled_value(_raise)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/promise/promise.py", line 226, in _settled_value
reraise(type(raise_val), raise_val, self._traceback)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/six.py", line 724, in reraise
raise value
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/promise/promise.py", line 844, in handle_future_result
resolve(future.result())
File "/opt/conda/envs/sldata/lib/python3.8/concurrent/futures/_base.py", line 437, in result
return self.__get_result()
File "/opt/conda/envs/sldata/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/opt/conda/envs/sldata/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/download/downloader.py", line 230, in _sync_download
with _open_url(url, verify=verify) as (response, iter_content):
File "/opt/conda/envs/sldata/lib/python3.8/contextlib.py", line 113, in __enter__
return next(self.gen)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/download/downloader.py", line 303, in _open_with_requests
_assert_status(response)
File "/opt/conda/envs/sldata/lib/python3.8/site-packages/tensorflow_datasets/core/download/downloader.py", line 330, in _assert_status
raise DownloadError(
tensorflow_datasets.core.download.downloader.DownloadError: Failed to get url https://firebasestorage.googleapis.com/v0/b/sign-language-datasets/o/poses%2Fholistic%2Fdgs_c
orpus%2F1176340_a.pose?alt=media. HTTP code: 403.
There was an update to store the data on R2:
https://github.com/sign-language-processing/datasets/commit/376a09582089a60866ab01763e7a7e778884a4a0
So not sure why it is trying firebasestorage
Ah, it's the pip version, I think
On Thu, Mar 13, 2025 at 9:44 AM Amit Moryossef @.***> wrote:
There was an update to store the data on R2: 376a095 https://github.com/sign-language-processing/datasets/commit/376a09582089a60866ab01763e7a7e778884a4a0 So not sure why it is trying firebasestorage
— Reply to this email directly, view it on GitHub https://github.com/sign-language-processing/datasets/issues/91#issuecomment-2721311036, or unsubscribe https://github.com/notifications/unsubscribe-auth/A5FSTNPIHZWSMN6DYYMRGY32UGDSBAVCNFSM6AAAAABY32DSGOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMRRGMYTCMBTGY . You are receiving this because you authored the thread.Message ID: @.***> [image: AmitMY]AmitMY left a comment (sign-language-processing/datasets#91) https://github.com/sign-language-processing/datasets/issues/91#issuecomment-2721311036
There was an update to store the data on R2: 376a095 https://github.com/sign-language-processing/datasets/commit/376a09582089a60866ab01763e7a7e778884a4a0 So not sure why it is trying firebasestorage
— Reply to this email directly, view it on GitHub https://github.com/sign-language-processing/datasets/issues/91#issuecomment-2721311036, or unsubscribe https://github.com/notifications/unsubscribe-auth/A5FSTNPIHZWSMN6DYYMRGY32UGDSBAVCNFSM6AAAAABY32DSGOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMRRGMYTCMBTGY . You are receiving this because you authored the thread.Message ID: @.***>