gcsfs
gcsfs copied to clipboard
fsspec
Pythonic file-system interface for Google Cloud Storage
Reading gzipped file using transcoding works when you use the `fs.open`, but not when using `fs.cat_file`. Here is and example uploading 2 files, 1 plaintext, 1 gzipped, and both files...
Google requires `#` to remain unescaped in the URL, but `aiohttp` considers it the start of the fragment and strips it out.
I tried to use browser authorization but kept getting the `401`. ```python from gcsfs import GCSFileSystem fs = GCSFileSystem(token="browser") ``` system or package info: - macOS: 13.0.1 - Python: `3.8.13`...
When using `gcsfs` with the latest version of `google-auth-oauthlib`, i run into this error. ```python In [1]: import gcsfs ``` ```python-traceback --------------------------------------------------------------------------- ImportError Traceback (most recent call last) Cell In...
Does this library use the `GOOGLE_APPLICATION_CREDENTIALS` env var? I set that value to the path of my `application_default_credentials.json` and have `GCSFileSystem(project=MY_PROJECT)`, but I get the error `gcsfs.retry.HttpError: Anonymous caller does...
I would like to connect to a bucket on google cloud storage using `gcsfs`. So far I have only been using the native `google.cloud` module but it turns out I...
Our workflows using gcsfs==2022.7.1 are seeing a new error connecting from google cloud environments ``` File "/usr/local/lib/python3.8/site-packages/gcsfs/core.py", line 280, in __init__ self.credentials = GoogleCredentials(project, access, token) File "/usr/local/lib/python3.8/site-packages/gcsfs/credentials.py", line 51,...
Hi, I am trying to train a PyTorch model on GCP and I am reading a csv file from a cloud storage bucket in the mean time. I get the...
I'm following this example to raise multiple exceptions, with the intention that this will help me better debug a GCS error: https://stackoverflow.com/a/50414672.
I create a folder in a bucket "/my-bucket/folder/" which contains some text files. I then run `fs.rename("/my-bucket/folder/", "/my-bucket/new_folder", recursive=True)` Instead of seeing "/my-bucket/new_folder", I see "/my-bucket/new_foldermy-bucket/folder" That doesn't seem correct....
