s3fs icon indicating copy to clipboard operation
s3fs copied to clipboard

Issues with s3fs and "/" prefix

Open holtgrewe opened this issue 6 years ago • 0 comments

It looks like s3fs has issues with S3 and the latest pyfilesystem2? Maybe it's the prefix?

>>> from fs_s3fs import S3FS 
>>> fs = S3FS('my-bucket', aws_access_key_id="XXX", aws_secret_access_key="YYY")                                                                                               
>>>  fs.tree()                                                                                                                                                                                                                           
└── 89cf0ccb-a492-4495-9022-e53dc2ed1461
    └── error (resource '/89cf0ccb-a492-4495-9022-e53dc2ed1461' not found)
>>> import boto3
>>> s3 = boto3.resource('s3', aws_access_key_id="XXX", aws_secret_access_key="YYY") 
>>> my_bucket = s3.Bucket('my-bucket')
>>> list(my_bucket.objects.all())                                                                                                                                                                                                       
[s3.ObjectSummary(bucket_name='my-bucket' key='89cf0ccb-a492-4495-9022-e53dc2ed1461/about.md'),
 s3.ObjectSummary(bucket_name='my-bucket', key='89cf0ccb-a492-4495-9022-e53dc2ed1461/data.h5ad'),
 s3.ObjectSummary(bucket_name='my-bucket', key='89cf0ccb-a492-4495-9022-e53dc2ed1461/markers.csv')]

holtgrewe avatar Jun 20 '19 11:06 holtgrewe