mountpoint-s3 icon indicating copy to clipboard operation
mountpoint-s3 copied to clipboard

Duplication of file and directory of same name in S3 Express Zone One bucket using Mountpoint

Open sauraank opened this issue 1 year ago • 0 comments

Mountpoint for Amazon S3 version

mount-s3 v1.3.2

AWS Region

us-east-1

Describe the running environment

Running in EC2 on Ubuntu 22.04 using instance profile credentials against an S3 Bucket in the same account.

Mountpoint options

mount-s3 <BUCKET_NAME--use1-az4--x-s3> mnt/ --allow-delete --foreground --region us-east-1 --debug

What happened?

I have a file and directory of same name(out) in S3 Express One Zone bucket as follows -

  • out/shadow_file.txt
  • out When I mount the bucket on mnt/ directory using Mountpoint, I get duplicate entries of out as follows:
~$ ls mnt/
out  out

When I try to access out, it only refer to the directory:

~/mnt$ cat out
cat: out: Is a directory

Relevant log output

2024-02-01T15:00:51.103143Z DEBUG readdirplus{req=20 ino=1 fh=2 offset=0}:list_objects{id=2 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1000" prefix=""}: mountpoint_s3_client::s3_crt_client::list_objects: new request
2024-02-01T15:00:51.385022Z DEBUG readdirplus{req=20 ino=1 fh=2 offset=0}:list_objects{id=2 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1000" prefix=""}: mountpoint_s3_client::s3_crt_client: CRT request finished request_type=Default crt_error=None http_status=200 range=None duration=281.374033ms ttfb=Some(140.112969ms) request_id=019c6216f800018d652fda11040719844ed0b2da
2024-02-01T15:00:51.385220Z DEBUG readdirplus{req=20 ino=1 fh=2 offset=0}:list_objects{id=2 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1000" prefix=""}: mountpoint_s3_client::s3_crt_client: meta request finished duration=281.774746ms
2024-02-01T15:00:51.385491Z DEBUG readdirplus{req=20 ino=1 fh=2 offset=0}: mountpoint_s3::inode: inode needs to be recreated parent=1 name="out" ino=3
2024-02-01T15:00:51.385542Z DEBUG readdirplus{req=20 ino=1 fh=2 offset=0}: mountpoint_s3::inode: inode needs to be recreated parent=1 name="out" ino=4
2024-02-01T15:00:51.385692Z DEBUG fuser::request: FUSE( 22) ino 0x0000000000000000 BATCHFORGET nodes [fuse_forget_one { nodeid: 3, nlookup: 1 }, fuse_forget_one { nodeid: 4, nlookup: 1 }]
2024-02-01T15:00:51.385716Z DEBUG fuser::request: FUSE( 24) ino 0x0000000000000001 READDIRPLUS fh FileHandle(2), offset 4, size 4096
2024-02-01T15:00:51.385857Z DEBUG fuser::request: FUSE( 26) ino 0x0000000000000001 RELEASEDIR fh FileHandle(2), flags 0x18800, flush false, lock owner None
2024-02-01T15:00:51.386715Z DEBUG fuser::request: FUSE( 28) ino 0x0000000000000001 GETATTR
2024-02-01T15:00:52.168796Z DEBUG fuser::request: FUSE( 30) ino 0x0000000000000001 LOOKUP name "out"
2024-02-01T15:00:52.170996Z DEBUG lookup{req=30 ino=1 name="out"}:head_object{id=3 bucket="BUCKET_NAME--use1-az4--x-s3" key="out"}: mountpoint_s3_client::s3_crt_client::head_object: new request
2024-02-01T15:00:52.173382Z DEBUG lookup{req=30 ino=1 name="out"}:list_objects{id=4 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1" prefix="out/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request
2024-02-01T15:00:52.457915Z DEBUG lookup{req=30 ino=1 name="out"}:head_object{id=3 bucket="BUCKET_NAME--use1-az4--x-s3" key="out"}: mountpoint_s3_client::s3_crt_client: CRT request finished request_type=Default crt_error=None http_status=200 range=None duration=286.566598ms ttfb=Some(145.861428ms) request_id=0141d2d4b400018d652fde3c0407ab9d29340b3a
2024-02-01T15:00:52.458136Z DEBUG lookup{req=30 ino=1 name="out"}:head_object{id=3 bucket="BUCKET_NAME--use1-az4--x-s3" key="out"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=287.019146ms
2024-02-01T15:00:52.459574Z DEBUG lookup{req=30 ino=1 name="out"}:list_objects{id=4 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1" prefix="out/"}: mountpoint_s3_client::s3_crt_client: CRT request finished request_type=Default crt_error=None http_status=200 range=None duration=285.961344ms ttfb=Some(145.328339ms) request_id=01b8e1f36200018d652fde3f0407b69feab40c0c
2024-02-01T15:00:52.459757Z DEBUG lookup{req=30 ino=1 name="out"}:list_objects{id=4 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1" prefix="out/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=286.288075ms
2024-02-01T15:00:52.460464Z DEBUG lookup{req=30 ino=1 name="out"}: mountpoint_s3::inode: inode needs to be recreated parent=1 name="out" ino=5
2024-02-01T15:00:52.460632Z DEBUG fuser::request: FUSE( 32) ino 0x0000000000000001 LOOKUP name "out"
2024-02-01T15:00:52.460656Z DEBUG fuser::request: FUSE( 34) ino 0x0000000000000000 BATCHFORGET nodes [fuse_forget_one { nodeid: 6, nlookup: 1 }, fuse_forget_one { nodeid: 5, nlookup: 1 }]
2024-02-01T15:00:52.462748Z DEBUG lookup{req=32 ino=1 name="out"}:head_object{id=5 bucket="BUCKET_NAME--use1-az4--x-s3" key="out"}: mountpoint_s3_client::s3_crt_client::head_object: new request
2024-02-01T15:00:52.465065Z DEBUG lookup{req=32 ino=1 name="out"}:list_objects{id=6 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1" prefix="out/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request
2024-02-01T15:00:52.744961Z DEBUG lookup{req=32 ino=1 name="out"}:head_object{id=5 bucket="BUCKET_NAME--use1-az4--x-s3" key="out"}: mountpoint_s3_client::s3_crt_client: CRT request finished request_type=Default crt_error=None http_status=200 range=None duration=281.912613ms ttfb=Some(141.511046ms) request_id=01868f955400018d652fdf6004079796d36ffe07
2024-02-01T15:00:52.745125Z DEBUG lookup{req=32 ino=1 name="out"}:head_object{id=5 bucket="BUCKET_NAME--use1-az4--x-s3" key="out"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=282.30472ms
2024-02-01T15:00:52.748984Z DEBUG lookup{req=32 ino=1 name="out"}:list_objects{id=6 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1" prefix="out/"}: mountpoint_s3_client::s3_crt_client: CRT request finished request_type=Default crt_error=None http_status=200 range=None duration=283.679608ms ttfb=Some(142.896249ms) request_id=014ea8bb4300018d652fdf6304070e9aec8a7200
2024-02-01T15:00:52.749103Z DEBUG lookup{req=32 ino=1 name="out"}:list_objects{id=6 bucket="BUCKET_NAME--use1-az4--x-s3" continued=false delimiter="/" max_keys="1" prefix="out/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=283.97957ms
2024-02-01T15:00:52.749905Z DEBUG fuser::request: FUSE( 36) ino 0x0000000000000007 OPENDIR flags 0x8000
2024-02-01T15:00:52.750251Z DEBUG fuser::request: FUSE( 38) ino 0x0000000000000007 RELEASEDIR fh FileHandle(3), flags 0x8000, flush false, lock owner None

sauraank avatar Feb 01 '24 15:02 sauraank