Can read, delete, but not write?

[mrAceT]

I am testing with AWS S3 and have a test-mount working with s3fs and with goofys.

The S3 provider I have selected also provides a "fast S3 solution", so I thought "lets have a go".. I now have that working on s3fs, but goofys has an odd problem, I can read the primary folder, read files in that folder and delete them. But I can not see sub folders, nor can I add files.

After finishing this text I refreshed the "goofys folder" and now the created test folder did appear, including it's content. I can also read that and delete it, but still I can not upload anywhere. Somehow this is delayed?

Overwriting the file with the same content does go well though, but overwriting with other content in it fails.

in my /var/log/messages: May 20 15:18:53 v01 /root/gocode/bin/goofys[1554426]: fuse.ERROR *fuseops.FlushFileOp error: invalid argument May 20 15:18:57 v01 /root/gocode/bin/goofys[1554426]: fuse.ERROR *fuseops.GetInodeAttributesOp error: no such file or directory May 20 15:19:00 v01 /root/gocode/bin/goofys[1554426]: fuse.ERROR *fuseops.GetInodeAttributesOp error: no such file or directory May 20 15:19:03 v01 /root/gocode/bin/goofys[1554426]: fuse.ERROR *fuseops.GetInodeAttributesOp error: no such file or directory

my FTP client gives a fail with error code 550 "could not get file size"

This is how I mounted the disk via the command line (the passwords etc. must be right.. since I do see something!?)

goofys --profile default -o allow_other --dir-mode 0777 --file-mode 0644 --debug_fuse --debug_s3 --uid [number] --gid [number] --endpoint https://s3.[url] [bucket name] /var/[folder]

[mrAceT]

No one has an idea?

[dannycjones]

I refreshed the "goofys folder" and now the created test folder did appear, including it's content. I can also read that and delete it, but still I can not upload anywhere.

Is this using the FTP client?

I now have that working on s3fs, but goofys has an odd problem, I can read the primary folder, read files in that folder and delete them. But I can not see sub folders, nor can I add files.

One difference between s3fs and goofys is that s3fs allows random write. I'm wondering if your FTP server is attempting to make random / non-sequential writes to the goofys file system - in this case, I think you would see errors for an unsupported operation.

[mrAceT]

Is this using the FTP client?

yes

... your FTP server ...

It worked fine with that standard S3 solution?

[dannycjones]

It worked fine with that standard S3 solution?

If I understand correctly, you're saying there's no issue if using Amazon S3 but using an S3-compatible object store has issues?

I see you have --debug_s3 as a flag - do you have more detailed logs from /var/log/messages?

[mrAceT]

If I understand correctly, you're saying there's no issue if using Amazon S3 but using an S3-compatible object store has issues?

Exactly

I see you have --debug_s3 as a flag - do you have more detailed logs from /var/log/messages?

Sorry, what I posted at the top is the only thing I see in the logs regarding the problem

[monthonk]

It's possible that this object store does not have read-after-write consistency.

Have you try uploading a file directly to this object store (not using goofys) and get the file immediately after that? if you don't see the new file then this probably be something out of goofys scope.

[mrAceT]

@monthonk,

Thank you for the suggestion, I'll ask the "object store provider"

[samyswam]

I am still getting this error even with write permission not able to write, it may be due to random write how to pass that state i want random write