ocis icon indicating copy to clipboard operation
ocis copied to clipboard

[Draft] Expose posix fs settings

Open aduffeck opened this issue 1 year ago • 3 comments

ocis companion PR for https://github.com/cs3org/reva/pull/4562

Example settings for gpfs with the gpfswatchfolder watcher:

"STORAGE_USERS_DRIVER": "posix",
"STORAGE_USERS_POSIX_ROOT": "/ibm/fs1/storage-users",
"STORAGE_USERS_POSIX_WATCH_TYPE": "gpfswatchfolder",
"STORAGE_USERS_POSIX_WATCH_PATH": "fs1_audit", // the kafka topic to watch
"STORAGE_USERS_POSIX_WATCH_FOLDER_KAFKA_BROKERS": "192.168.1.180:29092",
"STORAGE_USERS_ID_CACHE_STORE": "redis",
"STORAGE_USERS_ID_CACHE_STORE_NODES": "127.0.0.1:6379",

aduffeck avatar Mar 06 '24 15:03 aduffeck

Thanks for opening this pull request! The maintainers of this repository would appreciate it if you would create a changelog item based on your changes.

update-docs[bot] avatar Mar 06 '24 15:03 update-docs[bot]

Using

"STORAGE_USERS_DRIVER": "posix",
"STORAGE_USERS_POSIX_ROOT": "/home/jfd/ocis-posix",

on first login I get an error in the log

2024-05-29T11:19:24+02:00 ERR failed to list storage spaces error="error reading user index: stat /home/jfd/ocis-posix/indexes/by-user-id/some-admin-user-id-0000-000000000000.mpk: no such file or directory" filters=[{"Term":{"SpaceType":"project"},"type":4},{"Term":{"User":{"idp":"https://cloud.ocis.test","opaque_id":"some-admin-user-id-0000-000000000000"}},"type":6}] line=/home/jfd/Repositories/reva/internal/grpc/services/storageprovider/storageprovider.go:575 pkg=rgrpc service=storage-users status={"code":15,"message":"error listing spaces","trace":"10838818faa9f6ef276aeed0574143eb"} traceid=10838818faa9f6ef276aeed0574143eb

and I do not get a space in the web ui

butonic avatar May 29 '24 09:05 butonic

was fixed by enabling redis with

					"STORAGE_USERS_ID_CACHE_STORE": "redis",
					"STORAGE_USERS_ID_CACHE_STORE_NODES": "127.0.0.1:6379",

butonic avatar May 29 '24 10:05 butonic

When creating files and directories via cli they would get assimilated, but the browser listing would not change when reloading the page. The cause was that the web ui somehow was using old spaceids ... cached somewhere. when cutting everything but the domain web would pick up the new personal spaceid and new files would show up properly.

butonic avatar May 29 '24 10:05 butonic

ok, only issues I am aware of:

  • [ ] nats-js-kv does not seem to work, fine for now
    			//"STORAGE_USERS_ID_CACHE_STORE": "nats-js-kv",
    			//"STORAGE_USERS_ID_CACHE_STORE_NODES": "127.0.0.1:9233",
    
  • [ ] weird web ui caching where it remembers the old personal spaceid from a session with ocis using default decomposedfs where the userid will become the personal spaceid.
  • [ ] it seems two inotifywait processes are started ... one for the dataprovider and on for the storageprovider?
  • on arch inotify-tools must be installed for the default STORAGE_USERS_POSIX_WATCH_TYPE=inotifywait

butonic avatar May 29 '24 10:05 butonic

Has this currently be added to a release? I do not see mention in the changelogs.

johnmmcgee avatar Oct 04 '24 21:10 johnmmcgee