nkurn

has anyone seen this problem? thanks.

Hi This is the command I used hdfs dfs -mkdir cos://hdfsVault.applogs/1/ 2021-03-26 17:00:29,873 INFO fs.ObjectStoreVisitor: Stocator registered as cos for cos://hdfsVault.applogs/1 2021-03-26 17:00:29,885 INFO cos.COSAPIClient: Init : cos://hdfsVault.applogs/1 2021-03-26 17:00:31,073...

Hi @mrmadira Yes I am using IBM COS OS ----- NAME="Ubuntu" VERSION="16.04.3 LTS (Xenial Xerus)" ID=ubuntu ID_LIKE=debian hadoop ------- Hadoop 3.2.2 stocator -------- stocator-1.1.4 did you see the core-site.xml I...

hdfs dfs -ls hdfs dfs -cp and other operations work fine.

Hi, can you guys please let us know if we are missing any configuration ? why is stocator checking for file status ": file status 1 returned 404" when creating...

Also, mkdir is working inside the spark-shell scala> val statuses = fs.mkdirs(new Path(s"cos://TestVault1.mycos/d6")) statuses: Boolean = true it is failing only when I use the shell command, do you think...

hdfs dfs -mkdir cos://TestVault1.mycos/d7 2021-06-02 00:07:58,829 INFO fs.ObjectStoreVisitor: Stocator registered as cos for cos://TestVault1.mycos/d7 2021-06-02 00:07:58,840 INFO cos.COSAPIClient: Init : cos://TestVault1.mycos/d7 2021-06-02 00:07:59,855 WARN cos.COSAPIClient: file status d7 returned 404...

HADOOP_CLASSPATH=/src/hadoop-release/lib/*:/src/hadoop-release/etc/hadoop/conf/*:/src/hadoop-release/etc/hadoop/*:/src/hadoop-release/share/hadoop/tools/lib/*

I am the root user when I run the shell FS commands, does it matter which user runs hdfs mkdir commands?

on the spark-shell using fs.mkdirs call the accesser is getting the put request and is succeeding {"server_name":"xxxx","remote_address":"xxxx","remote_user":"xxxx","timestamp_start":"1622645396705","timestamp_finish":"1622645397190","time_start":"02/Jun/2021:14:49:56 +0000","time_finish":"02/Jun/2021:14:49:57 +0000","request_method":"PUT","request_uri":"/TestVault1/tdir1/","protocol":"HTTP/1.1","status":200,"response_length":"0","request_length":"0","user_agent":"stocator 1.0.38-SNAPSHOT, aws-sdk-java/1.11.589 Linux/3.10.0-1160.21.1.el7.x86_64 OpenJDK_64-Bit_Server_VM/25.242-b08 java/1.8.0_242 scala/2.11.12 vendor/Amazon.com_Inc. com.amazonaws.services.s3.transfer.TransferManager/1.11.589","request_latency":"485","request_id":"51dabdce-9374-472d-ac6f-86e70a91c1a8","request_type":"REST.PUT.OBJECT","interface_type":"s3","stat":{"client_wait":0.05,"storage_wait":0.491,"digest":0.0,"commit":460.31,"turn_around_time":0.0,"total_transfer":460.862,"pre_transfer":22.681,"post_transfer":0.321},"object_length":"0","version_name":"da7c586a-40c5-4f4d-ad95-a4b8db4946f7","version_transient":true,"delete_marker":false,"last_modified":"2021-06-02T14:49:56.729Z","last_changed":"2021-06-02T14:49:56.729Z","e_tag":"d41d8cd98f00b204e9800998ecf8427e","object_name":"tdir1/","vault_name":"TestVault1","is_secure":false,"principals":{"identity":"1d86d781-35fa-44a2-b327-322e3cb8723c@00000000-0000-0000-0000-000000000000","aws":"xxx"},"type":"http","format":1}