cloudserver

cloudserver copied to clipboard

Reame
Issues

Pyarrow pyarrow.fs.S3FileSystem error

Open LuisMoralesAlonso opened this issue 4 years ago • 2 comments

When using pyarrow 6.0.1 new features for creating Tabular Datasets I get a FileNotFound error.

This is my code (against docker cloudserver with SSL activated):

[bucket: dasynth; folder: parquet]

from pyarrow import fs import pyarrow.dataset as ds import pyarrow.parquet as pq scality = fs.S3FileSystem(access_key='accessKey1', secret_key='verySecretKey1', endpoint_override="https://s3.scality.test:8000", region="", scheme='https') scality.get_file_info("dasynth/parquet/")

Get this error in python code:

<FileInfo for 'dasynth/parquet/': type=FileType.NotFound>

And these ar los in cloudserver:

{"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":43082,"httpCode":200,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980157045,"req_id":"38652b871e469974dc19","level":"info","message":"received request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"method":"routeHEAD","time":1638980157045,"req_id":"38652b871e469974dc19","level":"debug","message":"routing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","method":"Arsenal.auth.server.extractParams","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"entered","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","version":"v4","authMethod":"headers","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"identified auth method","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"running header auth check","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","credentialStr":"Credential=accessKey1/20211208/us-east-1/s3/aws4_request","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"credentials from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signedHeadersStr":" SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"signed headers from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signatureStr":" Signature=2a7d317609aa567881a224424468f5f5189d66548fce55a6ba800d90cd936083","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"signature from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authHeader":"AWS4-HMAC-SHA256 Credential=accessKey1/20211208/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date, Signature=2a7d317609aa567881a224424468f5f5189d66548fce55a6ba800d90cd936083","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"authorization header from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","canonicalReqResult":"HEAD\n/dasynth/parquet\n\namz-sdk-invocation-id:A8563CBA-6879-4FA4-BF9C-AC012EC8ADEE\namz-sdk-request:attempt=1\ncontent-type:application/xml\nhost:s3.scality.test:8000\nx-amz-api-version:2006-03-01\nx-amz-content-sha256:UNSIGNED-PAYLOAD\nx-amz-date:20211208T161557Z\n\namz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date\nUNSIGNED-PAYLOAD","time":1638980157046,"req_id":"38652b871e469974dc19","level":"debug","message":"constructed canonicalRequest","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","stringToSign":"AWS4-HMAC-SHA256\n20211208T161557Z\n20211208/us-east-1/s3/aws4_request\nbf7968791e84bc1ba370cc7d2833f33d1321a280068652684688f5f651128e6d","time":1638980157046,"req_id":"38652b871e469974dc19","level":"trace","message":"constructed stringToSign","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980157046,"req_id":"38652b871e469974dc19","level":"debug","message":"authenticating V4 request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authInfo":{"message":{"body":{"userInfo":{"accountDisplayName":"Bart","canonicalID":"79a59df900b949e55d96a1e698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be","arn":"arn:aws:iam::123456789012:root"}}}},"time":1638980157046,"req_id":"38652b871e469974dc19","level":"debug","message":"received info from Vault","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","method":"objectHead","time":1638980157046,"req_id":"38652b871e469974dc19","level":"debug","message":"processing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980157046,"req_id":"38652b871e469974dc19","level":"debug","message":"getting bucket and object from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980157048,"req_id":"38652b871e469974dc19","level":"debug","message":"bucket and object retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","time":1638980157048,"req_id":"38652b871e469974dc19","level":"trace","message":"found bucket in metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","errCode":{"code":404,"description":"The specified key does not exist.","NoSuchKey":true},"time":1638980157048,"req_id":"38652b871e469974dc19","level":"trace","message":"sending error xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"headers":{},"time":1638980157048,"req_id":"38652b871e469974dc19","level":"trace","message":"setting response headers","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"clientIP":"::ffff:172.17.0.1","clientPort":43082,"httpCode":404,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980157048,"req_id":"38652b871e469974dc19","elapsed_ms":3.188198,"level":"info","message":"responded with error XML","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":43082,"httpCode":200,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"info","message":"received request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"method":"routeHEAD","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"routing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","method":"Arsenal.auth.server.extractParams","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"entered","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","version":"v4","authMethod":"headers","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"identified auth method","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"running header auth check","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","credentialStr":"Credential=accessKey1/20211208/us-east-1/s3/aws4_request","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"credentials from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signedHeadersStr":" SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"signed headers from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signatureStr":" Signature=7ed5d2c3a735123eee3ecd91ccd4769160bce5b8d48e0f0dd56f4337284ec88d","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"signature from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authHeader":"AWS4-HMAC-SHA256 Credential=accessKey1/20211208/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date, Signature=7ed5d2c3a735123eee3ecd91ccd4769160bce5b8d48e0f0dd56f4337284ec88d","time":1638980157049,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"authorization header from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","canonicalReqResult":"HEAD\n/dasynth/parquet\n\namz-sdk-invocation-id:40D7E36A-19C9-4AB2-815F-D45995553ABE\namz-sdk-request:attempt=1\ncontent-type:application/xml\nhost:s3.scality.test:8000\nx-amz-api-version:2006-03-01\nx-amz-content-sha256:UNSIGNED-PAYLOAD\nx-amz-date:20211208T161557Z\n\namz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date\nUNSIGNED-PAYLOAD","time":1638980157050,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"constructed canonicalRequest","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","stringToSign":"AWS4-HMAC-SHA256\n20211208T161557Z\n20211208/us-east-1/s3/aws4_request\neee165d5d479cb2aae4518965ffcdf9faf80780386ae81dad6ba2a29aa9ccd77","time":1638980157050,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"constructed stringToSign","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980157050,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"authenticating V4 request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authInfo":{"message":{"body":{"userInfo":{"accountDisplayName":"Bart","canonicalID":"79a59df900b949e55d96a1e698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be","arn":"arn:aws:iam::123456789012:root"}}}},"time":1638980157050,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"received info from Vault","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","method":"objectHead","time":1638980157050,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"processing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980157050,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"getting bucket and object from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980157051,"req_id":"6c75025f184689cbf4c6","level":"debug","message":"bucket and object retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","time":1638980157051,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"found bucket in metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","errCode":{"code":404,"description":"The specified key does not exist.","NoSuchKey":true},"time":1638980157052,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"sending error xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"headers":{},"time":1638980157052,"req_id":"6c75025f184689cbf4c6","level":"trace","message":"setting response headers","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"clientIP":"::ffff:172.17.0.1","clientPort":43082,"httpCode":404,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980157052,"req_id":"6c75025f184689cbf4c6","elapsed_ms":3.051608,"level":"info","message":"responded with error XML","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":43082,"httpCode":200,"httpMethod":"GET","httpURL":"/dasynth?delimiter=%2F&list-type=2&max-keys=1&prefix=parquet%2F","time":1638980157052,"req_id":"8b120d6e5548b8bc3da5","level":"info","message":"received request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"method":"routerGET","time":1638980157052,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"routing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","method":"Arsenal.auth.server.extractParams","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"entered","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","version":"v4","authMethod":"headers","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"identified auth method","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"running header auth check","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","credentialStr":"Credential=accessKey1/20211208/us-east-1/s3/aws4_request","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"credentials from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","signedHeadersStr":" SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"signed headers from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","signatureStr":" Signature=9d0a7a5d17006c4cc4cb07eb61a6456b470f0949ac206ccab1b2c6479e47e507","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"signature from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","authHeader":"AWS4-HMAC-SHA256 Credential=accessKey1/20211208/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date, Signature=9d0a7a5d17006c4cc4cb07eb61a6456b470f0949ac206ccab1b2c6479e47e507","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"authorization header from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","canonicalReqResult":"GET\n/dasynth\ndelimiter=%2F&list-type=2&max-keys=1&prefix=parquet%2F\namz-sdk-invocation-id:3F8504DE-1D41-44F0-8447-B17C358ADCAF\namz-sdk-request:attempt=1\ncontent-type:application/xml\nhost:s3.scality.test:8000\nx-amz-api-version:2006-03-01\nx-amz-content-sha256:UNSIGNED-PAYLOAD\nx-amz-date:20211208T161557Z\n\namz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date\nUNSIGNED-PAYLOAD","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"constructed canonicalRequest","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","stringToSign":"AWS4-HMAC-SHA256\n20211208T161557Z\n20211208/us-east-1/s3/aws4_request\n5fd77aacd0ad165799a0988b2cab1de2d28ea18b594d0eb76f8ce7e5580c59ba","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"constructed stringToSign","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"authenticating V4 request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","authInfo":{"message":{"body":{"userInfo":{"accountDisplayName":"Bart","canonicalID":"79a59df900b949e55d96a1e698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be","arn":"arn:aws:iam::123456789012:root"}}}},"time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"received info from Vault","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","method":"bucketGet","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"processing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980157053,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"getting bucket from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980157054,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"bucket retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980157054,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"found bucket in metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","listingParams":{"listingType":"DelimiterMaster","maxKeys":1,"delimiter":"/","prefix":"parquet/","v2":true,"fetchOwner":false},"time":1638980157054,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"performing metadata get object listing","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980157071,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"getting object listing from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980157071,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"object listing retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980157071,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"sending success xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"headers":{},"time":1638980157071,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"setting response headers","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"httpCode":200,"time":1638980157072,"req_id":"8b120d6e5548b8bc3da5","level":"debug","message":"response http code","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"xml":"<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>dasynth</Name><Prefix>parquet/</Prefix><MaxKeys>1</MaxKeys><Delimiter>/</Delimiter><IsTruncated>false</IsTruncated><FetchOwner>false</FetchOwner><KeyCount>0</KeyCount><CommonPrefixes><Prefix>parquet/taxies/</Prefix></CommonPrefixes></ListBucketResult>","time":1638980157072,"req_id":"8b120d6e5548b8bc3da5","level":"trace","message":"xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"clientIP":"::ffff:172.17.0.1","clientPort":43082,"httpCode":200,"httpMethod":"GET","httpURL":"/dasynth?delimiter=%2F&list-type=2&max-keys=1&prefix=parquet%2F","time":1638980157072,"req_id":"8b120d6e5548b8bc3da5","elapsed_ms":19.552601,"level":"info","message":"responded with XML","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":43084,"httpCode":200,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"info","message":"received request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"method":"routeHEAD","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"routing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","method":"Arsenal.auth.server.extractParams","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"entered","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","version":"v4","authMethod":"headers","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"identified auth method","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"running header auth check","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","credentialStr":"Credential=accessKey1/20211208/us-east-1/s3/aws4_request","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"credentials from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signedHeadersStr":" SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"signed headers from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signatureStr":" Signature=711c32e09f6052cb676094798dbc59611fed58e360d0f1fee6c1ce35ed142e63","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"signature from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authHeader":"AWS4-HMAC-SHA256 Credential=accessKey1/20211208/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date, Signature=711c32e09f6052cb676094798dbc59611fed58e360d0f1fee6c1ce35ed142e63","time":1638980356925,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"authorization header from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","canonicalReqResult":"HEAD\n/dasynth/parquet\n\namz-sdk-invocation-id:47DFB4E9-B92B-40FF-919F-78F085479239\namz-sdk-request:attempt=1\ncontent-type:application/xml\nhost:s3.scality.test:8000\nx-amz-api-version:2006-03-01\nx-amz-content-sha256:UNSIGNED-PAYLOAD\nx-amz-date:20211208T161916Z\n\namz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date\nUNSIGNED-PAYLOAD","time":1638980356926,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"constructed canonicalRequest","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","stringToSign":"AWS4-HMAC-SHA256\n20211208T161916Z\n20211208/us-east-1/s3/aws4_request\n2c26d591b50d5ebe7b30dec5882ae45255a5a92e1aaf9ce09bff2c139bb01be2","time":1638980356926,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"constructed stringToSign","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980356926,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"authenticating V4 request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authInfo":{"message":{"body":{"userInfo":{"accountDisplayName":"Bart","canonicalID":"79a59df900b949e55d96a1e698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be","arn":"arn:aws:iam::123456789012:root"}}}},"time":1638980356926,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"received info from Vault","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","method":"objectHead","time":1638980356926,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"processing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980356926,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"getting bucket and object from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980356928,"req_id":"5baa3fff3942a1f0102d","level":"debug","message":"bucket and object retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","time":1638980356928,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"found bucket in metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","errCode":{"code":404,"description":"The specified key does not exist.","NoSuchKey":true},"time":1638980356928,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"sending error xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"headers":{},"time":1638980356928,"req_id":"5baa3fff3942a1f0102d","level":"trace","message":"setting response headers","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"clientIP":"::ffff:172.17.0.1","clientPort":43084,"httpCode":404,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980356929,"req_id":"5baa3fff3942a1f0102d","elapsed_ms":3.928498,"level":"info","message":"responded with error XML","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":43084,"httpCode":200,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980356929,"req_id":"16d02a156e4cb00671d2","level":"info","message":"received request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"method":"routeHEAD","time":1638980356929,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"routing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","method":"Arsenal.auth.server.extractParams","time":1638980356929,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"entered","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","version":"v4","authMethod":"headers","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"identified auth method","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"running header auth check","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","credentialStr":"Credential=accessKey1/20211208/us-east-1/s3/aws4_request","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"credentials from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signedHeadersStr":" SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"signed headers from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","signatureStr":" Signature=02097525fb5a14598a34fb3ba0782e51814300688473379de1f2cf125d7e9279","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"signature from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authHeader":"AWS4-HMAC-SHA256 Credential=accessKey1/20211208/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date, Signature=02097525fb5a14598a34fb3ba0782e51814300688473379de1f2cf125d7e9279","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"authorization header from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","canonicalReqResult":"HEAD\n/dasynth/parquet\n\namz-sdk-invocation-id:5FB2C929-04D7-46AD-97FA-B42ECC73021F\namz-sdk-request:attempt=1\ncontent-type:application/xml\nhost:s3.scality.test:8000\nx-amz-api-version:2006-03-01\nx-amz-content-sha256:UNSIGNED-PAYLOAD\nx-amz-date:20211208T161916Z\n\namz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date\nUNSIGNED-PAYLOAD","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"constructed canonicalRequest","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","stringToSign":"AWS4-HMAC-SHA256\n20211208T161916Z\n20211208/us-east-1/s3/aws4_request\n50adde853071a86fbb9fc09d31dc1c5e22cdd2e785f87de815191a80d32fb5ba","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"constructed stringToSign","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"authenticating V4 request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","authInfo":{"message":{"body":{"userInfo":{"accountDisplayName":"Bart","canonicalID":"79a59df900b949e55d96a1e698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be","arn":"arn:aws:iam::123456789012:root"}}}},"time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"received info from Vault","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","method":"objectHead","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"processing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980356930,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"getting bucket and object from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","database":"dasynth","object":"parquet","time":1638980356932,"req_id":"16d02a156e4cb00671d2","level":"debug","message":"bucket and object retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","time":1638980356932,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"found bucket in metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","errCode":{"code":404,"description":"The specified key does not exist.","NoSuchKey":true},"time":1638980356932,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"sending error xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"headers":{},"time":1638980356932,"req_id":"16d02a156e4cb00671d2","level":"trace","message":"setting response headers","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","objectKey":"parquet","bytesReceived":0,"bodyLength":0,"service":"s3","action":"HeadObject","accountDisplayName":"Bart","accountName":"Bart","bytesSent":191,"clientIP":"::ffff:172.17.0.1","clientPort":43084,"httpCode":404,"httpMethod":"HEAD","httpURL":"/dasynth/parquet","time":1638980356932,"req_id":"16d02a156e4cb00671d2","elapsed_ms":3.264244,"level":"info","message":"responded with error XML","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":43084,"httpCode":200,"httpMethod":"GET","httpURL":"/dasynth?delimiter=%2F&list-type=2&max-keys=1&prefix=parquet%2F","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"info","message":"received request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"method":"routerGET","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"routing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","method":"Arsenal.auth.server.extractParams","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"entered","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","version":"v4","authMethod":"headers","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"identified auth method","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"running header auth check","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","credentialStr":"Credential=accessKey1/20211208/us-east-1/s3/aws4_request","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"credentials from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","signedHeadersStr":" SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"signed headers from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","signatureStr":" Signature=b45dfcf4d3db5f6d7ab7a45599cb7a0f8ec8d0899814e28319a4b378e2d66685","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"signature from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","authHeader":"AWS4-HMAC-SHA256 Credential=accessKey1/20211208/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date, Signature=b45dfcf4d3db5f6d7ab7a45599cb7a0f8ec8d0899814e28319a4b378e2d66685","time":1638980356933,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"authorization header from request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","canonicalReqResult":"GET\n/dasynth\ndelimiter=%2F&list-type=2&max-keys=1&prefix=parquet%2F\namz-sdk-invocation-id:7B8FC5EE-2AF8-4FC8-9200-42D48EE2C679\namz-sdk-request:attempt=1\ncontent-type:application/xml\nhost:s3.scality.test:8000\nx-amz-api-version:2006-03-01\nx-amz-content-sha256:UNSIGNED-PAYLOAD\nx-amz-date:20211208T161916Z\n\namz-sdk-invocation-id;amz-sdk-request;content-type;host;x-amz-api-version;x-amz-content-sha256;x-amz-date\nUNSIGNED-PAYLOAD","time":1638980356934,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"constructed canonicalRequest","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","stringToSign":"AWS4-HMAC-SHA256\n20211208T161916Z\n20211208/us-east-1/s3/aws4_request\n724e09cdcc1c37e7bae256841e2938a45af536ad72d53074c71763251f941c20","time":1638980356934,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"constructed stringToSign","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","time":1638980356934,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"authenticating V4 request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","authInfo":{"message":{"body":{"userInfo":{"accountDisplayName":"Bart","canonicalID":"79a59df900b949e55d96a1e698fbacedfd6e09d98eacf8f8d5218e7cd47ef2be","arn":"arn:aws:iam::123456789012:root"}}}},"time":1638980356934,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"received info from Vault","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","method":"bucketGet","time":1638980356934,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"processing request","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980356934,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"getting bucket from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980356935,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"bucket retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980356935,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"found bucket in metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","listingParams":{"listingType":"DelimiterMaster","maxKeys":1,"delimiter":"/","prefix":"parquet/","v2":true,"fetchOwner":false},"time":1638980356935,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"performing metadata get object listing","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980356957,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"getting object listing from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980356957,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"object listing retrieved from metadata","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","time":1638980356958,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"sending success xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"headers":{},"time":1638980356958,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"setting response headers","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"httpCode":200,"time":1638980356958,"req_id":"d5813cf7594897a8d8fc","level":"debug","message":"response http code","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"xml":"<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>dasynth</Name><Prefix>parquet/</Prefix><MaxKeys>1</MaxKeys><Delimiter>/</Delimiter><IsTruncated>false</IsTruncated><FetchOwner>false</FetchOwner><KeyCount>0</KeyCount><CommonPrefixes><Prefix>parquet/taxies/</Prefix></CommonPrefixes></ListBucketResult>","time":1638980356958,"req_id":"d5813cf7594897a8d8fc","level":"trace","message":"xml response","hostname":"15f61e8ee5b5","pid":73} {"name":"S3","bucketName":"dasynth","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":361,"clientIP":"::ffff:172.17.0.1","clientPort":43084,"httpCode":200,"httpMethod":"GET","httpURL":"/dasynth?delimiter=%2F&list-type=2&max-keys=1&prefix=parquet%2F","time":1638980356958,"req_id":"d5813cf7594897a8d8fc","elapsed_ms":25.180161,"level":"info","message":"responded with XML","hostname":"15f61e8ee5b5","pid":73}

Dec 08 '21 16:12 LuisMoralesAlonso

It seems it is a bug in CloudServer's implementation of ListObjects and ListObjectsV2. If you have a bucket named bucket with a single file named bucket/foo/bar.baz.txt, then the following requests succeed but return exactly 0 keys:

{"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":53906,"httpMethod":"GET","httpURL":"/bucket?delimiter=%2F&max-keys=1&prefix=foo%2F","time":1639669551400,"req_id":"7ae4f7eb6748bdcb8aff","level":"info","message":"received request","hostname":"d04f08cb0873","pid":71}
{"name":"S3","bucketName":"bucket","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjects","accountDisplayName":"Bart","accountName":"Bart","bytesSent":306,"clientIP":"::ffff:172.17.0.1","clientPort":53906,"httpMethod":"GET","httpURL":"/bucket?delimiter=%2F&max-keys=1&prefix=foo%2F","httpCode":200,"time":1639669551405,"req_id":"7ae4f7eb6748bdcb8aff","elapsed_ms":4.924161,"level":"info","message":"responded with XML","hostname":"d04f08cb0873","pid":71}

{"name":"S3","clientIP":"::ffff:172.17.0.1","clientPort":53776,"httpMethod":"GET","httpURL":"/bucket?delimiter=%2F&list-type=2&max-keys=1&prefix=foo%2F","time":1639669181969,"req_id":"d814624c254e8a3182ba","level":"info","message":"received request","hostname":"d04f08cb0873","pid":71}
{"name":"S3","bucketName":"bucket","bytesReceived":0,"bodyLength":0,"service":"s3","action":"ListObjectsV2","accountDisplayName":"Bart","accountName":"Bart","bytesSent":393,"clientIP":"::ffff:172.17.0.1","clientPort":53776,"httpMethod":"GET","httpURL":"/bucket?delimiter=%2F&list-type=2&max-keys=1&prefix=foo%2F","httpCode":200,"time":1639669181974,"req_id":"d814624c254e8a3182ba","elapsed_ms":4.745692,"level":"info","message":"responded with XML","hostname":"d04f08cb0873","pid":71}

Dec 16 '21 15:12 pitrou

These requests do return a non-zero number of common prefixes, though, so I can use that. Workaround in https://github.com/apache/arrow/pull/11977

Dec 16 '21 16:12 pitrou