[GH-ISSUE #1580] Connection loss due to authorization errors when using ibm_iam_auth after idling for hours #827

Closed
opened 2026-03-04 01:49:07 +03:00 by kerem · 1 comment
Owner

Originally created by @grishgo-dev on GitHub (Feb 19, 2021).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1580

Additional Information

We are using s3fs to mount IBM COS buckets as volumes in kubernetes. When using ibm_iam_auth, we notice connections to bucket fail with authorization errors, after leaving it idle for hours. Detailed logs are provided below.

Note: Logs and details below are collected from developer machine where I was able to reproduce same error.

Version of s3fs being used (s3fs --version)

V1.87

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

2.9.9

Kernel information (uname -r)

20.3.0

GNU/Linux Distribution, if applicable (cat /etc/os-release)

sysctl kern.version
kern.version: Darwin Kernel Version 20.3.0: Thu Jan 21 00:07:06 PST 2021; root:xnu-7195.81.3~1/RELEASE_X86_64

s3fs command line used, if applicable

s3fs <bucket> <folder> -o use_path_request_style -o passwd_file=<passwdfile> -o url=https://s3.us.cloud-object-storage.appdomain.cloud -o allow_other -o umask=0000 -o dbglevel=info -o curldbg -o ibm_iam_auth

/etc/fstab entry, if applicable

N/A

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages

CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(3159): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv/]
[INF]       curl.cpp:PreHeadRequest(3119): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv/][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 404 Not Found
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: cf92d138-ba90-4889-9f71-ff3a96ca01ae
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: cf92d138-ba90-4889-9f71-ff3a96ca01ae
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 382
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(3159): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv_$folder$]
[INF]       curl.cpp:PreHeadRequest(3119): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv_$folder$][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv_%24folder%24
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv_%24folder%24
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv_%24folder%24 HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 404 Not Found
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: 8277717b-857e-4efa-89e9-ca9f150be8bd
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 8277717b-857e-4efa-89e9-ca9f150be8bd
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 390
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT
[INF]   s3fs.cpp:list_bucket(2558): [path=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=2&prefix=._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 200 OK
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: 12408cc0-6ec5-4fe0-bf62-8f6cf8c87821
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 12408cc0-6ec5-4fe0-bf62-8f6cf8c87821
[CURL DBG] < ibm-sse-kp-enabled: false
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 383
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2520): HTTP response code 200
[INF] s3fs.cpp:s3fs_access(3532): [path=/State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv][mask=F_OK]
[INF] s3fs.cpp:s3fs_getattr(828): [path=/State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv]
[INF] s3fs.cpp:s3fs_access(3532): [path=/metadata.json][mask=R_OK ]
[INF] s3fs.cpp:s3fs_getattr(828): [path=/._metadata.json]
[INF]       curl.cpp:HeadRequest(3159): [tpath=/._metadata.json]
[INF]       curl.cpp:PreHeadRequest(3119): [tpath=/._metadata.json][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 404 Not Found
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: 734f172b-e6a8-414f-a297-aa20a0ba2ec1
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 734f172b-e6a8-414f-a297-aa20a0ba2ec1
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 320
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(3159): [tpath=/._metadata.json/]
[INF]       curl.cpp:PreHeadRequest(3119): [tpath=/._metadata.json/][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json/
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json/
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json/ HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 404 Not Found
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: 50da9332-ddd8-4b56-869e-c100634a546a
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 50da9332-ddd8-4b56-869e-c100634a546a
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 321
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(3159): [tpath=/._metadata.json_$folder$]
[INF]       curl.cpp:PreHeadRequest(3119): [tpath=/._metadata.json_$folder$][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json_%24folder%24
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json_%24folder%24
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json_%24folder%24 HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 404 Not Found
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: c0df31ef-71eb-4f04-834e-76e2afb67344
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: c0df31ef-71eb-4f04-834e-76e2afb67344
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 329
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT
[INF]   s3fs.cpp:list_bucket(2558): [path=/._metadata.json]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/._metadata.json]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=2&prefix=._metadata.json/
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._metadata.json/
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._metadata.json/ HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 200 OK
[CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT
[CURL DBG] < X-Clv-Request-Id: 5ffbf57b-183c-4812-a14a-1322789cd806
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 5ffbf57b-183c-4812-a14a-1322789cd806
[CURL DBG] < ibm-sse-kp-enabled: false
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 322
[CURL DBG] < 
[CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[INF]       curl.cpp:RequestPerform(2520): HTTP response code 200
[INF] s3fs.cpp:s3fs_access(3532): [path=/metadata.json][mask=F_OK]
[INF] s3fs.cpp:s3fs_getattr(828): [path=/metadata.json]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=F_OK]
[INF] s3fs.cpp:s3fs_getattr(828): [path=/]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=F_OK]
[INF] s3fs.cpp:s3fs_getattr(828): [path=/]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=F_OK]
[INF] s3fs.cpp:s3fs_getattr(828): [path=/]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK X_OK ]
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] * LibreSSL SSL_read: SSL_ERROR_SYSCALL, errno 54
[CURL DBG] * Connection died, retrying a fresh connect
[CURL DBG] * Closing connection 0
[CURL DBG] * Issue another request to this URL: 'https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix='
[CURL DBG] *   Trying 169.63.118.104...
[CURL DBG] * TCP_NODELAY set
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] * successfully set certificate verify locations:
[CURL DBG] *   CAfile: /etc/ssl/cert.pem
  CApath: none
[CURL DBG] * SSL re-using session ID
[CURL DBG] * TLSv1.2 (OUT), TLS handshake, Client hello (1):
[CURL DBG] * TLSv1.2 (IN), TLS handshake, Server hello (2):
[CURL DBG] * TLSv1.2 (IN), TLS handshake, Certificate (11):
[CURL DBG] * TLSv1.2 (IN), TLS handshake, Server finished (14):
[CURL DBG] * TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
[CURL DBG] * TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
[CURL DBG] * TLSv1.2 (OUT), TLS handshake, Finished (20):
[CURL DBG] * TLSv1.2 (IN), TLS change cipher, Change cipher spec (1):
[CURL DBG] * TLSv1.2 (IN), TLS handshake, Finished (20):
[CURL DBG] * old SSL session ID is stale, removing
[CURL DBG] * SSL connection using TLSv1.2 / AES256-SHA
[CURL DBG] * Server certificate:
[CURL DBG] *  subject: C=US; ST=New York; L=Armonk; O=International Business Machines Corporation; CN=*.s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] *  start date: Nov 23 00:00:00 2020 GMT
[CURL DBG] *  expire date: Dec 13 23:59:59 2021 GMT
[CURL DBG] *  subjectAltName: host "s3.us.cloud-object-storage.appdomain.cloud" matched cert's "s3.us.cloud-object-storage.appdomain.cloud"
[CURL DBG] *  issuer: C=US; O=DigiCert Inc; CN=DigiCert TLS RSA SHA256 2020 CA1
[CURL DBG] *  SSL certificate verify ok.
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT
[CURL DBG] < X-Clv-Request-Id: 1e2720b9-802d-4f37-907e-798ec53d810e
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 1e2720b9-802d-4f37-907e-798ec53d810e
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>1e2720b9-802d-4f37-907e-798ec53d810e</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT
[CURL DBG] < X-Clv-Request-Id: dea41935-5b72-4143-8eb7-152247aecb10
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: dea41935-5b72-4143-8eb7-152247aecb10
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>dea41935-5b72-4143-8eb7-152247aecb10</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT
[CURL DBG] < X-Clv-Request-Id: fbb36ef5-d528-4583-9007-f8ebb02183b1
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: fbb36ef5-d528-4583-9007-f8ebb02183b1
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>fbb36ef5-d528-4583-9007-f8ebb02183b1</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_getattr(828): [path=/]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=X_OK ]
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT
[CURL DBG] < X-Clv-Request-Id: db51bb83-8ad1-4961-8481-d1ca00f21932
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: db51bb83-8ad1-4961-8481-d1ca00f21932
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>db51bb83-8ad1-4961-8481-d1ca00f21932</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_getattr(828): [path=/]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK X_OK ]
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT
[CURL DBG] < X-Clv-Request-Id: 1d283111-d438-4611-8ff4-f1b05bf16faf
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 1d283111-d438-4611-8ff4-f1b05bf16faf
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>1d283111-d438-4611-8ff4-f1b05bf16faf</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:24 GMT
[CURL DBG] < X-Clv-Request-Id: 707e88fc-6ad9-4273-915d-2d86064d1fe7
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: 707e88fc-6ad9-4273-915d-2d86064d1fe7
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>707e88fc-6ad9-4273-915d-2d86064d1fe7</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:24 GMT
[CURL DBG] < X-Clv-Request-Id: a2121df5-1999-4b9f-9148-409c87096f0d
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: a2121df5-1999-4b9f-9148-409c87096f0d
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>a2121df5-1999-4b9f-9148-409c87096f0d</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).
[INF] s3fs.cpp:s3fs_getattr(828): [path=/]
[INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ]
[INF] s3fs.cpp:s3fs_readdir(2515): [path=/]
[INF]   s3fs.cpp:list_bucket(2558): [path=/]
[INF]       curl.cpp:ListBucketRequest(3560): [tpath=/]
[INF]       curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix=
[INF]       curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=
[CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline]
[CURL DBG] * Could pipeline, but not asked to!
[CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1)
[CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
[CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud
[CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt))
[CURL DBG] > Accept: */*
[CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ
[CURL DBG] > 
[CURL DBG] < HTTP/1.1 403 Forbidden
[CURL DBG] < Date: Fri, 19 Feb 2021 14:41:24 GMT
[CURL DBG] < X-Clv-Request-Id: e52c54bb-91f5-4b41-babb-8bd5c3a57103
[CURL DBG] < Server: Cleversafe
[CURL DBG] < X-Clv-S3-Version: 2.5
[CURL DBG] < Accept-Ranges: bytes
[CURL DBG] < x-amz-request-id: e52c54bb-91f5-4b41-babb-8bd5c3a57103
[CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network"
[CURL DBG] < Content-Type: application/xml
[CURL DBG] < Content-Length: 288
[CURL DBG] < 
[CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact
[ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>e52c54bb-91f5-4b41-babb-8bd5c3a57103</RequestId><httpStatusCode>403</httpStatusCode></Error>
[ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error.
[ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1).

Details about issue

When using ibm_iam_auth, we notice connections to bucket fail with authorization errors, after leaving it idle for hours. Detailed logs are provided below.

Note: Logs and details below are collected from developer machine where I was able to reproduce same error.

Originally created by @grishgo-dev on GitHub (Feb 19, 2021). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1580 ### Additional Information We are using s3fs to mount IBM COS buckets as volumes in kubernetes. When using `ibm_iam_auth`, we notice connections to bucket fail with authorization errors, after leaving it idle for hours. Detailed logs are provided below. Note: Logs and details below are collected from developer machine where I was able to reproduce same error. #### Version of s3fs being used (s3fs --version) V1.87 #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) 2.9.9 #### Kernel information (uname -r) 20.3.0 #### GNU/Linux Distribution, if applicable (cat /etc/os-release) sysctl kern.version kern.version: Darwin Kernel Version 20.3.0: Thu Jan 21 00:07:06 PST 2021; root:xnu-7195.81.3~1/RELEASE_X86_64 #### s3fs command line used, if applicable ``` s3fs <bucket> <folder> -o use_path_request_style -o passwd_file=<passwdfile> -o url=https://s3.us.cloud-object-storage.appdomain.cloud -o allow_other -o umask=0000 -o dbglevel=info -o curldbg -o ibm_iam_auth ``` #### /etc/fstab entry, if applicable ``` N/A ``` #### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs) _if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages_ ``` CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(3159): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv/] [INF] curl.cpp:PreHeadRequest(3119): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv/][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 404 Not Found [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: cf92d138-ba90-4889-9f71-ff3a96ca01ae [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: cf92d138-ba90-4889-9f71-ff3a96ca01ae [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 382 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(3159): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv_$folder$] [INF] curl.cpp:PreHeadRequest(3119): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv_$folder$][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv_%24folder%24 [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv_%24folder%24 [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv_%24folder%24 HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 404 Not Found [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: 8277717b-857e-4efa-89e9-ca9f150be8bd [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 8277717b-857e-4efa-89e9-ca9f150be8bd [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 390 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT [INF] s3fs.cpp:list_bucket(2558): [path=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/._State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=2&prefix=._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._State%20Population%20by%20Characteristics%202010-2019_SCPRC-EST2019-18%2BPOP-RES.csv/ HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 200 OK [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: 12408cc0-6ec5-4fe0-bf62-8f6cf8c87821 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 12408cc0-6ec5-4fe0-bf62-8f6cf8c87821 [CURL DBG] < ibm-sse-kp-enabled: false [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 383 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2520): HTTP response code 200 [INF] s3fs.cpp:s3fs_access(3532): [path=/State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv][mask=F_OK] [INF] s3fs.cpp:s3fs_getattr(828): [path=/State Population by Characteristics 2010-2019_SCPRC-EST2019-18+POP-RES.csv] [INF] s3fs.cpp:s3fs_access(3532): [path=/metadata.json][mask=R_OK ] [INF] s3fs.cpp:s3fs_getattr(828): [path=/._metadata.json] [INF] curl.cpp:HeadRequest(3159): [tpath=/._metadata.json] [INF] curl.cpp:PreHeadRequest(3119): [tpath=/._metadata.json][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 404 Not Found [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: 734f172b-e6a8-414f-a297-aa20a0ba2ec1 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 734f172b-e6a8-414f-a297-aa20a0ba2ec1 [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 320 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(3159): [tpath=/._metadata.json/] [INF] curl.cpp:PreHeadRequest(3119): [tpath=/._metadata.json/][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json/ [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json/ [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json/ HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 404 Not Found [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: 50da9332-ddd8-4b56-869e-c100634a546a [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 50da9332-ddd8-4b56-869e-c100634a546a [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 321 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(3159): [tpath=/._metadata.json_$folder$] [INF] curl.cpp:PreHeadRequest(3119): [tpath=/._metadata.json_$folder$][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json_%24folder%24 [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json_%24folder%24 [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > HEAD /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/._metadata.json_%24folder%24 HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 404 Not Found [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: c0df31ef-71eb-4f04-834e-76e2afb67344 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: c0df31ef-71eb-4f04-834e-76e2afb67344 [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 329 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2545): HTTP response code 404 was returned, returning ENOENT [INF] s3fs.cpp:list_bucket(2558): [path=/._metadata.json] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/._metadata.json] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=2&prefix=._metadata.json/ [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._metadata.json/ [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=2&prefix=._metadata.json/ HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 200 OK [CURL DBG] < Date: Fri, 19 Feb 2021 04:03:57 GMT [CURL DBG] < X-Clv-Request-Id: 5ffbf57b-183c-4812-a14a-1322789cd806 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 5ffbf57b-183c-4812-a14a-1322789cd806 [CURL DBG] < ibm-sse-kp-enabled: false [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 322 [CURL DBG] < [CURL DBG] * Connection #0 to host s3.us.cloud-object-storage.appdomain.cloud left intact [INF] curl.cpp:RequestPerform(2520): HTTP response code 200 [INF] s3fs.cpp:s3fs_access(3532): [path=/metadata.json][mask=F_OK] [INF] s3fs.cpp:s3fs_getattr(828): [path=/metadata.json] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=F_OK] [INF] s3fs.cpp:s3fs_getattr(828): [path=/] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=F_OK] [INF] s3fs.cpp:s3fs_getattr(828): [path=/] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=F_OK] [INF] s3fs.cpp:s3fs_getattr(828): [path=/] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK X_OK ] [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a7e9ea50 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#0) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#0) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] * LibreSSL SSL_read: SSL_ERROR_SYSCALL, errno 54 [CURL DBG] * Connection died, retrying a fresh connect [CURL DBG] * Closing connection 0 [CURL DBG] * Issue another request to this URL: 'https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix=' [CURL DBG] * Trying 169.63.118.104... [CURL DBG] * TCP_NODELAY set [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] * successfully set certificate verify locations: [CURL DBG] * CAfile: /etc/ssl/cert.pem CApath: none [CURL DBG] * SSL re-using session ID [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Client hello (1): [CURL DBG] * TLSv1.2 (IN), TLS handshake, Server hello (2): [CURL DBG] * TLSv1.2 (IN), TLS handshake, Certificate (11): [CURL DBG] * TLSv1.2 (IN), TLS handshake, Server finished (14): [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Client key exchange (16): [CURL DBG] * TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1): [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Finished (20): [CURL DBG] * TLSv1.2 (IN), TLS change cipher, Change cipher spec (1): [CURL DBG] * TLSv1.2 (IN), TLS handshake, Finished (20): [CURL DBG] * old SSL session ID is stale, removing [CURL DBG] * SSL connection using TLSv1.2 / AES256-SHA [CURL DBG] * Server certificate: [CURL DBG] * subject: C=US; ST=New York; L=Armonk; O=International Business Machines Corporation; CN=*.s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * start date: Nov 23 00:00:00 2020 GMT [CURL DBG] * expire date: Dec 13 23:59:59 2021 GMT [CURL DBG] * subjectAltName: host "s3.us.cloud-object-storage.appdomain.cloud" matched cert's "s3.us.cloud-object-storage.appdomain.cloud" [CURL DBG] * issuer: C=US; O=DigiCert Inc; CN=DigiCert TLS RSA SHA256 2020 CA1 [CURL DBG] * SSL certificate verify ok. [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT [CURL DBG] < X-Clv-Request-Id: 1e2720b9-802d-4f37-907e-798ec53d810e [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 1e2720b9-802d-4f37-907e-798ec53d810e [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>1e2720b9-802d-4f37-907e-798ec53d810e</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT [CURL DBG] < X-Clv-Request-Id: dea41935-5b72-4143-8eb7-152247aecb10 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: dea41935-5b72-4143-8eb7-152247aecb10 [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>dea41935-5b72-4143-8eb7-152247aecb10</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT [CURL DBG] < X-Clv-Request-Id: fbb36ef5-d528-4583-9007-f8ebb02183b1 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: fbb36ef5-d528-4583-9007-f8ebb02183b1 [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>fbb36ef5-d528-4583-9007-f8ebb02183b1</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_getattr(828): [path=/] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=X_OK ] [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT [CURL DBG] < X-Clv-Request-Id: db51bb83-8ad1-4961-8481-d1ca00f21932 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: db51bb83-8ad1-4961-8481-d1ca00f21932 [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>db51bb83-8ad1-4961-8481-d1ca00f21932</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_getattr(828): [path=/] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK X_OK ] [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:23 GMT [CURL DBG] < X-Clv-Request-Id: 1d283111-d438-4611-8ff4-f1b05bf16faf [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 1d283111-d438-4611-8ff4-f1b05bf16faf [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>1d283111-d438-4611-8ff4-f1b05bf16faf</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:24 GMT [CURL DBG] < X-Clv-Request-Id: 707e88fc-6ad9-4273-915d-2d86064d1fe7 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: 707e88fc-6ad9-4273-915d-2d86064d1fe7 [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>707e88fc-6ad9-4273-915d-2d86064d1fe7</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:24 GMT [CURL DBG] < X-Clv-Request-Id: a2121df5-1999-4b9f-9148-409c87096f0d [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: a2121df5-1999-4b9f-9148-409c87096f0d [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>a2121df5-1999-4b9f-9148-409c87096f0d</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). [INF] s3fs.cpp:s3fs_getattr(828): [path=/] [INF] s3fs.cpp:s3fs_access(3532): [path=/][mask=R_OK ] [INF] s3fs.cpp:s3fs_readdir(2515): [path=/] [INF] s3fs.cpp:list_bucket(2558): [path=/] [INF] curl.cpp:ListBucketRequest(3560): [tpath=/] [INF] curl.cpp:prepare_url(4831): URL is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d?delimiter=/&max-keys=1000&prefix= [INF] curl.cpp:prepare_url(4864): URL changed is https://s3.us.cloud-object-storage.appdomain.cloud/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= [CURL DBG] * Found bundle for host s3.us.cloud-object-storage.appdomain.cloud: 0x7fe6a9013970 [can pipeline] [CURL DBG] * Could pipeline, but not asked to! [CURL DBG] * Re-using existing connection! (#1) with host s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] * Connected to s3.us.cloud-object-storage.appdomain.cloud (169.63.118.104) port 443 (#1) [CURL DBG] > GET /rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 [CURL DBG] > Host: s3.us.cloud-object-storage.appdomain.cloud [CURL DBG] > User-Agent: s3fs/1.87 (commit hash unknown; GnuTLS(gcrypt)) [CURL DBG] > Accept: */* [CURL DBG] > Authorization: Bearer eyJraWQiOiIyMDIxMDEyMDE4MzUiLCJhbGciOiJSUzI1NiJ9.eyJpYW1faWQiOiJpYW0tU2VydmljZUlkLWUxNWMxNzM3LWVmZDgtNGNmMy1hNTRkLTgzY2Y1NDljYWEzMSIsImlkIjoiaWFtLVNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJyZWFsbWlkIjoiaWFtIiwianRpIjoiZjlkNmM0ZjMtMjBkYi00NjgwLWJiMmEtMzAzZjBmMjA2YTNjIiwiaWRlbnRpZmllciI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJuYW1lIjoiNWRiYjBmZjRjZTQ5NGUwMDEyZmE4OTY5LXNlcnZpY2VpZCIsInN1YiI6IlNlcnZpY2VJZC1lMTVjMTczNy1lZmQ4LTRjZjMtYTU0ZC04M2NmNTQ5Y2FhMzEiLCJzdWJfdHlwZSI6IlNlcnZpY2VJZCIsImFjY291bnQiOnsidmFsaWQiOnRydWUsImJzcyI6ImY5MTUxNWE0Nzk4YTRhODQ5NDE1NjZlYTg0YjYyNDZmIiwiZnJvemVuIjp0cnVlfSwiaWF0IjoxNjEzNzAzOTI2LCJleHAiOjE2MTM3MDc1MjYsImlzcyI6Imh0dHBzOi8vaWFtLm5nLmJsdWVtaXgubmV0L29pZGMvdG9rZW4iLCJncmFudF90eXBlIjoidXJuOmlibTpwYXJhbXM6b2F1dGg6Z3JhbnQtdHlwZTphcGlrZXkiLCJzY29wZSI6ImlibSBvcGVuaWQiLCJjbGllbnRfaWQiOiJieCIsImFjciI6MSwiYW1yIjpbInB3ZCJdfQ.brwEgYcwE6hHQko9gbtcEaRHzTe_Ton6mEeUl89QY6vXEzc96JbqDMkJWsnpjrTfSQgqygNYmFngMkQFqN8ZW6mJnt8tnGqbgwpKSwPowoAxbxgZEXA6r91eZtS2AIV8BS-TQmlClhUH9XrOEE1RpQFqJpuN7wopcPaBSB-vFrXnmYOCrvz7rhrCU8kmvs6fB1HIpuNPnx1teACoFQqN5fUWGKBmu0UgGD7Ra8Gx2STTLKWL9s63PEKNWRCn0iojGsssiWXzpWypKOeMQYGluUslhWGy3WNnark8Hurcy_Na2zINcl_PifoZlSLdgRFJdFuX02bjJxEwJVoyXsGqKQ [CURL DBG] > [CURL DBG] < HTTP/1.1 403 Forbidden [CURL DBG] < Date: Fri, 19 Feb 2021 14:41:24 GMT [CURL DBG] < X-Clv-Request-Id: e52c54bb-91f5-4b41-babb-8bd5c3a57103 [CURL DBG] < Server: Cleversafe [CURL DBG] < X-Clv-S3-Version: 2.5 [CURL DBG] < Accept-Ranges: bytes [CURL DBG] < x-amz-request-id: e52c54bb-91f5-4b41-babb-8bd5c3a57103 [CURL DBG] < WWW-Authenticate: Basic realm="Cleversafe Dispersed Storage Network" [CURL DBG] < Content-Type: application/xml [CURL DBG] < Content-Length: 288 [CURL DBG] < [CURL DBG] * Connection #1 to host s3.us.cloud-object-storage.appdomain.cloud left intact [ERR] curl.cpp:RequestPerform(2540): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?><Error><Code>AccessDenied</Code><Message>Access Denied</Message><Resource>/rhmccp-ae4ac7b9-38e6-4c5f-8e5b-566b7cfed37d/</Resource><RequestId>e52c54bb-91f5-4b41-babb-8bd5c3a57103</RequestId><httpStatusCode>403</httpStatusCode></Error> [ERR] s3fs.cpp:list_bucket(2594): ListBucketRequest returns with error. [ERR] s3fs.cpp:s3fs_readdir(2523): list_bucket returns error(-1). ``` ### Details about issue When using `ibm_iam_auth`, we notice connections to bucket fail with authorization errors, after leaving it idle for hours. Detailed logs are provided below. Note: Logs and details below are collected from developer machine where I was able to reproduce same error.
kerem closed this issue 2026-03-04 01:49:08 +03:00
Author
Owner

@grishgo-dev commented on GitHub (Feb 20, 2021):

Fixed in release 1.88
https://github.com/s3fs-fuse/s3fs-fuse/pull/1421

Closing issue.

<!-- gh-comment-id:782681710 --> @grishgo-dev commented on GitHub (Feb 20, 2021): Fixed in release 1.88 https://github.com/s3fs-fuse/s3fs-fuse/pull/1421 Closing issue.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#827
No description provided.