starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 05:16:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #2036] marker_xp->nodesetval is empty in calling list_bucket(get_base_exp) #1027

New issue
Open
opened 2026-03-04 01:50:47 +03:00 by kerem · 3 comments
kerem commented 2026-03-04 01:50:47 +03:00
Owner
Copy link

Originally created by @ggtakec on GitHub (Sep 24, 2022).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2036

Additional Information

This issue is what seems to be a bug reported by @SanjeetKr7 while testing #2028.
This is happening in master's code at the moment, but I haven't been able to reproduce it yet.

Logs

He could not start s3fs with the following error:

2022-09-08T05:37:16.750Z [INF] curl.cpp:InitMimeType(428): Loaded mime information from /etc/mime.types
2022-09-08T05:37:16.754Z [INF] s3fs.cpp:s3fs_init(3502): init v1.91(commit:69b0599) with OpenSSL
2022-09-08T05:37:38.357Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty.
2022-09-08T05:42:31.517Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty.
2022-09-08T06:02:03.424Z [INF]     s3fs.cpp:set_mountpoint_attribute(3737): PROC(uid=1000, gid=1000) - MountPoint(uid=1000, gid=1000, mode=40700)
2022-09-08T06:02:03.440Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty.
2022-09-08T06:02:03.446Z [INF] curl.cpp:InitMimeType(428): Loaded mime information from /etc/mime.types
2022-09-08T06:02:03.447Z [INF] fdcache_stat.cpp:CheckCacheFileStatTopDir(78): The path to cache top dir is empty, thus not need to check permission.
2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:StopThreads(195): Any threads are running now, then nothing to do.
2022-09-08T06:02:03.447Z [INF]       threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-08T06:02:03.447Z [INF]       threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-08T06:02:03.447Z [INF]       threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-08T06:02:03.447Z [INF]       threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-08T06:02:03.447Z [INF]       threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-08T06:02:03.454Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty.

my opinion at the moment

I think only list_bucket calls get_base_exp.
Therefore, the above log seems to have tried to obtain a file list such as ls for the mount point immediately after s3fs started.
And for some reason I am receiving an empty marker_xp->nodesetval.

We need a little more detailed log, so I ask him to get a log using the dbglevel=dbg and curldbg option.

Originally created by @ggtakec on GitHub (Sep 24, 2022). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2036 ### Additional Information This issue is what seems to be a bug reported by @SanjeetKr7 while testing #2028. This is happening in master's code at the moment, but I haven't been able to reproduce it yet. #### Logs He could not start s3fs with the following error: ``` 2022-09-08T05:37:16.750Z [INF] curl.cpp:InitMimeType(428): Loaded mime information from /etc/mime.types 2022-09-08T05:37:16.754Z [INF] s3fs.cpp:s3fs_init(3502): init v1.91(commit:69b0599) with OpenSSL 2022-09-08T05:37:38.357Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2022-09-08T05:42:31.517Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2022-09-08T06:02:03.424Z [INF] s3fs.cpp:set_mountpoint_attribute(3737): PROC(uid=1000, gid=1000) - MountPoint(uid=1000, gid=1000, mode=40700) 2022-09-08T06:02:03.440Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2022-09-08T06:02:03.446Z [INF] curl.cpp:InitMimeType(428): Loaded mime information from /etc/mime.types 2022-09-08T06:02:03.447Z [INF] fdcache_stat.cpp:CheckCacheFileStatTopDir(78): The path to cache top dir is empty, thus not need to check permission. 2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:StopThreads(195): Any threads are running now, then nothing to do. 2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-08T06:02:03.447Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-08T06:02:03.454Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. ``` #### my opinion at the moment I think only list_bucket calls get_base_exp. Therefore, the above log seems to have tried to obtain a file list such as ls for the mount point immediately after s3fs started. And for some reason I am receiving an empty marker_xp->nodesetval. We need a little more detailed log, so I ask him to get a log using the `dbglevel=dbg` and `curldbg` option.
kerem commented 2026-03-04 01:50:48 +03:00
Author
Owner
Copy link

@SanjeetKr7 commented on GitHub (Sep 26, 2022):

@ggtakec

Detailed Logs

/ # s3fs "defautl-bucket" "/root/dev1" \
>     -o ro \
>     -o noatime \
>     -o passwd_file="/etc/s3cred_defautl-bucket_user1,use_path_re
quest_style,url=http://s3.xxxxxx:80" \
>     -o curldbg="body" \
>     -o dbglevel=dbg \
>     -o connect_timeout="900" \
>     -o readwrite_timeout="600" \
>     -o multireq_max="50" \
>     -f -d -d

2022-09-26T12:00:44.562Z [INF] s3fs version 1.91(5b95a0f) : s3fs -o ro -o noatime -o passwd_file=/etc/s3cred_defautl-bucket_user1,use_path_request_style,url=http://s3.xxxxxx:80 -o curldbg=body -o dbglevel=dbg -o connect_timeout=900 -o readwrite_timeout=600 -o multireq_max=50 -f -d -d defautl-bucket /root/dev1
2022-09-26T12:00:44.563Z [CRT] s3fs_logger.cpp:LowSetLogLevel(240): change debug level from [CRT] to [DBG]
2022-09-26T12:00:44.563Z [INF] s3fs.cpp:set_mountpoint_attribute(3736): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40777)
2022-09-26T12:00:44.564Z [INF] s3fs_util.cpp:compare_sysname(421): system name is Linux
2022-09-26T12:00:44.564Z [WAN] curl.cpp:InitMimeType(400): Could not find mime.types files, you have to create file(/etc/mime.types) or specify mime option for existing mime.types file.
2022-09-26T12:00:44.564Z [WAN] s3fs.cpp:main(4683): Missing MIME types prevents setting Content-Type on uploaded objects.
2022-09-26T12:00:44.564Z [INF] fdcache_stat.cpp:CheckCacheFileStatTopDir(78): The path to cache top dir is empty, thus not need to check permission.
2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:StopThreads(195): Any threads are running now, then nothing to do.
2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan.
FUSE library version: 2.9.9
nullpath_ok: 0
nopath: 0
utime_omit_ok: 1
unique: 2, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0
INIT: 7.31
flags=0x03fffffb
max_readahead=0x00020000
2022-09-26T12:00:44.565Z [INF] s3fs.cpp:s3fs_init(3502): init v1.91(commit:5b95a0f) with OpenSSL
2022-09-26T12:00:44.565Z [INF] s3fs.cpp:s3fs_check_service(3622): check services.
2022-09-26T12:00:44.565Z [INF] curl.cpp:CheckBucket(3549): check a bucket.
2022-09-26T12:00:44.565Z [DBG] curl_handlerpool.cpp:GetHandler(79): Get handler from pool: rest = 31
2022-09-26T12:00:44.565Z [INF] curl_util.cpp:prepare_url(257): URL is http://s3.xxxxxx:80/defautl-bucket/
2022-09-26T12:00:44.565Z [INF] curl_util.cpp:prepare_url(290): URL changed is http://s3.xxxxxx:80/defautl-bucket/
2022-09-26T12:00:44.565Z [DBG] curl.cpp:RequestPerform(2366): connecting to URL http://s3.xxxxxx:80/defautl-bucket/
2022-09-26T12:00:44.565Z [INF] curl.cpp:insertV4Headers(2773): computing signature [GET] [/] [] []
2022-09-26T12:00:44.565Z [INF] curl_util.cpp:url_to_host(334): url is http://s3.xxxxxx:80
2022-09-26T12:00:44.565Z [CURL DBG] * Uses proxy env variable NO_PROXY == ',.xxxxxx'
2022-09-26T12:00:44.569Z [CURL DBG] * Trying 172.xxxxxx:80...
2022-09-26T12:00:44.570Z [CURL DBG] * Connected to s3.xxxxxx (172.xxxxxx) port 80 (#0)
2022-09-26T12:00:44.570Z [CURL DBG] > GET /defautl-bucket/ HTTP/1.1
2022-09-26T12:00:44.570Z [CURL DBG] > Host: s3.xxxxxx:80
2022-09-26T12:00:44.570Z [CURL DBG] > User-Agent: s3fs/1.91 (commit hash 5b95a0f; OpenSSL)
2022-09-26T12:00:44.570Z [CURL DBG] > Accept: /
2022-09-26T12:00:44.570Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=Ak12bt7qsxUKBtTZcC0Q/20220926/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=119e466d06da90fb987961f25c3aa0950adfec23ce23456d6ec92af7fd943324
2022-09-26T12:00:44.570Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2022-09-26T12:00:44.570Z [CURL DBG] > x-amz-date: 20220926T120044Z
2022-09-26T12:00:44.570Z [CURL DBG] >
2022-09-26T12:00:44.632Z [CURL DBG] * Mark bundle as not supporting multiuse
2022-09-26T12:00:44.632Z [CURL DBG] < HTTP/1.1 200 OK
2022-09-26T12:00:44.632Z [CURL DBG] < x-amz-request-id: l8ipxee3-4tqc7y-12dr
2022-09-26T12:00:44.632Z [CURL DBG] < x-amz-id-2: l8ipxee3-4tqc7y-12dr
2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Origin: *
2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Credentials: true
2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Methods: GET,POST,PUT,DELETE,OPTIONS
2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Headers: Content-Type,Content-MD5,Authorization,X-Amz-User-Agent,X-Amz-Date,ETag,X-Amz-Content-Sha256
2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Expose-Headers: ETag,X-Amz-Version-Id
2022-09-26T12:00:44.632Z [CURL DBG] < Content-Type: application/xml
2022-09-26T12:00:44.632Z [CURL DBG] < Content-Length: 326206
2022-09-26T12:00:44.632Z [CURL DBG] < Date: Mon, 26 Sep 2022 12:00:44 GMT
2022-09-26T12:00:44.632Z [CURL DBG] < Connection: keep-alive
2022-09-26T12:00:44.632Z [CURL DBG] < Keep-Alive: timeout=5
2022-09-26T12:00:44.632Z [CURL DBG] <
2022-09-26T12:00:44.634Z [CURL DBG] * Connection #0 to host s3.xxxxxx left intact
2022-09-26T12:00:44.634Z [INF] curl.cpp:RequestPerform(2401): HTTP response code 200
2022-09-26T12:00:44.634Z [DBG] curl_handlerpool.cpp:ReturnHandler(101): Return handler to pool
INIT: 7.19
flags=0x00000039
max_readahead=0x00020000
max_write=0x00020000
max_background=0
congestion_threshold=0
unique: 2, success, outsize: 40
unique: 4, opcode: GETXATTR (22), nodeid: 1, insize: 68, pid: 1081
unique: 4, error: -38 (Function not implemented), outsize: 16
unique: 6, opcode: ACCESS (34), nodeid: 1, insize: 48, pid: 1081
access / 01
2022-09-26T12:01:10.212Z [INF] s3fs.cpp:s3fs_access(3561): [path=/][mask=X_OK ]
2022-09-26T12:01:10.212Z [DBG] s3fs.cpp:check_object_access(521): [path=/]
2022-09-26T12:01:10.212Z [DBG] s3fs.cpp:check_object_access(526): [pid=1081,uid=0,gid=0]
2022-09-26T12:01:10.212Z [DBG] s3fs.cpp:get_object_attribute(352): [path=/]
unique: 6, success, outsize: 16
unique: 8, opcode: OPENDIR (27), nodeid: 1, insize: 48, pid: 1111
opendir flags: 0x18000 /
2022-09-26T12:01:14.381Z [INF] s3fs.cpp:s3fs_opendir(2585): [path=/][flags=0x18000]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(521): [path=/]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(526): [pid=1111,uid=0,gid=0]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:get_object_attribute(352): [path=/]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_parent_object_access(629): [path=/]
opendir[0] flags: 0x18000 /
unique: 8, success, outsize: 32
unique: 10, opcode: READDIR (28), nodeid: 1, insize: 80, pid: 1111
readdir[0] from 0
2022-09-26T12:01:14.381Z [INF] s3fs.cpp:s3fs_readdir(2758): [path=/]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(521): [path=/]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(526): [pid=1111,uid=0,gid=0]
2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:get_object_attribute(352): [path=/]
2022-09-26T12:01:14.381Z [INF] s3fs.cpp:list_bucket(2802): [path=/]
2022-09-26T12:01:14.381Z [INF] curl.cpp:ListBucketRequest(3599): [tpath=/]
2022-09-26T12:01:14.381Z [DBG] curl_handlerpool.cpp:GetHandler(79): Get handler from pool: rest = 31
2022-09-26T12:01:14.381Z [INF] curl_util.cpp:prepare_url(257): URL is http://s3.xxxxxx:80/defautl-bucket?delimiter=/&max-keys=1000&prefix=
2022-09-26T12:01:14.381Z [INF] curl_util.cpp:prepare_url(290): URL changed is http://s3.xxxxxx:80/defautl-bucket/?delimiter=/&max-keys=1000&prefix=
2022-09-26T12:01:14.381Z [DBG] curl.cpp:RequestPerform(2366): connecting to URL http://s3.xxxxxx:80/defautl-bucket/?delimiter=/&max-keys=1000&prefix=
2022-09-26T12:01:14.381Z [INF] curl.cpp:insertV4Headers(2773): computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] []
2022-09-26T12:01:14.381Z [INF] curl_util.cpp:url_to_host(334): url is http://s3.xxxxxx:80
2022-09-26T12:01:14.381Z [CURL DBG] * Uses proxy env variable NO_PROXY == ',.xxxxxx'
2022-09-26T12:01:14.381Z [CURL DBG] * Connection 0 seems to be dead!
2022-09-26T12:01:14.381Z [CURL DBG] * Closing connection 0
2022-09-26T12:01:14.381Z [CURL DBG] * Hostname s3.xxxxxx was found in DNS cache
2022-09-26T12:01:14.381Z [CURL DBG] * Trying 172.xxxxxx:80...
2022-09-26T12:01:14.382Z [CURL DBG] * Connected to s3.xxxxxx (172.xxxxxx) port 80 (#1)
2022-09-26T12:01:14.382Z [CURL DBG] > GET /defautl-bucket/?delimiter=/&max-keys=1000&prefix= HTTP/1.1
2022-09-26T12:01:14.382Z [CURL DBG] > Host: s3.xxxxxx:80
2022-09-26T12:01:14.382Z [CURL DBG] > User-Agent: s3fs/1.91 (commit hash 5b95a0f; OpenSSL)
2022-09-26T12:01:14.382Z [CURL DBG] > Accept: /
2022-09-26T12:01:14.382Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=Ak12bt7qsxUKBtTZcC0Q/20220926/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=1b3c29265e3867f2f9344360bb6812f086662e1c5c1af08e619ba8b4028dddc2
2022-09-26T12:01:14.382Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2022-09-26T12:01:14.382Z [CURL DBG] > x-amz-date: 20220926T120114Z
2022-09-26T12:01:14.382Z [CURL DBG] >
2022-09-26T12:01:14.416Z [CURL DBG] * Mark bundle as not supporting multiuse
2022-09-26T12:01:14.416Z [CURL DBG] < HTTP/1.1 200 OK
2022-09-26T12:01:14.416Z [CURL DBG] < x-amz-request-id: l8ipy1e7-1po09i-lnp
2022-09-26T12:01:14.416Z [CURL DBG] < x-amz-id-2: l8ipy1e7-1po09i-lnp
2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Origin: *
2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Credentials: true
2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Methods: GET,POST,PUT,DELETE,OPTIONS
2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Headers: Content-Type,Content-MD5,Authorization,X-Amz-User-Agent,X-Amz-Date,ETag,X-Amz-Content-Sha256
2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Expose-Headers: ETag,X-Amz-Version-Id
2022-09-26T12:01:14.416Z [CURL DBG] < Content-Type: application/xml
2022-09-26T12:01:14.416Z [CURL DBG] < Content-Length: 287
2022-09-26T12:01:14.416Z [CURL DBG] < Date: Mon, 26 Sep 2022 12:01:14 GMT
2022-09-26T12:01:14.416Z [CURL DBG] < Connection: keep-alive
2022-09-26T12:01:14.416Z [CURL DBG] < Keep-Alive: timeout=5
2022-09-26T12:01:14.416Z [CURL DBG] <
2022-09-26T12:01:14.416Z [CURL DBG] BODY < <?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>defautl-bucket</Name><Delimiter>/</Delimiter><MaxKeys>1000</MaxKeys><IsTruncated>false</IsTruncated><CommonPrefixes><Prefix>RBTS/</Prefix></CommonPrefixes></ListBucketResult>
2022-09-26T12:01:14.416Z [CURL DBG] * Connection #1 to host s3.xxxxxx left intact
2022-09-26T12:01:14.416Z [INF] curl.cpp:RequestPerform(2401): HTTP response code 200
2022-09-26T12:01:14.416Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty.
2022-09-26T12:01:14.416Z [DBG] s3fs_xml.cpp:append_objects_from_xml_ex(353): contents_xp->nodesetval is empty.
2022-09-26T12:01:14.416Z [DBG] curl_handlerpool.cpp:ReturnHandler(101): Return handler to pool
2022-09-26T12:01:14.417Z [INF] s3fs.cpp:readdir_multi_head(2677): [path=/][list=0]
2022-09-26T12:01:14.417Z [INF] curl.cpp:PreHeadRequest(3137): [tpath=/RBTS/][bpath=RBTS/][save=/RBTS/][sseckeypos=18446744073709551615]
2022-09-26T12:01:14.417Z [INF] curl_util.cpp:prepare_url(257): URL is http://s3.xxxxxx:80/defautl-bucket/RBTS/
2022-09-26T12:01:14.417Z [INF] curl_util.cpp:prepare_url(290): URL changed is http://s3.xxxxxx:80/defautl-bucket/RBTS/
2022-09-26T12:01:14.417Z [INF] curl_multi.cpp:Request(306): [count=1]
2022-09-26T12:01:14.417Z [DBG] curl_handlerpool.cpp:GetHandler(79): Get handler from pool: rest = 31
2022-09-26T12:01:14.417Z [DBG] curl.cpp:RequestPerform(2366): connecting to URL http://s3.xxxxxx:80/defautl-bucket/RBTS/
2022-09-26T12:01:14.417Z [INF] curl.cpp:insertV4Headers(2773): computing signature [HEAD] [/RBTS/] [] []
2022-09-26T12:01:14.417Z [INF] curl_util.cpp:url_to_host(334): url is http://s3.xxxxxx:80
2022-09-26T12:01:14.417Z [CURL DBG] * Uses proxy env variable NO_PROXY == ',*.xxxxxx'
2022-09-26T12:01:14.417Z [CURL DBG] * Found bundle for host s3.xxxxxx: 0x7fb5a25ef9a0 [serially]
2022-09-26T12:01:14.417Z [CURL DBG] * Can not multiplex, even if we wanted to!
2022-09-26T12:01:14.417Z [CURL DBG] * Re-using existing connection! (#1) with host s3.xxxxxx
2022-09-26T12:01:14.417Z [CURL DBG] * Connected to s3.xxxxxx (172.xxxxxx) port 80 (#1)
2022-09-26T12:01:14.417Z [CURL DBG] > HEAD /defautl-bucket/RBTS/ HTTP/1.1
2022-09-26T12:01:14.417Z [CURL DBG] > Host: s3.xxxxxx:80
2022-09-26T12:01:14.417Z [CURL DBG] > User-Agent: s3fs/1.91 (commit hash 5b95a0f; OpenSSL)
2022-09-26T12:01:14.417Z [CURL DBG] > Accept: /
2022-09-26T12:01:14.417Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=Ak12bt7qsxUKBtTZcC0Q/20220926/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=ecddcc0b22a0565a322b4e12db50a2ff06023ac7ae53ad3454638b5cad81f2e5
2022-09-26T12:01:14.417Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2022-09-26T12:01:14.417Z [CURL DBG] > x-amz-date: 20220926T120114Z
2022-09-26T12:01:14.417Z [CURL DBG] >
2022-09-26T12:01:14.420Z [CURL DBG] * Mark bundle as not supporting multiuse
2022-09-26T12:01:14.420Z [CURL DBG] < HTTP/1.1 404 Not Found
2022-09-26T12:01:14.420Z [CURL DBG] < x-amz-request-id: l8ipy1f5-2acs1l-hu8
2022-09-26T12:01:14.420Z [CURL DBG] < x-amz-id-2: l8ipy1f5-2acs1l-hu8
2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Origin: *
2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Credentials: true
2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Methods: GET,POST,PUT,DELETE,OPTIONS
2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Headers: Content-Type,Content-MD5,Authorization,X-Amz-User-Agent,X-Amz-Date,ETag,X-Amz-Content-Sha256
2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Expose-Headers: ETag,X-Amz-Version-Id
2022-09-26T12:01:14.420Z [CURL DBG] < Content-Type: application/xml
2022-09-26T12:01:14.420Z [CURL DBG] < Content-Length: 214
2022-09-26T12:01:14.420Z [CURL DBG] < Date: Mon, 26 Sep 2022 12:01:14 GMT
2022-09-26T12:01:14.420Z [CURL DBG] < Connection: keep-alive
2022-09-26T12:01:14.420Z [CURL DBG] < Keep-Alive: timeout=5
2022-09-26T12:01:14.420Z [CURL DBG] <
2022-09-26T12:01:14.420Z [CURL DBG] * Connection #1 to host s3.xxxxxx left intact
2022-09-26T12:01:14.420Z [INF] curl.cpp:RequestPerform(2453): HTTP response code 404 was returned, returning ENOENT
2022-09-26T12:01:14.420Z [DBG] curl.cpp:RequestPerform(2454): Body Text:
2022-09-26T12:01:14.420Z [DBG] curl_handlerpool.cpp:ReturnHandler(101): Return handler to pool
unique: 10, success, outsize: 80
unique: 12, opcode: READDIR (28), nodeid: 1, insize: 80, pid: 1111
unique: 12, success, outsize: 16
unique: 14, opcode: RELEASEDIR (29), nodeid: 1, insize: 64, pid: 0
unique: 14, success, outsize: 16

<!-- gh-comment-id:1257966718 --> @SanjeetKr7 commented on GitHub (Sep 26, 2022): @ggtakec `Detailed Logs` ``` / # s3fs "defautl-bucket" "/root/dev1" \ > -o ro \ > -o noatime \ > -o passwd_file="/etc/s3cred_defautl-bucket_user1,use_path_re quest_style,url=http://s3.xxxxxx:80" \ > -o curldbg="body" \ > -o dbglevel=dbg \ > -o connect_timeout="900" \ > -o readwrite_timeout="600" \ > -o multireq_max="50" \ > -f -d -d ``` 2022-09-26T12:00:44.562Z [INF] s3fs version 1.91(5b95a0f) : s3fs -o ro -o noatime -o passwd_file=/etc/s3cred_defautl-bucket_user1,use_path_request_style,url=http://s3.xxxxxx:80 -o curldbg=body -o dbglevel=dbg -o connect_timeout=900 -o readwrite_timeout=600 -o multireq_max=50 -f -d -d defautl-bucket /root/dev1 2022-09-26T12:00:44.563Z [CRT] s3fs_logger.cpp:LowSetLogLevel(240): change debug level from [CRT] to [DBG] 2022-09-26T12:00:44.563Z [INF] s3fs.cpp:set_mountpoint_attribute(3736): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40777) 2022-09-26T12:00:44.564Z [INF] s3fs_util.cpp:compare_sysname(421): system name is Linux 2022-09-26T12:00:44.564Z [WAN] curl.cpp:InitMimeType(400): Could not find mime.types files, you have to create file(/etc/mime.types) or specify mime option for existing mime.types file. 2022-09-26T12:00:44.564Z [WAN] s3fs.cpp:main(4683): Missing MIME types prevents setting Content-Type on uploaded objects. 2022-09-26T12:00:44.564Z [INF] fdcache_stat.cpp:CheckCacheFileStatTopDir(78): The path to cache top dir is empty, thus not need to check permission. 2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:StopThreads(195): Any threads are running now, then nothing to do. 2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. 2022-09-26T12:00:44.564Z [INF] threadpoolman.cpp:Worker(76): Start worker thread in ThreadPoolMan. FUSE library version: 2.9.9 nullpath_ok: 0 nopath: 0 utime_omit_ok: 1 unique: 2, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0 INIT: 7.31 flags=0x03fffffb max_readahead=0x00020000 2022-09-26T12:00:44.565Z [INF] s3fs.cpp:s3fs_init(3502): init v1.91(commit:5b95a0f) with OpenSSL 2022-09-26T12:00:44.565Z [INF] s3fs.cpp:s3fs_check_service(3622): check services. 2022-09-26T12:00:44.565Z [INF] curl.cpp:CheckBucket(3549): check a bucket. 2022-09-26T12:00:44.565Z [DBG] curl_handlerpool.cpp:GetHandler(79): Get handler from pool: rest = 31 2022-09-26T12:00:44.565Z [INF] curl_util.cpp:prepare_url(257): URL is http://s3.xxxxxx:80/defautl-bucket/ 2022-09-26T12:00:44.565Z [INF] curl_util.cpp:prepare_url(290): URL changed is http://s3.xxxxxx:80/defautl-bucket/ 2022-09-26T12:00:44.565Z [DBG] curl.cpp:RequestPerform(2366): connecting to URL http://s3.xxxxxx:80/defautl-bucket/ 2022-09-26T12:00:44.565Z [INF] curl.cpp:insertV4Headers(2773): computing signature [GET] [/] [] [] 2022-09-26T12:00:44.565Z [INF] curl_util.cpp:url_to_host(334): url is http://s3.xxxxxx:80 2022-09-26T12:00:44.565Z [CURL DBG] * Uses proxy env variable NO_PROXY == ',*.xxxxxx' 2022-09-26T12:00:44.569Z [CURL DBG] * Trying 172.xxxxxx:80... 2022-09-26T12:00:44.570Z [CURL DBG] * Connected to s3.xxxxxx (172.xxxxxx) port 80 (#0) 2022-09-26T12:00:44.570Z [CURL DBG] > GET /defautl-bucket/ HTTP/1.1 2022-09-26T12:00:44.570Z [CURL DBG] > Host: s3.xxxxxx:80 2022-09-26T12:00:44.570Z [CURL DBG] > User-Agent: s3fs/1.91 (commit hash 5b95a0f; OpenSSL) 2022-09-26T12:00:44.570Z [CURL DBG] > Accept: */* 2022-09-26T12:00:44.570Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=Ak12bt7qsxUKBtTZcC0Q/20220926/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=119e466d06da90fb987961f25c3aa0950adfec23ce23456d6ec92af7fd943324 2022-09-26T12:00:44.570Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2022-09-26T12:00:44.570Z [CURL DBG] > x-amz-date: 20220926T120044Z 2022-09-26T12:00:44.570Z [CURL DBG] > 2022-09-26T12:00:44.632Z [CURL DBG] * Mark bundle as not supporting multiuse 2022-09-26T12:00:44.632Z [CURL DBG] < HTTP/1.1 200 OK 2022-09-26T12:00:44.632Z [CURL DBG] < x-amz-request-id: l8ipxee3-4tqc7y-12dr 2022-09-26T12:00:44.632Z [CURL DBG] < x-amz-id-2: l8ipxee3-4tqc7y-12dr 2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Origin: * 2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Credentials: true 2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Methods: GET,POST,PUT,DELETE,OPTIONS 2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Allow-Headers: Content-Type,Content-MD5,Authorization,X-Amz-User-Agent,X-Amz-Date,ETag,X-Amz-Content-Sha256 2022-09-26T12:00:44.632Z [CURL DBG] < Access-Control-Expose-Headers: ETag,X-Amz-Version-Id 2022-09-26T12:00:44.632Z [CURL DBG] < Content-Type: application/xml 2022-09-26T12:00:44.632Z [CURL DBG] < Content-Length: 326206 2022-09-26T12:00:44.632Z [CURL DBG] < Date: Mon, 26 Sep 2022 12:00:44 GMT 2022-09-26T12:00:44.632Z [CURL DBG] < Connection: keep-alive 2022-09-26T12:00:44.632Z [CURL DBG] < Keep-Alive: timeout=5 2022-09-26T12:00:44.632Z [CURL DBG] < 2022-09-26T12:00:44.634Z [CURL DBG] * Connection #0 to host s3.xxxxxx left intact 2022-09-26T12:00:44.634Z [INF] curl.cpp:RequestPerform(2401): HTTP response code 200 2022-09-26T12:00:44.634Z [DBG] curl_handlerpool.cpp:ReturnHandler(101): Return handler to pool INIT: 7.19 flags=0x00000039 max_readahead=0x00020000 max_write=0x00020000 max_background=0 congestion_threshold=0 unique: 2, success, outsize: 40 unique: 4, opcode: GETXATTR (22), nodeid: 1, insize: 68, pid: 1081 unique: 4, error: -38 (Function not implemented), outsize: 16 unique: 6, opcode: ACCESS (34), nodeid: 1, insize: 48, pid: 1081 access / 01 2022-09-26T12:01:10.212Z [INF] s3fs.cpp:s3fs_access(3561): [path=/][mask=X_OK ] 2022-09-26T12:01:10.212Z [DBG] s3fs.cpp:check_object_access(521): [path=/] 2022-09-26T12:01:10.212Z [DBG] s3fs.cpp:check_object_access(526): [pid=1081,uid=0,gid=0] 2022-09-26T12:01:10.212Z [DBG] s3fs.cpp:get_object_attribute(352): [path=/] unique: 6, success, outsize: 16 unique: 8, opcode: OPENDIR (27), nodeid: 1, insize: 48, pid: 1111 opendir flags: 0x18000 / 2022-09-26T12:01:14.381Z [INF] s3fs.cpp:s3fs_opendir(2585): [path=/][flags=0x18000] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(521): [path=/] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(526): [pid=1111,uid=0,gid=0] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:get_object_attribute(352): [path=/] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_parent_object_access(629): [path=/] opendir[0] flags: 0x18000 / unique: 8, success, outsize: 32 unique: 10, opcode: READDIR (28), nodeid: 1, insize: 80, pid: 1111 readdir[0] from 0 2022-09-26T12:01:14.381Z [INF] s3fs.cpp:s3fs_readdir(2758): [path=/] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(521): [path=/] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:check_object_access(526): [pid=1111,uid=0,gid=0] 2022-09-26T12:01:14.381Z [DBG] s3fs.cpp:get_object_attribute(352): [path=/] 2022-09-26T12:01:14.381Z [INF] s3fs.cpp:list_bucket(2802): [path=/] 2022-09-26T12:01:14.381Z [INF] curl.cpp:ListBucketRequest(3599): [tpath=/] 2022-09-26T12:01:14.381Z [DBG] curl_handlerpool.cpp:GetHandler(79): Get handler from pool: rest = 31 2022-09-26T12:01:14.381Z [INF] curl_util.cpp:prepare_url(257): URL is http://s3.xxxxxx:80/defautl-bucket?delimiter=/&max-keys=1000&prefix= 2022-09-26T12:01:14.381Z [INF] curl_util.cpp:prepare_url(290): URL changed is http://s3.xxxxxx:80/defautl-bucket/?delimiter=/&max-keys=1000&prefix= 2022-09-26T12:01:14.381Z [DBG] curl.cpp:RequestPerform(2366): connecting to URL http://s3.xxxxxx:80/defautl-bucket/?delimiter=/&max-keys=1000&prefix= 2022-09-26T12:01:14.381Z [INF] curl.cpp:insertV4Headers(2773): computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] [] 2022-09-26T12:01:14.381Z [INF] curl_util.cpp:url_to_host(334): url is http://s3.xxxxxx:80 2022-09-26T12:01:14.381Z [CURL DBG] * Uses proxy env variable NO_PROXY == ',*.xxxxxx' 2022-09-26T12:01:14.381Z [CURL DBG] * Connection 0 seems to be dead! 2022-09-26T12:01:14.381Z [CURL DBG] * Closing connection 0 2022-09-26T12:01:14.381Z [CURL DBG] * Hostname s3.xxxxxx was found in DNS cache 2022-09-26T12:01:14.381Z [CURL DBG] * Trying 172.xxxxxx:80... 2022-09-26T12:01:14.382Z [CURL DBG] * Connected to s3.xxxxxx (172.xxxxxx) port 80 (#1) 2022-09-26T12:01:14.382Z [CURL DBG] > GET /defautl-bucket/?delimiter=/&max-keys=1000&prefix= HTTP/1.1 2022-09-26T12:01:14.382Z [CURL DBG] > Host: s3.xxxxxx:80 2022-09-26T12:01:14.382Z [CURL DBG] > User-Agent: s3fs/1.91 (commit hash 5b95a0f; OpenSSL) 2022-09-26T12:01:14.382Z [CURL DBG] > Accept: */* 2022-09-26T12:01:14.382Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=Ak12bt7qsxUKBtTZcC0Q/20220926/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=1b3c29265e3867f2f9344360bb6812f086662e1c5c1af08e619ba8b4028dddc2 2022-09-26T12:01:14.382Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2022-09-26T12:01:14.382Z [CURL DBG] > x-amz-date: 20220926T120114Z 2022-09-26T12:01:14.382Z [CURL DBG] > 2022-09-26T12:01:14.416Z [CURL DBG] * Mark bundle as not supporting multiuse 2022-09-26T12:01:14.416Z [CURL DBG] < HTTP/1.1 200 OK 2022-09-26T12:01:14.416Z [CURL DBG] < x-amz-request-id: l8ipy1e7-1po09i-lnp 2022-09-26T12:01:14.416Z [CURL DBG] < x-amz-id-2: l8ipy1e7-1po09i-lnp 2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Origin: * 2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Credentials: true 2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Methods: GET,POST,PUT,DELETE,OPTIONS 2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Allow-Headers: Content-Type,Content-MD5,Authorization,X-Amz-User-Agent,X-Amz-Date,ETag,X-Amz-Content-Sha256 2022-09-26T12:01:14.416Z [CURL DBG] < Access-Control-Expose-Headers: ETag,X-Amz-Version-Id 2022-09-26T12:01:14.416Z [CURL DBG] < Content-Type: application/xml 2022-09-26T12:01:14.416Z [CURL DBG] < Content-Length: 287 2022-09-26T12:01:14.416Z [CURL DBG] < Date: Mon, 26 Sep 2022 12:01:14 GMT 2022-09-26T12:01:14.416Z [CURL DBG] < Connection: keep-alive 2022-09-26T12:01:14.416Z [CURL DBG] < Keep-Alive: timeout=5 2022-09-26T12:01:14.416Z [CURL DBG] < 2022-09-26T12:01:14.416Z [CURL DBG] BODY \< \<?xml version="1.0" encoding="UTF-8"?\>\<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name\>defautl-bucket\</Name\><Delimiter\>/\</Delimiter\><MaxKeys\>1000\</MaxKeys\><IsTruncated\>false\</IsTruncated\><CommonPrefixes\><Prefix\>RBTS/\</Prefix\></CommonPrefixes\></ListBucketResult\> 2022-09-26T12:01:14.416Z [CURL DBG] * Connection #1 to host s3.xxxxxx left intact 2022-09-26T12:01:14.416Z [INF] curl.cpp:RequestPerform(2401): HTTP response code 200 2022-09-26T12:01:14.416Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2022-09-26T12:01:14.416Z [DBG] s3fs_xml.cpp:append_objects_from_xml_ex(353): contents_xp->nodesetval is empty. 2022-09-26T12:01:14.416Z [DBG] curl_handlerpool.cpp:ReturnHandler(101): Return handler to pool 2022-09-26T12:01:14.417Z [INF] s3fs.cpp:readdir_multi_head(2677): [path=/][list=0] 2022-09-26T12:01:14.417Z [INF] curl.cpp:PreHeadRequest(3137): [tpath=/RBTS/][bpath=RBTS/][save=/RBTS/][sseckeypos=18446744073709551615] 2022-09-26T12:01:14.417Z [INF] curl_util.cpp:prepare_url(257): URL is http://s3.xxxxxx:80/defautl-bucket/RBTS/ 2022-09-26T12:01:14.417Z [INF] curl_util.cpp:prepare_url(290): URL changed is http://s3.xxxxxx:80/defautl-bucket/RBTS/ 2022-09-26T12:01:14.417Z [INF] curl_multi.cpp:Request(306): [count=1] 2022-09-26T12:01:14.417Z [DBG] curl_handlerpool.cpp:GetHandler(79): Get handler from pool: rest = 31 2022-09-26T12:01:14.417Z [DBG] curl.cpp:RequestPerform(2366): connecting to URL http://s3.xxxxxx:80/defautl-bucket/RBTS/ 2022-09-26T12:01:14.417Z [INF] curl.cpp:insertV4Headers(2773): computing signature [HEAD] [/RBTS/] [] [] 2022-09-26T12:01:14.417Z [INF] curl_util.cpp:url_to_host(334): url is http://s3.xxxxxx:80 2022-09-26T12:01:14.417Z [CURL DBG] * Uses proxy env variable NO_PROXY == ',*.xxxxxx' 2022-09-26T12:01:14.417Z [CURL DBG] * Found bundle for host s3.xxxxxx: 0x7fb5a25ef9a0 [serially] 2022-09-26T12:01:14.417Z [CURL DBG] * Can not multiplex, even if we wanted to! 2022-09-26T12:01:14.417Z [CURL DBG] * Re-using existing connection! (#1) with host s3.xxxxxx 2022-09-26T12:01:14.417Z [CURL DBG] * Connected to s3.xxxxxx (172.xxxxxx) port 80 (#1) 2022-09-26T12:01:14.417Z [CURL DBG] > HEAD /defautl-bucket/RBTS/ HTTP/1.1 2022-09-26T12:01:14.417Z [CURL DBG] > Host: s3.xxxxxx:80 2022-09-26T12:01:14.417Z [CURL DBG] > User-Agent: s3fs/1.91 (commit hash 5b95a0f; OpenSSL) 2022-09-26T12:01:14.417Z [CURL DBG] > Accept: */* 2022-09-26T12:01:14.417Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=Ak12bt7qsxUKBtTZcC0Q/20220926/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=ecddcc0b22a0565a322b4e12db50a2ff06023ac7ae53ad3454638b5cad81f2e5 2022-09-26T12:01:14.417Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2022-09-26T12:01:14.417Z [CURL DBG] > x-amz-date: 20220926T120114Z 2022-09-26T12:01:14.417Z [CURL DBG] > 2022-09-26T12:01:14.420Z [CURL DBG] * Mark bundle as not supporting multiuse 2022-09-26T12:01:14.420Z [CURL DBG] < HTTP/1.1 404 Not Found 2022-09-26T12:01:14.420Z [CURL DBG] < x-amz-request-id: l8ipy1f5-2acs1l-hu8 2022-09-26T12:01:14.420Z [CURL DBG] < x-amz-id-2: l8ipy1f5-2acs1l-hu8 2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Origin: * 2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Credentials: true 2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Methods: GET,POST,PUT,DELETE,OPTIONS 2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Allow-Headers: Content-Type,Content-MD5,Authorization,X-Amz-User-Agent,X-Amz-Date,ETag,X-Amz-Content-Sha256 2022-09-26T12:01:14.420Z [CURL DBG] < Access-Control-Expose-Headers: ETag,X-Amz-Version-Id 2022-09-26T12:01:14.420Z [CURL DBG] < Content-Type: application/xml 2022-09-26T12:01:14.420Z [CURL DBG] < Content-Length: 214 2022-09-26T12:01:14.420Z [CURL DBG] < Date: Mon, 26 Sep 2022 12:01:14 GMT 2022-09-26T12:01:14.420Z [CURL DBG] < Connection: keep-alive 2022-09-26T12:01:14.420Z [CURL DBG] < Keep-Alive: timeout=5 2022-09-26T12:01:14.420Z [CURL DBG] < 2022-09-26T12:01:14.420Z [CURL DBG] * Connection #1 to host s3.xxxxxx left intact 2022-09-26T12:01:14.420Z [INF] curl.cpp:RequestPerform(2453): HTTP response code 404 was returned, returning ENOENT 2022-09-26T12:01:14.420Z [DBG] curl.cpp:RequestPerform(2454): Body Text: 2022-09-26T12:01:14.420Z [DBG] curl_handlerpool.cpp:ReturnHandler(101): Return handler to pool unique: 10, success, outsize: 80 unique: 12, opcode: READDIR (28), nodeid: 1, insize: 80, pid: 1111 unique: 12, success, outsize: 16 unique: 14, opcode: RELEASEDIR (29), nodeid: 1, insize: 64, pid: 0 unique: 14, success, outsize: 16
kerem commented 2026-03-04 01:50:48 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Feb 12, 2023):

@SanjeetKr7 Sorry for my late reply
Your log says that the RBTS directory object does not exist.

If you create a directory with s3fs, an object called RBTS/ should be created, but it seems that processing has stopped because it does not exist.
When creating an object(file) using a client other than s3fs, the intermediate directory may not be created as an object or may be created with the name RBTS.
In this case, we can imagine this situation.

And I forgot to ask what version of s3fs you are using.
If you are using s3fs v1.91, the default value of the behavior option has been changed to compensate for the nonexistent case of the directory object (RBTS/) mentioned above.

Try starting s3fs with options like compat_dir and complement_stat.

<!-- gh-comment-id:1426963920 --> @ggtakec commented on GitHub (Feb 12, 2023): @SanjeetKr7 Sorry for my late reply Your log says that the `RBTS` directory object does not exist. If you create a directory with s3fs, an object called `RBTS/` should be created, but it seems that processing has stopped because it does not exist. When creating an object(file) using a client other than s3fs, the intermediate directory may not be created as an object or may be created with the name `RBTS`. In this case, we can imagine this situation. And I forgot to ask what version of s3fs you are using. If you are using s3fs v1.91, the default value of the behavior option has been changed to compensate for the nonexistent case of the directory object (`RBTS/`) mentioned above. Try starting s3fs with options like `compat_dir` and `complement_stat`.
kerem commented 2026-03-04 01:50:48 +03:00
Author
Owner
Copy link

@qianyi-sourse commented on GitHub (Aug 25, 2023):

Hi,I met the same problem .There are 100000 files in the s3fs mount directory, and when I execute the ls command, the log also prints this error, and the s3fs process exits abnormally.

Logs

2023-08-25T10:42:13.979Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.039Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.099Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.157Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.216Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.273Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.332Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.391Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.444Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.495Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.552Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.607Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.662Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.716Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.775Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.825Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.882Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.948Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.005Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.061Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.116Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.174Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.229Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.283Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.347Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.407Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.464Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.524Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.581Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.638Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.708Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.768Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.825Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.876Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.934Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.993Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.050Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.107Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.166Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.227Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty.

<!-- gh-comment-id:1693196697 --> @qianyi-sourse commented on GitHub (Aug 25, 2023): Hi,I met the same problem .There are 100000 files in the s3fs mount directory, and when I execute the ls command, the log also prints this error, and the s3fs process exits abnormally. ### Logs ` 2023-08-25T10:42:13.979Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.039Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.099Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.157Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.216Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.273Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.332Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.391Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.444Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.495Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.552Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.607Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.662Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.716Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.775Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.825Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.882Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:14.948Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.005Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.061Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.116Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.174Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.229Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.283Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.347Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.407Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.464Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.524Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.581Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.638Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.708Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.768Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.825Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.876Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.934Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:15.993Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.050Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.107Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.166Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. 2023-08-25T10:42:16.227Z [ERR] s3fs_xml.cpp:get_base_exp(113): marker_xp->nodesetval is empty. `
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#1027
No description provided.