[GH-ISSUE #614] directories are not recognized #347

Closed
opened 2026-03-04 01:44:37 +03:00 by kerem · 2 comments
Owner

Originally created by @o999oo99 on GitHub (Jun 4, 2017).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/614

Hello,

I know it was discussed a lot but I'm lost in possible solutions.
Using s3fs 1.82 with fuse 2.9.2

Unable to see directories objects.
S3Browser & s3cmd recognizing them fine.

Some details and debug below.
Please advise. Thanks in advance!

[root@nbuagra s3mount]# ls -la /tmp/s3mount/
total 6
drwxrwx---. 1 s3user s3user 0 Dec 31 1969 .
drwxrwxrwt. 29 root root 4096 Jun 4 13:03 ..
-rwxrwx---. 1 s3user s3user 96 Jun 3 04:08 dir_s3_browser # DIR
-rwxrwx---. 1 s3user s3user 96 Jun 3 04:08 dir_vxfs # DIR
-rwxrwx---. 1 s3user s3user 309 Feb 3 07:02 hosts

[root@nbuagra s3mount]# s3cmd ls s3://buck1/
DIR s3://buck1/dir_s3_browser
DIR s3://buck1/dir_vxfs
2017-02-03 15:02 309 s3://buck1/hosts

root@nbuagra tmp]# s3fs buck1 /tmp/s3mount -osigv2 -d -d -f -o curldbg -o passwd_file=~/.passwd-s3fs -o "url=http://s3.access:8143/" -o use_path_request_style -o dbglevel=dbg -o umask=007 -o uid=1001 -o gid=1001

[CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [CRT] to [INF]
[CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [INF] to [DBG]
[INF] s3fs.cpp:set_mountpoint_attribute(4193): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40777)
FUSE library version: 2.9.2
nullpath_ok: 0
nopath: 0
utime_omit_ok: 0
unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0
INIT: 7.22
flags=0x0000f7fb
max_readahead=0x00020000
[CRT] s3fs.cpp:s3fs_init(3378): init v1.82(commit:unknown) with OpenSSL
[INF] s3fs.cpp:s3fs_check_service(3754): check services.
[INF] curl.cpp:CheckBucket(2914): check a bucket.
[DBG] curl.cpp:GetHandler(283): Get handler from pool: 31
[INF] curl.cpp:prepare_url(4205): URL is http://s3.access:8143/buck1/
[INF] curl.cpp:prepare_url(4237): URL changed is http://s3.access:8143/buck1/
[DBG] curl.cpp:RequestPerform(1923): connecting to URL http://s3.access:8143/buck1/

  • About to connect() to s3.access port 8143 (#0)
  • Trying 10.40.224.137...
  • Connected to s3.access (10.40.224.137) port 8143 (#0)

GET /buck1/ HTTP/1.1
User-Agent: s3fs/1.82 (commit hash unknown; OpenSSL)
Host: s3.access:8143
Accept: /
Authorization: AWS NDk4OWNiMGM4YWM3ZThl:rsNwY7IT5Ndmfi4cecgZp6CfdUU=
Date: Sat, 03 Jun 2017 08:13:14 GMT

< HTTP/1.1 200 OK
< Server: Object Access
< Content-Type: application/xml
< Content-Length: 600
<

  • Connection #0 to host s3.access left intact
    [INF] curl.cpp:RequestPerform(1940): HTTP response code 200
    [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31
    INIT: 7.19
    flags=0x00000019
    max_readahead=0x00020000
    max_write=0x00020000
    max_background=0
    congestion_threshold=0
    unique: 1, success, outsize: 40

LOOKUP /dir_s3_browser
getattr /dir_s3_browser
[INF] s3fs.cpp:s3fs_getattr(812): [path=/dir_s3_browser]
[DBG] s3fs.cpp:check_parent_object_access(669): [path=/dir_s3_browser]
[DBG] s3fs.cpp:check_object_access(563): [path=/]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/]
[DBG] s3fs.cpp:check_object_access(563): [path=/dir_s3_browser]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/dir_s3_browser]
[DBG] cache.cpp:GetStat(276): stat cache hit [path=/dir_s3_browser/][time=62984.302320987][hit count=16]
[DBG] fdcache.cpp:ExistOpen(2082): [path=/dir_s3_browser][fd=-1][ignore_existfd=false]
[DBG] fdcache.cpp:Open(2016): [path=/dir_s3_browser][size=-1][time=-1]
[DBG] s3fs.cpp:s3fs_getattr(836): [path=/dir_s3_browser] uid=0, gid=0, mode=100000
NODEID: 3
unique: 75, success, outsize: 144
unique: 76, opcode: LOOKUP (1), nodeid: 1, insize: 49, pid: 21608
LOOKUP /dir_vxfs
getattr /dir_vxfs
[INF] s3fs.cpp:s3fs_getattr(812): [path=/dir_vxfs]
[DBG] s3fs.cpp:check_parent_object_access(669): [path=/dir_vxfs]
[DBG] s3fs.cpp:check_object_access(563): [path=/]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/]
[DBG] s3fs.cpp:check_object_access(563): [path=/dir_vxfs]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/dir_vxfs]
[DBG] cache.cpp:GetStat(276): stat cache hit [path=/dir_vxfs/][time=62984.302320987][hit count=18]
[DBG] fdcache.cpp:ExistOpen(2082): [path=/dir_vxfs][fd=-1][ignore_existfd=false]
[DBG] fdcache.cpp:Open(2016): [path=/dir_vxfs][size=-1][time=-1]
[DBG] s3fs.cpp:s3fs_getattr(836): [path=/dir_vxfs] uid=0, gid=0, mode=100000
NODEID: 2

Originally created by @o999oo99 on GitHub (Jun 4, 2017). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/614 Hello, I know it was discussed a lot but I'm lost in possible solutions. Using s3fs 1.82 with fuse 2.9.2 Unable to see directories objects. S3Browser & s3cmd recognizing them fine. Some details and debug below. Please advise. Thanks in advance! [root@nbuagra s3mount]# ls -la /tmp/s3mount/ total 6 drwxrwx---. 1 s3user s3user 0 Dec 31 1969 . drwxrwxrwt. 29 root root 4096 Jun 4 13:03 .. -rwxrwx---. 1 s3user s3user 96 Jun 3 04:08 dir_s3_browser # DIR -rwxrwx---. 1 s3user s3user 96 Jun 3 04:08 dir_vxfs # DIR -rwxrwx---. 1 s3user s3user 309 Feb 3 07:02 hosts [root@nbuagra s3mount]# s3cmd ls s3://buck1/ DIR s3://buck1/dir_s3_browser DIR s3://buck1/dir_vxfs 2017-02-03 15:02 309 s3://buck1/hosts root@nbuagra tmp]# s3fs buck1 /tmp/s3mount -osigv2 -d -d -f -o curldbg -o passwd_file=~/.passwd-s3fs -o "url=http://s3.access:8143/" -o use_path_request_style -o dbglevel=dbg -o umask=007 -o uid=1001 -o gid=1001 [CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [CRT] to [INF] [CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [INF] to [DBG] [INF] s3fs.cpp:set_mountpoint_attribute(4193): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40777) FUSE library version: 2.9.2 nullpath_ok: 0 nopath: 0 utime_omit_ok: 0 unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0 INIT: 7.22 flags=0x0000f7fb max_readahead=0x00020000 [CRT] s3fs.cpp:s3fs_init(3378): init v1.82(commit:unknown) with OpenSSL [INF] s3fs.cpp:s3fs_check_service(3754): check services. [INF] curl.cpp:CheckBucket(2914): check a bucket. [DBG] curl.cpp:GetHandler(283): Get handler from pool: 31 [INF] curl.cpp:prepare_url(4205): URL is http://s3.access:8143/buck1/ [INF] curl.cpp:prepare_url(4237): URL changed is http://s3.access:8143/buck1/ [DBG] curl.cpp:RequestPerform(1923): connecting to URL http://s3.access:8143/buck1/ * About to connect() to s3.access port 8143 (#0) * Trying 10.40.224.137... * Connected to s3.access (10.40.224.137) port 8143 (#0) > GET /buck1/ HTTP/1.1 User-Agent: s3fs/1.82 (commit hash unknown; OpenSSL) Host: s3.access:8143 Accept: */* Authorization: AWS NDk4OWNiMGM4YWM3ZThl:rsNwY7IT5Ndmfi4cecgZp6CfdUU= Date: Sat, 03 Jun 2017 08:13:14 GMT < HTTP/1.1 200 OK < Server: Object Access < Content-Type: application/xml < Content-Length: 600 < * Connection #0 to host s3.access left intact [INF] curl.cpp:RequestPerform(1940): HTTP response code 200 [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31 INIT: 7.19 flags=0x00000019 max_readahead=0x00020000 max_write=0x00020000 max_background=0 congestion_threshold=0 unique: 1, success, outsize: 40 LOOKUP /dir_s3_browser getattr /dir_s3_browser [INF] s3fs.cpp:s3fs_getattr(812): [path=/dir_s3_browser] [DBG] s3fs.cpp:check_parent_object_access(669): [path=/dir_s3_browser] [DBG] s3fs.cpp:check_object_access(563): [path=/] [DBG] s3fs.cpp:get_object_attribute(416): [path=/] [DBG] s3fs.cpp:check_object_access(563): [path=/dir_s3_browser] [DBG] s3fs.cpp:get_object_attribute(416): [path=/dir_s3_browser] [DBG] cache.cpp:GetStat(276): stat cache hit [path=/dir_s3_browser/][time=62984.302320987][hit count=16] [DBG] fdcache.cpp:ExistOpen(2082): [path=/dir_s3_browser][fd=-1][ignore_existfd=false] [DBG] fdcache.cpp:Open(2016): [path=/dir_s3_browser][size=-1][time=-1] [DBG] s3fs.cpp:s3fs_getattr(836): [path=/dir_s3_browser] uid=0, gid=0, mode=100000 NODEID: 3 unique: 75, success, outsize: 144 unique: 76, opcode: LOOKUP (1), nodeid: 1, insize: 49, pid: 21608 LOOKUP /dir_vxfs getattr /dir_vxfs [INF] s3fs.cpp:s3fs_getattr(812): [path=/dir_vxfs] [DBG] s3fs.cpp:check_parent_object_access(669): [path=/dir_vxfs] [DBG] s3fs.cpp:check_object_access(563): [path=/] [DBG] s3fs.cpp:get_object_attribute(416): [path=/] [DBG] s3fs.cpp:check_object_access(563): [path=/dir_vxfs] [DBG] s3fs.cpp:get_object_attribute(416): [path=/dir_vxfs] [DBG] cache.cpp:GetStat(276): stat cache hit [path=/dir_vxfs/][time=62984.302320987][hit count=18] [DBG] fdcache.cpp:ExistOpen(2082): [path=/dir_vxfs][fd=-1][ignore_existfd=false] [DBG] fdcache.cpp:Open(2016): [path=/dir_vxfs][size=-1][time=-1] [DBG] s3fs.cpp:s3fs_getattr(836): [path=/dir_vxfs] uid=0, gid=0, mode=100000 NODEID: 2
kerem 2026-03-04 01:44:37 +03:00
  • closed this issue
  • added the
    need info
    label
Author
Owner

@gaul commented on GitHub (Feb 3, 2020):

Could you test with the latest version 1.85? It improves some of this directory handling logic.

<!-- gh-comment-id:581295205 --> @gaul commented on GitHub (Feb 3, 2020): Could you test with the latest version 1.85? It improves some of this directory handling logic.
Author
Owner

@gaul commented on GitHub (Jun 23, 2020):

Closing due to inactivity. Please reopen if symptoms persist.

<!-- gh-comment-id:647884318 --> @gaul commented on GitHub (Jun 23, 2020): Closing due to inactivity. Please reopen if symptoms persist.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#347
No description provided.