[GH-ISSUE #2509] s3fs use memory over 20GB #1224

New issue

Open

opened 2026-03-04 01:52:22 +03:00 by kerem · 1 comment

kerem commented

2026-03-04 01:52:22 +03:00

Owner

Originally created by @hyf1128 on GitHub (Aug 5, 2024).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2509

Additional Information

I used s3fs mount bucket, after some days, s3fs used memory over 20GB.
My IO model is that, some threads write compressed package on a directory, if someone need use infomation of one of thess, a thread will decompress to another directory and read it.

Version of s3fs being used (`s3fs --version`)

V1.91

Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`)

2.9.7

Kernel information (`uname -r`)

GNU/Linux Distribution, if applicable (`cat /etc/os-release`)

CentOS 7.9

How to run s3fs, if applicable

s3fs bucket /mnt/bucket -o url=https:// -o endpoint= -o passwd_file=/opt/passwd-s3fs -o big_writes -o sigv2 -o allow_other -o no_check_certificate -o ssl_verify_hostname=0 -o max_write=131072 -o multipart_size=20 -o umask=0

s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`)

Details about issue

Originally created by @hyf1128 on GitHub (Aug 5, 2024). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2509  ### Additional Information I used s3fs mount bucket, after some days, s3fs used memory over 20GB. My IO model is that, some threads write compressed package on a directory, if someone need use infomation of one of thess, a thread will decompress to another directory and read it. #### Version of s3fs being used (`s3fs --version`)  V1.91 #### Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`)  2.9.7 #### Kernel information (`uname -r`)  #### GNU/Linux Distribution, if applicable (`cat /etc/os-release`)  CentOS 7.9 #### How to run s3fs, if applicable   ``` s3fs bucket /mnt/bucket -o url=https:// -o endpoint= -o passwd_file=/opt/passwd-s3fs -o big_writes -o sigv2 -o allow_other -o no_check_certificate -o ssl_verify_hostname=0 -o max_write=131072 -o multipart_size=20 -o umask=0 ``` #### s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`)  ``` ``` ### Details about issue