[GH-ISSUE #2522] s3fs occasionally experiences 100% CPU usage and tens of GB of memory consumption #1236

New issue

Open

opened 2026-03-04 01:52:27 +03:00 by kerem · 1 comment

kerem commented

2026-03-04 01:52:27 +03:00

Owner

Originally created by @yuqaf1989 on GitHub (Sep 3, 2024).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2522

Additional Information

Version of s3fs being used (`s3fs --version`)

V1.94 (commit:70a30d6) with GnuTLS(gcrypt)
V1.9.0 have the same issue

Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`)

Version: 2.9.9-5ubuntu3
Depends: libc6 (>= 2.34), libfuse2 (= 2.9.9-5ubuntu3), adduser, mount (>= 2.19.1), sed (>= 4)

Kernel information (`uname -r`)

5.15.0-119-generic

GNU/Linux Distribution, if applicable (`cat /etc/os-release`)

PRETTY_NAME="Ubuntu 22.04.4 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.4 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy

How to run s3fs, if applicable

[] /etc/fstab

s3 /s3 fuse.s3fs _netdev,allow_other,use_path_request_style,umask=0002,uid=1000,gid=1000,url=https://selfhost 0 0

s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`)

Details about issue

s3fs occasionally experiences 100% CPU usage and tens of GB of memory consumption. Using perf top -p $pid, the output indicates that the call to std::vector<std::unique_ptr<S3fsCurl, std::default_delete >, std::allocator<std::unique_ptr<S3fsCurl, std::default_delete > > >::_M_erase consumes all CPU resources.

Originally created by @yuqaf1989 on GitHub (Sep 3, 2024). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2522  ### Additional Information #### Version of s3fs being used (`s3fs --version`) V1.94 (commit:70a30d6) with GnuTLS(gcrypt) V1.9.0 have the same issue #### Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`) Version: 2.9.9-5ubuntu3 Depends: libc6 (>= 2.34), libfuse2 (= 2.9.9-5ubuntu3), adduser, mount (>= 2.19.1), sed (>= 4) #### Kernel information (`uname -r`) 5.15.0-119-generic #### GNU/Linux Distribution, if applicable (`cat /etc/os-release`) PRETTY_NAME="Ubuntu 22.04.4 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.4 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu ID_LIKE=debian HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" UBUNTU_CODENAME=jammy #### How to run s3fs, if applicable  [] /etc/fstab  ``` s3 /s3 fuse.s3fs _netdev,allow_other,use_path_request_style,umask=0002,uid=1000,gid=1000,url=https://selfhost 0 0 ``` #### s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`)  ``` ``` ### Details about issue  s3fs occasionally experiences 100% CPU usage and tens of GB of memory consumption. Using perf top -p $pid, the output indicates that the call to std::vector<std::unique_ptr<S3fsCurl, std::default_delete<S3fsCurl> >, std::allocator<std::unique_ptr<S3fsCurl, std::default_delete<S3fsCurl> > > >::_M_erase consumes all CPU resources. ![2024-09-03_14-40](https://github.com/user-attachments/assets/e78d6017-b44b-4f89-9faa-3ae76507b486)

kerem commented

2026-03-04 01:52:27 +03:00

Author

Owner

@patrickmagyarskaylink commented on GitHub (Sep 20, 2024):

we have the behavior too.
maybe related to: https://github.com/s3fs-fuse/s3fs-fuse/issues/2509

@patrickmagyarskaylink commented on GitHub (Sep 20, 2024): we have the behavior too. maybe related to: https://github.com/s3fs-fuse/s3fs-fuse/issues/2509