[GH-ISSUE #1940] location of cache on / #978

Open
opened 2026-03-04 01:50:23 +03:00 by kerem · 1 comment
Owner

Originally created by @fishpm-anu on GitHub (May 1, 2022).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1940

Additional Information

The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all.
Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD

Version of s3fs being used (s3fs --version)

Amazon Simple Storage Service File System V1.91

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

fusermount version: 2.9.2

Kernel information (uname -r)

3.10.0-1160.62.1.el7.x86_64

GNU/Linux Distribution, if applicable (cat /etc/os-release)

NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

May 1 17:08:20 rsb-linuxprod3 s3fs[2317]: s3fs version 1.91(unknown) : s3fs -o url=https://anuarchives3.anu.edu.au -o ensure_diskfree=1000 -o multipart_size=100 -o multipart_copy_size=100 sasha-deigo-data:/backup05 /home/sasham/sasha-deigo-data/backup05
May 1 17:08:20 rsb-linuxprod3 s3fs[2317]: Loaded mime information from /etc/mime.types
May 1 17:08:20 rsb-linuxprod3 s3fs[2319]: init v1.91(commit:unknown) with OpenSSL

Details about issue

when I use s3fs and do not use the option use_cache I still see / partition is consumed and used up to 100%. But I cannot find exactly where the data is being stored. I need to know so I can mount a larger disk onto that dir. What's odd is that a du -skh /* does not show where / is being consumed. Can you tell me the exact location of the data usage under /. I can see /home and /tmp is not being used.

Originally created by @fishpm-anu on GitHub (May 1, 2022). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1940 ### Additional Information _The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all._ _Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD_ #### Version of s3fs being used (s3fs --version) Amazon Simple Storage Service File System V1.91 #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) fusermount version: 2.9.2 #### Kernel information (uname -r) 3.10.0-1160.62.1.el7.x86_64 #### GNU/Linux Distribution, if applicable (cat /etc/os-release) NAME="CentOS Linux" VERSION="7 (Core)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (Core)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/" CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION="7" #### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs) May 1 17:08:20 rsb-linuxprod3 s3fs[2317]: s3fs version 1.91(unknown) : s3fs -o url=https://anuarchives3.anu.edu.au -o ensure_diskfree=1000 -o multipart_size=100 -o multipart_copy_size=100 sasha-deigo-data:/backup05 /home/sasham/sasha-deigo-data/backup05 May 1 17:08:20 rsb-linuxprod3 s3fs[2317]: Loaded mime information from /etc/mime.types May 1 17:08:20 rsb-linuxprod3 s3fs[2319]: init v1.91(commit:unknown) with OpenSSL #### Details about issue when I use s3fs and do not use the option use_cache I still see / partition is consumed and used up to 100%. But I cannot find exactly where the data is being stored. I need to know so I can mount a larger disk onto that dir. What's odd is that a du -skh /* does not show where / is being consumed. Can you tell me the exact location of the data usage under /. I can see /home and /tmp is not being used.
Author
Owner

@akomlik commented on GitHub (Jun 25, 2023):

It's under /tmp. you can see it with lsof command when s3fs is transferring file like so:

# lsof -p `pgrep s3fs`  | grep deleted
s3fs    26301 root    6u   REG              259,3 4194304000       1218 /tmp/#1218 (deleted)
s3fs    26301 root    7u   REG              259,3 4194304000       1218 /tmp/#1218 (deleted)

Not the file is deleted while open so you won't see it with ls command

<!-- gh-comment-id:1605816241 --> @akomlik commented on GitHub (Jun 25, 2023): It's under /tmp. you can see it with lsof command when s3fs is transferring file like so: ``` # lsof -p `pgrep s3fs` | grep deleted s3fs 26301 root 6u REG 259,3 4194304000 1218 /tmp/#1218 (deleted) s3fs 26301 root 7u REG 259,3 4194304000 1218 /tmp/#1218 (deleted) ``` Not the file is deleted while open so you won't see it with `ls` command
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#978
No description provided.