[GH-ISSUE #2336] Inconsistency of bucket size and filesystem volume size where the bucket is mounted #1154

Closed
opened 2026-03-04 01:51:47 +03:00 by kerem · 2 comments
Owner

Originally created by @itsystem on GitHub (Sep 27, 2023).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2336

Additional Information

Version of s3fs being used

Amazon Simple Storage Service File System V1.93 (commit:unknown) with OpenSSL

Version of fuse being used

2.9.2

Kernel information

3.10.0-1160.6.1.el7.x86_64

GNU/Linux Distribution

CentOS Linux 7 (Core)

How to run s3fs

command line
s3fs /home/bitrix/static -o passwd_file=$HOME/.passwd-s3fs -o url=https://storage.yandexcloud.net -o use_path_request_style -o bucket=test.static.example.com

/etc/fstab entry
test.static.example.com /home/bitrix/static fuse.s3fs _netdev,allow_other,use_path_request_style,url=https://storage.yandexcloud.net,passwd_file=/root/.passwd-s3fs 0 0

s3fs syslog messages

Syslog messages when mounted via fstab entry:

Sep 27 10:05:29 host-ask-sandbox-01 s3fs[36147]: s3fs version 1.93(unknown) : s3fs -o rw,allow_other,use_path_request_style,url=https://storage.yandexcloud.net,passwd_file=/root/.passwd-s3fs,dev,suid test.static.example.com /home/bitrix/static
Sep 27 10:05:29 host-ask-sandbox-01 s3fs[36147]: Loaded mime information from /etc/mime.types
Sep 27 10:05:29 host-ask-sandbox-01 s3fs[36149]: init v1.93(commit:unknown) with OpenSSL, credential-library(built-in)

Syslog messages when mounted via command line:

Sep 27 10:08:52 host-ask-sandbox-01 s3fs[19890]: s3fs version 1.93(unknown) : s3fs -o passwd_file=/root/.passwd-s3fs -o url=https://storage.yandexcloud.net -o use_path_request_style -o bucket=test.static.example.com /home/bitrix/static
Sep 27 10:08:52 host-ask-sandbox-01 s3fs[19890]: Loaded mime information from /etc/mime.types
Sep 27 10:08:52 host-ask-sandbox-01 s3fs[19893]: init v1.93(commit:unknown) with OpenSSL, credential-library(built-in)

Details about issue

The issue is that volume of mounted bucket is shown by df -h is 4GB while real volume of the bucket is 500GB.
I tried to mount with option bucket_size=500G but then I got message "s3fs: invalid bucket_size option." from s3fs.

So the question is: how to mount the bucket with its real volume?

Originally created by @itsystem on GitHub (Sep 27, 2023). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2336 <!-- -------------------------------------------------------------------------- The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all. Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD. --------------------------------------------------------------------------- --> ### Additional Information #### Version of s3fs being used Amazon Simple Storage Service File System V1.93 (commit:unknown) with OpenSSL #### Version of fuse being used 2.9.2 #### Kernel information 3.10.0-1160.6.1.el7.x86_64 #### GNU/Linux Distribution CentOS Linux 7 (Core) #### How to run s3fs <!-- Describe the s3fs "command line" or "/etc/fstab" entry used. --> <!-- Executed command line or /etc/fastab entry --> command line ```s3fs /home/bitrix/static -o passwd_file=$HOME/.passwd-s3fs -o url=https://storage.yandexcloud.net -o use_path_request_style -o bucket=test.static.example.com``` /etc/fstab entry ```test.static.example.com /home/bitrix/static fuse.s3fs _netdev,allow_other,use_path_request_style,url=https://storage.yandexcloud.net,passwd_file=/root/.passwd-s3fs 0 0``` #### s3fs syslog messages <!-- if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages. --> Syslog messages when mounted via fstab entry: ``` Sep 27 10:05:29 host-ask-sandbox-01 s3fs[36147]: s3fs version 1.93(unknown) : s3fs -o rw,allow_other,use_path_request_style,url=https://storage.yandexcloud.net,passwd_file=/root/.passwd-s3fs,dev,suid test.static.example.com /home/bitrix/static Sep 27 10:05:29 host-ask-sandbox-01 s3fs[36147]: Loaded mime information from /etc/mime.types Sep 27 10:05:29 host-ask-sandbox-01 s3fs[36149]: init v1.93(commit:unknown) with OpenSSL, credential-library(built-in) ``` Syslog messages when mounted via command line: ``` Sep 27 10:08:52 host-ask-sandbox-01 s3fs[19890]: s3fs version 1.93(unknown) : s3fs -o passwd_file=/root/.passwd-s3fs -o url=https://storage.yandexcloud.net -o use_path_request_style -o bucket=test.static.example.com /home/bitrix/static Sep 27 10:08:52 host-ask-sandbox-01 s3fs[19890]: Loaded mime information from /etc/mime.types Sep 27 10:08:52 host-ask-sandbox-01 s3fs[19893]: init v1.93(commit:unknown) with OpenSSL, credential-library(built-in) ``` ### Details about issue <!-- Please describe the content of the issue in detail. --> The issue is that volume of mounted bucket is shown by df -h is 4GB while real volume of the bucket is 500GB. I tried to mount with option bucket_size=500G but then I got message "s3fs: invalid bucket_size option." from s3fs. So the question is: how to mount the bucket with its real volume?
kerem closed this issue 2026-03-04 01:51:47 +03:00
Author
Owner

@OttaviaB commented on GitHub (Oct 13, 2023):

Hello,
the bucket_size option expects either GB or GiB as units, not G.
Does that fix your problem?

<!-- gh-comment-id:1761526177 --> @OttaviaB commented on GitHub (Oct 13, 2023): Hello, the bucket_size option expects either GB or GiB as units, not G. Does that fix your problem?
Author
Owner

@itsystem commented on GitHub (Oct 19, 2023):

Hello. Thanks alot. That fixed our problem.

<!-- gh-comment-id:1770212196 --> @itsystem commented on GitHub (Oct 19, 2023): Hello. Thanks alot. That fixed our problem.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#1154
No description provided.