[GH-ISSUE #1248] File content not being updated but timestamps are! #667

Closed
opened 2026-03-04 01:47:43 +03:00 by kerem · 2 comments
Owner

Originally created by @sharmad on GitHub (Feb 26, 2020).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1248

Version of s3fs being used

1.79

Version of fuse being used

2.9.4

Kernel information (uname -r)

4.14.158-101.185.amzn1.x86_64

GNU/Linux Distribution, if applicable (cat /etc/os-release)

NAME="Amazon Linux AMI"
VERSION="2018.03"
ID="amzn"
ID_LIKE="rhel fedora"
VERSION_ID="2018.03"
PRETTY_NAME="Amazon Linux AMI 2018.03"
ANSI_COLOR="0;33"
CPE_NAME="cpe:/o:amazon:linux:2018.03:ga"
HOME_URL="http://aws.amazon.com/amazon-linux-ami/"

/etc/fstab entry

s3fs#shared-bucket /s3mnt fuse allow_other,use_rrs,uid=test,gid=test,use_cache=/storage/s3-cache-shared,iam_role=test-role,_netdev 0 0

Details about issue

We have several servers using s3fs-fuse to mount the same s3 bucket and accessing the target file object. However, we found that updating the file, updated it in some servers but not in others. Interestingly, the timestamp updated in all servers and their caches, but the content didn't for around half.

It should also be noted that we were just updating one character in this 20.9kb file. For example, going from "38" to "37" in a line somewhere in the file.

Temporarily, this was fixed by removing the file from the cache directory of the problematic servers. After this we got the updated content! And the cache gets updated too with the new file/content. 

Originally created by @sharmad on GitHub (Feb 26, 2020). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1248 #### Version of s3fs being used 1.79 #### Version of fuse being used 2.9.4 #### Kernel information (uname -r) 4.14.158-101.185.amzn1.x86_64 #### GNU/Linux Distribution, if applicable (cat /etc/os-release) ``` NAME="Amazon Linux AMI" VERSION="2018.03" ID="amzn" ID_LIKE="rhel fedora" VERSION_ID="2018.03" PRETTY_NAME="Amazon Linux AMI 2018.03" ANSI_COLOR="0;33" CPE_NAME="cpe:/o:amazon:linux:2018.03:ga" HOME_URL="http://aws.amazon.com/amazon-linux-ami/" ``` #### /etc/fstab entry ``` s3fs#shared-bucket /s3mnt fuse allow_other,use_rrs,uid=test,gid=test,use_cache=/storage/s3-cache-shared,iam_role=test-role,_netdev 0 0 ``` ### Details about issue We have several servers using s3fs-fuse to mount the same s3 bucket and accessing the target file object. However, we found that updating the file, updated it in some servers but not in others. Interestingly, the timestamp updated in all servers and their caches, but the content didn't for around half. It should also be noted that we were just updating one character in this 20.9kb file. For example, going from "38" to "37" in a line somewhere in the file. Temporarily, this was fixed by removing the file from the cache directory of the problematic servers. After this we got the updated content! And the cache gets updated too with the new file/content. 
kerem 2026-03-04 01:47:43 +03:00
  • closed this issue
  • added the
    need info
    label
Author
Owner

@gaul commented on GitHub (Apr 22, 2020):

By default s3fs does not have a stat cache age. If you set -o stat_cache_expire=60 does the time update on other servers?

<!-- gh-comment-id:617755567 --> @gaul commented on GitHub (Apr 22, 2020): By default s3fs does not have a stat cache age. If you set `-o stat_cache_expire=60` does the time update on other servers?
Author
Owner

@gaul commented on GitHub (Jul 26, 2020):

Closing due to inactivity. Please reopen if symptoms persist.

<!-- gh-comment-id:663950760 --> @gaul commented on GitHub (Jul 26, 2020): Closing due to inactivity. Please reopen if symptoms persist.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#667
No description provided.