[GH-ISSUE #1309] File upload stat in /var/log/message #700

Closed
opened 2026-03-04 01:48:01 +03:00 by kerem · 1 comment
Owner

Originally created by @rsravanam on GitHub (Jun 18, 2020).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1309

Details about the issue

I have an s3 mount to the /folder in my CentOS7.6 machine. I have enabled the debug level as INFO. I have observed that 1GB file writes large number of log lines in /var/log/messages and i am unable to understand the file get uploaded or not.
_What i need exactly is, when a file get uploaded from s3 mount folder to s3-bucket it should log in /var/log/messages be like "INFO: File /data/flow.json uploaded to BUCKET_NAME" Is there a way to get it, or do i need to do configure any in s3-fuse?
My team wants to read that line and keeps the history of file upload stats
Any help on this, please?

My fs tab entry:
s3fs#my-s3-bucket /my-folder fuse _netdev,uid=owt,gid=owt,allow_other,use_cache=/tmp,mp_umask=022,dbglevel=info,retries=5, 0 0

Originally created by @rsravanam on GitHub (Jun 18, 2020). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1309 ### Details about the issue _I have an s3 mount to the /folder in my CentOS7.6 machine. I have enabled the debug level as INFO. I have observed that 1GB file writes large number of log lines in /var/log/messages and i am unable to understand the file get uploaded or not._ __What i need exactly is, when a file get uploaded from s3 mount folder to s3-bucket it should log in /var/log/messages be like "INFO: File /data/flow.json uploaded to BUCKET_NAME" Is there a way to get it, or do i need to do configure any in s3-fuse?_ _My team wants to read that line and keeps the history of file upload stats_ _Any help on this, please?_ My fs tab entry: s3fs#my-s3-bucket /my-folder fuse _netdev,uid=owt,gid=owt,allow_other,use_cache=/tmp,mp_umask=022,dbglevel=info,retries=5, 0 0
kerem closed this issue 2026-03-04 01:48:02 +03:00
Author
Owner

@gaul commented on GitHub (Jul 26, 2020):

s3fs sends objects to S3 during fsync and close. If you application issues these calls, then it will be uploaded to S3. There is currently no asynchronous flushing.

<!-- gh-comment-id:663949447 --> @gaul commented on GitHub (Jul 26, 2020): s3fs sends objects to S3 during `fsync` and `close`. If you application issues these calls, then it will be uploaded to S3. There is currently no asynchronous flushing.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#700
No description provided.