[GH-ISSUE #120] Frequent Input/output error #74

New issue

Closed

opened 2026-03-04 01:41:47 +03:00 by kerem · 2 comments

kerem commented

2026-03-04 01:41:47 +03:00

Owner

Originally created by @junaidnasir on GitHub (Feb 9, 2015).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/120

we are trying to move a large number of small files approx. 20 files (100KB) every 2 seconds.
after some time the move operations start piling up and eventually after about 20 minutes s3fs throws an error on any file operation sudo ls /mnt/bucket ls: reading directory /mnt/bucket: Input/output error
in these 20 minutes load average goes from 3 to roughly 8000.
System: Amazon EC2 C3 large
s3fs version: 1.78

Originally created by @junaidnasir on GitHub (Feb 9, 2015). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/120 we are trying to move a large number of small files approx. 20 files (100KB) every 2 seconds. after some time the move operations start piling up and eventually after about 20 minutes s3fs throws an error on any file operation `sudo ls /mnt/bucket ls: reading directory /mnt/bucket: Input/output error` in these 20 minutes load average goes from 3 to roughly 8000. System: Amazon EC2 C3 large s3fs version: 1.78

kerem closed this issue

2026-03-04 01:41:47 +03:00

kerem commented

2026-03-04 01:41:48 +03:00

Author

Owner

@ggtakec commented on GitHub (Apr 12, 2015):

If this reason is timeout error, you can probably solve this by changing the timeout value.
#167 is changed the default timeout value for connecting and reading/writing.
Please try to use latest codes, and if you got same error please retry to run s3fs with connect_timeout and readwrite_timeout options.
thanks in advance for your help.

@ggtakec commented on GitHub (Apr 12, 2015): If this reason is timeout error, you can probably solve this by changing the timeout value. #167 is changed the default timeout value for connecting and reading/writing. Please try to use latest codes, and if you got same error please retry to run s3fs with connect_timeout and readwrite_timeout options. thanks in advance for your help.

kerem commented

2026-03-04 01:41:48 +03:00

Author

Owner

@ggtakec commented on GitHub (Jan 17, 2016):

I'm closing this issue, if you have a problem yet, please post new issue or reopen this issue.

Thanks in advance for your help.

@ggtakec commented on GitHub (Jan 17, 2016): I'm closing this issue, if you have a problem yet, please post new issue or reopen this issue. Thanks in advance for your help.

kerem referenced this issue

2026-03-04 01:53:27 +03:00

[PR #74] [MERGED] url: handle scheme omission #1339

kerem referenced this issue

2026-03-04 01:53:30 +03:00

[PR #116] [MERGED] Supported signature version 4 #1350