[GH-ISSUE #1750] cp failed with "Input/output error" #901

New issue

Closed

opened 2026-03-04 01:49:47 +03:00 by kerem · 1 comment

kerem commented

2026-03-04 01:49:47 +03:00

Owner

Originally created by @VVoidV on GitHub (Aug 27, 2021).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1750

Additional Information

The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all.
Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD

Version of s3fs being used (s3fs --version)

Installed from epel s3fs-fuse-1.90-1.el7.x86_64
[root@localhost ~]# s3fs --version
Amazon Simple Storage Service File System V1.90 (commit:unknown) with OpenSSL
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 https://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

fuse-2.9.2-11.el7.x86_64

Kernel information (uname -r)

5.4.140-1.el7.elrepo.x86_64_

GNU/Linux Distribution, if applicable (cat /etc/os-release)

[root@localhost ~]# cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

s3fs command line used, if applicable

/usr/bin/s3fs -o logfile=/opt/s3fs.log,curldbg,dbglevel=debug,use_path_request_style,allow_other,del_cache,connect_timeout=300,readwrite_timeout=120,url=http://xxxx,use_cache=s3fs_cache/d3c6799e-dcb9-4ba5-b9a8-c463b87b4622  bucketname /exports/test1

/etc/fstab entry, if applicable

None

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages

2021-08-27T05:49:45.589Z [ERR] fdcache_fdinfo.cpp:GetUploadId(145): Multipart Upload has not started yet.
2021-08-27T05:49:45.589Z [ERR] fdcache_entity.cpp:NoCacheLoadAndPost(1178): failed to multipart post(start=0, size=10485760) for file(physical_fd=28).
2021-08-27T05:49:45.640Z [ERR] fdcache_entity.cpp:WriteMixMultipart(1993): failed to load uninitialized area and multipart uploading it(errno=-5)

use_cache dir info

[root@localhost d3c6799e-dcb9-4ba5-b9a8-c463b87b4622]# df -h /dev/vdb
Filesystem      Size  Used Avail Use% Mounted on
/dev/vdb         10G  9.6G  401M  97% /s3fs_cache/d3c6799e-dcb9-4ba5-b9a8-c463b87b4622

Details about issue

mount bucket with -o use_cache=xxx, the free space of cache dir is about 400M, then copy a 500M file into s3fs. cp will exit with
Input/output error.

[root@localhost ~]# cp 500M /exports/test1/
cp: error writing ‘/exports/test1/500M’: Input/output error
cp: failed to extend ‘/exports/test1/500M’: Input/output error
cp: failed to close ‘/exports/test1/500M’: Input/output error

STEP to reproduce

moutn s3fs with -o use_cache=xxx
ensure the free space is smaller than test file size
cp test file into s3fs

Originally created by @VVoidV on GitHub (Aug 27, 2021). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1750 ### Additional Information _The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all._ _Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD_ #### Version of s3fs being used (s3fs --version) Installed from epel s3fs-fuse-1.90-1.el7.x86_64 [root@localhost ~]# s3fs --version Amazon Simple Storage Service File System V1.90 (commit:unknown) with OpenSSL Copyright (C) 2010 Randy Rizun <rrizun@gmail.com> License GPL2: GNU GPL version 2 <https://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) fuse-2.9.2-11.el7.x86_64 #### Kernel information (uname -r) 5.4.140-1.el7.elrepo.x86_64_ #### GNU/Linux Distribution, if applicable (cat /etc/os-release) [root@localhost ~]# cat /etc/os-release NAME="CentOS Linux" VERSION="7 (Core)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (Core)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/" CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION="7" #### s3fs command line used, if applicable ``` /usr/bin/s3fs -o logfile=/opt/s3fs.log,curldbg,dbglevel=debug,use_path_request_style,allow_other,del_cache,connect_timeout=300,readwrite_timeout=120,url=http://xxxx,use_cache=s3fs_cache/d3c6799e-dcb9-4ba5-b9a8-c463b87b4622 bucketname /exports/test1 ``` #### /etc/fstab entry, if applicable None #### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs) _if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages_ ``` 2021-08-27T05:49:45.589Z [ERR] fdcache_fdinfo.cpp:GetUploadId(145): Multipart Upload has not started yet. 2021-08-27T05:49:45.589Z [ERR] fdcache_entity.cpp:NoCacheLoadAndPost(1178): failed to multipart post(start=0, size=10485760) for file(physical_fd=28). 2021-08-27T05:49:45.640Z [ERR] fdcache_entity.cpp:WriteMixMultipart(1993): failed to load uninitialized area and multipart uploading it(errno=-5) ``` ### use_cache dir info ``` [root@localhost d3c6799e-dcb9-4ba5-b9a8-c463b87b4622]# df -h /dev/vdb Filesystem Size Used Avail Use% Mounted on /dev/vdb 10G 9.6G 401M 97% /s3fs_cache/d3c6799e-dcb9-4ba5-b9a8-c463b87b4622 ``` ### Details about issue mount bucket with -o use_cache=xxx, the free space of cache dir is about 400M, then copy a 500M file into s3fs. cp will exit with Input/output error. ``` [root@localhost ~]# cp 500M /exports/test1/ cp: error writing ‘/exports/test1/500M’: Input/output error cp: failed to extend ‘/exports/test1/500M’: Input/output error cp: failed to close ‘/exports/test1/500M’: Input/output error ``` ### STEP to reproduce 1. moutn s3fs with -o use_cache=xxx 2. ensure the free space is smaller than test file size 3. cp test file into s3fs