mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 13:26:00 +03:00
[GH-ISSUE #2622] cp: failed to close ‘<file>: Input/output error #1251
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#1251
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @mselvaggio-iqvia on GitHub (Dec 17, 2024).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2622
Additional Information
Version of s3fs being used (
s3fs --version)Amazon Simple Storage Service File System V1.86 (commit:unknown) with OpenSSL
Version of fuse being used (
pkg-config --modversion fuse,rpm -qi fuseordpkg -s fuse)rpm -qi fuse
Name : fuse
Version : 2.9.2
Release : 7.el7
Architecture: x86_64
Install Date: Fri 03 Feb 2017 02:46:20 PM EST
Group : System Environment/Base
Size : 222906
License : GPL+
Signature : RSA/SHA256, Mon 26 Sep 2016 11:00:16 AM EDT, Key ID 199e2f91fd431d51
Source RPM : fuse-2.9.2-7.el7.src.rpm
Build Date : Thu 19 May 2016 07:01:08 AM EDT
Build Host : x86-020.build.eng.bos.redhat.com
Relocations : (not relocatable)
Packager : Red Hat, Inc. http://bugzilla.redhat.com/bugzilla
Vendor : Red Hat, Inc.
URL : http://fuse.sf.net
Summary : File System in Userspace (FUSE) utilities
Description :
With FUSE it is possible to implement a fully functional filesystem in a
userspace program. This package contains the FUSE userspace tools to
mount a FUSE filesystem.
Kernel information (
uname -r)uname -r
3.10.0-514.6.1.el7.x86_64
GNU/Linux Distribution, if applicable (
cat /etc/os-release)cat /etc/os-release
NAME="Red Hat Enterprise Linux Server"
VERSION="7.3 (Maipo)"
ID="rhel"
ID_LIKE="fedora"
VERSION_ID="7.3"
PRETTY_NAME="Red Hat Enterprise Linux"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:7.3:GA:server"
HOME_URL="https://www.redhat.com/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7"
REDHAT_BUGZILLA_PRODUCT_VERSION=7.3
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="7.3"
How to run s3fs, if applicable
command line
s3fs talend-dev-s3 /talend-dev-s3 -o passwd_file=/home/tadmin/.passwd-s3fs -o use_cache=/app2/tadmin_s3stmp -o allow_other -d -d -f -o f2 -o curldbg
s3fs syslog messages (
grep s3fs /var/log/syslog,journalctl | grep s3fs, ors3fs outputs)save_s3fs.log
Details about issue
input/output errors from a server on a directory of a buket:
[tadmin@DIS1DHAPP1 log]$ wc -l /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/z*
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicmi6Nx
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicShxHq
201088 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj
wc: /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj: Input/output error
77 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zihB82Ms
57932 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a
wc: /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a: Input/output error
72 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zinIjibL
259267 total
but the same command from a different server using the same bucket works fine:
[tadmin@DIS3DHAPP1 scripts]$ wc -l /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/z*
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicmi6Nx
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicShxHq
50 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj
77 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zihB82Ms
21 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a
72 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zinIjibL
318 total
file sizes look wrong with an ls as well:
[tadmin@DIS1DHAPP1 log]$ ls -l /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne
total 78685
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zicmi6Nx
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zicShxHq
-rw-------. 1 tadmin tadmingroup 63733641 Dec 16 11:22 zidYRlJj
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zihB82Ms
-rw-------. 1 tadmin tadmingroup 16771717 Dec 16 11:23 zii3ZG4a
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:24 zinIjibL
[tadmin@DIS1DHAPP1 log]$
on other server:
[tadmin@DIS3DHAPP1 IMSOne]$ ls -l
total 99
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zicmi6Nx
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zicShxHq
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:22 zidYRlJj
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zihB82Ms
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:23 zii3ZG4a
-rw-------. 1 tadmin tadmingroup 16384 Dec 16 11:24 zinIjibL
thoughts?
@gaul commented on GitHub (Dec 17, 2024):
Could you test with the latest version 1.95?
@mselvaggio-iqvia commented on GitHub (Dec 17, 2024):
Works fine on 1.94 ... is something fixed in 1.95? this 1.86 version has been working for a long time
ed fields
[root@ip-172-28-1-105 ec2-user]# su infadmin
[infadmin@ip-172-28-1-105 ec2-user]$ wc -l /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/z*
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicmi6Nx
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicShxHq
50 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj
77 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zihB82Ms
21 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a
72 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zinIjibL
318 total
[infadmin@ip-172-28-1-105 ec2-user]$ s3fs --version
Amazon Simple Storage Service File System V1.94 (commit:unknown) with OpenSSL
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 https://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
[infadmin@ip-172-28-1-105 ec2-user]$
@mselvaggio-iqvia commented on GitHub (Dec 17, 2024):
repeated copies seems to fix the issue:
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a .
cp: failed to close ‘/talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a’: Input/output error
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a .
[tadmin@DIS1DHAPP1 ~]$ cp /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj .
[tadmin@DIS1DHAPP1 ~]$ wc -l /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/z*
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicmi6Nx
49 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zicShxHq
50 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zidYRlJj
77 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zihB82Ms
21 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zii3ZG4a
72 /talend-dev-s3/Dexcom/PROD/Outbox/IMSOne/zinIjibL
318 total
[tadmin@DIS1DHAPP1 ~]$
@brentclark commented on GitHub (Mar 26, 2025):
Good day
This still appears to be a problem Debian Bookwork with V1.95
Even with a ls, I get Input/output error