starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 13:26:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #1033] copying failed for files >10G on RHEL 7.6 #567

New issue
Closed
opened 2026-03-04 01:46:47 +03:00 by kerem · 3 comments
kerem commented 2026-03-04 01:46:47 +03:00
Owner
Copy link

Originally created by @ttdsuen on GitHub (Jun 3, 2019).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1033

Additional Information

I was trying to copy some files to an S3 bucket and some files over 10G could not get through with error:

cp: error writing ‘/opt/elk/data/backup1/abc.txt’: Input/output error
cp: failed to extend ‘/opt/elk/data/backup1/abc.txt’: Input/output error
cp: failed to close ‘/opt/elk/data/backup1/abc.txt’: Operation not permitted

abc.txt is a 11G file, and the result of this operation is an empty file at the target location.

Version of s3fs being used (s3fs --version)

Amazon Simple Storage Service File System V1.85(commit:unknown) with OpenSSL
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 https://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

Name : fuse
Version : 2.9.2
Release : 11.el7
Architecture: x86_64
Install Date: Mon 04 Mar 2019 08:47:46 AM EST
Group : System Environment/Base
Size : 223297
License : GPL+
Signature : RSA/SHA256, Mon 06 Aug 2018 09:13:08 AM EDT, Key ID 199e2f91fd431d51
Source RPM : fuse-2.9.2-11.el7.src.rpm
Build Date : Tue 24 Jul 2018 10:58:28 AM EDT
Build Host : x86-039.build.eng.bos.redhat.com
Relocations : (not relocatable)
Packager : Red Hat, Inc. http://bugzilla.redhat.com/bugzilla
Vendor : Red Hat, Inc.
URL : https://github.com/libfuse/libfuse
Summary : File System in Userspace (FUSE) utilities
Description :
With FUSE it is possible to implement a fully functional filesystem in a
userspace program. This package contains the FUSE userspace tools to
mount a FUSE filesystem.

Kernel information (uname -r)

3.10.0-957.10.1.el7.x86_64

GNU/Linux Distribution, if applicable (cat /etc/os-release)

NAME="Red Hat Enterprise Linux Server"
VERSION="7.6 (Maipo)"
ID="rhel"
ID_LIKE="fedora"
VARIANT="Server"
VARIANT_ID="server"
VERSION_ID="7.6"
PRETTY_NAME="Red Hat Enterprise Linux"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:7.6:GA:server"
HOME_URL="https://www.redhat.com/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"

REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7"
REDHAT_BUGZILLA_PRODUCT_VERSION=7.6
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="7.6"

s3fs command line used, if applicable

/etc/fstab entry, if applicable

s3fs#some_bucket /opt/elk/data/backup1 fuse _netdev,dbglevel=debug,nomultipart,allow_other,mp_umask=022,uid=43128,gid=100,use_path_request_style,url=http://s3_remote.dev.mycompany.com:9020 0 0

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages

Jun  3 12:43:44 my_host s3fs[66247]: [path=/]
Jun  3 12:43:44 my_host s3fs[66247]: [path=/][flags=100352]
Jun  3 12:43:44 my_host s3fs[66247]: [path=/]
Jun  3 12:43:44 my_host s3fs[66247]:  [path=/]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/]
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket?delimiter=/&max-keys=1000&prefix=
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/?delimiter=/&max-keys=1000&prefix=
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 200
Jun  3 12:43:44 my_host s3fs[66247]:  [path=/][list=0]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir/][bpath=target_dir/][save=/target_dir/][sseckeypos=-1]
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [HEAD] [/target_dir/] [] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/abc.txt][bpath=abc.txt][save=/abc.txt][sseckeypos=-1]
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/abc.txt
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/abc.txt
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [HEAD] [/abc.txt] [] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]:      [count=2]
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 404 was returned, returning ENOENT
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 200
Jun  3 12:43:44 my_host s3fs[66247]:      add stat cache entry[path=/abc.txt]
Jun  3 12:43:44 my_host s3fs[66247]:    Could not find /target_dir file in stat cache.
Jun  3 12:43:44 my_host s3fs[66247]: [path=/]
Jun  3 12:43:44 my_host s3fs[66247]: [path=/target_dir]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir][bpath=][save=][sseckeypos=-1]
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [HEAD] [/target_dir] [] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 404 was returned, returning ENOENT
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir/]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir/][bpath=][save=][sseckeypos=-1]
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [HEAD] [/target_dir/] [] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 404 was returned, returning ENOENT
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir_$folder$]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir_$folder$][bpath=][save=][sseckeypos=-1]
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir_%24folder%24
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir_%24folder%24
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [HEAD] [/target_dir_$folder$] [] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 404 was returned, returning ENOENT
Jun  3 12:43:44 my_host s3fs[66247]:  [path=/target_dir]
Jun  3 12:43:44 my_host s3fs[66247]:      [tpath=/target_dir]
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jun  3 12:43:44 my_host s3fs[66247]:      URL is http://s3_remote.dev.mycompany.com:9020/some_bucket?delimiter=/&max-keys=2&prefix=target_dir/
Jun  3 12:43:44 my_host s3fs[66247]:      URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/?delimiter=/&max-keys=2&prefix=target_dir/
Jun  3 12:43:44 my_host s3fs[66247]:      computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=target_dir/] []
Jun  3 12:43:44 my_host s3fs[66247]:      url is http://s3_remote.dev.mycompany.com:9020
Jun  3 12:43:44 my_host s3fs[66247]:      HTTP response code 200
Jun  3 12:43:44 my_host s3fs[66247]:      add stat cache entry[path=/target_dir/]
Jun  3 12:43:44 my_host s3fs[66247]: [path=/abc.txt]
Jun  3 12:44:17 my_host s3fs[66247]: [path=/]

Details about issue

I have these rpms installed:

fuse-libs-2.9.2-11.el7.x86_64
s3fs-fuse-1.85-1.el7.x86_64
fuse-2.9.2-11.el7.x86_64
libcurl-7.29.0-51.el7.x86_64
libcurl-devel-7.29.0-51.el7.x86_64

Copying smaller files are ok. I have debugged turned on, I got error in the log (see the section on logging message).

In the beginning, I did not put "nomultipart" in the mount option, as I saw errors related to it in debug mode. But even if I put this in, I still hit the same issue.

I tried mounting with another more updated version of curl 7.64.1, but still not working, same error.

Originally created by @ttdsuen on GitHub (Jun 3, 2019). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1033 ### Additional Information I was trying to copy some files to an S3 bucket and some files over 10G could not get through with error: cp: error writing ‘/opt/elk/data/backup1/abc.txt’: Input/output error cp: failed to extend ‘/opt/elk/data/backup1/abc.txt’: Input/output error cp: failed to close ‘/opt/elk/data/backup1/abc.txt’: Operation not permitted abc.txt is a 11G file, and the result of this operation is an empty file at the target location. #### Version of s3fs being used (s3fs --version) Amazon Simple Storage Service File System V1.85(commit:unknown) with OpenSSL Copyright (C) 2010 Randy Rizun <rrizun@gmail.com> License GPL2: GNU GPL version 2 <https://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) Name : fuse Version : 2.9.2 Release : 11.el7 Architecture: x86_64 Install Date: Mon 04 Mar 2019 08:47:46 AM EST Group : System Environment/Base Size : 223297 License : GPL+ Signature : RSA/SHA256, Mon 06 Aug 2018 09:13:08 AM EDT, Key ID 199e2f91fd431d51 Source RPM : fuse-2.9.2-11.el7.src.rpm Build Date : Tue 24 Jul 2018 10:58:28 AM EDT Build Host : x86-039.build.eng.bos.redhat.com Relocations : (not relocatable) Packager : Red Hat, Inc. <http://bugzilla.redhat.com/bugzilla> Vendor : Red Hat, Inc. URL : https://github.com/libfuse/libfuse Summary : File System in Userspace (FUSE) utilities Description : With FUSE it is possible to implement a fully functional filesystem in a userspace program. This package contains the FUSE userspace tools to mount a FUSE filesystem. #### Kernel information (uname -r) 3.10.0-957.10.1.el7.x86_64 #### GNU/Linux Distribution, if applicable (cat /etc/os-release) NAME="Red Hat Enterprise Linux Server" VERSION="7.6 (Maipo)" ID="rhel" ID_LIKE="fedora" VARIANT="Server" VARIANT_ID="server" VERSION_ID="7.6" PRETTY_NAME="Red Hat Enterprise Linux" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:redhat:enterprise_linux:7.6:GA:server" HOME_URL="https://www.redhat.com/" BUG_REPORT_URL="https://bugzilla.redhat.com/" REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7" REDHAT_BUGZILLA_PRODUCT_VERSION=7.6 REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" REDHAT_SUPPORT_PRODUCT_VERSION="7.6" #### s3fs command line used, if applicable ``` ``` #### /etc/fstab entry, if applicable ``` s3fs#some_bucket /opt/elk/data/backup1 fuse _netdev,dbglevel=debug,nomultipart,allow_other,mp_umask=022,uid=43128,gid=100,use_path_request_style,url=http://s3_remote.dev.mycompany.com:9020 0 0 ``` #### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs) _if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages_ ``` Jun 3 12:43:44 my_host s3fs[66247]: [path=/] Jun 3 12:43:44 my_host s3fs[66247]: [path=/][flags=100352] Jun 3 12:43:44 my_host s3fs[66247]: [path=/] Jun 3 12:43:44 my_host s3fs[66247]: [path=/] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/] Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket?delimiter=/&max-keys=1000&prefix= Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/?delimiter=/&max-keys=1000&prefix= Jun 3 12:43:44 my_host s3fs[66247]: computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 200 Jun 3 12:43:44 my_host s3fs[66247]: [path=/][list=0] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir/][bpath=target_dir/][save=/target_dir/][sseckeypos=-1] Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/ Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/ Jun 3 12:43:44 my_host s3fs[66247]: computing signature [HEAD] [/target_dir/] [] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/abc.txt][bpath=abc.txt][save=/abc.txt][sseckeypos=-1] Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/abc.txt Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/abc.txt Jun 3 12:43:44 my_host s3fs[66247]: computing signature [HEAD] [/abc.txt] [] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: [count=2] Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 404 was returned, returning ENOENT Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 200 Jun 3 12:43:44 my_host s3fs[66247]: add stat cache entry[path=/abc.txt] Jun 3 12:43:44 my_host s3fs[66247]: Could not find /target_dir file in stat cache. Jun 3 12:43:44 my_host s3fs[66247]: [path=/] Jun 3 12:43:44 my_host s3fs[66247]: [path=/target_dir] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir][bpath=][save=][sseckeypos=-1] Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir Jun 3 12:43:44 my_host s3fs[66247]: computing signature [HEAD] [/target_dir] [] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 404 was returned, returning ENOENT Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir/] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir/][bpath=][save=][sseckeypos=-1] Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/ Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir/ Jun 3 12:43:44 my_host s3fs[66247]: computing signature [HEAD] [/target_dir/] [] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 404 was returned, returning ENOENT Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir_$folder$] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir_$folder$][bpath=][save=][sseckeypos=-1] Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir_%24folder%24 Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/target_dir_%24folder%24 Jun 3 12:43:44 my_host s3fs[66247]: computing signature [HEAD] [/target_dir_$folder$] [] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 404 was returned, returning ENOENT Jun 3 12:43:44 my_host s3fs[66247]: [path=/target_dir] Jun 3 12:43:44 my_host s3fs[66247]: [tpath=/target_dir] Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1855): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: curl.cpp:ResetHandle(1858): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later. Jun 3 12:43:44 my_host s3fs[66247]: URL is http://s3_remote.dev.mycompany.com:9020/some_bucket?delimiter=/&max-keys=2&prefix=target_dir/ Jun 3 12:43:44 my_host s3fs[66247]: URL changed is http://s3_remote.dev.mycompany.com:9020/some_bucket/?delimiter=/&max-keys=2&prefix=target_dir/ Jun 3 12:43:44 my_host s3fs[66247]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=target_dir/] [] Jun 3 12:43:44 my_host s3fs[66247]: url is http://s3_remote.dev.mycompany.com:9020 Jun 3 12:43:44 my_host s3fs[66247]: HTTP response code 200 Jun 3 12:43:44 my_host s3fs[66247]: add stat cache entry[path=/target_dir/] Jun 3 12:43:44 my_host s3fs[66247]: [path=/abc.txt] Jun 3 12:44:17 my_host s3fs[66247]: [path=/] ``` ### Details about issue I have these rpms installed: fuse-libs-2.9.2-11.el7.x86_64 s3fs-fuse-1.85-1.el7.x86_64 fuse-2.9.2-11.el7.x86_64 libcurl-7.29.0-51.el7.x86_64 libcurl-devel-7.29.0-51.el7.x86_64 Copying smaller files are ok. I have debugged turned on, I got error in the log (see the section on logging message). In the beginning, I did not put "nomultipart" in the mount option, as I saw errors related to it in debug mode. But even if I put this in, I still hit the same issue. I tried mounting with another more updated version of curl 7.64.1, but still not working, same error.
kerem 2026-03-04 01:46:47 +03:00
  • closed this issue
  • added the
    need info
         label
kerem commented 2026-03-04 01:46:48 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Jun 13, 2019):

These logs do not seem to correlate with the error you have experienced. Could you try running your test again and collecting the logs, particularly with the -o curldbg option?

<!-- gh-comment-id:501861375 --> @gaul commented on GitHub (Jun 13, 2019): These logs do not seem to correlate with the error you have experienced. Could you try running your test again and collecting the logs, particularly with the `-o curldbg` option?
kerem commented 2026-03-04 01:46:48 +03:00
Author
Owner
Copy link

@capdragon commented on GitHub (Nov 19, 2019):

Same issue here on Ubuntu 18.04 mounting via command, not fstab. I'll try to gather some logs.

<!-- gh-comment-id:555646832 --> @capdragon commented on GitHub (Nov 19, 2019): Same issue here on Ubuntu 18.04 mounting via command, not fstab. I'll try to gather some logs.
kerem commented 2026-03-04 01:46:48 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Feb 3, 2020):

Closing due to inactivity. Please reopen if symptoms persist.

<!-- gh-comment-id:581289673 --> @gaul commented on GitHub (Feb 3, 2020): Closing due to inactivity. Please reopen if symptoms persist.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#567
No description provided.