[GH-ISSUE #2584] S3 PUT file part fails 400 RequestTimeout Your socket connection to the server was not read from or written to within the timeout period #1242

New issue

Open

opened 2026-03-04 01:52:30 +03:00 by kerem · 0 comments

kerem commented

2026-03-04 01:52:30 +03:00

Owner

Originally created by @rabell on GitHub (Nov 1, 2024).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2584

Additional Information

Version of s3fs being used (`s3fs --version`)

Amazon Simple Storage Service File System V1.95 with OpenSSL

Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`)

2.9.9

Kernel information (`uname -r`)

Debian 6.1.112-1 (2024-09-30)

GNU/Linux Distribution, if applicable (`cat /etc/os-release`)

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm

How to run s3fs, if applicable

[x] command line
[] /etc/fstab

/usr/local/bin/s3fs ppt-samba-test /s3fs -d -o logfile=/var/log/s3fs.log -o endpoint=eu-west-1 -o url=https://s3-eu-west-1.amazonaws.com -o allow_other

s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`)

2024-11-01T14:22:52.998Z [INF]       curl.cpp:insertV4Headers(2975): computing signature [PUT] [/Email.fmp12] [partNumber=156&uploadId=H0Rog0zLOPLR7UlN4d8gRwTjVKNIrsdJjv8h0Jzhe8dnaDU66W8ixGny3ICduzeLk263ou7ED3SZ.WhsdPpPYQ--] [e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855]
2024-11-01T14:22:52.998Z [INF]       curl_util.cpp:url_to_host(266): url is https://s3-eu-west-1.amazonaws.com
2024-11-01T14:22:52.998Z [CURL DBG] * Found bundle for host: 0xffff400013d0 [serially]

2024-11-01T14:22:52.998Z [CURL DBG] * Can not multiplex, even if we wanted to

2024-11-01T14:22:52.998Z [CURL DBG] * Re-using existing connection #1 with host ppt-samba-test.s3-eu-west-1.amazonaws.com

2024-11-01T14:22:52.998Z [CURL DBG] > PUT /Email.fmp12?partNumber=156&uploadId=H0Rog0zLOPLR7UlN4d8gRwTjVKNIrsdJjv8h0Jzhe8dnaDU66W8ixGny3ICduzeLk263ou7ED3SZ.WhsdPpPYQ-- HTTP/1.1
2024-11-01T14:22:52.998Z [CURL DBG] > Host: ppt-samba-test.s3-eu-west-1.amazonaws.com
2024-11-01T14:22:52.998Z [CURL DBG] > User-Agent: s3fs/1.95 (commit hash ; OpenSSL)
2024-11-01T14:22:52.998Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=AKIAI3B4ESABJDTPT2JA/20241101/eu-west-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=291d7aba38242c7746ded8e9b6d4e12069dcf8b630a679119fa3cd61f17cbc65
2024-11-01T14:22:52.998Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2024-11-01T14:22:52.998Z [CURL DBG] > x-amz-date: 20241101T142252Z
2024-11-01T14:22:52.998Z [CURL DBG] > Content-Length: 10485760
2024-11-01T14:22:52.998Z [CURL DBG] > Expect: 100-continue
2024-11-01T14:22:52.998Z [CURL DBG] > 
2024-11-01T14:22:53.009Z [CURL DBG] < HTTP/1.1 100 Continue
2024-11-01T14:23:12.821Z [CURL DBG] < HTTP/1.1 400 Bad Request
2024-11-01T14:23:12.821Z [CURL DBG] < x-amz-request-id: 81RZH38NV01G0B40
2024-11-01T14:23:12.821Z [CURL DBG] < x-amz-id-2: yxI7PsJWFhqwMkRtGd8r4NFANjLPWqAVoloZfC7bxmYtxN+U92Gzqtufh6C8nVIPiPCZGvIEO4jzhNb0iAZ3v+UAk/V6BSW8
2024-11-01T14:23:12.821Z [CURL DBG] < Content-Type: application/xml
2024-11-01T14:23:12.821Z [CURL DBG] < Transfer-Encoding: chunked
2024-11-01T14:23:12.821Z [CURL DBG] < Date: Fri, 01 Nov 2024 14:23:12 GMT
2024-11-01T14:23:12.821Z [CURL DBG] < Server: AmazonS3
2024-11-01T14:23:12.821Z [CURL DBG] < Connection: close
2024-11-01T14:23:12.821Z [CURL DBG] < 
2024-11-01T14:23:12.821Z [CURL DBG] * Closing connection 1

2024-11-01T14:23:12.822Z [CURL DBG] * TLSv1.3 (IN), TLS alert, close notify (256):

2024-11-01T14:23:12.822Z [CURL DBG] * TLSv1.3 (OUT), TLS alert, close notify (256):

2024-11-01T14:23:12.831Z [ERR] curl.cpp:RequestPerform(2632): HTTP response code 400, returning EIO. Body Text: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>RequestTimeout</Code><Message>Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.</Message><RequestId>81RZH38NV01G0B40</RequestId><HostId>yxI7PsJWFhqwMkRtGd8r4NFANjLPWqAVoloZfC7bxmYtxN+U92Gzqtufh6C8nVIPiPCZGvIEO4jzhNb0iAZ3v+UAk/V6BSW8</HostId></Error>
2024-11-01T14:23:12.831Z [WAN] curl_multi.cpp:MultiPerform(138): thread terminated with non-zero return code: -5
2024-11-01T14:23:12.831Z [INF]       curl.cpp:insertV4Headers(2975): computing signature [PUT] [/Email.fmp12] [partNumber=157&uploadId=H0Rog0zLOPLR7UlN4d8gRwTjVKNIrsdJjv8h0Jzhe8dnaDU66W8ixGny3ICduzeLk263ou7ED3SZ.WhsdPpPYQ--] [e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855]
2024-11-01T14:23:12.831Z [INF]       curl_util.cpp:url_to_host(266): url is https://s3-eu-west-1.amazonaws.com
2024-11-01T14:23:12.835Z [CURL DBG] *   Trying 3.5.70.173:443...

2024-11-01T14:23:12.836Z [CURL DBG] * Connected to ppt-samba-test.s3-eu-west-1.amazonaws.com (3.5.70.173) port 443 (#2)

2024-11-01T14:23:12.838Z [CURL DBG] * TLSv1.3 (OUT), TLS handshake, Client hello (1):

2024-11-01T14:23:12.858Z [CURL DBG] < HTTP/1.1 400 Bad Request
2024-11-01T14:23:12.858Z [CURL DBG] < x-amz-request-id: 81RQQ46SFKSP3SH7
2024-11-01T14:23:12.858Z [CURL DBG] < x-amz-id-2: yBJDlqlRWJ8+NYYlim4JVq97aiWVx315SIqwtdZQH3/W9UmlcQyn/kS/13ugXg2VEQtSpeES+QfgOl073bqzzgqrUB7YvZ/k
2024-11-01T14:23:12.858Z [CURL DBG] < Content-Type: application/xml
2024-11-01T14:23:12.858Z [CURL DBG] < Transfer-Encoding: chunked
2024-11-01T14:23:12.858Z [CURL DBG] < Date: Fri, 01 Nov 2024 14:23:12 GMT
2024-11-01T14:23:12.858Z [CURL DBG] < Server: AmazonS3
2024-11-01T14:23:12.858Z [CURL DBG] < Connection: close
2024-11-01T14:23:12.858Z [CURL DBG] < 
2024-11-01T14:23:12.858Z [CURL DBG] * Closing connection 1

2024-11-01T14:23:12.858Z [CURL DBG] * TLSv1.3 (IN), TLS alert, close notify (256):

2024-11-01T14:23:12.858Z [CURL DBG] * TLSv1.3 (OUT), TLS alert, close notify (256):

2024-11-01T14:23:12.860Z [ERR] curl.cpp:RequestPerform(2632): HTTP response code 400, returning EIO. Body Text: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>RequestTimeout</Code><Message>Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.</Message><RequestId>81RQQ46SFKSP3SH7</RequestId><HostId>yBJDlqlRWJ8+NYYlim4JVq97aiWVx315SIqwtdZQH3/W9UmlcQyn/kS/13ugXg2VEQtSpeES+QfgOl073bqzzgqrUB7YvZ/k</HostId></Error>

Details about issue

When copying large file (e.g. 3GB) the transfer stalls.
Above shows in log.
Server is in same zone as bucket (eu-west-1)

Originally created by @rabell on GitHub (Nov 1, 2024). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2584 ### Additional Information #### Version of s3fs being used (`s3fs --version`) Amazon Simple Storage Service File System V1.95 with OpenSSL #### Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`) 2.9.9 #### Kernel information (`uname -r`) Debian 6.1.112-1 (2024-09-30) #### GNU/Linux Distribution, if applicable (`cat /etc/os-release`) PRETTY_NAME="Debian GNU/Linux 12 (bookworm)" NAME="Debian GNU/Linux" VERSION_ID="12" VERSION="12 (bookworm)" VERSION_CODENAME=bookworm #### How to run s3fs, if applicable  [x] command line [] /etc/fstab  ``` /usr/local/bin/s3fs ppt-samba-test /s3fs -d -o logfile=/var/log/s3fs.log -o endpoint=eu-west-1 -o url=https://s3-eu-west-1.amazonaws.com -o allow_other ``` #### s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`) ``` 2024-11-01T14:22:52.998Z [INF] curl.cpp:insertV4Headers(2975): computing signature [PUT] [/Email.fmp12] [partNumber=156&uploadId=H0Rog0zLOPLR7UlN4d8gRwTjVKNIrsdJjv8h0Jzhe8dnaDU66W8ixGny3ICduzeLk263ou7ED3SZ.WhsdPpPYQ--] [e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855] 2024-11-01T14:22:52.998Z [INF] curl_util.cpp:url_to_host(266): url is https://s3-eu-west-1.amazonaws.com 2024-11-01T14:22:52.998Z [CURL DBG] * Found bundle for host: 0xffff400013d0 [serially] 2024-11-01T14:22:52.998Z [CURL DBG] * Can not multiplex, even if we wanted to 2024-11-01T14:22:52.998Z [CURL DBG] * Re-using existing connection #1 with host ppt-samba-test.s3-eu-west-1.amazonaws.com 2024-11-01T14:22:52.998Z [CURL DBG] > PUT /Email.fmp12?partNumber=156&uploadId=H0Rog0zLOPLR7UlN4d8gRwTjVKNIrsdJjv8h0Jzhe8dnaDU66W8ixGny3ICduzeLk263ou7ED3SZ.WhsdPpPYQ-- HTTP/1.1 2024-11-01T14:22:52.998Z [CURL DBG] > Host: ppt-samba-test.s3-eu-west-1.amazonaws.com 2024-11-01T14:22:52.998Z [CURL DBG] > User-Agent: s3fs/1.95 (commit hash ; OpenSSL) 2024-11-01T14:22:52.998Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=AKIAI3B4ESABJDTPT2JA/20241101/eu-west-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=291d7aba38242c7746ded8e9b6d4e12069dcf8b630a679119fa3cd61f17cbc65 2024-11-01T14:22:52.998Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2024-11-01T14:22:52.998Z [CURL DBG] > x-amz-date: 20241101T142252Z 2024-11-01T14:22:52.998Z [CURL DBG] > Content-Length: 10485760 2024-11-01T14:22:52.998Z [CURL DBG] > Expect: 100-continue 2024-11-01T14:22:52.998Z [CURL DBG] > 2024-11-01T14:22:53.009Z [CURL DBG] < HTTP/1.1 100 Continue 2024-11-01T14:23:12.821Z [CURL DBG] < HTTP/1.1 400 Bad Request 2024-11-01T14:23:12.821Z [CURL DBG] < x-amz-request-id: 81RZH38NV01G0B40 2024-11-01T14:23:12.821Z [CURL DBG] < x-amz-id-2: yxI7PsJWFhqwMkRtGd8r4NFANjLPWqAVoloZfC7bxmYtxN+U92Gzqtufh6C8nVIPiPCZGvIEO4jzhNb0iAZ3v+UAk/V6BSW8 2024-11-01T14:23:12.821Z [CURL DBG] < Content-Type: application/xml 2024-11-01T14:23:12.821Z [CURL DBG] < Transfer-Encoding: chunked 2024-11-01T14:23:12.821Z [CURL DBG] < Date: Fri, 01 Nov 2024 14:23:12 GMT 2024-11-01T14:23:12.821Z [CURL DBG] < Server: AmazonS3 2024-11-01T14:23:12.821Z [CURL DBG] < Connection: close 2024-11-01T14:23:12.821Z [CURL DBG] < 2024-11-01T14:23:12.821Z [CURL DBG] * Closing connection 1 2024-11-01T14:23:12.822Z [CURL DBG] * TLSv1.3 (IN), TLS alert, close notify (256): 2024-11-01T14:23:12.822Z [CURL DBG] * TLSv1.3 (OUT), TLS alert, close notify (256): 2024-11-01T14:23:12.831Z [ERR] curl.cpp:RequestPerform(2632): HTTP response code 400, returning EIO. Body Text: <?xml version="1.0" encoding="UTF-8"?> <Error><Code>RequestTimeout</Code><Message>Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.</Message><RequestId>81RZH38NV01G0B40</RequestId><HostId>yxI7PsJWFhqwMkRtGd8r4NFANjLPWqAVoloZfC7bxmYtxN+U92Gzqtufh6C8nVIPiPCZGvIEO4jzhNb0iAZ3v+UAk/V6BSW8</HostId></Error> 2024-11-01T14:23:12.831Z [WAN] curl_multi.cpp:MultiPerform(138): thread terminated with non-zero return code: -5 2024-11-01T14:23:12.831Z [INF] curl.cpp:insertV4Headers(2975): computing signature [PUT] [/Email.fmp12] [partNumber=157&uploadId=H0Rog0zLOPLR7UlN4d8gRwTjVKNIrsdJjv8h0Jzhe8dnaDU66W8ixGny3ICduzeLk263ou7ED3SZ.WhsdPpPYQ--] [e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855] 2024-11-01T14:23:12.831Z [INF] curl_util.cpp:url_to_host(266): url is https://s3-eu-west-1.amazonaws.com 2024-11-01T14:23:12.835Z [CURL DBG] * Trying 3.5.70.173:443... 2024-11-01T14:23:12.836Z [CURL DBG] * Connected to ppt-samba-test.s3-eu-west-1.amazonaws.com (3.5.70.173) port 443 (#2) 2024-11-01T14:23:12.838Z [CURL DBG] * TLSv1.3 (OUT), TLS handshake, Client hello (1): 2024-11-01T14:23:12.858Z [CURL DBG] < HTTP/1.1 400 Bad Request 2024-11-01T14:23:12.858Z [CURL DBG] < x-amz-request-id: 81RQQ46SFKSP3SH7 2024-11-01T14:23:12.858Z [CURL DBG] < x-amz-id-2: yBJDlqlRWJ8+NYYlim4JVq97aiWVx315SIqwtdZQH3/W9UmlcQyn/kS/13ugXg2VEQtSpeES+QfgOl073bqzzgqrUB7YvZ/k 2024-11-01T14:23:12.858Z [CURL DBG] < Content-Type: application/xml 2024-11-01T14:23:12.858Z [CURL DBG] < Transfer-Encoding: chunked 2024-11-01T14:23:12.858Z [CURL DBG] < Date: Fri, 01 Nov 2024 14:23:12 GMT 2024-11-01T14:23:12.858Z [CURL DBG] < Server: AmazonS3 2024-11-01T14:23:12.858Z [CURL DBG] < Connection: close 2024-11-01T14:23:12.858Z [CURL DBG] < 2024-11-01T14:23:12.858Z [CURL DBG] * Closing connection 1 2024-11-01T14:23:12.858Z [CURL DBG] * TLSv1.3 (IN), TLS alert, close notify (256): 2024-11-01T14:23:12.858Z [CURL DBG] * TLSv1.3 (OUT), TLS alert, close notify (256): 2024-11-01T14:23:12.860Z [ERR] curl.cpp:RequestPerform(2632): HTTP response code 400, returning EIO. Body Text: <?xml version="1.0" encoding="UTF-8"?> <Error><Code>RequestTimeout</Code><Message>Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.</Message><RequestId>81RQQ46SFKSP3SH7</RequestId><HostId>yBJDlqlRWJ8+NYYlim4JVq97aiWVx315SIqwtdZQH3/W9UmlcQyn/kS/13ugXg2VEQtSpeES+QfgOl073bqzzgqrUB7YvZ/k</HostId></Error> ``` ### Details about issue When copying large file (e.g. 3GB) the transfer stalls. Above shows in log. Server is in same zone as bucket (eu-west-1)