starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 13:26:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #620] On 32-bit ARM Processors, large files transfers fail with size < 0 #354

New issue
Closed
opened 2026-03-04 01:44:39 +03:00 by kerem · 4 comments
kerem commented 2026-03-04 01:44:39 +03:00
Owner
Copy link

Originally created by @gorky on GitHub (Jun 28, 2017).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/620

Additional Information

When S3FS is used to mount a bucket on a Rasperry PI, large files (7.7GB was the smallest that was tried and failed, but next size down that succeed was 700MB), fail to transfer. File size is logged as a large negative number. (missed that on current runs initially when I was redirecting output to a log file).

  • Version of s3fs being used
    Amazon Simple Storage Service File System V1.82(commit:620f6ec) with OpenSSL
    Copyright (C) 2010 Randy Rizun rrizun@gmail.com
    License GPL2: GNU GPL version 2 http://gnu.org/licenses/gpl.html
    This is free software: you are free to change and redistribute it.
    There is NO WARRANTY, to the extent permitted by law.

  • Version of fuse being used
    pkg-config --modversion fuse
    2.9.3

  • System information
    uname -a
    Linux cvjenkins 4.9.28-v7+ #998 SMP Mon May 15 16:55:39 BST 2017 armv7l GNU/Linux

  • Distro (cat /etc/issue)
    Raspbian GNU/Linux 8 \n \l

  • s3fs command line used (if applicable)

cp /opt/jenkins-s3fs-prod/cvjenkins/jenkins.1.tbz .
cp: cannot open ‘/opt/jenkins-s3fs-prod/cvjenkins/jenkins.1.tbz’ for reading: Input/output error
From the output:
cat /tmp/s3fs.log 
[CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [CRT] to [INF] 
[CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [INF] to [DBG] 
[INF]     s3fs.cpp:set_mountpoint_attribute(4182): PROC(uid=0, gid=0) - MountPoint(uid=112, gid=119, mode=40755)
[CRT] s3fs.cpp:s3fs_init(3367): init v1.82(commit:620f6ec) with OpenSSL
[INF] s3fs.cpp:s3fs_check_service(3743): check services.
[INF]       curl.cpp:CheckBucket(2914): check a bucket.
[DBG] curl.cpp:GetHandler(283): Get handler from pool: 31
[INF]       curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/
[INF]       curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/
[INF]       curl.cpp:insertV4Headers(2267): computing signature [GET] [/] [] []
[INF]       curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com
[DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/
[INF]       curl.cpp:RequestPerform(1952): HTTP response code 400 was returned, returning EIO.
[DBG] curl.cpp:RequestPerform(1953): Body Text: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'us-east-2'</Message><Region>us-east-2</Region><RequestId>713808215CA57AEB</RequestId><HostId>WDcgrnme/Ifv1fehKxZ5BWYRLfpvWnMxnrd/5M9wr7Os8Py+VqDBa/a2DrVjpw0n8BOgfMNedJ4=</HostId></Error>
[ERR] curl.cpp:CheckBucket(2953): Check bucket failed, S3 response: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'us-east-2'</Message><Region>us-east-2</Region><RequestId>713808215CA57AEB</RequestId><HostId>WDcgrnme/Ifv1fehKxZ5BWYRLfpvWnMxnrd/5M9wr7Os8Py+VqDBa/a2DrVjpw0n8BOgfMNedJ4=</HostId></Error>
[CRT] s3fs.cpp:s3fs_check_service(3764): Could not connect wrong region us-east-1, so retry to connect region us-east-2.
[DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31
[INF]       curl.cpp:CheckBucket(2914): check a bucket.
[DBG] curl.cpp:GetHandler(283): Get handler from pool: 31
[INF]       curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/
[INF]       curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/
[INF]       curl.cpp:insertV4Headers(2267): computing signature [GET] [/] [] []
[INF]       curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com
[DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/
[INF]       curl.cpp:RequestPerform(1940): HTTP response code 200
[DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31
[INF] s3fs.cpp:s3fs_getattr(812): [path=/cvjenkins]
[DBG] s3fs.cpp:check_parent_object_access(669): [path=/cvjenkins]
[DBG] s3fs.cpp:check_object_access(563): [path=/]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/]
[DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins]
[INF]       curl.cpp:HeadRequest(2516): [tpath=/cvjenkins]
[INF]       curl.cpp:PreHeadRequest(2453): [tpath=/cvjenkins][bpath=][save=][sseckeypos=-1]
[DBG] curl.cpp:GetHandler(283): Get handler from pool: 31
[INF]       curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins
[INF]       curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins
[INF]       curl.cpp:insertV4Headers(2267): computing signature [HEAD] [/cvjenkins] [] []
[INF]       curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com
[DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins
[INF]       curl.cpp:RequestPerform(1962): HTTP response code 404 was returned, returning ENOENT
[DBG] curl.cpp:RequestPerform(1963): Body Text: 
[DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31
[INF]       curl.cpp:HeadRequest(2516): [tpath=/cvjenkins/]
[INF]       curl.cpp:PreHeadRequest(2453): [tpath=/cvjenkins/][bpath=][save=][sseckeypos=-1]
[DBG] curl.cpp:GetHandler(283): Get handler from pool: 31
[INF]       curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/
[INF]       curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/
[INF]       curl.cpp:insertV4Headers(2267): computing signature [HEAD] [/cvjenkins/] [] []
[INF]       curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com
[DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/
[INF]       curl.cpp:RequestPerform(1940): HTTP response code 200
[DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31
[INF]       cache.cpp:AddStat(356): add stat cache entry[path=/cvjenkins/]
[DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/][time=139414.244779483][hit count=0]
[DBG] fdcache.cpp:ExistOpen(2082): [path=/cvjenkins][fd=-1][ignore_existfd=false]
[DBG] fdcache.cpp:Open(2016): [path=/cvjenkins][size=-1][time=-1]
[DBG] s3fs.cpp:s3fs_getattr(836): [path=/cvjenkins] uid=0, gid=0, mode=40000
[INF] s3fs.cpp:s3fs_getattr(812): [path=/cvjenkins/jenkins.1.tbz]
[DBG] s3fs.cpp:check_parent_object_access(669): [path=/cvjenkins/jenkins.1.tbz]
[DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins]
[DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/][time=139414.244779483][hit count=1]
[DBG] s3fs.cpp:check_object_access(563): [path=/]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/]
[DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins/jenkins.1.tbz]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins/jenkins.1.tbz]
[INF]       curl.cpp:HeadRequest(2516): [tpath=/cvjenkins/jenkins.1.tbz]
[INF]       curl.cpp:PreHeadRequest(2453): [tpath=/cvjenkins/jenkins.1.tbz][bpath=][save=][sseckeypos=-1]
[DBG] curl.cpp:GetHandler(283): Get handler from pool: 31
[INF]       curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz
[INF]       curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz
[INF]       curl.cpp:insertV4Headers(2267): computing signature [HEAD] [/cvjenkins/jenkins.1.tbz] [] []
[INF]       curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com
[DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz
[INF]       curl.cpp:RequestPerform(1940): HTTP response code 200
[DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31
[INF]       cache.cpp:AddStat(356): add stat cache entry[path=/cvjenkins/jenkins.1.tbz]
[DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/jenkins.1.tbz][time=139414.304779372][hit count=0]
[DBG] fdcache.cpp:ExistOpen(2082): [path=/cvjenkins/jenkins.1.tbz][fd=-1][ignore_existfd=false]
**[DBG] fdcache.cpp:Open(2016): [path=/cvjenkins/jenkins.1.tbz][size=-1][time=-1]**
[DBG] s3fs.cpp:s3fs_getattr(836): [path=/cvjenkins/jenkins.1.tbz] uid=107, gid=113, mode=100444
[INF] s3fs.cpp:s3fs_open(2052): [path=/cvjenkins/jenkins.1.tbz][flags=131072]
[INF]       cache.cpp:DelStat(565): delete stat cache entry[path=/cvjenkins/jenkins.1.tbz]
[DBG] s3fs.cpp:check_parent_object_access(669): [path=/cvjenkins/jenkins.1.tbz]
[DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins]
[DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/][time=139414.244779483][hit count=2]
[DBG] s3fs.cpp:check_object_access(563): [path=/]
[DBG] s3fs.cpp:get_object_attribute(416): [path=/]
[DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins/jenkins.1.tbz]

From the Console:
sudo s3fs jenkins.cloudvisory.config /opt/jenkins-s3fs-prod -o passwd_file=/etc/passwd-s3fs -d -d -f -o f2 -o curldbg -o use_path_request_style -o url=https://s3-us-east-2.amazonaws.com -o allow_other -o umask=022 | tee > /tmp/s3fs.log
FUSE library version: 2.9.3
nullpath_ok: 0
nopath: 0
utime_omit_ok: 0
unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0
INIT: 7.26
flags=0x001ffffb
max_readahead=0x00020000
* Hostname was NOT found in DNS cache
*   Trying 52.219.84.27...
* Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#0)
* found 174 certificates in /etc/ssl/certs/ca-certificates.crt
* 	 server certificate verification OK
* 	 common name: *.s3.us-east-2.amazonaws.com (matched)
* 	 server certificate expiration date OK
* 	 server certificate activation date OK
* 	 certificate public key: RSA
* 	 certificate version: #3
* 	 subject: C=US,ST=Washington,L=Seattle,O=Amazon.com Inc.,CN=*.s3.us-east-2.amazonaws.com
* 	 start date: Thu, 09 Mar 2017 00:00:00 GMT

* 	 expire date: Tue, 13 Mar 2018 12:00:00 GMT

* 	 issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert Baltimore CA-2 G2
* 	 compression: NULL
* 	 cipher: AES-128-GCM
* 	 MAC: AEAD
> GET /jenkins.cloudvisory.config/ HTTP/1.1
User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL)
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=ecee7ba85b80360871e9cbfebcb9b29a2c6503135cbf512576c3a6437aa9ad1a
host: s3-us-east-2.amazonaws.com
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20170628T152734Z

< HTTP/1.1 400 Bad Request
< x-amz-bucket-region: us-east-2
< x-amz-request-id: 713808215CA57AEB
< x-amz-id-2: WDcgrnme/Ifv1fehKxZ5BWYRLfpvWnMxnrd/5M9wr7Os8Py+VqDBa/a2DrVjpw0n8BOgfMNedJ4=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Wed, 28 Jun 2017 15:27:35 GMT
< Connection: close
* Server AmazonS3 is not blacklisted
< Server: AmazonS3
< 
* Closing connection 0
* Hostname was found in DNS cache
*   Trying 52.219.84.27...
* Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1)
* found 174 certificates in /etc/ssl/certs/ca-certificates.crt
* SSL re-using session ID
* 	 server certificate verification OK
* 	 common name: *.s3.us-east-2.amazonaws.com (matched)
* 	 server certificate expiration date OK
* 	 server certificate activation date OK
* 	 certificate public key: RSA
* 	 certificate version: #3
* 	 subject: C=US,ST=Washington,L=Seattle,O=Amazon.com Inc.,CN=*.s3.us-east-2.amazonaws.com
* 	 start date: Thu, 09 Mar 2017 00:00:00 GMT

* 	 expire date: Tue, 13 Mar 2018 12:00:00 GMT

* 	 issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert Baltimore CA-2 G2
* 	 compression: NULL
* 	 cipher: AES-128-GCM
* 	 MAC: AEAD
> GET /jenkins.cloudvisory.config/ HTTP/1.1
User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL)
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=43aafb9322437e61a6ac065910c9a59cf412e336226ac50df9ca8a2bc376af36
host: s3-us-east-2.amazonaws.com
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20170628T152735Z

< HTTP/1.1 200 OK
< x-amz-id-2: zOyk0IezIBeaqXCVMtptGC9BEfPEGGlT92bXWYGa2CT8+cX/DSunhOU3rNSjO/wgLx9X+p65bw0=
< x-amz-request-id: 42BBFBFA4C4E75FC
< Date: Wed, 28 Jun 2017 15:27:37 GMT
< x-amz-bucket-region: us-east-2
< Content-Type: application/xml
< Transfer-Encoding: chunked
* Server AmazonS3 is not blacklisted
< Server: AmazonS3
< 

* Connection #1 to host s3-us-east-2.amazonaws.com left intact
   INIT: 7.19
   flags=0x00000019
   max_readahead=0x00020000
   max_write=0x00020000
   max_background=0
   congestion_threshold=0
   unique: 1, success, outsize: 40
unique: 2, opcode: LOOKUP (1), nodeid: 1, insize: 50, pid: 27899
LOOKUP /cvjenkins
getattr /cvjenkins
* Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0
* Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com
* Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1)
> HEAD /jenkins.cloudvisory.config/cvjenkins HTTP/1.1
User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL)
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=0f88978062b7ebf3d30f2c32c3012e725c5a3d5ba85a6720321717a73b52e16a
host: s3-us-east-2.amazonaws.com
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20170628T152744Z

< HTTP/1.1 404 Not Found
< x-amz-request-id: 1932AEC60C620BB6
< x-amz-id-2: hGJEOEeh8kHC+ga2K/yUic7uKv6NPi3jdrLfB+0z3BEC9v6+d1JLoLVy3d20aVS4yKLOPeuPxDQ=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Wed, 28 Jun 2017 15:27:44 GMT
* Server AmazonS3 is not blacklisted
< Server: AmazonS3
< 
* Connection #1 to host s3-us-east-2.amazonaws.com left intact
* Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0
* Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com
* Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1)
> HEAD /jenkins.cloudvisory.config/cvjenkins/ HTTP/1.1
User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL)
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=7ef61c6c7dbbf99545fdb545eae1d56aa290a63b4be0fb1456fbbacf1c808d7e
host: s3-us-east-2.amazonaws.com
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20170628T152744Z

< HTTP/1.1 200 OK
< x-amz-id-2: 8Kd4CzmxyBHoxg9FQnTd2/OQPK98NyOrSG7krGKQ5W7DVTJUpEX1TyEs0dqX7lZbJP3yC84UasA=
< x-amz-request-id: 5E623C2C2D297783
< Date: Wed, 28 Jun 2017 15:27:45 GMT
< Last-Modified: Thu, 01 Dec 2016 01:41:52 GMT
< ETag: "d41d8cd98f00b204e9800998ecf8427e"
< x-amz-server-side-encryption: AES256
< Accept-Ranges: bytes
< Content-Type: binary/octet-stream
< Content-Length: 0
* Server AmazonS3 is not blacklisted
< Server: AmazonS3
< 
* Connection #1 to host s3-us-east-2.amazonaws.com left intact
   NODEID: 2
   unique: 2, success, outsize: 144
unique: 3, opcode: LOOKUP (1), nodeid: 2, insize: 54, pid: 27899
LOOKUP /cvjenkins/jenkins.1.tbz
getattr /cvjenkins/jenkins.1.tbz
* Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0
* Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com
* Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1)
> HEAD /jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz HTTP/1.1
User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL)
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=f1665a2095bcccaf3dd3e2394920d9cb3092b744c64a1dbaacfa53825b849d85
host: s3-us-east-2.amazonaws.com
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20170628T152744Z

< HTTP/1.1 200 OK
< x-amz-id-2: o4w7R6CBnqTDhtRnss4f9YjI5If/4Tw7xMfztC/zkkvMffDUW5PizW829diaUWOMyzJttSqPotk=
< x-amz-request-id: A00264B10D090C6C
< Date: Wed, 28 Jun 2017 15:27:45 GMT
< Last-Modified: Wed, 28 Jun 2017 03:53:29 GMT
< ETag: "b021153728c301676539cd3799e50def-16"
< x-amz-meta-mode: 33060
< x-amz-meta-gid: 113
< x-amz-meta-uid: 107
< Accept-Ranges: bytes
< Content-Type: application/octet-stream
< Content-Length: 8275250430
* Server AmazonS3 is not blacklisted
< Server: AmazonS3
< 
* Connection #1 to host s3-us-east-2.amazonaws.com left intact
   NODEID: 3
   unique: 3, success, outsize: 144
unique: 4, opcode: OPEN (14), nodeid: 3, insize: 48, pid: 27899
open flags: 0x20000 /cvjenkins/jenkins.1.tbz
* Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0
* Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com
* Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1)
> HEAD /jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz HTTP/1.1
User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL)
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=f1665a2095bcccaf3dd3e2394920d9cb3092b744c64a1dbaacfa53825b849d85
host: s3-us-east-2.amazonaws.com
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20170628T152744Z

< HTTP/1.1 200 OK
< x-amz-id-2: gTztPv5O5sWvI4ncb22cTMxw6z4zXivAVUyz05E8f0sRFziSrqiHMkpYBMEUAmdSehWKSZXnCNY=
< x-amz-request-id: 833C8AD7C4FC5CF9
< Date: Wed, 28 Jun 2017 15:27:45 GMT
< Last-Modified: Wed, 28 Jun 2017 03:53:29 GMT
< ETag: "b021153728c301676539cd3799e50def-16"
< x-amz-meta-mode: 33060
< x-amz-meta-gid: 113
< x-amz-meta-uid: 107
< Accept-Ranges: bytes
< Content-Type: application/octet-stream
< Content-Length: 8275250430
* Server AmazonS3 is not blacklisted
< Server: AmazonS3
< 
* Connection #1 to host s3-us-east-2.amazonaws.com left intact
   unique: 4, error: -5 (Input/output error), outsize: 16

Details about issue

On other platforms, this works quite well, but not on the Raspberry PI.

NOTE: If required, a Rasperry Pi can be setup with remote access for testing/debugging.

Originally created by @gorky on GitHub (Jun 28, 2017). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/620 #### Additional Information When S3FS is used to mount a bucket on a Rasperry PI, large files (7.7GB was the smallest that was tried and failed, but next size down that succeed was 700MB), fail to transfer. File size is logged as a large negative number. (missed that on current runs initially when I was redirecting output to a log file). - Version of s3fs being used Amazon Simple Storage Service File System V1.82(commit:620f6ec) with OpenSSL Copyright (C) 2010 Randy Rizun <rrizun@gmail.com> License GPL2: GNU GPL version 2 <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. - Version of fuse being used pkg-config --modversion fuse 2.9.3 - System information uname -a Linux cvjenkins 4.9.28-v7+ #998 SMP Mon May 15 16:55:39 BST 2017 armv7l GNU/Linux - Distro (cat /etc/issue) Raspbian GNU/Linux 8 \n \l - s3fs command line used (if applicable) ```sudo s3fs jenkins.yyyyyyyyyy.yyyyyyyyyyy /opt/jenkins-s3fs-prod -o passwd_file=/etc/passwd-s3fs -d -d -f -o f2 -o curldbg -o use_path_request_style -o url=https://s3-us-east-2.amazonaws.com -o allow_other -o umask=022 ``` - /etc/fstab entry (if applicable): url=https://s3-us-east-2.amazonaws.com,noexec,gid=jenkins,uid=jenkins 0 0 s3fs#jenkins.yyyyyyyy.yyyyy:/cvjenkins /opt/jenkins-s3fs-prod - s3fs syslog messages (grep s3fs /var/log/syslog, or s3fs outputs) ``` cp /opt/jenkins-s3fs-prod/cvjenkins/jenkins.1.tbz . cp: cannot open ‘/opt/jenkins-s3fs-prod/cvjenkins/jenkins.1.tbz’ for reading: Input/output error From the output: cat /tmp/s3fs.log [CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [CRT] to [INF] [CRT] s3fs.cpp:set_s3fs_log_level(257): change debug level from [INF] to [DBG] [INF] s3fs.cpp:set_mountpoint_attribute(4182): PROC(uid=0, gid=0) - MountPoint(uid=112, gid=119, mode=40755) [CRT] s3fs.cpp:s3fs_init(3367): init v1.82(commit:620f6ec) with OpenSSL [INF] s3fs.cpp:s3fs_check_service(3743): check services. [INF] curl.cpp:CheckBucket(2914): check a bucket. [DBG] curl.cpp:GetHandler(283): Get handler from pool: 31 [INF] curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/ [INF] curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/ [INF] curl.cpp:insertV4Headers(2267): computing signature [GET] [/] [] [] [INF] curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com [DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/ [INF] curl.cpp:RequestPerform(1952): HTTP response code 400 was returned, returning EIO. [DBG] curl.cpp:RequestPerform(1953): Body Text: <?xml version="1.0" encoding="UTF-8"?> <Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'us-east-2'</Message><Region>us-east-2</Region><RequestId>713808215CA57AEB</RequestId><HostId>WDcgrnme/Ifv1fehKxZ5BWYRLfpvWnMxnrd/5M9wr7Os8Py+VqDBa/a2DrVjpw0n8BOgfMNedJ4=</HostId></Error> [ERR] curl.cpp:CheckBucket(2953): Check bucket failed, S3 response: <?xml version="1.0" encoding="UTF-8"?> <Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'us-east-2'</Message><Region>us-east-2</Region><RequestId>713808215CA57AEB</RequestId><HostId>WDcgrnme/Ifv1fehKxZ5BWYRLfpvWnMxnrd/5M9wr7Os8Py+VqDBa/a2DrVjpw0n8BOgfMNedJ4=</HostId></Error> [CRT] s3fs.cpp:s3fs_check_service(3764): Could not connect wrong region us-east-1, so retry to connect region us-east-2. [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31 [INF] curl.cpp:CheckBucket(2914): check a bucket. [DBG] curl.cpp:GetHandler(283): Get handler from pool: 31 [INF] curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/ [INF] curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/ [INF] curl.cpp:insertV4Headers(2267): computing signature [GET] [/] [] [] [INF] curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com [DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/ [INF] curl.cpp:RequestPerform(1940): HTTP response code 200 [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31 [INF] s3fs.cpp:s3fs_getattr(812): [path=/cvjenkins] [DBG] s3fs.cpp:check_parent_object_access(669): [path=/cvjenkins] [DBG] s3fs.cpp:check_object_access(563): [path=/] [DBG] s3fs.cpp:get_object_attribute(416): [path=/] [DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins] [DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins] [INF] curl.cpp:HeadRequest(2516): [tpath=/cvjenkins] [INF] curl.cpp:PreHeadRequest(2453): [tpath=/cvjenkins][bpath=][save=][sseckeypos=-1] [DBG] curl.cpp:GetHandler(283): Get handler from pool: 31 [INF] curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins [INF] curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins [INF] curl.cpp:insertV4Headers(2267): computing signature [HEAD] [/cvjenkins] [] [] [INF] curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com [DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins [INF] curl.cpp:RequestPerform(1962): HTTP response code 404 was returned, returning ENOENT [DBG] curl.cpp:RequestPerform(1963): Body Text: [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31 [INF] curl.cpp:HeadRequest(2516): [tpath=/cvjenkins/] [INF] curl.cpp:PreHeadRequest(2453): [tpath=/cvjenkins/][bpath=][save=][sseckeypos=-1] [DBG] curl.cpp:GetHandler(283): Get handler from pool: 31 [INF] curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/ [INF] curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/ [INF] curl.cpp:insertV4Headers(2267): computing signature [HEAD] [/cvjenkins/] [] [] [INF] curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com [DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/ [INF] curl.cpp:RequestPerform(1940): HTTP response code 200 [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31 [INF] cache.cpp:AddStat(356): add stat cache entry[path=/cvjenkins/] [DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/][time=139414.244779483][hit count=0] [DBG] fdcache.cpp:ExistOpen(2082): [path=/cvjenkins][fd=-1][ignore_existfd=false] [DBG] fdcache.cpp:Open(2016): [path=/cvjenkins][size=-1][time=-1] [DBG] s3fs.cpp:s3fs_getattr(836): [path=/cvjenkins] uid=0, gid=0, mode=40000 [INF] s3fs.cpp:s3fs_getattr(812): [path=/cvjenkins/jenkins.1.tbz] [DBG] s3fs.cpp:check_parent_object_access(669): [path=/cvjenkins/jenkins.1.tbz] [DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins] [DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins] [DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/][time=139414.244779483][hit count=1] [DBG] s3fs.cpp:check_object_access(563): [path=/] [DBG] s3fs.cpp:get_object_attribute(416): [path=/] [DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins/jenkins.1.tbz] [DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins/jenkins.1.tbz] [INF] curl.cpp:HeadRequest(2516): [tpath=/cvjenkins/jenkins.1.tbz] [INF] curl.cpp:PreHeadRequest(2453): [tpath=/cvjenkins/jenkins.1.tbz][bpath=][save=][sseckeypos=-1] [DBG] curl.cpp:GetHandler(283): Get handler from pool: 31 [INF] curl.cpp:prepare_url(4205): URL is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz [INF] curl.cpp:prepare_url(4237): URL changed is https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz [INF] curl.cpp:insertV4Headers(2267): computing signature [HEAD] [/cvjenkins/jenkins.1.tbz] [] [] [INF] curl.cpp:url_to_host(100): url is https://s3-us-east-2.amazonaws.com [DBG] curl.cpp:RequestPerform(1923): connecting to URL https://s3-us-east-2.amazonaws.com/jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz [INF] curl.cpp:RequestPerform(1940): HTTP response code 200 [DBG] curl.cpp:ReturnHandler(306): Return handler to pool: 31 [INF] cache.cpp:AddStat(356): add stat cache entry[path=/cvjenkins/jenkins.1.tbz] [DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/jenkins.1.tbz][time=139414.304779372][hit count=0] [DBG] fdcache.cpp:ExistOpen(2082): [path=/cvjenkins/jenkins.1.tbz][fd=-1][ignore_existfd=false] **[DBG] fdcache.cpp:Open(2016): [path=/cvjenkins/jenkins.1.tbz][size=-1][time=-1]** [DBG] s3fs.cpp:s3fs_getattr(836): [path=/cvjenkins/jenkins.1.tbz] uid=107, gid=113, mode=100444 [INF] s3fs.cpp:s3fs_open(2052): [path=/cvjenkins/jenkins.1.tbz][flags=131072] [INF] cache.cpp:DelStat(565): delete stat cache entry[path=/cvjenkins/jenkins.1.tbz] [DBG] s3fs.cpp:check_parent_object_access(669): [path=/cvjenkins/jenkins.1.tbz] [DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins] [DBG] s3fs.cpp:get_object_attribute(416): [path=/cvjenkins] [DBG] cache.cpp:GetStat(276): stat cache hit [path=/cvjenkins/][time=139414.244779483][hit count=2] [DBG] s3fs.cpp:check_object_access(563): [path=/] [DBG] s3fs.cpp:get_object_attribute(416): [path=/] [DBG] s3fs.cpp:check_object_access(563): [path=/cvjenkins/jenkins.1.tbz] From the Console: sudo s3fs jenkins.cloudvisory.config /opt/jenkins-s3fs-prod -o passwd_file=/etc/passwd-s3fs -d -d -f -o f2 -o curldbg -o use_path_request_style -o url=https://s3-us-east-2.amazonaws.com -o allow_other -o umask=022 | tee > /tmp/s3fs.log FUSE library version: 2.9.3 nullpath_ok: 0 nopath: 0 utime_omit_ok: 0 unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0 INIT: 7.26 flags=0x001ffffb max_readahead=0x00020000 * Hostname was NOT found in DNS cache * Trying 52.219.84.27... * Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#0) * found 174 certificates in /etc/ssl/certs/ca-certificates.crt * server certificate verification OK * common name: *.s3.us-east-2.amazonaws.com (matched) * server certificate expiration date OK * server certificate activation date OK * certificate public key: RSA * certificate version: #3 * subject: C=US,ST=Washington,L=Seattle,O=Amazon.com Inc.,CN=*.s3.us-east-2.amazonaws.com * start date: Thu, 09 Mar 2017 00:00:00 GMT * expire date: Tue, 13 Mar 2018 12:00:00 GMT * issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert Baltimore CA-2 G2 * compression: NULL * cipher: AES-128-GCM * MAC: AEAD > GET /jenkins.cloudvisory.config/ HTTP/1.1 User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=ecee7ba85b80360871e9cbfebcb9b29a2c6503135cbf512576c3a6437aa9ad1a host: s3-us-east-2.amazonaws.com x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20170628T152734Z < HTTP/1.1 400 Bad Request < x-amz-bucket-region: us-east-2 < x-amz-request-id: 713808215CA57AEB < x-amz-id-2: WDcgrnme/Ifv1fehKxZ5BWYRLfpvWnMxnrd/5M9wr7Os8Py+VqDBa/a2DrVjpw0n8BOgfMNedJ4= < Content-Type: application/xml < Transfer-Encoding: chunked < Date: Wed, 28 Jun 2017 15:27:35 GMT < Connection: close * Server AmazonS3 is not blacklisted < Server: AmazonS3 < * Closing connection 0 * Hostname was found in DNS cache * Trying 52.219.84.27... * Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1) * found 174 certificates in /etc/ssl/certs/ca-certificates.crt * SSL re-using session ID * server certificate verification OK * common name: *.s3.us-east-2.amazonaws.com (matched) * server certificate expiration date OK * server certificate activation date OK * certificate public key: RSA * certificate version: #3 * subject: C=US,ST=Washington,L=Seattle,O=Amazon.com Inc.,CN=*.s3.us-east-2.amazonaws.com * start date: Thu, 09 Mar 2017 00:00:00 GMT * expire date: Tue, 13 Mar 2018 12:00:00 GMT * issuer: C=US,O=DigiCert Inc,OU=www.digicert.com,CN=DigiCert Baltimore CA-2 G2 * compression: NULL * cipher: AES-128-GCM * MAC: AEAD > GET /jenkins.cloudvisory.config/ HTTP/1.1 User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=43aafb9322437e61a6ac065910c9a59cf412e336226ac50df9ca8a2bc376af36 host: s3-us-east-2.amazonaws.com x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20170628T152735Z < HTTP/1.1 200 OK < x-amz-id-2: zOyk0IezIBeaqXCVMtptGC9BEfPEGGlT92bXWYGa2CT8+cX/DSunhOU3rNSjO/wgLx9X+p65bw0= < x-amz-request-id: 42BBFBFA4C4E75FC < Date: Wed, 28 Jun 2017 15:27:37 GMT < x-amz-bucket-region: us-east-2 < Content-Type: application/xml < Transfer-Encoding: chunked * Server AmazonS3 is not blacklisted < Server: AmazonS3 < * Connection #1 to host s3-us-east-2.amazonaws.com left intact INIT: 7.19 flags=0x00000019 max_readahead=0x00020000 max_write=0x00020000 max_background=0 congestion_threshold=0 unique: 1, success, outsize: 40 unique: 2, opcode: LOOKUP (1), nodeid: 1, insize: 50, pid: 27899 LOOKUP /cvjenkins getattr /cvjenkins * Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0 * Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com * Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1) > HEAD /jenkins.cloudvisory.config/cvjenkins HTTP/1.1 User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=0f88978062b7ebf3d30f2c32c3012e725c5a3d5ba85a6720321717a73b52e16a host: s3-us-east-2.amazonaws.com x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20170628T152744Z < HTTP/1.1 404 Not Found < x-amz-request-id: 1932AEC60C620BB6 < x-amz-id-2: hGJEOEeh8kHC+ga2K/yUic7uKv6NPi3jdrLfB+0z3BEC9v6+d1JLoLVy3d20aVS4yKLOPeuPxDQ= < Content-Type: application/xml < Transfer-Encoding: chunked < Date: Wed, 28 Jun 2017 15:27:44 GMT * Server AmazonS3 is not blacklisted < Server: AmazonS3 < * Connection #1 to host s3-us-east-2.amazonaws.com left intact * Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0 * Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com * Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1) > HEAD /jenkins.cloudvisory.config/cvjenkins/ HTTP/1.1 User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=7ef61c6c7dbbf99545fdb545eae1d56aa290a63b4be0fb1456fbbacf1c808d7e host: s3-us-east-2.amazonaws.com x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20170628T152744Z < HTTP/1.1 200 OK < x-amz-id-2: 8Kd4CzmxyBHoxg9FQnTd2/OQPK98NyOrSG7krGKQ5W7DVTJUpEX1TyEs0dqX7lZbJP3yC84UasA= < x-amz-request-id: 5E623C2C2D297783 < Date: Wed, 28 Jun 2017 15:27:45 GMT < Last-Modified: Thu, 01 Dec 2016 01:41:52 GMT < ETag: "d41d8cd98f00b204e9800998ecf8427e" < x-amz-server-side-encryption: AES256 < Accept-Ranges: bytes < Content-Type: binary/octet-stream < Content-Length: 0 * Server AmazonS3 is not blacklisted < Server: AmazonS3 < * Connection #1 to host s3-us-east-2.amazonaws.com left intact NODEID: 2 unique: 2, success, outsize: 144 unique: 3, opcode: LOOKUP (1), nodeid: 2, insize: 54, pid: 27899 LOOKUP /cvjenkins/jenkins.1.tbz getattr /cvjenkins/jenkins.1.tbz * Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0 * Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com * Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1) > HEAD /jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz HTTP/1.1 User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=f1665a2095bcccaf3dd3e2394920d9cb3092b744c64a1dbaacfa53825b849d85 host: s3-us-east-2.amazonaws.com x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20170628T152744Z < HTTP/1.1 200 OK < x-amz-id-2: o4w7R6CBnqTDhtRnss4f9YjI5If/4Tw7xMfztC/zkkvMffDUW5PizW829diaUWOMyzJttSqPotk= < x-amz-request-id: A00264B10D090C6C < Date: Wed, 28 Jun 2017 15:27:45 GMT < Last-Modified: Wed, 28 Jun 2017 03:53:29 GMT < ETag: "b021153728c301676539cd3799e50def-16" < x-amz-meta-mode: 33060 < x-amz-meta-gid: 113 < x-amz-meta-uid: 107 < Accept-Ranges: bytes < Content-Type: application/octet-stream < Content-Length: 8275250430 * Server AmazonS3 is not blacklisted < Server: AmazonS3 < * Connection #1 to host s3-us-east-2.amazonaws.com left intact NODEID: 3 unique: 3, success, outsize: 144 unique: 4, opcode: OPEN (14), nodeid: 3, insize: 48, pid: 27899 open flags: 0x20000 /cvjenkins/jenkins.1.tbz * Found bundle for host s3-us-east-2.amazonaws.com: 0x74f357d0 * Re-using existing connection! (#1) with host s3-us-east-2.amazonaws.com * Connected to s3-us-east-2.amazonaws.com (52.219.84.27) port 443 (#1) > HEAD /jenkins.cloudvisory.config/cvjenkins/jenkins.1.tbz HTTP/1.1 User-Agent: s3fs/1.82 (commit hash 620f6ec; OpenSSL) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=AKIAJ4R3IBJTUMJCEMDQ/20170628/us-east-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=f1665a2095bcccaf3dd3e2394920d9cb3092b744c64a1dbaacfa53825b849d85 host: s3-us-east-2.amazonaws.com x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20170628T152744Z < HTTP/1.1 200 OK < x-amz-id-2: gTztPv5O5sWvI4ncb22cTMxw6z4zXivAVUyz05E8f0sRFziSrqiHMkpYBMEUAmdSehWKSZXnCNY= < x-amz-request-id: 833C8AD7C4FC5CF9 < Date: Wed, 28 Jun 2017 15:27:45 GMT < Last-Modified: Wed, 28 Jun 2017 03:53:29 GMT < ETag: "b021153728c301676539cd3799e50def-16" < x-amz-meta-mode: 33060 < x-amz-meta-gid: 113 < x-amz-meta-uid: 107 < Accept-Ranges: bytes < Content-Type: application/octet-stream < Content-Length: 8275250430 * Server AmazonS3 is not blacklisted < Server: AmazonS3 < * Connection #1 to host s3-us-east-2.amazonaws.com left intact unique: 4, error: -5 (Input/output error), outsize: 16 ``` #### Details about issue On other platforms, this works quite well, but not on the Raspberry PI. NOTE: If required, a Rasperry Pi can be setup with remote access for testing/debugging.
kerem closed this issue 2026-03-04 01:44:40 +03:00
kerem commented 2026-03-04 01:44:41 +03:00
Author
Owner
Copy link

@ghost commented on GitHub (Oct 11, 2017):

#656 I got the same issue.

<!-- gh-comment-id:335736637 --> @ghost commented on GitHub (Oct 11, 2017): #656 I got the same issue.
kerem commented 2026-03-04 01:44:41 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Oct 15, 2017):

@gorky
I commented about same issue #656 by @gui-don, please see it.

<!-- gh-comment-id:336691481 --> @ggtakec commented on GitHub (Oct 15, 2017): @gorky I commented about same issue #656 by @gui-don, please see it.
kerem commented 2026-03-04 01:44:41 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Feb 2, 2019):

I wonder if ARM has a 32-bit off_t? This would explain how transfers larger that 4 GB fail but smaller ones succeed. Similar to #656.

<!-- gh-comment-id:459931074 --> @gaul commented on GitHub (Feb 2, 2019): I wonder if ARM has a 32-bit `off_t`? This would explain how transfers larger that 4 GB fail but smaller ones succeed. Similar to #656.
kerem commented 2026-03-04 01:44:41 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Apr 9, 2019):

If someone can provide a Raspberry Pi that I can ssh into or a working VM image we can investigate this.

<!-- gh-comment-id:481186082 --> @gaul commented on GitHub (Apr 9, 2019): If someone can provide a Raspberry Pi that I can ssh into or a working VM image we can investigate this.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#354
No description provided.