mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 05:16:00 +03:00
[GH-ISSUE #465] Mount fails on eu-central-1 hosting, again? #257
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#257
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @FlashBlack on GitHub (Sep 7, 2016).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/465
Hi there!
I can't mount my bucket based on eu-central-1 (Frankfurt).
Version:
1.8 (from master)
Run:
s3fs my-bucket-name ./files/ -o passwd_file=/root/.passwd-s3fs -d -d -f -o f2 -o curldbgLog:
@bubblegum76 commented on GitHub (Oct 24, 2016):
Same problem :( CentOS 7, fuse 1.8, Frankfurt region.
@devopsraman commented on GitHub (Nov 1, 2016):
me also have same issue .
I am not able to mount s3 bucket eu-central-1 regions.
s3fs s3://tui-nexus-backups/ /mnt/s3mnt -o passwd_file=/root/.passwd-s3fs -d -d -f -o f2 -o curldbg
[CRT] s3fs.cpp:set_s3fs_log_level(253): change debug level from [CRT] to [INF]
[CRT] s3fs.cpp:set_s3fs_log_level(253): change debug level from [INF] to [DBG]
[INF] s3fs.cpp:set_moutpoint_attribute(4151): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40777)
FUSE library version: 2.9.7
nullpath_ok: 0
nopath: 0
utime_omit_ok: 0
unique: 1, opcode: INIT (26), nodeid: 0, insize: 56, pid: 0
INIT: 7.14
flags=0x0000f07b
max_readahead=0x00020000
[CRT] s3fs.cpp:s3fs_init(3334): init v1.80(commit:unknown) with OpenSSL
[WAN] curl.cpp:InitShareCurl(483): curl_share_setopt(SSL SESSION) returns 1(Unknown share option), but continue without shared ssl session data.
[INF] s3fs.cpp:s3fs_check_service(3708): check services.
[INF] curl.cpp:CheckBucket(2860): check a bucket.
[DBG] curl.cpp:GetHandler(272): Get handler from pool: 31
[INF] curl.cpp:prepare_url(4175): URL is http://s3.amazonaws.com/s3//tui-nexus-backups/
[INF] curl.cpp:prepare_url(4207): URL changed is http://s3.s3.amazonaws.com/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/
[INF] curl.cpp:insertV4Headers(2237): computing signature [GET] [//tui-nexus-backups/] [] []
[INF] curl.cpp:url_to_host(100): url is http://s3.amazonaws.com
[DBG] curl.cpp:RequestPerform(1893): connecting to URL http://s3.s3.amazonaws.com/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/
About to connect() to proxy 10.169.237.43 port 8888 (#0)
Trying 10.169.237.43... * connected
Connected to 10.169.237.43 (10.169.237.43) port 8888 (#0)
HTTP 1.0, assume close after body
< HTTP/1.0 403 Forbidden
< x-amz-request-id: 6883F308769A0744
< x-amz-id-2: dDzvzEiODilaISRkSJScBWpLZ9fEHQ6lZs9OV8J3dgFmeooUlaJEWxtcqM/9CH+dBdfCIw9/Owo=
< Content-Type: application/xml
< Date: Tue, 01 Nov 2016 14:55:20 GMT
< Server: AmazonS3
< X-Cache: MISS from ip-10-169-237-43
< X-Cache-Lookup: MISS from ip-10-169-237-43:8888
< Via: 1.0 ip-10-169-237-43 (squid/3.1.23)
< Connection: close
<
Closing connection #0
[INF] curl.cpp:RequestPerform(1927): HTTP response code 403 was returned, returning EPERM
[DBG] curl.cpp:RequestPerform(1928): Body Text:
SignatureDoesNotMatchThe request signature we calculated does not match the signature you provided. Check your key and signing method.AKIAIXEMHQLBSPEM2OCQAWS4-HMAC-SHA25620161101T145517Z
20161101/us-east-1/s3/aws4_request
ee38912397e57ffb2e80af70efddeeb43b33cd5abfd9b8047501049df966ce1f607779e289f60c4ed452f2b47cffc02ef7c31101ef8484df87b0c49059df9d8d41 57 53 34 2d 48 4d 41 43 2d 53 48 41 32 35 36 0a 32 30 31 36 31 31 30 31 54 31 34 35 35 31 37 5a 0a 32 30 31 36 31 31 30 31 2f 75 73 2d 65 61 73 74 2d 31 2f 73 33 2f 61 77 73 34 5f 72 65 71 75 65 73 74 0a 65 65 33 38 39 31 32 33 39 37 65 35 37 66 66 62 32 65 38 30 61 66 37 30 65 66 64 64 65 65 62 34 33 62 33 33 63 64 35 61 62 66 64 39 62 38 30 34 37 35 30 31 30 34 39 64 66 39 36 36 63 65 31 66GET
/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/
host:s3.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20161101T145517Z
host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b85547 45 54 0a 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2f 2e 61 6d 61 7a 6f 6e 61 77 73 2e 63 6f 6d 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2f 0a 0a 68 6f 73 74 3a 73 33 2e 73 33 2e 61 6d 61 7a 6f 6e 61 77 73 2e 63 6f 6d 0a 78 2d 61 6d 7a 2d 63 6f 6e 74 65 6e 74 2d 73 68 61 32 35 36 3a 65 33 62 30 63 34 34 32 39 38 66 63 31 63 31 34 39 61 66 62 66 34 63 38 39 39 36 66 62 39 32 34 32 37 61 65 34 31 65 34 36 34 39 62 39 33 34 63 61 34 39 35 39 39 31 62 37 38 35 32 62 38 35 35 0a 78 2d 61 6d 7a 2d 64 61 74 65 3a 32 30 31 36 31 31 30 31 54 31 34 35 35 31 37 5a 0a 0a 68 6f 73 74 3b 78 2d 61 6d 7a 2d 63 6f 6e 74 65 6e 74 2d 73 68 61 32 35 36 3b 78 2d 61 6d 7a 2d 64 61 74 65 0a 65 33 62 30 63 34 34 32 39 38 66 63 31 63 31 34 39 61 66 62 66 34 63 38 39 39 36 66 62 39 32 34 32 37 61 65 34 31 65 34 36 34 39 62 39 33 34 63 61 34 39 35 39 39 31 62 37 38 35 32 62 38 35 356883F308769A0744dDzvzEiODilaISRkSJScBWpLZ9fEHQ6lZs9OV8J3dgFmeooUlaJEWxtcqM/9CH+dBdfCIw9/Owo=
[ERR] curl.cpp:CheckBucket(2899): Check bucket failed, S3 response:
SignatureDoesNotMatchThe request signature we calculated does not match the signature you provided. Check your key and signing method.AKIAIXEMHQLBSPEM2OCQAWS4-HMAC-SHA25620161101T145517Z
20161101/us-east-1/s3/aws4_request
ee38912397e57ffb2e80af70efddeeb43b33cd5abfd9b8047501049df966ce1f607779e289f60c4ed452f2b47cffc02ef7c31101ef8484df87b0c49059df9d8d41 57 53 34 2d 48 4d 41 43 2d 53 48 41 32 35 36 0a 32 30 31 36 31 31 30 31 54 31 34 35 35 31 37 5a 0a 32 30 31 36 31 31 30 31 2f 75 73 2d 65 61 73 74 2d 31 2f 73 33 2f 61 77 73 34 5f 72 65 71 75 65 73 74 0a 65 65 33 38 39 31 32 33 39 37 65 35 37 66 66 62 32 65 38 30 61 66 37 30 65 66 64 64 65 65 62 34 33 62 33 33 63 64 35 61 62 66 64 39 62 38 30 34 37 35 30 31 30 34 39 64 66 39 36 36 63 65 31 66GET
/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/
host:s3.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20161101T145517Z
host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b85547 45 54 0a 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2f 2e 61 6d 61 7a 6f 6e 61 77 73 2e 63 6f 6d 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2f 0a 0a 68 6f 73 74 3a 73 33 2e 73 33 2e 61 6d 61 7a 6f 6e 61 77 73 2e 63 6f 6d 0a 78 2d 61 6d 7a 2d 63 6f 6e 74 65 6e 74 2d 73 68 61 32 35 36 3a 65 33 62 30 63 34 34 32 39 38 66 63 31 63 31 34 39 61 66 62 66 34 63 38 39 39 36 66 62 39 32 34 32 37 61 65 34 31 65 34 36 34 39 62 39 33 34 63 61 34 39 35 39 39 31 62 37 38 35 32 62 38 35 35 0a 78 2d 61 6d 7a 2d 64 61 74 65 3a 32 30 31 36 31 31 30 31 54 31 34 35 35 31 37 5a 0a 0a 68 6f 73 74 3b 78 2d 61 6d 7a 2d 63 6f 6e 74 65 6e 74 2d 73 68 61 32 35 36 3b 78 2d 61 6d 7a 2d 64 61 74 65 0a 65 33 62 30 63 34 34 32 39 38 66 63 31 63 31 34 39 61 66 62 66 34 63 38 39 39 36 66 62 39 32 34 32 37 61 65 34 31 65 34 36 34 39 62 39 33 34 63 61 34 39 35 39 39 31 62 37 38 35 32 62 38 35 356883F308769A0744dDzvzEiODilaISRkSJScBWpLZ9fEHQ6lZs9OV8J3dgFmeooUlaJEWxtcqM/9CH+dBdfCIw9/Owo=
[WAN] s3fs.cpp:s3fs_check_service(3749): Could not connect, so retry to connect by signature version 2.
[DBG] curl.cpp:ReturnHandler(295): Return handler to pool: 31
[INF] curl.cpp:CheckBucket(2860): check a bucket.
[DBG] curl.cpp:GetHandler(272): Get handler from pool: 31
[INF] curl.cpp:prepare_url(4175): URL is http://s3.amazonaws.com/s3//tui-nexus-backups/
[INF] curl.cpp:prepare_url(4207): URL changed is http://s3.s3.amazonaws.com/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/
[DBG] curl.cpp:RequestPerform(1893): connecting to URL http://s3.s3.amazonaws.com/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/
About to connect() to proxy 10.169.237.43 port 8888 (#0)
Trying 10.169.237.43... * connected
Connected to 10.169.237.43 (10.169.237.43) port 8888 (#0)
HTTP 1.0, assume close after body
< HTTP/1.0 403 Forbidden
< x-amz-request-id: ED56F36ACBDEB44C
< x-amz-id-2: bCUDQ17PSadNIPQi7fhxWS42JPL+D1qowOsqvrPfaIncf+jbVYABUMEEpWjUYHLnHTzk9E2ppzo=
< Content-Type: application/xml
< Date: Tue, 01 Nov 2016 14:55:20 GMT
< Server: AmazonS3
< X-Cache: MISS from ip-10-169-237-43
< X-Cache-Lookup: MISS from ip-10-169-237-43:8888
< Via: 1.0 ip-10-169-237-43 (squid/3.1.23)
< Connection: close
<
Closing connection #0
[INF] curl.cpp:RequestPerform(1927): HTTP response code 403 was returned, returning EPERM
[DBG] curl.cpp:RequestPerform(1928): Body Text:
SignatureDoesNotMatchThe request signature we calculated does not match the signature you provided. Check your key and signing method.AKIAIXEMHQLBSPEM2OCQGETTue, 01 Nov 2016 14:55:17 GMT
/s3/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/ggU0G4cXp8mNAqCuArzD3dEILgQ=47 45 54 0a 0a 0a 54 75 65 2c 20 30 31 20 4e 6f 76 20 32 30 31 36 20 31 34 3a 35 35 3a 31 37 20 47 4d 54 0a 2f 73 33 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2f 2e 61 6d 61 7a 6f 6e 61 77 73 2e 63 6f 6d 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2fED56F36ACBDEB44CbCUDQ17PSadNIPQi7fhxWS42JPL+D1qowOsqvrPfaIncf+jbVYABUMEEpWjUYHLnHTzk9E2ppzo=
[ERR] curl.cpp:CheckBucket(2899): Check bucket failed, S3 response:
SignatureDoesNotMatchThe request signature we calculated does not match the signature you provided. Check your key and signing method.AKIAIXEMHQLBSPEM2OCQGETTue, 01 Nov 2016 14:55:17 GMT
/s3/s3//tui-nexus-backups/.amazonaws.com/s3//tui-nexus-backups/ggU0G4cXp8mNAqCuArzD3dEILgQ=47 45 54 0a 0a 0a 54 75 65 2c 20 30 31 20 4e 6f 76 20 32 30 31 36 20 31 34 3a 35 35 3a 31 37 20 47 4d 54 0a 2f 73 33 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2f 2e 61 6d 61 7a 6f 6e 61 77 73 2e 63 6f 6d 2f 73 33 2f 2f 74 75 69 2d 6e 65 78 75 73 2d 62 61 63 6b 75 70 73 2fED56F36ACBDEB44CbCUDQ17PSadNIPQi7fhxWS42JPL+D1qowOsqvrPfaIncf+jbVYABUMEEpWjUYHLnHTzk9E2ppzo=
[CRT] s3fs.cpp:s3fs_check_service(3765): invalid credentials - result of checking service.
[DBG] curl.cpp:ReturnHandler(295): Return handler to pool: 31
[ERR] s3fs.cpp:s3fs_exit_fuseloop(3324): Exiting FUSE event loop due to errors
INIT: 7.19
flags=0x00000011
max_readahead=0x00020000
max_write=0x00020000
max_background=0
congestion_threshold=0
unique: 1, success, outsize: 40
[INF] s3fs.cpp:s3fs_destroy(3395): destroy
[WAN] s3fs.cpp:s3fs_destroy(3399): Could not release curl library.
@rikkouri commented on GitHub (Nov 29, 2016):
Bump. Same issue here.
@rikkouri commented on GitHub (Nov 29, 2016):
Work around:
Mounting the s3 bucket in the fstab seems to still work fine:
@DenisBY commented on GitHub (Feb 10, 2017):
Workaround doesn't work for me. Same problem.
@PolGuixe commented on GitHub (Mar 6, 2017):
Has anyone found a solution? I am still hitting this issue.
@praveenkpatidar commented on GitHub (Apr 19, 2017):
FSTab solution worked for me but only for one or two sync and again the mount is lost.
If I restart it will work for one or two update
@praveenkpatidar commented on GitHub (Apr 19, 2017):
The problem is I am not able to get debug log. Keep getting hung processes. df -h also hung.
@sekiwired commented on GitHub (Apr 26, 2017):
Hi, same problem here,
My debug msg shows this :
[DBG] curl.cpp:RequestPerform(1953): Body Text:
AuthorizationHeaderMalformedThe authorization header is malformed; the region 'us-east-1' is wrong; expecting 'eu-central-1'eu-central-1@gaul commented on GitHub (Apr 26, 2017):
I just created a bucket in eu-central-1 and successfully mounted it via
s3fsusing master atdf0ff3a2fd. Which version do you use? Also please run again with the flags-f -o curldbg.@rangasoa commented on GitHub (May 4, 2017):
Hi, same problem here. trying to mount s3 bucket with IAM user with S3full access using access ID and key ID without success. This is in AWS Beijing china. do we have any fix or workaround
< HTTP/1.1 403 Forbidden
< x-amz-request-id: B91C15261A89DCAA
< x-amz-id-2: 1Uwxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx843QGk+SAhddamCx3Mr+OQdl9DFs=
< Content-Type: application/xml
< Transfer-Encoding: chunked
[CRT] s3fs.cpp:s3fs_check_service(3765): invalid credentials - result of checking service.
[DBG] curl.cpp:ReturnHandler(295): Return handler to pool: 31
[ERR] s3fs.cpp:s3fs_exit_fuseloop(3324): Exiting FUSE event loop due to errors
@pelamfi commented on GitHub (May 9, 2017):
Same problem here
eu-frankfurt-1,
Ubuntu 16.04
apt-cache show s3fs:
Architecture: amd64
Source: s3fs-fuse
Version: 1.79+git90-g8f11507-2
@ghost commented on GitHub (Jul 13, 2017):
Works for me using commit
github.com/s3fs-fuse/s3fs-fuse@620f6ec616so far.@paulswanson commented on GitHub (Mar 2, 2018):
I'm experiencing exactly the same problem.
Created an S3 bucket in Frankfurt (eu-central-1), permissioned it correctly with a policy. Able to access the bucket over AWS CLI and AWS console with the appropriate access ID and key, but S3FS fails with the invalid credentials error, as above.
Repeated exactly the same process in N Virginia and it worked first time. Same access ID and policy applied.
I'm using the default package install of S3FS on Ubuntu 17.10. I looked through the debug logs for s3fs but it only lists the commit as "commit has unknown".
@abrkn commented on GitHub (Mar 2, 2018):
I am having the same issue on Ubuntu 16.04 in the Singapore region:
The file
/etc/passwd-s3fscontains thekey:secretof my root account's access key.Any ideas?
EDIT: Figured it out. You can see in the log it fails to send authorization header after redirect. Solved by adding
-o url=http://s3-ap-southeast-1.amazonaws.com@Prinzhorn commented on GitHub (May 6, 2018):
The previous comment contains the solution (for me at least) but might be missed at the bottom of it. Looks like the default url is hard coded to
s3.amazonaws.comwhich is us-east-1 (US East (N. Virginia)). I was expecting s3fs-fuse to automatically figure out the endpoint for the given bucket. However, just specify the endpoint using theurloption. In this case eu-central-1Here's the fill list (Endpoint column) from https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region
As a side note, this seems to be the minimal policy you need, which I could find nowhere.
@ryanotella commented on GitHub (Dec 6, 2018):
I wonder if there is an interaction between non-default bucket locations and the 307 Temporary Redirect response you may receive for certain buckets during the 24 hour period after they are created.
Perhaps s3fs doesn't correctly recalculate V4 signatures when there is a redirect to a different URL?
These problems are still resolved for me by explicitly specifying
-o url=... -o endpoint=....@gaul commented on GitHub (Jan 24, 2019):
Could you test again against master? It includes fixes for 301/307 response codes.
@MisterDuval commented on GitHub (Feb 22, 2019):
Same problem here using Wasabi, and fixed using a different server, the same as my bucket:
-o s3.eu-central-1.wasabisys.com@gaul commented on GitHub (Apr 9, 2019):
Closing due to inactivity. Please reopen if symptoms persist.
@davidjeddy commented on GitHub (Apr 22, 2019):
I would like to note that the symptoms persist. I will try the
-obucket URL as @MisterDuval did in order to confirm remediation.@sravanthimodepu commented on GitHub (Jun 27, 2019):
Hi,
I have installed and mounted S3fs for an AWS ec2 instance, but not able to upload the files to the mounted path.
While uploading the files, it is throwing the below error:
[Thu Jun 27 08:59:10.595980 2019] [wsgi:error] [pid 4716:tid 140447467534080] [client 10.100.1.7:43314] [2019-06-27 08:59:10,595] ERROR in api: Error unable to save file: [Errno 13] Permission denied: '/var/www/src/static/uploads/1561021355983HqiBl3eY88RBIDqv-2019-06-27-08-59-10.pdf', referer: http://outreach-ubuntu.vlabs.ac.in/admin
[Thu Jun 27 08:59:10.596185 2019] [wsgi:error] [pid 4716:tid 140447467534080] [client 10.100.1.7:43314] [2019-06-27 08:59:10,596] ERROR in app: error code = 500, referer: http://outreach-ubuntu.vlabs.ac.in/admin
[Thu Jun 27 08:59:10.596316 2019] [wsgi:error] [pid 4716:tid 140447467534080] [client 10.100.1.7:43314] [2019-06-27 08:59:10,596] ERROR in app: error desc = error is [Errno 13] Permission denied: '/var/www/src/static/uploads/1561021355983HqiBl3eY88RBIDqv-2019-06-27-08-59-10.pdf', referer: http://outreach-ubuntu.vlabs.ac.in/admin
^C
Can somone help me in this
@gaul commented on GitHub (Jun 30, 2019):
@sravanthimodepu This looks like an unrelated permission symptom on your local file system. Please check these and open a new issue if your symptoms persist.
@Jukert commented on GitHub (Mar 15, 2021):
Hello, in my case it helped to change the time to the correct one on the host.