mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 13:26:00 +03:00
[GH-ISSUE #1193] EC2 instance of IAM user access S3 occur error #631
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#631
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @orangeSi on GitHub (Nov 7, 2019).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1193
Version of s3fs being used (s3fs --version)
V1.85
Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)
2.9.4
Kernel information (uname -r)
4.14.146-93.123.amzn1.x86_64
GNU/Linux Distribution, if applicable (cat /etc/os-release)
NAME="Amazon Linux AMI"
VERSION="2018.03"
ID="amzn"
ID_LIKE="rhel fedora"
VERSION_ID="2018.03"
PRETTY_NAME="Amazon Linux AMI 2018.03"
ANSI_COLOR="0;33"
CPE_NAME="cpe:/o:amazon:linux:2018.03:ga"
HOME_URL="http://aws.amazon.com/amazon-linux-ami/"
s3fs command line used, if applicable
hi, I create a Ec2 instance in
cn-northwest-1cregion witha IAM user account, and then create a S3 bucket incn-northwest-1region and upload data to itwith same IAM user. And want to mount that S3 bucket to Ec2 instance, so I run this command in instance:then got this error:
if add
-o curldbg -dthen got this detail error:
it seems to force to
us-east-1instead of recognizecn-northwest-1region, ignore the parameter ``-o endpoint=cn-northwest-1 ```.it confuse me a lot, thanks for help~
Regard
Si
@bramevo commented on GitHub (Feb 20, 2020):
Try setting both -o url="https://s3-eu-west-1.amazonaws.com" and -o endpoint="eu-west-1"
@web-engineer commented on GitHub (Apr 29, 2020):
We are having the same problem or very similar -
url=http://s3-eu-west-2.amazonaws.com
HTTP response code 400
The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256.
Trying to find info on a fix but answers seem to be centred around the use a different endpoint that supports the older protocol. However - this seems to me to be flawed since this is likely to be a problem for everyone eventually.
Has this been fixed in the repo? Or will there be another release soon? Does anyone know of any way to patch this?
@web-engineer commented on GitHub (Apr 29, 2020):
To add some more detail - have pulled from git and tried -
Result the same when using the region above.
Also updated curl to the latest (as this was mentioned in the debug) made no difference however.
AWS is insisting on the updated V4 authentication protocol - whats the state of play here?
@orangeSi commented on GitHub (Apr 30, 2020):
I still not reslove this yet
@lpasselin commented on GitHub (Jul 17, 2020):
I had a similar issue. It was solved by removing endpoint argument and upgrading from 1.80 to 1.86.
@orangeSi commented on GitHub (Jul 27, 2020):
Thanks for the reply! beacase I am not in the situation yet , so I have no chance to do anything or as your solution to reslove the error.
@caleuanhopkins commented on GitHub (Aug 6, 2020):
Don this but I still have a 403 coming back. When using an IAM Role does a
passwd_filestill have to be supplied?@gaul commented on GitHub (Oct 10, 2020):
What is the current status of this bug? Can someone test again with the latest version 1.87 and the suggested flags
-o url="https://s3-eu-west-1.amazonaws.com" -o endpoint="eu-west-1"?@kontrollanten commented on GitHub (Nov 6, 2020):
@gaul Since I upgraded from 1.86 to 1.87 I got it working. Thanks!
Ubuntu 20.04
kernel version: 5.4.0-52-generic
fuse version: 2.9.9-3
@gaul commented on GitHub (Nov 6, 2020):
Thanks for testing!
@vjmedina commented on GitHub (Feb 3, 2023):
I'm having the same issue connecting to buckets in the eu-west-1 region. Even with use of the endpoint and/or url flags I still get errors. Policies are fine, as I can list and download files using the AWS CLI and also get successful results using the IAM policy simulator.
Right now I'm copying files over to an EC2 instance using the AWS CLI, but I'm using s3fs as part of an automatic script that requires mounting s3 folders inside the EC2 instance, so copying the files every time is not feasible as it takes a lot of time and disk space.
To provide a little more context, I'm using s3fs-fuse version 1.91 (built from source) on Ubuntu 18.04. Previously I tried with the pre-built s3fs version 1.82 with the same results.
I'm trying to access buckets on two different accounts, A and B (both in the same region, eu-west-1), from an EC2 instance in account A.
When I try to mount the bucket in account A, the process seems to finish (HTTP response code 200), but it just never releases the lock on the directory, so I can't do anything with it:
When I try to access the bucket in account B, I get the following error and then s3fs exits:
@c-imp11 commented on GitHub (May 7, 2024):
I'm having the same issue in Linux 2023, connecting to a bucket in eu-central-1. For context I have an existing bucket in us-east-1 and it works fine on that. I have 1.94 version