mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 13:26:00 +03:00
[GH-ISSUE #1626] Cannot mount S3 compatible storage (NetApp) #853
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#853
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @nicoske on GitHub (Apr 20, 2021).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1626
Additional Information
Version of s3fs being used (s3fs --version)
Amazon Simple Storage Service File System V1.89 (commit:unknown) with OpenSSL
Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)
Name : fuse
Version : 2.9.7
Release : 12.el8
Architecture: x86_64
Kernel information (uname -r)
4.18.0-240.15.1.el8_3.x86_64
GNU/Linux Distribution, if applicable (cat /etc/os-release)
NAME="Red Hat Enterprise Linux"
VERSION="8.3 (Ootpa)"
ID="rhel"
ID_LIKE="fedora"
VERSION_ID="8.3"
PLATFORM_ID="platform:el8"
PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
HOME_URL="https://www.redhat.com/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
s3fs command line used, if applicable
/etc/fstab entry, if applicable
s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)
if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages
Details about issue
I cannot mount S3 compatible storage (NetApp) using s3fs. Their implementation require to enable path style and only support signature v4.
It works fine with s3cmd, Wowza, S3 browser.
@gaul commented on GitHub (Apr 20, 2021):
It appears that your credentials are incorrect due to the
SignatureDoesNotMatcherror code. Can you see if they are what you expect in$HOME/.aws/credentials? You might try testing with the AWS CLI since s3fs supports the same format.@nicoske commented on GitHub (Apr 21, 2021):
I did used the system wide credentials file as described in the documentation. It is stored in
/etc/passwd-s3fsand I specify the path using-o passwd_file=/etc/passwd-s3fs. I used the format ACCESS_KEY_ID:SECRET_ACCESS_KEY. I already tripled checked the key and I used the same in s3cmd with success.I just did another test by removing the option flag to that file and use
$HOME/.aws/credentialswith the following format:I have the same result:
curl.cpp:RequestPerform(2324): HTTP response code 403, returning EPERM. Body Text: <?xml version="1.0" encoding="UTF-8"?><Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided.</Message></Error>I have a call with NetApp this morning, I'll keep you updated.
@gaul commented on GitHub (Apr 21, 2021):
NetApp has a tutorial on using s3fs with their product:
https://cloud.netapp.com/blog/amazon-s3-as-a-file-system
Hopefully they can offer you some pointers since I lack access to this hardware. It might help to test with AWS or Minio locally to have some comparison point. I strongly suspect that it is just misconfiguration of credentials though.
@nicoske commented on GitHub (Apr 22, 2021):
Hello,
This documentation refers to the usage of AWS S3 on any Linux system, it is not about using their S3 implementation unfortunately.
I just gave a try with the original awscli, and it works using the same credentials in
$HOME/.aws/credentialsthan what I used for s3fs-fuse and fails:I'm going to send NetApp all the log files of the different tools I used but I suspect that there's something wrong with signature calculation by s3fs-fuse for a unknown reason..
@nicoske commented on GitHub (May 6, 2021):
Hi @gaul
I received some feedback from NetApp. Could it be that s3fs cannot handle keys larger than 123 characters ? By default they use a 128 characters key.
@gaul commented on GitHub (May 6, 2021):
Unexpectedly, this was true -- please thank your NetApp representative for the exact cause! I wonder why they didn't submit their own PR but in the end there is a simple fix.
@nicoske commented on GitHub (May 6, 2021):
Thanks for the quick reaction @gaul ! I just compiled secret-key-length branch and I confirm I can mount successfully !!