mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 13:26:00 +03:00
[GH-ISSUE #2408] df -kh hangs while mounting s3 bucket using s3 access point alias #1186
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#1186
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @amitdctm on GitHub (Feb 10, 2024).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2408
Environment:
OS : Amazon Linux (RHEL 7.9, 8.4, 8.8)
s3fs : V1.93 (commit:unknown) with OpenSSL
AWS Cli : V2
Problem:
My team has been using s3fs since long using Instance IAM Profile Role on EC2. The Instance Profile Roles are being updated to use S3 Access Points Policy. We have been successful using Instance Profile Role so far using AWS Cli. The only change we observed is that we need to use Access Point alias instead of Bucket Name while using S3-SDK/AWS-CLI.
E.g.,
aws s3 cp s3://<Access Point alias>/<folder>/<file> /usr/local/When we follow the steps below for remounting, the server hangs (mainly
df -khorcd /mnt)! We have no errors!Please help if
s3fssupports use of Access Point alias.s3fs#<Access Point alias> /mnt/mybucket fuse rw,iam_role=<Instance-Profile-Role>,use_cache=/tmp,uid=<12345>,gid=<12345>,allow_other 0 0mount -aWhen using mount-s3 it goes well and superfast! The only reason for using s3fs is that mount-s3 doesn't support
mvfor us as it is not implemented yet.E.g.,
mount-s3 \ --allow-overwrite \ --allow-delete \ --uid 12345 \ --gid 12345 \ --cache /tmp \ <Access Point alias> \ /mnt/mybucketHelp will be much appreciated with s3fs hanging issue! I'm new to s3fs but not sure if there are any logs those I can check to find more details.
Version of s3fs being used (
s3fs --version)Amazon Simple Storage Service File System V1.93 (commit:unknown) with OpenSSL
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 https://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Version of fuse being used (
pkg-config --modversion fuse,rpm -qi fuseordpkg -s fuse)Name : fuse
Version : 2.9.7
Release : 17.el8
Architecture: x86_64
Install Date: Wed 07 Feb 2024 16:40:51 GMT
Group : Unspecified
Size : 208380
License : GPL+
Signature : RSA/SHA256, Fri 28 Apr 2023 11:07:38 BST, Key ID 199e2f91fd431d51
Source RPM : fuse-2.9.7-17.el8.src.rpm
Build Date : Tue 18 Apr 2023 19:30:27 BST
Build Host : x86-64-02.build.eng.rdu2.redhat.com
Relocations : (not relocatable)
Packager : Red Hat, Inc. http://bugzilla.redhat.com/bugzilla
Vendor : Red Hat, Inc.
URL : http://fuse.sf.net
Summary : File System in Userspace (FUSE) v2 utilities
Description :
With FUSE it is possible to implement a fully functional filesystem in a
userspace program. This package contains the FUSE v2 userspace tools to
mount a FUSE filesystem.
Kernel information (
uname -r)4.18.0-513.9.1.el8_9.x86_64
GNU/Linux Distribution, if applicable (
cat /etc/os-release)NAME="Red Hat Enterprise Linux"
VERSION="8.9 (Ootpa)"
ID="rhel"
ID_LIKE="fedora"
VERSION_ID="8.9"
PLATFORM_ID="platform:el8"
PRETTY_NAME="Red Hat Enterprise Linux 8.9 (Ootpa)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
HOME_URL="https://www.redhat.com/"
DOCUMENTATION_URL="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/8"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
REDHAT_BUGZILLA_PRODUCT_VERSION=8.9
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="8.9"
@amitdctm commented on GitHub (Feb 10, 2024):
I'm pleased to inform that the issue has now been resolved!
This is odd but when I use EC2 Instance Role Profile backed with S3 Access Point policy it struggle connecting appropriate S3 Regional endpoint, and it works fine if I use EC2 Instance Role Profile backed by Role based Policy (not S3 Access Point Policy).
After putting my head on fire, it really brighten my thoughts and given me an idea to try!
This what made me happy!
Ansible Task
If you want to use non-fstab style, use like below:
Thanks for supporting the community!💯