[GH-ISSUE #1721] s3fs: failed to set internal data for access key/secret key from passwd file. #883

Open
opened 2026-03-04 01:49:40 +03:00 by kerem · 0 comments
Owner

Originally created by @00void00 on GitHub (Jul 16, 2021).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1721

Additional Information

The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all.
Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD

Version of s3fs being used (s3fs --version)

1.89(7890989)

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

package fuse, is not installed
package dpkg is not installed
package fuse is not installed

Kernel information (uname -r)

_command result: 4.14.232-177.418.amzn2.x86_64

GNU/Linux Distribution, if applicable (cat /etc/os-release)

_command result:
NAME="Amazon Linux"
VERSION="2"
ID="amzn"
ID_LIKE="centos rhel fedora"
VERSION_ID="2"
PRETTY_NAME="Amazon Linux 2"
ANSI_COLOR="0;33"
CPE_NAME="cpe:2.3amazon:amazon_linux:2"
HOME_URL="https://amazonlinux.com/"

Details about issue

Created a docker image using this docker file

FROM ubuntu:14.04

ENV DUMB_INIT_VER 1.2.0
ENV S3_BUCKET ''
ENV MNT_POINT /data
ENV S3_REGION ''
ENV AWS_KEY ''
ENV AWS_SECRET_KEY ''

RUN DEBIAN_FRONTEND=noninteractive apt-get -y update --fix-missing && \
    apt-get install -y automake autotools-dev g++ git libcurl4-gnutls-dev wget \
                       libfuse-dev libssl-dev libxml2-dev make pkg-config && \
    git clone https://github.com/s3fs-fuse/s3fs-fuse.git /tmp/s3fs-fuse && \
    cd /tmp/s3fs-fuse && ./autogen.sh && ./configure && make && make install && \
    ldconfig && /usr/local/bin/s3fs --version && \
    wget -O /tmp/dumb-init_${DUMB_INIT_VER}_amd64.deb https://github.com/Yelp/dumb-init/releases/download/v${DUMB_INIT_VER}/dumb-init_${DUMB_INIT_VER}_amd64.deb && \
    dpkg -i /tmp/dumb-init_*.deb

RUN echo "${AWS_KEY}:${AWS_SECRET_KEY}" > /etc/passwd-s3fs && \
    chmod 600 /etc/passwd-s3fs && chmod 640 /etc/passwd-s3fs

RUN mkdir -p "$MNT_POINT"

RUN DEBIAN_FRONTEND=noninteractive apt-get purge -y wget automake autotools-dev g++ git make && \
    apt-get -y autoremove --purge && apt-get clean && \
    rm -rf /var/lib/apt/lists/* /tmp/* /var/tmp/*

# Runs "/usr/bin/dumb-init -- CMD_COMMAND_HERE"
#ENTRYPOINT ["/usr/bin/dumb-init", "--"]

CMD exec /usr/local/bin/s3fs $S3_BUCKET $MNT_POINT -f -o endpoint=${S3_REGION},allow_other,use_cache=/tmp,max_stat_cache_size=1000,stat_cache_expire=900,retries=5,connect_timeout=10

This image was then pushed to the EKS Cluster via ECR.
On deploying this, the following error popped up

s3fs: failed to set internal data for access key/secret key from passwd file.

Originally created by @00void00 on GitHub (Jul 16, 2021). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1721 ### Additional Information _The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all._ _Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD_ #### Version of s3fs being used (s3fs --version) 1.89(7890989) #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) package fuse, is not installed package dpkg is not installed package fuse is not installed #### Kernel information (uname -r) _command result: 4.14.232-177.418.amzn2.x86_64 #### GNU/Linux Distribution, if applicable (cat /etc/os-release) _command result: NAME="Amazon Linux" VERSION="2" ID="amzn" ID_LIKE="centos rhel fedora" VERSION_ID="2" PRETTY_NAME="Amazon Linux 2" ANSI_COLOR="0;33" CPE_NAME="cpe:2.3:o:amazon:amazon_linux:2" HOME_URL="https://amazonlinux.com/" ### Details about issue Created a docker image using this docker file ``` FROM ubuntu:14.04 ENV DUMB_INIT_VER 1.2.0 ENV S3_BUCKET '' ENV MNT_POINT /data ENV S3_REGION '' ENV AWS_KEY '' ENV AWS_SECRET_KEY '' RUN DEBIAN_FRONTEND=noninteractive apt-get -y update --fix-missing && \ apt-get install -y automake autotools-dev g++ git libcurl4-gnutls-dev wget \ libfuse-dev libssl-dev libxml2-dev make pkg-config && \ git clone https://github.com/s3fs-fuse/s3fs-fuse.git /tmp/s3fs-fuse && \ cd /tmp/s3fs-fuse && ./autogen.sh && ./configure && make && make install && \ ldconfig && /usr/local/bin/s3fs --version && \ wget -O /tmp/dumb-init_${DUMB_INIT_VER}_amd64.deb https://github.com/Yelp/dumb-init/releases/download/v${DUMB_INIT_VER}/dumb-init_${DUMB_INIT_VER}_amd64.deb && \ dpkg -i /tmp/dumb-init_*.deb RUN echo "${AWS_KEY}:${AWS_SECRET_KEY}" > /etc/passwd-s3fs && \ chmod 600 /etc/passwd-s3fs && chmod 640 /etc/passwd-s3fs RUN mkdir -p "$MNT_POINT" RUN DEBIAN_FRONTEND=noninteractive apt-get purge -y wget automake autotools-dev g++ git make && \ apt-get -y autoremove --purge && apt-get clean && \ rm -rf /var/lib/apt/lists/* /tmp/* /var/tmp/* # Runs "/usr/bin/dumb-init -- CMD_COMMAND_HERE" #ENTRYPOINT ["/usr/bin/dumb-init", "--"] CMD exec /usr/local/bin/s3fs $S3_BUCKET $MNT_POINT -f -o endpoint=${S3_REGION},allow_other,use_cache=/tmp,max_stat_cache_size=1000,stat_cache_expire=900,retries=5,connect_timeout=10 ``` This image was then pushed to the EKS Cluster via ECR. On deploying this, the following error popped up ``` s3fs: failed to set internal data for access key/secret key from passwd file. ```
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#883
No description provided.