starred/s3fs-fuse

Fork 0

mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 13:26:00 +03:00

[GH-ISSUE #746] Does s3fs support AWS Batch job role? #427

New issue

Closed

opened 2026-03-04 01:45:29 +03:00 by kerem · 5 comments

kerem commented

2026-03-04 01:45:29 +03:00

Owner

Originally created by @monitoringit on GitHub (Apr 9, 2018).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/746

Additional Information

The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all.

Version of s3fs being used (s3fs --version)

example: 1.00

Version of fuse being used (pkg-config --modversion fuse)

example: 2.9.4

System information (uname -r)

command result: uname -r

Distro (cat /etc/issue)

command result: cat /etc/issue

s3fs command line used (if applicable)

/etc/fstab entry (if applicable):

s3fs syslog messages (grep s3fs /var/log/syslog, or s3fs outputs)

if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages

Details about issue

If i am trying to mount s3fs within a container (executed by AWS Batch) running on an ec2 machine, will -o iam_role option while mounting s3fs, honor container's job role or will it only use underlying ec2 host iam role?

Originally created by @monitoringit on GitHub (Apr 9, 2018). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/746 ### Additional Information _The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all._ #### Version of s3fs being used (s3fs --version) _example: 1.00_ #### Version of fuse being used (pkg-config --modversion fuse) _example: 2.9.4_ #### System information (uname -r) _command result: uname -r_ #### Distro (cat /etc/issue) _command result: cat /etc/issue_ #### s3fs command line used (if applicable) ``` ``` #### /etc/fstab entry (if applicable): ``` ``` #### s3fs syslog messages (grep s3fs /var/log/syslog, or s3fs outputs) _if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages_ ``` ``` ### Details about issue If i am trying to mount s3fs within a container (executed by AWS Batch) running on an ec2 machine, will -o iam_role option while mounting s3fs, honor container's job role or will it only use underlying ec2 host iam role?

kerem

2026-03-04 01:45:29 +03:00

closed this issue
added the
need info
label

kerem commented

2026-03-04 01:45:30 +03:00

Author

Owner

@monitoringit commented on GitHub (Apr 9, 2018):

I can confirm that the AWS Batch job roles are not honoured but underlying ec2 instance profile role is what s3fs honors when using -o iam_role option [curl -s http://169.254.169.254/latest/meta-data/iam/info]. It will really be nice to make s3fs use job roles over ec2 instance role as then access to s3 folders can be granted at job level rather than ec2 instance level.

@monitoringit commented on GitHub (Apr 9, 2018): I can confirm that the AWS Batch job roles are not honoured but underlying ec2 instance profile role is what s3fs honors when using -o iam_role option [curl -s http://169.254.169.254/latest/meta-data/iam/info]. It will really be nice to make s3fs use job roles over ec2 instance role as then access to s3 folders can be granted at job level rather than ec2 instance level.

kerem commented

2026-03-04 01:45:30 +03:00

Author

Owner

@monitoringit commented on GitHub (Apr 9, 2018):

will using job role over ec2 iam role be a priority in future?

@monitoringit commented on GitHub (Apr 9, 2018): will using job role over ec2 iam role be a priority in future?

kerem commented

2026-03-04 01:45:30 +03:00

Author

Owner

@harveypham commented on GitHub (Feb 2, 2019):

We use option -o ecs to mount S3 with AWS batch job role and it works. This option is not available on version 1.79, which is the default version for ubuntu xenial, so we have to compile the latest code base (v 1.84) in our docker image. If you use any version in between, YMMV.

@harveypham commented on GitHub (Feb 2, 2019): We use option _-o ecs_ to mount S3 with AWS batch job role and it works. This option is not available on version 1.79, which is the default version for ubuntu xenial, so we have to compile the latest code base (v 1.84) in our docker image. If you use any version in between, YMMV.

kerem commented

2026-03-04 01:45:30 +03:00

Author

Owner

@gaul commented on GitHub (Aug 16, 2020):

Can someone clarify what needs to be fixed here? s3fs has both the -o ecs and o iam_role flags -- do these allow use of the batch role?

@gaul commented on GitHub (Aug 16, 2020): Can someone clarify what needs to be fixed here? s3fs has both the `-o ecs` and `o iam_role` flags -- do these allow use of the batch role?

kerem commented

2026-03-04 01:45:30 +03:00

Author

Owner

@gaul commented on GitHub (Nov 15, 2020):

Please reopen if symptoms persist.

@gaul commented on GitHub (Nov 15, 2020): Please reopen if symptoms persist.