[GH-ISSUE #1787] Reduce AWS CLI run-time #918

Open
opened 2026-03-04 01:49:53 +03:00 by kerem · 2 comments
Owner

Originally created by @gaul on GitHub (Oct 26, 2021).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1787

The s3fs integration tests invoke the CLI 20 times * 10 flags = 200 invocations total. Since the CLI takes 300 ms to start up this contributes 60 seconds to the 15 minute run-time. We could reduce this by moving to minio CLI which only takes 25 ms. References aws/aws-cli#6500.

Originally created by @gaul on GitHub (Oct 26, 2021). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1787 The s3fs integration tests invoke the CLI 20 times * 10 flags = 200 invocations total. Since the CLI takes 300 ms to start up this contributes 60 seconds to the 15 minute run-time. We could reduce this by moving to minio CLI which only takes 25 ms. References aws/aws-cli#6500.
Author
Owner

@ggtakec commented on GitHub (Oct 26, 2021):

Thanks for your issue to aws-cli.
I think that we should wait for the solution (or know the cause) on the aws-cli side before migrating (before we migrate to minio cli).

<!-- gh-comment-id:951856597 --> @ggtakec commented on GitHub (Oct 26, 2021): Thanks for your issue to aws-cli. I think that we should wait for the solution (or know the cause) on the aws-cli side before migrating (before we migrate to minio cli).
Author
Owner

@gaul commented on GitHub (Nov 5, 2021):

aws-cli-repl might address this. But I opened several issues against it that which we should resolve first.

<!-- gh-comment-id:961834783 --> @gaul commented on GitHub (Nov 5, 2021): [aws-cli-repl](https://github.com/janakaud/aws-cli-repl) might address this. But I opened several issues against it that which we should resolve first.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#918
No description provided.