[GH-ISSUE #205] Any way to do recursive operations faster? #112

New issue

Closed

opened 2026-03-04 01:42:14 +03:00 by kerem · 3 comments

kerem commented

2026-03-04 01:42:14 +03:00

Owner

Originally created by @Jafo232 on GitHub (Jul 6, 2015).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/205

When doing a recursive operation like CHMOD or CHOWN, it takes FOREVER. Is there anyway to speed this up?

Originally created by @Jafo232 on GitHub (Jul 6, 2015). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/205 When doing a recursive operation like CHMOD or CHOWN, it takes FOREVER. Is there anyway to speed this up?

kerem closed this issue

2026-03-04 01:42:14 +03:00

kerem commented

2026-03-04 01:42:15 +03:00

Author

Owner

@gaul commented on GitHub (Jul 6, 2015):

This is a problem for single-threaded commands running against any network file system but particularly acute for s3fs. Could you introduce parallelism via:

find | xargs --max-args=1 --max-procs=50 chmod

@gaul commented on GitHub (Jul 6, 2015): This is a problem for single-threaded commands running against any network file system but particularly acute for s3fs. Could you introduce parallelism via: ``` find | xargs --max-args=1 --max-procs=50 chmod ```

kerem commented

2026-03-04 01:42:15 +03:00

Author

Owner

@Jafo232 commented on GitHub (Jul 7, 2015):

Thanks, that helps a bit. Still slow, but not as much.

@Jafo232 commented on GitHub (Jul 7, 2015): Thanks, that helps a bit. Still slow, but not as much.

kerem commented

2026-03-04 01:42:15 +03:00

Author

Owner

@gaul commented on GitHub (Jul 7, 2015):

Also you can mount your S3 bucket with an EC2 instance in the same region to decrease per-operation latency.

@gaul commented on GitHub (Jul 7, 2015): Also you can mount your S3 bucket with an EC2 instance in the same region to decrease per-operation latency.