[GH-ISSUE #1010] Sub-object caching #555

New issue

Closed

opened 2026-03-04 01:46:41 +03:00 by kerem · 2 comments

kerem commented

2026-03-04 01:46:41 +03:00

Owner

Originally created by @cafarm on GitHub (Apr 10, 2019).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1010

Is s3fs capable of sub-object caching? Meaning if I have a large object and I only read a portion of it, can s3fs cache just that portion?

I've been doing a bit of experimenting but I've never seen anything show up in the cache folder even when I read an entire file.

Originally created by @cafarm on GitHub (Apr 10, 2019). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1010 Is s3fs capable of sub-object caching? Meaning if I have a large object and I only read a portion of it, can s3fs cache just that portion? I've been doing a bit of experimenting but I've never seen anything show up in the cache folder even when I read an entire file.

kerem closed this issue

2026-03-04 01:46:41 +03:00

kerem commented

2026-03-04 01:46:42 +03:00

Author

Owner

@ggtakec commented on GitHub (Apr 16, 2019):

If you open () and read () a file, s3fs will perform partial download according to the range.
And if you specify use_cache, partially downloaded content will be stored under that directory.
(The cache file is a file with "holes" using truncate)

@ggtakec commented on GitHub (Apr 16, 2019): If you open () and read () a file, s3fs will perform partial download according to the range. And if you specify use_cache, partially downloaded content will be stored under that directory. (The cache file is a file with "holes" using truncate)

kerem commented

2026-03-04 01:46:42 +03:00

Author

Owner

@gaul commented on GitHub (Feb 3, 2020):

I believe @ggtakec answered this. Please reopen if I misunderstand.

@gaul commented on GitHub (Feb 3, 2020): I believe @ggtakec answered this. Please reopen if I misunderstand.

kerem referenced this issue

2026-03-04 02:00:59 +03:00

[PR #555] [MERGED] don't sign empty headers (as they are discarded by libcurl) #1546