[GH-ISSUE #671] Store objects as binary instead of JSON #118

New issue

Closed

opened 2026-03-03 12:08:26 +03:00 by kerem · 1 comment

kerem commented

2026-03-03 12:08:26 +03:00

Owner

Originally created by @gaul on GitHub (Feb 2, 2022).
Original GitHub issue: https://github.com/fsouza/fake-gcs-server/issues/671

Storing objects in binary more efficient than encoding as JSON which has high memory usage for large files. fake-gcs-server can store the metadata in extended attributes instead. References #669.

Originally created by @gaul on GitHub (Feb 2, 2022). Original GitHub issue: https://github.com/fsouza/fake-gcs-server/issues/671 Storing objects in binary more efficient than encoding as JSON which has high memory usage for large files. fake-gcs-server can store the metadata in extended attributes instead. References #669.

kerem

2026-03-03 12:08:26 +03:00

closed this issue
added the
enhancement
label

kerem commented

2026-03-03 12:08:27 +03:00

Author

Owner

@fsouza commented on GitHub (Feb 2, 2022):

Yeah using JSON isn't great, specially when we're dealing with ranges. It also means we can't store metadata for buckets (as they're represented as simple folders). I wonder if using extended attributes will limit what kind of filesystem we can use (I haven't done this before, so I really don't know), but we can definitely explore it.

Alternatively we can always have a metadata file in some structured format, in addition with the actual content.

@fsouza commented on GitHub (Feb 2, 2022): Yeah using JSON isn't great, specially when we're dealing with ranges. It also means we can't store metadata for buckets (as they're represented as simple folders). I wonder if using extended attributes will limit what kind of filesystem we can use (I haven't done this before, so I really don't know), but we can definitely explore it. Alternatively we can always have a metadata file in some structured format, in addition with the actual content.

kerem referenced this issue

2026-03-03 12:29:37 +03:00

[PR #118] [MERGED] build(deps): bump golang from 1.13.3-alpine to 1.13.4-alpine #352