starred/fake-gcs-server

Fork 0

mirror of https://github.com/fsouza/fake-gcs-server.git synced 2026-04-25 13:45:52 +03:00

[GH-ISSUE #84] Multi-part upload isn't supported in all cases #17

New issue

Closed

opened 2026-03-03 12:07:25 +03:00 by kerem · 7 comments

kerem commented

2026-03-03 12:07:25 +03:00

Owner

Originally created by @nhoughto on GitHub (Sep 28, 2019).
Original GitHub issue: https://github.com/fsouza/fake-gcs-server/issues/84

Using the Java SDK in this fashion

bucketStorage.create(BlobInfo.newBuilder(bucketInfo, fullKey).build(), inputstream);

Appears to send data using an unsupported mechanism, gives this error:

multipart: NextPart: EOF

com.google.cloud.storage.StorageException: 500 Internal Server Error
multipart: NextPart: EOF

	at com.google.cloud.storage.spi.v1.HttpStorageRpc.translate(HttpStorageRpc.java:229)
	at com.google.cloud.storage.spi.v1.HttpStorageRpc.create(HttpStorageRpc.java:310)
	at com.google.cloud.storage.StorageImpl.create(StorageImpl.java:180)

Originally created by @nhoughto on GitHub (Sep 28, 2019). Original GitHub issue: https://github.com/fsouza/fake-gcs-server/issues/84 Using the Java SDK in this fashion `bucketStorage.create(BlobInfo.newBuilder(bucketInfo, fullKey).build(), inputstream);` Appears to send data using an unsupported mechanism, gives this error: ``` multipart: NextPart: EOF com.google.cloud.storage.StorageException: 500 Internal Server Error multipart: NextPart: EOF at com.google.cloud.storage.spi.v1.HttpStorageRpc.translate(HttpStorageRpc.java:229) at com.google.cloud.storage.spi.v1.HttpStorageRpc.create(HttpStorageRpc.java:310) at com.google.cloud.storage.StorageImpl.create(StorageImpl.java:180) ```

kerem closed this issue

2026-03-03 12:07:26 +03:00

kerem commented

2026-03-03 12:07:26 +03:00

Author

Owner

@nhoughto commented on GitHub (Sep 28, 2019):

I see looking through the code that there is a section for multipart uploads, possibly multi part uploads from the java sdk behave slightly differently?

Is there a way to enable more logging to give you more information?

@nhoughto commented on GitHub (Sep 28, 2019): I see looking through the code that there is a section for multipart uploads, possibly multi part uploads from the java sdk behave slightly differently? Is there a way to enable more logging to give you more information?

kerem commented

2026-03-03 12:07:26 +03:00

Author

Owner

@nhoughto commented on GitHub (Sep 29, 2019):

Ah this is because the java sdk sending protobuf/grpc by default, not JSON. Trying to figure out if can configure it to use JSON instead.. there is this sdk that is deprecated

https://developers.google.com/api-client-library/java/apis/storage/v1

@nhoughto commented on GitHub (Sep 29, 2019): Ah this is because the java sdk sending protobuf/grpc by default, not JSON. Trying to figure out if can configure it to use JSON instead.. there is this sdk that is deprecated https://developers.google.com/api-client-library/java/apis/storage/v1

kerem commented

2026-03-03 12:07:27 +03:00

Author

Owner

@nhoughto commented on GitHub (Sep 30, 2019):

Works with old java sdk with gzip disabled 👍

@nhoughto commented on GitHub (Sep 30, 2019): Works with old java sdk with gzip disabled :+1:

kerem commented

2026-03-03 12:07:27 +03:00

Author

Owner

@nhoughto commented on GitHub (Oct 11, 2019):

@fsouza Any plan for adding a gRPC interface to this? This was the cause of my java sdk problems in the end.

@nhoughto commented on GitHub (Oct 11, 2019): @fsouza Any plan for adding a gRPC interface to this? This was the cause of my java sdk problems in the end.

kerem commented

2026-03-03 12:07:27 +03:00

Author

Owner

@fsouza commented on GitHub (Oct 11, 2019):

@nhoughto I believe this would be way more complex. I don't have any plans right now, but I also don't have enough information. I can investigate and write down my findings.

@fsouza commented on GitHub (Oct 11, 2019): @nhoughto I believe this would be way more complex. I don't have any plans right now, but I also don't have enough information. I can investigate and write down my findings.

kerem commented

2026-03-03 12:07:27 +03:00

Author

Owner

@nhoughto commented on GitHub (Oct 11, 2019):

Ok that would be great, grpc appears to be the future for gcp apis, only the deprecated GCS library does JSON now. So someone is going to have to do it eventually 😉.

And you appear to be the only project out there solving this problem! 🤞🏼

@nhoughto commented on GitHub (Oct 11, 2019): Ok that would be great, grpc appears to be the future for gcp apis, only the deprecated GCS library does JSON now. So someone is going to have to do it eventually 😉. And you appear to be the only project out there solving this problem! 🤞🏼

kerem commented

2026-03-03 12:07:27 +03:00

Author

Owner

@DanieleSassoli commented on GitHub (Nov 28, 2019):

@fsouza any chance you looked into this? I'm hitting the same issue and not really in a position where I can use the deprecated SDK, it'd be great if this could work as, as @nhoughto says, you're the only one providing a docker emulator for gcs.

@DanieleSassoli commented on GitHub (Nov 28, 2019): @fsouza any chance you looked into this? I'm hitting the same issue and not really in a position where I can use the deprecated SDK, it'd be great if this could work as, as @nhoughto says, you're the only one providing a docker emulator for gcs.

kerem referenced this issue

2026-03-03 12:09:58 +03:00

[PR #17] [MERGED] chore(deps): update module google.golang.org/api to v0.2.0 #267