[PR #859] [MERGED] Upload S3 parts without batching #1665

New issue

Closed

opened 2026-03-04 02:01:34 +03:00 by kerem · 0 comments

kerem commented

2026-03-04 02:01:34 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/s3fs-fuse/s3fs-fuse/pull/859
Author: @gaul
Created: 11/16/2018
Status: ✅ Merged
Merged: 11/18/2018
Merged by: @ggtakec

Base: master ← Head: upload-remove-batching

📝 Commits (1)

88cd8fe Upload S3 parts without batching

📊 Changes

3 files changed (+150 additions, -45 deletions)

View changed files

📝 src/curl.cpp (+82 -45)
📝 src/curl.h (+3 -0)
➕ src/psemaphore.h (+65 -0)

📄 Description

Previously s3fs would issue a batch of uploads and wait for all to
succeed before issuing the next batch. Now it issues the first batch
and only waits for a single part to succeed before uploading the next
part. This can improve performance when one part lags due to network
errors. Fixes #183.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/s3fs-fuse/s3fs-fuse/pull/859 **Author:** [@gaul](https://github.com/gaul) **Created:** 11/16/2018 **Status:** ✅ Merged **Merged:** 11/18/2018 **Merged by:** [@ggtakec](https://github.com/ggtakec) **Base:** `master` ← **Head:** `upload-remove-batching` --- ### 📝 Commits (1) - [`88cd8fe`](https://github.com/s3fs-fuse/s3fs-fuse/commit/88cd8feb053980c808d67771d63a84ca25f6db8a) Upload S3 parts without batching ### 📊 Changes **3 files changed** (+150 additions, -45 deletions) <details> <summary>View changed files</summary> 📝 `src/curl.cpp` (+82 -45) 📝 `src/curl.h` (+3 -0) ➕ `src/psemaphore.h` (+65 -0) </details> ### 📄 Description Previously s3fs would issue a batch of uploads and wait for all to succeed before issuing the next batch. Now it issues the first batch and only waits for a single part to succeed before uploading the next part. This can improve performance when one part lags due to network errors. Fixes #183. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>