[PR #552] [MERGED] switch S3fsMultiCurl to use foreground threads #1542

New issue

Closed

opened 2026-03-04 02:00:58 +03:00 by kerem · 0 comments

kerem commented

2026-03-04 02:00:58 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/s3fs-fuse/s3fs-fuse/pull/552
Author: @orozery
Created: 4/2/2017
Status: ✅ Merged
Merged: 4/16/2017
Merged by: @ggtakec

Base: master ← Head: foreground_threads

📝 Commits (1)

96764b7 switch S3fsMultiCurl to use foreground threads

📊 Changes

2 files changed (+84 additions, -154 deletions)

View changed files

📝 src/curl.cpp (+82 -153)
📝 src/curl.h (+2 -1)

📄 Description

Details

Currently, s3fs uses a multicurl handle to use parallel connections to s3.
The connections are indeed parallel, but are handled by a single CPU thread.
This creates a CPU bottleneck when reaching high throughput with TLS (HTTPS) connections.
To solve this issue, I propose a change to the S3fsMultiCurl class to use foreground pthreads instead of a multicurl handle.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/s3fs-fuse/s3fs-fuse/pull/552 **Author:** [@orozery](https://github.com/orozery) **Created:** 4/2/2017 **Status:** ✅ Merged **Merged:** 4/16/2017 **Merged by:** [@ggtakec](https://github.com/ggtakec) **Base:** `master` ← **Head:** `foreground_threads` --- ### 📝 Commits (1) - [`96764b7`](https://github.com/s3fs-fuse/s3fs-fuse/commit/96764b7410ed151d77a2d262d85d217de67fb3eb) switch S3fsMultiCurl to use foreground threads ### 📊 Changes **2 files changed** (+84 additions, -154 deletions) <details> <summary>View changed files</summary> 📝 `src/curl.cpp` (+82 -153) 📝 `src/curl.h` (+2 -1) </details> ### 📄 Description #### Details Currently, s3fs uses a multicurl handle to use parallel connections to s3. The connections are indeed parallel, but are handled by a single CPU thread. This creates a CPU bottleneck when reaching high throughput with TLS (HTTPS) connections. To solve this issue, I propose a change to the S3fsMultiCurl class to use foreground pthreads instead of a multicurl handle. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>