[GH-ISSUE #1060] Does s3fs limit the size of uploaded files? #580

Closed
opened 2026-03-04 01:46:56 +03:00 by kerem · 4 comments
Owner

Originally created by @XiaoGe2030 on GitHub (Jun 30, 2019).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1060

Does s3fs limit the size of uploaded files? Or ,There is some params limit the size ?
I upload a 10G file was successful, but uploading a 100G file failed. please help me, and tell me why,Thanks!!!
image

image

Originally created by @XiaoGe2030 on GitHub (Jun 30, 2019). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1060 Does s3fs limit the size of uploaded files? Or ,There is some params limit the size ? I upload a 10G file was successful, but uploading a 100G file failed. please help me, and tell me why,Thanks!!! ![image](https://user-images.githubusercontent.com/22184388/60394043-90c48d00-9b50-11e9-8df2-79d1aff4e79e.png) ![image](https://user-images.githubusercontent.com/22184388/60394053-b6ea2d00-9b50-11e9-9819-55504b1e9074.png)
kerem 2026-03-04 01:46:56 +03:00
  • closed this issue
  • added the
    need info
    label
Author
Owner

@threadfly commented on GitHub (Jul 2, 2019):

Hello, why is your test speed up to 310MB/s?

<!-- gh-comment-id:507500140 --> @threadfly commented on GitHub (Jul 2, 2019): Hello, why is your test speed up to 310MB/s?
Author
Owner

@jheiselman commented on GitHub (Jul 2, 2019):

According to the FAQ, the size is dependent on the S3 service you are using and isn't limited by the driver.
https://github.com/s3fs-fuse/s3fs-fuse/wiki/Fuse-Over-Amazon#overview

<!-- gh-comment-id:507688282 --> @jheiselman commented on GitHub (Jul 2, 2019): According to the FAQ, the size is dependent on the S3 service you are using and isn't limited by the driver. https://github.com/s3fs-fuse/s3fs-fuse/wiki/Fuse-Over-Amazon#overview
Author
Owner

@gaul commented on GitHub (Jul 2, 2019):

I suspect that this is a duplicate of as #1019. Could you run s3fs with -f -d -o curldbg to check? If so, please downgrade to version 1.84 until we can address this properly.

<!-- gh-comment-id:507755764 --> @gaul commented on GitHub (Jul 2, 2019): I suspect that this is a duplicate of as #1019. Could you run s3fs with `-f -d -o curldbg` to check? If so, please downgrade to version 1.84 until we can address this properly.
Author
Owner

@gaul commented on GitHub (Jun 23, 2020):

Closing due to inactivity. Please reopen if symptoms persist.

<!-- gh-comment-id:647867915 --> @gaul commented on GitHub (Jun 23, 2020): Closing due to inactivity. Please reopen if symptoms persist.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#580
No description provided.