starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 13:26:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #1243] Error uploading large file when writing via nfs #666

New issue
Closed
opened 2026-03-04 01:47:40 +03:00 by kerem · 3 comments
kerem commented 2026-03-04 01:47:40 +03:00
Owner
Copy link

Originally created by @judassssss on GitHub (Feb 6, 2020).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1243

Additional Information

I use s3fs-fuse to mount object-storage bucket，and share the mounted directory for others by NFS, when I write a big file (for exmple 200M or more) to NFS client, s3fs multipart tries to split the file for upload, but the truncation must be repeated many times resulting in a file error

Version of s3fs being used (s3fs --version)

Amazon Simple Storage Service File System V1.86 (commit:bb20fc3) with OpenSSL

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

Version: 2.9.4-1ubuntu3.1

Kernel information (uname -r)

4.4.0-131-generic

GNU/Linux Distribution, if applicable (cat /etc/os-release)

Description: Ubuntu 16.04.5 LTS

s3fs command line used, if applicable

s3fs bucket /s3fs/ -o url=https://xxx.com -o use_cache=/cache -o use_path_request_style -o sigv2 -o curldbg -d
nfs3, nfs4.1

Details about issue

At nfs-server I wrote a large file to try mount successfully, check logs that s3fs only split the file once (eg: 200MB file divided into 20 parts and uploaded).
But at nfs client, splitting the file over and over again, for example, when uploading a 200 MB file initially divided into 12 parts after a while uploading s3fs divided into 6 parts again and I don't know if it stopped. Larger files are more prone to errors

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

logs erros
curl.cpp:url_to_host(99): url is https://xxxx.com [ERR] curl.cpp:RequestPerform(2424): HTTP response code 400, returning EIO. Body Text: EntityTooSmallYour proposed upload is smaller than the minimum allowed size

nfs-server/mount s3fs:

s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=1&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=1&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=2&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=2&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=3&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=3&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=4&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=4&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=5&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=5&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=6&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=6&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=7&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=7&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=8&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=8&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=9&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=9&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=10&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=10&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=11&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=11&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=12&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=12&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=13&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=13&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=14&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=14&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=15&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=15&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=16&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=16&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=17&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=17&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=18&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=18&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=19&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=19&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=20&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=20&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: > PUT /bucket/test1.img?partNumber=1&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=2&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=3&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=4&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=5&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=6&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=7&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=8&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=9&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=10&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=11&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=12&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=13&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=14&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=15&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=16&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=17&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=18&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=19&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: > PUT /bucket/test1.img?partNumber=20&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/test1.img?uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 
s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5
s3fs[13084]: > POST /bucket/test1.img?uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1

nfs client:

s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=4&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=5&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=6&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2
s3fs[13084]: > POST /bucket/file200MB?uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=7&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=7&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=8&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=8&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=9&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=9&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=10&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=10&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=11&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=11&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=4&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=5&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=6&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=7&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=8&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=9&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=10&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=11&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2
s3fs[13084]: > POST /bucket/file200MB?uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw
s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=4&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw
s3fs[13084]: > POST /bucket/file200MB?uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl
s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1
s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1
s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl 
s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl
s3fs[13084]: > POST /bucket/file200MB?uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1
Originally created by @judassssss on GitHub (Feb 6, 2020). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1243 ### Additional Information I use s3fs-fuse to mount object-storage bucket，and share the mounted directory for others by NFS, when I write a big file (for exmple 200M or more) to NFS client, s3fs multipart tries to split the file for upload, but the truncation must be repeated many times resulting in a file error #### Version of s3fs being used (s3fs --version) Amazon Simple Storage Service File System V1.86 (commit:bb20fc3) with OpenSSL #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) Version: 2.9.4-1ubuntu3.1 #### Kernel information (uname -r) 4.4.0-131-generic #### GNU/Linux Distribution, if applicable (cat /etc/os-release) Description: Ubuntu 16.04.5 LTS #### s3fs command line used, if applicable s3fs bucket /s3fs/ -o url=https://xxx.com -o use_cache=/cache -o use_path_request_style -o sigv2 -o curldbg -d nfs3, nfs4.1 ### Details about issue At nfs-server I wrote a large file to try mount successfully, check logs that s3fs only split the file once (eg: 200MB file divided into 20 parts and uploaded). But at nfs client, splitting the file over and over again, for example, when uploading a 200 MB file initially divided into 12 parts after a while uploading s3fs divided into 6 parts again and I don't know if it stopped. Larger files are more prone to errors #### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs) **logs erros** curl.cpp:url_to_host(99): url is https://xxxx.com [ERR] curl.cpp:RequestPerform(2424): HTTP response code 400, returning EIO. Body Text: <Error><Code>EntityTooSmall</Code><Message>Your proposed upload is smaller than the minimum allowed size</Message> **nfs-server/mount s3fs:** ``` s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=1&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=1&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=2&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=2&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=3&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=3&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=4&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=4&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=5&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=5&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=6&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=6&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=7&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=7&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=8&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=8&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=9&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=9&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=10&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=10&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=11&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=11&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=12&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=12&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=13&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=13&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=14&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=14&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=15&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=15&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=16&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=16&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=17&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=17&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=18&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=18&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=19&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=19&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?partNumber=20&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?partNumber=20&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: > PUT /bucket/test1.img?partNumber=1&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=2&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=3&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=4&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=5&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=6&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=7&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=8&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=9&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=10&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=11&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=12&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=13&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=14&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=15&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=16&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=17&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=18&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=19&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: > PUT /bucket/test1.img?partNumber=20&uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/test1.img?uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: URL changed is https://xxx.com/bucket/test1.img?uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 s3fs[13084]: > POST /bucket/test1.img?uploadId=MmZmNWJhOTAtOGZmYy00MjZiLThhNjAtNzkwMDk5MDExNmM5 HTTP/1.1 ``` **nfs client:** ``` s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=4&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=5&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=6&uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 s3fs[13084]: > POST /bucket/file200MB?uploadId=ZTdmNGU1ODAtMmQ3My00YmVhLTk1NWUtNjJlYzc2MzZkOWE2 HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=5&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=6&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=7&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=7&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=8&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=8&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=9&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=9&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=10&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=10&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=11&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=11&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=4&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=5&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=6&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=7&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=8&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=9&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=10&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=11&uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 s3fs[13084]: > POST /bucket/file200MB?uploadId=ZmVhNDE3YWYtNDI5ZS00NTkyLTlmY2QtOGVkNzg5NzVjMWE2 HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=4&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=4&uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw s3fs[13084]: > POST /bucket/file200MB?uploadId=NmJlNzk3ZWUtY2EyNC00YTFlLTliZTUtYTI2YTg2MjUwNjIw HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=1&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=2&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: URL is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?partNumber=3&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: > PUT /bucket/file200MB?partNumber=1&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=2&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1 s3fs[13084]: > PUT /bucket/file200MB?partNumber=3&uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1 s3fs[13084]: URL is https://xxx.com/bucket/file200MB?uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: URL changed is https://xxx.com/bucket/file200MB?uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl s3fs[13084]: > POST /bucket/file200MB?uploadId=ZGM1M2Q4YjctOGY0ZS00NmEwLWI5ZjYtMjJjODg5MDhlNjJl HTTP/1.1 ```
kerem closed this issue 2026-03-04 01:47:41 +03:00
kerem commented 2026-03-04 01:47:42 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Apr 22, 2020):

Could you test with the latest master? It includes a fix for the mixupload optimization.

<!-- gh-comment-id:617564820 --> @gaul commented on GitHub (Apr 22, 2020): Could you test with the latest master? It includes a fix for the mixupload optimization.
kerem commented 2026-03-04 01:47:42 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Jun 4, 2020):

Closing; please reopen if symptoms persist.

<!-- gh-comment-id:638722078 --> @gaul commented on GitHub (Jun 4, 2020): Closing; please reopen if symptoms persist.
kerem commented 2026-03-04 01:47:42 +03:00
Author
Owner
Copy link

@shuangzai21 commented on GitHub (Aug 31, 2021):

Have you solved this problem? I also met the same problem.

<!-- gh-comment-id:908843892 --> @shuangzai21 commented on GitHub (Aug 31, 2021): Have you solved this problem? I also met the same problem.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#666
No description provided.