[GH-ISSUE #2447] s3fs mount freezes when uploading a bigger single file (>1GB) and uploaded data reaches precise 1GB. #1208

Closed
opened 2026-03-04 01:52:13 +03:00 by kerem · 2 comments
Owner

Originally created by @starislv on GitHub (Apr 25, 2024).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2447

Additional Information

Version of s3fs being used (s3fs --version)

Amazon Simple Storage Service File System V1.94 (commit:unknown) with OpenSSL

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse or dpkg -s fuse)

Name : fuse
Version : 2.9.7
Release : 17.el8
Architecture: aarch64

Installed Packages
Name : s3fs-fuse
Version : 1.94
Release : 1.el8
Architecture : aarch64

Kernel information (uname -r)

4.18.0-513.18.1.el8_9.aarch64

GNU/Linux Distribution, if applicable (cat /etc/os-release)

Rocky Linux release 8.9 (Green Obsidian)

How to run s3fs, if applicable

${s3}:/$SFTP_USER /home/$SFTP_USER/uploads fuse.s3fs _netdev,nonempty,allow_other,iam_role=auto,uid=$USRUID,gid=$USRGID,storage_class=intelligent_tiering,ensure_diskfree=5120,list_object_max_keys=4000,max_stat_cache_size=400000,dbglevel=debug,curldbg,endpoint=eu-north-1,logfile=/home/someuser/s3.log 0 0

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

The logfile=/home/someuser/s3.log is 42MB in size so I will copy out the last part. At the beginning are the data for every copied chunk (i suppose) and they are many. When my upload do freeze, it still outputs the same identical "2024-04-24T22:24:34.004Z [DBG] s3fs.cpp:s3fs_write(2942)" until my software (WinSCP/Filezilla on Windows11/Windows10) timeouts connection. Then s3.log outputs the last part which consists of retries to reconnect. In my case we have also added sftp users homedir to /home/sftpuser/uploads/ so when mount do freeze, user cannot read his homedir and connection gets timed out.

2024-04-24T22:24:34.250Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=31840][offset=1073610752][pseudo_fd=2][pid=5035,uid=1002,gid=1003]
2024-04-24T22:24:34.250Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2]
2024-04-24T22:24:34.250Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073610752][size=31840]
2024-04-24T22:24:34.250Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073610752][size=31840]
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073642592 : tag=49163}
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ]
2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=32736][offset=1073642592][pseudo_fd=2][pid=5035,uid=1002,gid=1003]
2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073642592][size=32736]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073642592][size=32736]
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073675328 : tag=49164}
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ]
2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=960][offset=1073675328][pseudo_fd=2][pid=5035,uid=1002,gid=1003]
2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073675328][size=960]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073675328][size=960]
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073676288 : tag=49165}
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ]
2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=31776][offset=1073676288][pseudo_fd=2][pid=5035,uid=1002,gid=1003]
2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073676288][size=31776]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073676288][size=31776]
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073708064 : tag=49166}
2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ]
2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=32736][offset=1073708064][pseudo_fd=2][pid=5035,uid=1002,gid=1003]
2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073708064][size=32736]
2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073708064][size=32736]
2024-04-24T22:24:34.251Z [INF] curl.cpp:PreMultipartPostRequest(3766): [tpath=/Advailo_test/Downloads.7z.filepart]
2024-04-24T22:24:34.251Z [DBG] curl_handlerpool.cpp:GetHandler(83): Get handler from pool: rest = 31
2024-04-24T22:24:34.251Z [INF] curl_util.cpp:prepare_url(210): URL is https://s3.amazonaws.com/1837463830-tf-tru-sftp/some/Advailo_test/Downloads.7z.filepart?uploads
2024-04-24T22:24:34.251Z [INF] curl_util.cpp:prepare_url(243): URL changed is https://1837463830-tf-tru-sftp.s3.amazonaws.com/tvkurzeme/Advailo_test/Downloads.7z.filepart?uploads
2024-04-24T22:24:34.252Z [DBG] curl.cpp:RequestPerform(2460): connecting to URL https://1837463830-tf-tru-sftp.s3.amazonaws.com/tvkurzeme/Advailo_test/Downloads.7z.filepart?uploads
2024-04-24T22:24:34.252Z [INF] curl.cpp:insertV4Headers(2847): computing signature [POST] [/tvkurzeme/Advailo_test/Downloads.7z.filepart] [uploads] []
2024-04-24T22:24:34.252Z [INF] curl_util.cpp:url_to_host(265): url is https://s3.amazonaws.com
2024-04-24T22:24:34.252Z [CURL DBG] * Connection 6 seems to be dead!

2024-04-24T22:24:34.252Z [CURL DBG] * Closing connection 6

2024-04-24T22:24:34.252Z [CURL DBG] * TLSv1.2 (OUT), TLS alert, close notify (256):

2024-04-24T22:24:34.257Z [CURL DBG] * Trying 16.12.9.27...

2024-04-24T22:24:34.257Z [CURL DBG] * TCP_NODELAY set

2024-04-24T22:24:34.258Z [CURL DBG] * Connected to 1837463830-tf-tru-sftp.s3.amazonaws.com (16.12.9.27) port 443 (#7)

2024-04-24T22:24:34.265Z [CURL DBG] * successfully set certificate verify locations:

2024-04-24T22:24:34.265Z [CURL DBG] * CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none

2024-04-24T22:24:34.265Z [CURL DBG] * SSL re-using session ID

2024-04-24T22:24:34.265Z [CURL DBG] * TLSv1.3 (OUT), TLS handshake, Client hello (1):

2024-04-24T22:24:34.266Z [CURL DBG] * TLSv1.3 (IN), TLS handshake, Server hello (2):

2024-04-24T22:24:34.267Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Certificate (11):

2024-04-24T22:24:34.267Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Server key exchange (12):

2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Server finished (14):

2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Client key exchange (16):

2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):

2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Finished (20):

2024-04-24T22:24:34.270Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Finished (20):

2024-04-24T22:24:34.270Z [CURL DBG] * SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256

2024-04-24T22:24:34.270Z [CURL DBG] * old SSL session ID is stale, removing

2024-04-24T22:24:34.270Z [CURL DBG] * Server certificate:

2024-04-24T22:24:34.270Z [CURL DBG] * subject: CN=*.s3.amazonaws.com

2024-04-24T22:24:34.270Z [CURL DBG] * start date: Oct 10 00:00:00 2023 GMT

2024-04-24T22:24:34.270Z [CURL DBG] * expire date: Jul 3 23:59:59 2024 GMT

2024-04-24T22:24:34.270Z [CURL DBG] * subjectAltName: host "1837463830-tf-tru-sftp.s3.amazonaws.com" matched cert's "*.s3.amazonaws.com"

2024-04-24T22:24:34.270Z [CURL DBG] * issuer: C=US; O=Amazon; CN=Amazon RSA 2048 M01

2024-04-24T22:24:34.270Z [CURL DBG] * SSL certificate verify ok.

2024-04-24T22:24:34.270Z [CURL DBG] > POST /tvkurzeme/Advailo_test/Downloads.7z.filepart?uploads HTTP/1.1
2024-04-24T22:24:34.270Z [CURL DBG] > Host: 1837463830-tf-tru-sftp.s3.amazonaws.com
2024-04-24T22:24:34.270Z [CURL DBG] > User-Agent: s3fs/1.94 (commit hash unknown; OpenSSL)
2024-04-24T22:24:34.270Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=ASIASCNHIMKGMCGUPMQP/20240424/eu-north-1/s3/aws4_request, SignedHeaders=content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-atime;x-amz-meta-ctime;x-amz-meta-gid;x-amz-meta-mode;x-amz-meta-mtime;x-amz-meta-uid;x-amz-security-token;x-amz-storage-class, Signature=aeea50e67510bee2f3d5266e0d2975ced8da12ab8cb9b06690ae21082242cb1b
2024-04-24T22:24:34.270Z [CURL DBG] > Content-Type: application/octet-stream
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-date: 20240424T222434Z
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-atime: 1713997441.553519259
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-ctime: 1713997441.553519259
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-gid: 1003
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-mode: 33188
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-mtime: 1713997441.553519259
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-uid: 1002
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-security-token: IQoJb3JpZ2luX2VjEE4aCmV1LW5vcnRoLTEiRzBFAiBXIRyBtXq+wtEPwS7plC2l9hOpRHxnKWEzBhcraUPw5wIhAL/5QGRk0lFGz0G6G6dEwxCmmuTlecn8Xo93MqLPrz6vKsUFCJf//////////wEQAhoMMTQyNjIxNTY1NTgwIgyXknktizbOQjTj4/MqmQVaNa+UFuRV84TMANFRRa4xRguz4hAHctQZYRcAX2neVkCFAimC9d6q3GQu2mn6zDVCEcmd5DKDS5wF5GotjOmM81r3pStveL03WU220xzNWorcD17BUAv/HFdTeNNffQiAbaTjg0MPBtuJAsfRMd4o3/ccaHgF0YBM8yJZeBXp6oczStRk1NiKhKGzt3fhXjUDxKlLVDR4ynNSFencj52zmxMGmoSLVzMJC/qU9ULGIowKUpTQDdO+1hAstsU7vlVeDsXlTTPYr+fGQFmHj16EcKHALZH2t4VPER7p7TBBsQ4odNcnqsn9rWKTTVAKAKu9BjhjiYcN6yursbjqe2E4vzneXwphTy3frn7O+9rPHFozFcwxRjTur7d2M8kTkilTJGOlhgdXXSojhVWglF4/KTVLevj0LAhTcBRaq7zFiCvlYtLMNzCCH/52VqcbB9jM6c0P19vE4QMoA01VW2WjEmd25DQNN7XgVlFxwXa6fC46oK+tlug3tZsdSytYHIgW9lgTcXL9CIeCcwly/zXe9zMM+/CQedSdZ1cGJ1gaJw4KVwkyeHLzgJdPEUc2qKsf/TDJGKwsxAVnYRby/1b6sUzHaEouJxug7YHccw85V7N+T2B1sprLJeQQmJKv2ZxqzmRL2E/zZAKq52NFwXYuJVMzNHlVCLGzIX4MS8ZkV9TnmwuWn3r9IC/TzoSHO+eEgxOBkJSqYNapmoy9Ys3faEYxugDJknINf7yISTXq8mMtGHwlNOeGCczie34glxqgP9dpGUsMLVSnXDSI7n/q9pogq9J+M9nubiq9DRtja93LgkVLLA3xhq/RXFpdhDwwdoGyaUUrVbQix94d9Ti4P/czSLdXepHQ7Sp4aXUIFkqiQlHFyIIqiTDGi6axBjqxAU4Rck5oSLE7ZUYfRXD7GMnV/XOi0M/J4NMoavU8s4nWH54Li5YCgyXzPwauSBrPqcfRApiRxs9nANg4whoKwnQp8GZ4ftZcyR595PBhUK44caUV+CEkEeKL810y8u4bRmDRTN48LIeH3VdhHztA6yTtovdGIaHwBoFsueEX5TJkDCrF1CJN/dREpp9m/H+NsZiEhS/gEgBmUKu/s0KrfAvZm6Y2ne9mzauqQ/YM4jprhQ==
2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-storage-class: INTELLIGENT_TIERING
2024-04-24T22:24:34.270Z [CURL DBG] > Content-Length: 0
2024-04-24T22:24:34.270Z [CURL DBG] >
2024-04-24T22:24:34.363Z [CURL DBG] < HTTP/1.1 200 OK
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-id-2: 74zWd+iINNV1/n/Rl6UESVGYhx8vKfHBSLPcQxWtkAq36/8aO2Ok4WVExdhaDY128QaHPMUSh94=
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-request-id: 4V023HRWZ84QW760
2024-04-24T22:24:34.363Z [CURL DBG] < Date: Wed, 24 Apr 2024 22:24:35 GMT
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-abort-date: Fri, 26 Apr 2024 00:00:00 GMT
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-abort-rule-id: lifecycle
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-server-side-encryption: aws:kms
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-server-side-encryption-aws-kms-key-id: arn:aws:kms:eu-north-1:1837463830:key/f341ee1e-0db4-4542-adb1-66a8cf5e71f5
2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-server-side-encryption-bucket-key-enabled: true
2024-04-24T22:24:34.363Z [CURL DBG] < Transfer-Encoding: chunked
2024-04-24T22:24:34.363Z [CURL DBG] < Server: AmazonS3
2024-04-24T22:24:34.363Z [CURL DBG] <
2024-04-24T22:24:34.363Z [CURL DBG] * Connection #7 to host 1837463830-tf-tru-sftp.s3.amazonaws.com left intact

2024-04-24T22:24:34.363Z [INF] curl.cpp:RequestPerform(2495): HTTP response code 200
2024-04-24T22:24:34.363Z [DBG] curl_handlerpool.cpp:ReturnHandler(103): Return handler to pool
2024-04-24T22:24:34.363Z [INF] fdcache_entity.cpp:NoCacheLoadAndPost(1141): [path=/Advailo_test/Downloads.7z.filepart][physical_fd=7][offset=0][size=1073708064]
2024-04-24T22:25:55.315Z [INF] s3fs.cpp:s3fs_access(4346): [path=/][mask=X_OK ][pid=5074,uid=1002,gid=1003]
2024-04-24T22:25:55.315Z [DBG] s3fs.cpp:check_object_access(750): [path=/]
2024-04-24T22:25:55.315Z [DBG] s3fs.cpp:check_object_access(755): [pid=5074,uid=1002,gid=1003]
2024-04-24T22:25:55.315Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/]
2024-04-24T22:25:55.315Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=13]
2024-04-24T22:25:55.354Z [INF] s3fs.cpp:s3fs_getattr(1008): [path=/][pid=5074,uid=1002,gid=1003]
2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:check_parent_object_access(857): [path=/]
2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:check_object_access(750): [path=/]
2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:check_object_access(755): [pid=5074,uid=1002,gid=1003]
2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/]
2024-04-24T22:25:55.354Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=14]
2024-04-24T22:25:55.354Z [DBG] fdcache.cpp:OpenExistFdEntity(674): [path=/][flags=0x0]
2024-04-24T22:25:55.354Z [DBG] fdcache.cpp:Open(567): [path=/][size=-1][ts_mctime=0.1073741822][flags=0x0][force_tmpfile=no][create=no][ignore_modify=no]
2024-04-24T22:27:17.785Z [INF] s3fs.cpp:s3fs_access(4346): [path=/][mask=X_OK ][pid=5084,uid=1002,gid=1003]
2024-04-24T22:27:17.785Z [DBG] s3fs.cpp:check_object_access(750): [path=/]
2024-04-24T22:27:17.785Z [DBG] s3fs.cpp:check_object_access(755): [pid=5084,uid=1002,gid=1003]
2024-04-24T22:27:17.785Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/]
2024-04-24T22:27:17.785Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=15]
2024-04-24T22:27:17.820Z [INF] s3fs.cpp:s3fs_getattr(1008): [path=/][pid=5084,uid=1002,gid=1003]
2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:check_parent_object_access(857): [path=/]
2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:check_object_access(750): [path=/]
2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:check_object_access(755): [pid=5084,uid=1002,gid=1003]
2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/]
2024-04-24T22:27:17.820Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=16]
2024-04-24T22:27:17.820Z [DBG] fdcache.cpp:OpenExistFdEntity(674): [path=/][flags=0x0]
2024-04-24T22:27:17.820Z [DBG] fdcache.cpp:Open(567): [path=/][size=-1][ts_mctime=0.1073741822][flags=0x0][force_tmpfile=no][create=no][ignore_modify=no]

Details about issue

Hi!
I have a issue with uploading files to S3 bucket, larger than precise 1GB. I can upload 950MB file or plenty of 950MB files at the same time without problems. If I try to upload 1.05GB file, it will upload it until 1GB and then freeze. At that moment mount is dead. I can't do anything with it.
If I try to umount that mount in console - nothing happens and console freezes. I need to reconnect to instance to be able to work in console, but mount is still stuck. Only solution - rebooting instance.

User uses windows 10/11 and winscp/filezilla. User has his root directory reconfigured to /home/user/uploads/ where /uploads/ is mounted to S3 bucket. User connects to our instance through sFTP and gets straight in /uploads/ (s3 mount) and there uploads/downloads files.

Users uses optical 1Gbps up/down wired connection to his PC. Also tested on different ISP and computers.
Download is not impacted. I uploaded straight to S3 bucket a 2GB file and downloaded it without any problem. Tried to upload the same file through my sFTP --> S3FS mount and it freezes at 1GB precise.
If this would be Rocky Linux sFTP related then s3fs mount shouldn't be affected, but I cannot unmount or list that mount until full reboot.

Ekrānuzņēmums 2024-04-24 231758

Could there be a some tmp/cache issue on linux side, where I need to increase some partition sizes or some variables?
Ekrānuzņēmums 2024-04-25 141250

Originally created by @starislv on GitHub (Apr 25, 2024). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/2447 <!-- -------------------------------------------------------------------------- The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all. Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD. --------------------------------------------------------------------------- --> ### Additional Information #### Version of s3fs being used (`s3fs --version`) **Amazon Simple Storage Service File System V1.94 (commit:unknown) with OpenSSL** #### Version of fuse being used (`pkg-config --modversion fuse`, `rpm -qi fuse` or `dpkg -s fuse`) **Name : fuse Version : 2.9.7 Release : 17.el8 Architecture: aarch64** **Installed Packages Name : s3fs-fuse Version : 1.94 Release : 1.el8 Architecture : aarch64** #### Kernel information (`uname -r`) **4.18.0-513.18.1.el8_9.aarch64** #### GNU/Linux Distribution, if applicable (`cat /etc/os-release`) **Rocky Linux release 8.9 (Green Obsidian)** #### How to run s3fs, if applicable **${s3}:/$SFTP_USER /home/$SFTP_USER/uploads fuse.s3fs _netdev,nonempty,allow_other,iam_role=auto,uid=$USRUID,gid=$USRGID,storage_class=intelligent_tiering,ensure_diskfree=5120,list_object_max_keys=4000,max_stat_cache_size=400000,dbglevel=debug,curldbg,endpoint=eu-north-1,logfile=/home/someuser/s3.log 0 0** <!-- Executed command line or /etc/fastab entry --> ``` ``` #### s3fs syslog messages (`grep s3fs /var/log/syslog`, `journalctl | grep s3fs`, or `s3fs outputs`) The logfile=/home/someuser/s3.log is 42MB in size so I will copy out the last part. At the beginning are the data for every copied chunk (i suppose) and they are many. When my upload do freeze, it still outputs the same identical "2024-04-24T22:24:34.004Z [DBG] s3fs.cpp:s3fs_write(2942)" until my software (WinSCP/Filezilla on Windows11/Windows10) timeouts connection. Then s3.log outputs the last part which consists of retries to reconnect. In my case we have also added sftp users homedir to /home/sftpuser/uploads/ so when mount do freeze, user cannot read his homedir and connection gets timed out. 2024-04-24T22:24:34.250Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=31840][offset=1073610752][pseudo_fd=2][pid=5035,uid=1002,gid=1003] 2024-04-24T22:24:34.250Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2] 2024-04-24T22:24:34.250Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073610752][size=31840] 2024-04-24T22:24:34.250Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073610752][size=31840] 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [ 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073642592 : tag=49163} 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ] 2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=32736][offset=1073642592][pseudo_fd=2][pid=5035,uid=1002,gid=1003] 2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073642592][size=32736] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073642592][size=32736] 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [ 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073675328 : tag=49164} 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ] 2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=960][offset=1073675328][pseudo_fd=2][pid=5035,uid=1002,gid=1003] 2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073675328][size=960] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073675328][size=960] 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [ 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073676288 : tag=49165} 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ] 2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=31776][offset=1073676288][pseudo_fd=2][pid=5035,uid=1002,gid=1003] 2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073676288][size=31776] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073676288][size=31776] 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(263): untreated list = [ 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(265): {00000000000000 - 00001073708064 : tag=49166} 2024-04-24T22:24:34.251Z [DBG] fdcache_untreated.cpp:Dump(267): ] 2024-04-24T22:24:34.251Z [DBG] s3fs.cpp:s3fs_write(2942): [path=/Advailo_test/Downloads.7z.filepart][size=32736][offset=1073708064][pseudo_fd=2][pid=5035,uid=1002,gid=1003] 2024-04-24T22:24:34.251Z [DBG] fdcache.cpp:GetExistFdEntity(657): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:Write(2076): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073708064][size=32736] 2024-04-24T22:24:34.251Z [DBG] fdcache_entity.cpp:WriteMixMultipart(2289): [path=/Advailo_test/Downloads.7z.filepart][pseudo_fd=2][physical_fd=7][offset=1073708064][size=32736] 2024-04-24T22:24:34.251Z [INF] curl.cpp:PreMultipartPostRequest(3766): [tpath=/Advailo_test/Downloads.7z.filepart] 2024-04-24T22:24:34.251Z [DBG] curl_handlerpool.cpp:GetHandler(83): Get handler from pool: rest = 31 2024-04-24T22:24:34.251Z [INF] curl_util.cpp:prepare_url(210): URL is https://s3.amazonaws.com/1837463830-tf-tru-sftp/some/Advailo_test/Downloads.7z.filepart?uploads 2024-04-24T22:24:34.251Z [INF] curl_util.cpp:prepare_url(243): URL changed is https://1837463830-tf-tru-sftp.s3.amazonaws.com/tvkurzeme/Advailo_test/Downloads.7z.filepart?uploads 2024-04-24T22:24:34.252Z [DBG] curl.cpp:RequestPerform(2460): connecting to URL https://1837463830-tf-tru-sftp.s3.amazonaws.com/tvkurzeme/Advailo_test/Downloads.7z.filepart?uploads 2024-04-24T22:24:34.252Z [INF] curl.cpp:insertV4Headers(2847): computing signature [POST] [/tvkurzeme/Advailo_test/Downloads.7z.filepart] [uploads] [] 2024-04-24T22:24:34.252Z [INF] curl_util.cpp:url_to_host(265): url is https://s3.amazonaws.com 2024-04-24T22:24:34.252Z [CURL DBG] * Connection 6 seems to be dead! 2024-04-24T22:24:34.252Z [CURL DBG] * Closing connection 6 2024-04-24T22:24:34.252Z [CURL DBG] * TLSv1.2 (OUT), TLS alert, close notify (256): 2024-04-24T22:24:34.257Z [CURL DBG] * Trying 16.12.9.27... 2024-04-24T22:24:34.257Z [CURL DBG] * TCP_NODELAY set 2024-04-24T22:24:34.258Z [CURL DBG] * Connected to 1837463830-tf-tru-sftp.s3.amazonaws.com (16.12.9.27) port 443 (#7) 2024-04-24T22:24:34.265Z [CURL DBG] * successfully set certificate verify locations: 2024-04-24T22:24:34.265Z [CURL DBG] * CAfile: /etc/pki/tls/certs/ca-bundle.crt CApath: none 2024-04-24T22:24:34.265Z [CURL DBG] * SSL re-using session ID 2024-04-24T22:24:34.265Z [CURL DBG] * TLSv1.3 (OUT), TLS handshake, Client hello (1): 2024-04-24T22:24:34.266Z [CURL DBG] * TLSv1.3 (IN), TLS handshake, Server hello (2): 2024-04-24T22:24:34.267Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Certificate (11): 2024-04-24T22:24:34.267Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Server key exchange (12): 2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Server finished (14): 2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Client key exchange (16): 2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1): 2024-04-24T22:24:34.268Z [CURL DBG] * TLSv1.2 (OUT), TLS handshake, Finished (20): 2024-04-24T22:24:34.270Z [CURL DBG] * TLSv1.2 (IN), TLS handshake, Finished (20): 2024-04-24T22:24:34.270Z [CURL DBG] * SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256 2024-04-24T22:24:34.270Z [CURL DBG] * old SSL session ID is stale, removing 2024-04-24T22:24:34.270Z [CURL DBG] * Server certificate: 2024-04-24T22:24:34.270Z [CURL DBG] * subject: CN=*.s3.amazonaws.com 2024-04-24T22:24:34.270Z [CURL DBG] * start date: Oct 10 00:00:00 2023 GMT 2024-04-24T22:24:34.270Z [CURL DBG] * expire date: Jul 3 23:59:59 2024 GMT 2024-04-24T22:24:34.270Z [CURL DBG] * subjectAltName: host "1837463830-tf-tru-sftp.s3.amazonaws.com" matched cert's "*.s3.amazonaws.com" 2024-04-24T22:24:34.270Z [CURL DBG] * issuer: C=US; O=Amazon; CN=Amazon RSA 2048 M01 2024-04-24T22:24:34.270Z [CURL DBG] * SSL certificate verify ok. 2024-04-24T22:24:34.270Z [CURL DBG] > POST /tvkurzeme/Advailo_test/Downloads.7z.filepart?uploads HTTP/1.1 2024-04-24T22:24:34.270Z [CURL DBG] > Host: 1837463830-tf-tru-sftp.s3.amazonaws.com 2024-04-24T22:24:34.270Z [CURL DBG] > User-Agent: s3fs/1.94 (commit hash unknown; OpenSSL) 2024-04-24T22:24:34.270Z [CURL DBG] > Authorization: AWS4-HMAC-SHA256 Credential=ASIASCNHIMKGMCGUPMQP/20240424/eu-north-1/s3/aws4_request, SignedHeaders=content-type;host;x-amz-content-sha256;x-amz-date;x-amz-meta-atime;x-amz-meta-ctime;x-amz-meta-gid;x-amz-meta-mode;x-amz-meta-mtime;x-amz-meta-uid;x-amz-security-token;x-amz-storage-class, Signature=aeea50e67510bee2f3d5266e0d2975ced8da12ab8cb9b06690ae21082242cb1b 2024-04-24T22:24:34.270Z [CURL DBG] > Content-Type: application/octet-stream 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-date: 20240424T222434Z 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-atime: 1713997441.553519259 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-ctime: 1713997441.553519259 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-gid: 1003 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-mode: 33188 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-mtime: 1713997441.553519259 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-meta-uid: 1002 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-security-token: IQoJb3JpZ2luX2VjEE4aCmV1LW5vcnRoLTEiRzBFAiBXIRyBtXq+wtEPwS7plC2l9hOpRHxnKWEzBhcraUPw5wIhAL/5QGRk0lFGz0G6G6dEwxCmmuTlecn8Xo93MqLPrz6vKsUFCJf//////////wEQAhoMMTQyNjIxNTY1NTgwIgyXknktizbOQjTj4/MqmQVaNa+UFuRV84TMANFRRa4xRguz4hAHctQZYRcAX2neVkCFAimC9d6q3GQu2mn6zDVCEcmd5DKDS5wF5GotjOmM81r3pStveL03WU220xzNWorcD17BUAv/HFdTeNNffQiAbaTjg0MPBtuJAsfRMd4o3/ccaHgF0YBM8yJZeBXp6oczStRk1NiKhKGzt3fhXjUDxKlLVDR4ynNSFencj52zmxMGmoSLVzMJC/qU9ULGIowKUpTQDdO+1hAstsU7vlVeDsXlTTPYr+fGQFmHj16EcKHALZH2t4VPER7p7TBBsQ4odNcnqsn9rWKTTVAKAKu9BjhjiYcN6yursbjqe2E4vzneXwphTy3frn7O+9rPHFozFcwxRjTur7d2M8kTkilTJGOlhgdXXSojhVWglF4/KTVLevj0LAhTcBRaq7zFiCvlYtLMNzCCH/52VqcbB9jM6c0P19vE4QMoA01VW2WjEmd25DQNN7XgVlFxwXa6fC46oK+tlug3tZsdSytYHIgW9lgTcXL9CIeCcwly/zXe9zMM+/CQedSdZ1cGJ1gaJw4KVwkyeHLzgJdPEUc2qKsf/TDJGKwsxAVnYRby/1b6sUzHaEouJxug7YHccw85V7N+T2B1sprLJeQQmJKv2ZxqzmRL2E/zZAKq52NFwXYuJVMzNHlVCLGzIX4MS8ZkV9TnmwuWn3r9IC/TzoSHO+eEgxOBkJSqYNapmoy9Ys3faEYxugDJknINf7yISTXq8mMtGHwlNOeGCczie34glxqgP9dpGUsMLVSnXDSI7n/q9pogq9J+M9nubiq9DRtja93LgkVLLA3xhq/RXFpdhDwwdoGyaUUrVbQix94d9Ti4P/czSLdXepHQ7Sp4aXUIFkqiQlHFyIIqiTDGi6axBjqxAU4Rck5oSLE7ZUYfRXD7GMnV/XOi0M/J4NMoavU8s4nWH54Li5YCgyXzPwauSBrPqcfRApiRxs9nANg4whoKwnQp8GZ4ftZcyR595PBhUK44caUV+CEkEeKL810y8u4bRmDRTN48LIeH3VdhHztA6yTtovdGIaHwBoFsueEX5TJkDCrF1CJN/dREpp9m/H+NsZiEhS/gEgBmUKu/s0KrfAvZm6Y2ne9mzauqQ/YM4jprhQ== 2024-04-24T22:24:34.270Z [CURL DBG] > x-amz-storage-class: INTELLIGENT_TIERING 2024-04-24T22:24:34.270Z [CURL DBG] > Content-Length: 0 2024-04-24T22:24:34.270Z [CURL DBG] > 2024-04-24T22:24:34.363Z [CURL DBG] < HTTP/1.1 200 OK 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-id-2: 74zWd+iINNV1/n/Rl6UESVGYhx8vKfHBSLPcQxWtkAq36/8aO2Ok4WVExdhaDY128QaHPMUSh94= 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-request-id: 4V023HRWZ84QW760 2024-04-24T22:24:34.363Z [CURL DBG] < Date: Wed, 24 Apr 2024 22:24:35 GMT 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-abort-date: Fri, 26 Apr 2024 00:00:00 GMT 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-abort-rule-id: lifecycle 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-server-side-encryption: aws:kms 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-server-side-encryption-aws-kms-key-id: arn:aws:kms:eu-north-1:1837463830:key/f341ee1e-0db4-4542-adb1-66a8cf5e71f5 2024-04-24T22:24:34.363Z [CURL DBG] < x-amz-server-side-encryption-bucket-key-enabled: true 2024-04-24T22:24:34.363Z [CURL DBG] < Transfer-Encoding: chunked 2024-04-24T22:24:34.363Z [CURL DBG] < Server: AmazonS3 2024-04-24T22:24:34.363Z [CURL DBG] < 2024-04-24T22:24:34.363Z [CURL DBG] * Connection #7 to host 1837463830-tf-tru-sftp.s3.amazonaws.com left intact 2024-04-24T22:24:34.363Z [INF] curl.cpp:RequestPerform(2495): HTTP response code 200 2024-04-24T22:24:34.363Z [DBG] curl_handlerpool.cpp:ReturnHandler(103): Return handler to pool 2024-04-24T22:24:34.363Z [INF] fdcache_entity.cpp:NoCacheLoadAndPost(1141): [path=/Advailo_test/Downloads.7z.filepart][physical_fd=7][offset=0][size=1073708064] 2024-04-24T22:25:55.315Z [INF] s3fs.cpp:s3fs_access(4346): [path=/][mask=X_OK ][pid=5074,uid=1002,gid=1003] 2024-04-24T22:25:55.315Z [DBG] s3fs.cpp:check_object_access(750): [path=/] 2024-04-24T22:25:55.315Z [DBG] s3fs.cpp:check_object_access(755): [pid=5074,uid=1002,gid=1003] 2024-04-24T22:25:55.315Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/] 2024-04-24T22:25:55.315Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=13] 2024-04-24T22:25:55.354Z [INF] s3fs.cpp:s3fs_getattr(1008): [path=/][pid=5074,uid=1002,gid=1003] 2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:check_parent_object_access(857): [path=/] 2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:check_object_access(750): [path=/] 2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:check_object_access(755): [pid=5074,uid=1002,gid=1003] 2024-04-24T22:25:55.354Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/] 2024-04-24T22:25:55.354Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=14] 2024-04-24T22:25:55.354Z [DBG] fdcache.cpp:OpenExistFdEntity(674): [path=/][flags=0x0] 2024-04-24T22:25:55.354Z [DBG] fdcache.cpp:Open(567): [path=/][size=-1][ts_mctime=0.1073741822][flags=0x0][force_tmpfile=no][create=no][ignore_modify=no] 2024-04-24T22:27:17.785Z [INF] s3fs.cpp:s3fs_access(4346): [path=/][mask=X_OK ][pid=5084,uid=1002,gid=1003] 2024-04-24T22:27:17.785Z [DBG] s3fs.cpp:check_object_access(750): [path=/] 2024-04-24T22:27:17.785Z [DBG] s3fs.cpp:check_object_access(755): [pid=5084,uid=1002,gid=1003] 2024-04-24T22:27:17.785Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/] 2024-04-24T22:27:17.785Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=15] 2024-04-24T22:27:17.820Z [INF] s3fs.cpp:s3fs_getattr(1008): [path=/][pid=5084,uid=1002,gid=1003] 2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:check_parent_object_access(857): [path=/] 2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:check_object_access(750): [path=/] 2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:check_object_access(755): [pid=5084,uid=1002,gid=1003] 2024-04-24T22:27:17.820Z [DBG] s3fs.cpp:get_object_attribute(516): [path=/] 2024-04-24T22:27:17.820Z [DBG] cache.cpp:GetStat(262): stat cache hit [path=/][time=122.306488130][hit count=16] 2024-04-24T22:27:17.820Z [DBG] fdcache.cpp:OpenExistFdEntity(674): [path=/][flags=0x0] 2024-04-24T22:27:17.820Z [DBG] fdcache.cpp:Open(567): [path=/][size=-1][ts_mctime=0.1073741822][flags=0x0][force_tmpfile=no][create=no][ignore_modify=no] ### Details about issue **Hi! I have a issue with uploading files to S3 bucket, larger than precise 1GB. I can upload 950MB file or plenty of 950MB files at the same time without problems. If I try to upload 1.05GB file, it will upload it until 1GB and then freeze. At that moment mount is dead. I can't do anything with it. If I try to umount that mount in console - nothing happens and console freezes. I need to reconnect to instance to be able to work in console, but mount is still stuck. Only solution - rebooting instance.** User uses windows 10/11 and winscp/filezilla. User has his root directory reconfigured to /home/user/uploads/ where /uploads/ is mounted to S3 bucket. User connects to our instance through sFTP and gets straight in /uploads/ (s3 mount) and there uploads/downloads files. Users uses optical 1Gbps up/down wired connection to his PC. Also tested on different ISP and computers. Download is not impacted. I uploaded straight to S3 bucket a 2GB file and downloaded it without any problem. Tried to upload the same file through my sFTP --> S3FS mount and it freezes at 1GB precise. If this would be Rocky Linux sFTP related then s3fs mount shouldn't be affected, but I cannot unmount or list that mount until full reboot. ![Ekrānuzņēmums 2024-04-24 231758](https://github.com/s3fs-fuse/s3fs-fuse/assets/102369195/b27dad6c-b06e-40e3-ab37-05e7687ad52d) Could there be a some tmp/cache issue on linux side, where I need to increase some partition sizes or some variables? ![Ekrānuzņēmums 2024-04-25 141250](https://github.com/s3fs-fuse/s3fs-fuse/assets/102369195/e12721e3-de30-4d3d-b92c-57db8ce8cc36)
kerem closed this issue 2026-03-04 01:52:13 +03:00
Author
Owner

@starislv commented on GitHub (Apr 29, 2024):

Fixed by increasing /

<!-- gh-comment-id:2083716227 --> @starislv commented on GitHub (Apr 29, 2024): Fixed by increasing /
Author
Owner

@jtarun4625 commented on GitHub (Jul 8, 2024):

What did you increase ?

<!-- gh-comment-id:2213096792 --> @jtarun4625 commented on GitHub (Jul 8, 2024): What did you increase ?
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#1208
No description provided.