starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 05:16:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #565] Randomly Disconnect #321

New issue
Closed
opened 2026-03-04 01:44:22 +03:00 by kerem · 5 comments
kerem commented 2026-03-04 01:44:22 +03:00
Owner
Copy link

Originally created by @kenanchristian on GitHub (Apr 19, 2017).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/565

This is my command to mount the bucket.
s3fs peeqrprofile ./peeqr -o passwd_file=/config/s3fs -o multireq_max=5 -o use_cache=/tmp

Everything works well in the past, but now I got Transport endpoint is not connected very often. The only thing that changes is the instance size, I use the s3fs from master branch.

When I tried to use the -f and -d flag, it spits out this log. Anything wrong?

[CRT] s3fs.cpp:set_s3fs_log_level(253): change debug level from [CRT] to [INF]
[INF]     s3fs.cpp:set_moutpoint_attribute(4151): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40755)
[CRT] s3fs.cpp:s3fs_init(3334): init v1.80(commit:unknown) with OpenSSL
[INF] s3fs.cpp:s3fs_check_service(3708): check services.
[INF]       curl.cpp:CheckBucket(2860): check a bucket.
[INF]       curl.cpp:prepare_url(4175): URL is http://s3.amazonaws.com/peeqrprofile/
[INF]       curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3.amazonaws.com/
[INF]       curl.cpp:insertV4Headers(2237): computing signature [GET] [/] [] []
[INF]       curl.cpp:url_to_host(100): url is http://s3.amazonaws.com
[INF]       curl.cpp:RequestPerform(1922): HTTP response code 400 was returned, returning EIO.
[ERR] curl.cpp:CheckBucket(2899): Check bucket failed, S3 response: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'ap-southeast-1'</Message><Region>ap-southeast-1</Region><RequestId>F96CE8E39E89A30F</RequestId><HostId>ANnktNmxQhEOKyinW4oM9dRBsU6HwGf5LID2K0DnebOtg9nXKr6Eqo6DCXNA0GMW25I1dMtNdPs=</HostId></Error>
[CRT] s3fs.cpp:s3fs_check_service(3729): Could not connect wrong region us-east-1, so retry to connect region ap-southeast-1.
[INF]       curl.cpp:CheckBucket(2860): check a bucket.
[INF]       curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/
[INF]       curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/
[INF]       curl.cpp:insertV4Headers(2237): computing signature [GET] [/] [] []
[INF]       curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com
[INF]       curl.cpp:RequestPerform(1910): HTTP response code 200
[INF] s3fs.cpp:s3fs_getattr(808): [path=/logs]
[INF]       curl.cpp:HeadRequest(2486): [tpath=/logs]
[INF]       curl.cpp:PreHeadRequest(2423): [tpath=/logs][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs
[INF]       curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs
[INF]       curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs] [] []
[INF]       curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com
[INF]       curl.cpp:RequestPerform(1932): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(2486): [tpath=/logs/]
[INF]       curl.cpp:PreHeadRequest(2423): [tpath=/logs/][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs/
[INF]       curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs/
[INF]       curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs/] [] []
[INF]       curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com
[INF]       curl.cpp:RequestPerform(1910): HTTP response code 200
[INF]       cache.cpp:AddStat(346): add stat cache entry[path=/logs/]
[INF] s3fs.cpp:s3fs_getattr(808): [path=/logs/status.json]
[INF]       curl.cpp:HeadRequest(2486): [tpath=/logs/status.json]
[INF]       curl.cpp:PreHeadRequest(2423): [tpath=/logs/status.json][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs/status.json
[INF]       curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs/status.json
[INF]       curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs/status.json] [] []
[INF]       curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com
[INF]       curl.cpp:RequestPerform(1910): HTTP response code 200
[INF]       cache.cpp:AddStat(346): add stat cache entry[path=/logs/status.json]
[INF] s3fs.cpp:s3fs_getattr(808): [path=/logs/vid-stat.json]
[INF]       curl.cpp:HeadRequest(2486): [tpath=/logs/vid-stat.json]
[INF]       curl.cpp:PreHeadRequest(2423): [tpath=/logs/vid-stat.json][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs/vid-stat.json
[INF]       curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs/vid-stat.json
[INF]       curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs/vid-stat.json] [] []
[INF]       curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com
[INF]       curl.cpp:RequestPerform(1910): HTTP response code 200
[INF]       cache.cpp:AddStat(346): add stat cache entry[path=/logs/vid-stat.json]
Originally created by @kenanchristian on GitHub (Apr 19, 2017). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/565 This is my command to mount the bucket. `s3fs peeqrprofile ./peeqr -o passwd_file=/config/s3fs -o multireq_max=5 -o use_cache=/tmp` Everything works well in the past, but now I got `Transport endpoint is not connected` very often. The only thing that changes is the instance size, I use the s3fs from master branch. When I tried to use the `-f` and `-d` flag, it spits out this log. Anything wrong? ``` [CRT] s3fs.cpp:set_s3fs_log_level(253): change debug level from [CRT] to [INF] [INF] s3fs.cpp:set_moutpoint_attribute(4151): PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40755) [CRT] s3fs.cpp:s3fs_init(3334): init v1.80(commit:unknown) with OpenSSL [INF] s3fs.cpp:s3fs_check_service(3708): check services. [INF] curl.cpp:CheckBucket(2860): check a bucket. [INF] curl.cpp:prepare_url(4175): URL is http://s3.amazonaws.com/peeqrprofile/ [INF] curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3.amazonaws.com/ [INF] curl.cpp:insertV4Headers(2237): computing signature [GET] [/] [] [] [INF] curl.cpp:url_to_host(100): url is http://s3.amazonaws.com [INF] curl.cpp:RequestPerform(1922): HTTP response code 400 was returned, returning EIO. [ERR] curl.cpp:CheckBucket(2899): Check bucket failed, S3 response: <?xml version="1.0" encoding="UTF-8"?> <Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'ap-southeast-1'</Message><Region>ap-southeast-1</Region><RequestId>F96CE8E39E89A30F</RequestId><HostId>ANnktNmxQhEOKyinW4oM9dRBsU6HwGf5LID2K0DnebOtg9nXKr6Eqo6DCXNA0GMW25I1dMtNdPs=</HostId></Error> [CRT] s3fs.cpp:s3fs_check_service(3729): Could not connect wrong region us-east-1, so retry to connect region ap-southeast-1. [INF] curl.cpp:CheckBucket(2860): check a bucket. [INF] curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/ [INF] curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/ [INF] curl.cpp:insertV4Headers(2237): computing signature [GET] [/] [] [] [INF] curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com [INF] curl.cpp:RequestPerform(1910): HTTP response code 200 [INF] s3fs.cpp:s3fs_getattr(808): [path=/logs] [INF] curl.cpp:HeadRequest(2486): [tpath=/logs] [INF] curl.cpp:PreHeadRequest(2423): [tpath=/logs][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs [INF] curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs [INF] curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs] [] [] [INF] curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com [INF] curl.cpp:RequestPerform(1932): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(2486): [tpath=/logs/] [INF] curl.cpp:PreHeadRequest(2423): [tpath=/logs/][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs/ [INF] curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs/ [INF] curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs/] [] [] [INF] curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com [INF] curl.cpp:RequestPerform(1910): HTTP response code 200 [INF] cache.cpp:AddStat(346): add stat cache entry[path=/logs/] [INF] s3fs.cpp:s3fs_getattr(808): [path=/logs/status.json] [INF] curl.cpp:HeadRequest(2486): [tpath=/logs/status.json] [INF] curl.cpp:PreHeadRequest(2423): [tpath=/logs/status.json][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs/status.json [INF] curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs/status.json [INF] curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs/status.json] [] [] [INF] curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com [INF] curl.cpp:RequestPerform(1910): HTTP response code 200 [INF] cache.cpp:AddStat(346): add stat cache entry[path=/logs/status.json] [INF] s3fs.cpp:s3fs_getattr(808): [path=/logs/vid-stat.json] [INF] curl.cpp:HeadRequest(2486): [tpath=/logs/vid-stat.json] [INF] curl.cpp:PreHeadRequest(2423): [tpath=/logs/vid-stat.json][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4175): URL is http://s3-ap-southeast-1.amazonaws.com/peeqrprofile/logs/vid-stat.json [INF] curl.cpp:prepare_url(4207): URL changed is http://peeqrprofile.s3-ap-southeast-1.amazonaws.com/logs/vid-stat.json [INF] curl.cpp:insertV4Headers(2237): computing signature [HEAD] [/logs/vid-stat.json] [] [] [INF] curl.cpp:url_to_host(100): url is http://s3-ap-southeast-1.amazonaws.com [INF] curl.cpp:RequestPerform(1910): HTTP response code 200 [INF] cache.cpp:AddStat(346): add stat cache entry[path=/logs/vid-stat.json] ```
kerem closed this issue 2026-03-04 01:44:22 +03:00
kerem commented 2026-03-04 01:44:23 +03:00
Author
Owner
Copy link

@alexisgayte commented on GitHub (Apr 19, 2017):

+1,
It disconnected yesterday and today for me. I am using the V1.80.
I had to unmount and mount again.

<!-- gh-comment-id:295269161 --> @alexisgayte commented on GitHub (Apr 19, 2017): +1, It disconnected yesterday and today for me. I am using the V1.80. I had to unmount and mount again.
kerem commented 2026-03-04 01:44:23 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Apr 30, 2017):

@kenanchristian
Please try to specify retries option or if you can please try to use latest codes in master branch(with building it).
Thanks in advance for your assistance.

<!-- gh-comment-id:298241924 --> @ggtakec commented on GitHub (Apr 30, 2017): @kenanchristian Please try to specify retries option or if you can please try to use latest codes in master branch(with building it). Thanks in advance for your assistance.
kerem commented 2026-03-04 01:44:23 +03:00
Author
Owner
Copy link

@pikitgb commented on GitHub (Mar 14, 2018):

+1 here. This seems to be happening when transfering large amounts of files continuously

<!-- gh-comment-id:373187877 --> @pikitgb commented on GitHub (Mar 14, 2018): +1 here. This seems to be happening when transfering large amounts of files continuously
kerem commented 2026-03-04 01:44:23 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Mar 15, 2019):

If someone can reproduce these symptoms, please run with -f -d. If s3fs is crashing, try gdb so we can get a stack trace via bt.

<!-- gh-comment-id:473199801 --> @gaul commented on GitHub (Mar 15, 2019): If someone can reproduce these symptoms, please run with `-f -d`. If s3fs is crashing, try `gdb` so we can get a stack trace via `bt`.
kerem commented 2026-03-04 01:44:23 +03:00
Author
Owner
Copy link

@gaul commented on GitHub (Apr 9, 2019):

Closing due to inactivity. Please reopen if symptoms persist.

<!-- gh-comment-id:481186724 --> @gaul commented on GitHub (Apr 9, 2019): Closing due to inactivity. Please reopen if symptoms persist.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#321
No description provided.