starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 05:16:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #23] curl ssl problems #14

New issue
Closed
opened 2026-03-04 01:41:10 +03:00 by kerem · 5 comments
kerem commented 2026-03-04 01:41:10 +03:00
Owner
Copy link

Originally created by @h0nIg on GitHub (Mar 7, 2014).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/23

as described on

https://code.google.com/p/s3fs/issues/detail?id=343&can=1
https://code.google.com/p/s3fs/issues/detail?id=257&can=1
https://code.google.com/p/s3fs/issues/detail?id=235&can=1

the problem with curl error 35 (CURLE_SSL_CONNECT_ERROR) still exists with version 1.74. on my case it was caused by a heavy mv with 180 files, 1gb per file

system: ubuntu 12.04

Mar  7 10:04:30 vm s3fs: connecting to URL https://bucket123.s3-eu-west-1.amazonaws.com?delimiter=/&prefix=path/file/&max-keys=1000
Mar  7 10:04:30 vm s3fs: HTTP response code 200
Mar  7 10:04:30 vm s3fs: contents_xp->nodesetval is empty.
Mar  7 10:04:30 vm s3fs: contents_xp->nodesetval is empty.
Mar  7 10:04:30 vm s3fs: copying... [path=/path/file]
Mar  7 10:04:30 vm s3fs: connecting to URL https://bucket123.s3-eu-west-1.amazonaws.com/path/file
Mar  7 10:06:13 vm s3fs: ### CURLE_RECV_ERROR
Mar  7 10:06:15 vm s3fs: ### retrying...
Mar  7 10:06:15 vm s3fs: Retry request. [type=2][url=https://bucket123.s3-eu-west-1.amazonaws.com/path/file][path=/path/file]
Mar  7 10:06:15 vm s3fs: ###curlCode: 35  msg: SSL connect error
Originally created by @h0nIg on GitHub (Mar 7, 2014). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/23 as described on https://code.google.com/p/s3fs/issues/detail?id=343&can=1 https://code.google.com/p/s3fs/issues/detail?id=257&can=1 https://code.google.com/p/s3fs/issues/detail?id=235&can=1 the problem with curl error 35 (CURLE_SSL_CONNECT_ERROR) still exists with version 1.74. on my case it was caused by a heavy mv with 180 files, 1gb per file system: ubuntu 12.04 ``` Mar 7 10:04:30 vm s3fs: connecting to URL https://bucket123.s3-eu-west-1.amazonaws.com?delimiter=/&prefix=path/file/&max-keys=1000 Mar 7 10:04:30 vm s3fs: HTTP response code 200 Mar 7 10:04:30 vm s3fs: contents_xp->nodesetval is empty. Mar 7 10:04:30 vm s3fs: contents_xp->nodesetval is empty. Mar 7 10:04:30 vm s3fs: copying... [path=/path/file] Mar 7 10:04:30 vm s3fs: connecting to URL https://bucket123.s3-eu-west-1.amazonaws.com/path/file Mar 7 10:06:13 vm s3fs: ### CURLE_RECV_ERROR Mar 7 10:06:15 vm s3fs: ### retrying... Mar 7 10:06:15 vm s3fs: Retry request. [type=2][url=https://bucket123.s3-eu-west-1.amazonaws.com/path/file][path=/path/file] Mar 7 10:06:15 vm s3fs: ###curlCode: 35 msg: SSL connect error ```
kerem closed this issue 2026-03-04 01:41:11 +03:00
kerem commented 2026-03-04 01:41:12 +03:00
Author
Owner
Copy link

@worpet commented on GitHub (Mar 19, 2014):

I am also seeing this issue with the latest version. I cannot consistently reproduce it, but it seems to most often happen during heavy usage, like when copying many files.

curl --version
curl 7.32.0 (x86_64-redhat-linux-gnu) libcurl/7.32.0 NSS/3.15.2 zlib/1.2.8 libidn/1.28 libssh2/1.4.3
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp scp sftp smtp smtps telnet tftp
Features: AsynchDNS GSS-Negotiate IDN IPv6 Largefile NTLM NTLM_WB SSL libz Metalink

When it breaks, in /var/log/messages this line appears:

###curlCode: 35  msg: SSL connect error
<!-- gh-comment-id:38049948 --> @worpet commented on GitHub (Mar 19, 2014): I am also seeing this issue with the latest version. I cannot consistently reproduce it, but it seems to most often happen during heavy usage, like when copying many files. ``` curl --version curl 7.32.0 (x86_64-redhat-linux-gnu) libcurl/7.32.0 NSS/3.15.2 zlib/1.2.8 libidn/1.28 libssh2/1.4.3 Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp scp sftp smtp smtps telnet tftp Features: AsynchDNS GSS-Negotiate IDN IPv6 Largefile NTLM NTLM_WB SSL libz Metalink ``` When it breaks, in /var/log/messages this line appears: ``` ###curlCode: 35 msg: SSL connect error ```
kerem commented 2026-03-04 01:41:12 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Mar 21, 2014):

I fixed a bug against #18, and branched codes as "bugfix#18" .
The bug is in retries logic, and I think that as possibly these ssl connect error is caused by it.
("... Retry request. [type=2]..." message in your log.)

If you can, please use "bugfix#18" branch and check it.
Thanks in advance for your help.

<!-- gh-comment-id:38279011 --> @ggtakec commented on GitHub (Mar 21, 2014): I fixed a bug against #18, and branched codes as "bugfix#18" . The bug is in retries logic, and I think that as possibly these ssl connect error is caused by it. ("... Retry request. [type=2]..." message in your log.) If you can, please use "bugfix#18" branch and check it. Thanks in advance for your help.
kerem commented 2026-03-04 01:41:12 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Mar 22, 2014):

I'm sorry, your problem is not same as #18 (which is error in parallel request).
I continue this problem and check it.
Regards.

<!-- gh-comment-id:38354755 --> @ggtakec commented on GitHub (Mar 22, 2014): I'm sorry, your problem is not same as #18 (which is error in parallel request). I continue this problem and check it. Regards.
kerem commented 2026-03-04 01:41:12 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Apr 4, 2014):

I have beed checked this ssl error reason(from on googlecodes), but could not find it.
I think the reason maybe depends on users network or etc.
So, I added error handling for CURLE_SSL_CONNECT_ERROR in curl.cpp.
If CURLE_SSL_CONNECT_ERROR is occurred, s3fs waits 2 second and retry to send last request again after waiting.

I commit new branch “sslproblem#23”, please try to use this branch and report results.

Regards,

<!-- gh-comment-id:39584554 --> @ggtakec commented on GitHub (Apr 4, 2014): I have beed checked this ssl error reason(from on googlecodes), but could not find it. I think the reason maybe depends on users network or etc. So, I added error handling for CURLE_SSL_CONNECT_ERROR in curl.cpp. If CURLE_SSL_CONNECT_ERROR is occurred, s3fs waits 2 second and retry to send last request again after waiting. I commit new branch “sslproblem#23”, please try to use this branch and report results. Regards,
kerem commented 2026-03-04 01:41:12 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Apr 19, 2014):

I merged #32 codes to master branch.
Please try to use it, and if you have same problem, please let me know.
I closed this issue, but you can reopen this issue when latest codes can not solve your problem.
Thanks.

<!-- gh-comment-id:40872951 --> @ggtakec commented on GitHub (Apr 19, 2014): I merged #32 codes to master branch. Please try to use it, and if you have same problem, please let me know. I closed this issue, but you can reopen this issue when latest codes can not solve your problem. Thanks.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#14
No description provided.