starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 05:16:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #1252] create file in a mounted directory success, but modify and read would fail #671

New issue
Closed
opened 2026-03-04 01:47:44 +03:00 by kerem · 3 comments
kerem commented 2026-03-04 01:47:44 +03:00
Owner
Copy link

Originally created by @kathur2rain on GitHub (Mar 17, 2020).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1252

Version of s3fs being used (s3fs --version)

1.84

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

2.9.9

Kernel information (uname -r)

4.19.76-linuxkit

GNU/Linux Distribution, if applicable (cat /etc/os-release)

PRETTY_NAME="Debian GNU/Linux 10 (buster)"
NAME="Debian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

s3fs command line used, if applicable

s3fs "$MINIO_BUCKET" /tmp/qe -o allow_other,umask=0002,uid=`id -u`,gid=`id -g` -o nonempty,passwd_file=/etc/passwd-s3fs,use_path_request_style,url=http://"$MINIO_ENDPOINT"

s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)

did not see any output by these command.
i did manage to get some log output by set dbglevel=info and curldbg, but they are too long and most of them are normal message.

I just noticed that, in the log, Date was in GMT, but both my s3 server(which is minio) and my host machine are in UTC. I don't know if this matters.

< X-Amz-Meta-Gid: 0
< X-Amz-Meta-Mode: 33188
< X-Amz-Meta-Mtime: 1584602421
< X-Amz-Meta-Uid: 0
< X-Amz-Request-Id: 15FDA381B3445B26
< X-Xss-Protection: 1; mode=block
< Date: Thu, 19 Mar 2020 07:20:21 GMT

Details about issue

I built a docker environment, with devices: dev/fuse, cap_add: sys_admin, successfully I mounted my bucket to /tmp/qe and write some a .sqlite file (db file from sqlite) into disk with no error.
I wrote the file in my program, via python sqlite api and also i tried to use gdal create sqlite datasource, both worked for me.
I was able to read that sqlite file after download it, but everytime i try to read it via sqlite3 (sqlite client) in docker container, i got an error

root@d86f3abcc8ad:/# mount | grep s3fs
s3fs on /tmp/qe type fuse.s3fs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)

root@d86f3abcc8ad:/# cd tmp/qe/

root@d86f3abcc8ad:/tmp/qe# ls
41d9a041-170c-4411-ae1c-29f869df2b5f.sqlite  f6545143-1e8a-4060-b4c1-2d16444a79e4.sqlite

root@d86f3abcc8ad:/tmp/qe# sqlite3 41d9a041-170c-4411-ae1c-29f869df2b5f.sqlite 
Error: unable to open database "41d9a041-170c-4411-ae1c-29f869df2b5f.sqlite": unable to open database file

I guess it might be problem from mount permission, but i'm not able to find out a solution, could anyone provide hints?

update:
I just find that I can touch create a txt file in bash,

touch test.txt

but even

echo 123 > test.txt

return IO error

I updated this down below, seems I can create new empty file, or create new file with content, delete file. But I can't read existing file and I can't write to existing file.

Originally created by @kathur2rain on GitHub (Mar 17, 2020). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/1252 #### Version of s3fs being used (s3fs --version) 1.84 #### Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse) 2.9.9 #### Kernel information (uname -r) 4.19.76-linuxkit #### GNU/Linux Distribution, if applicable (cat /etc/os-release) PRETTY_NAME="Debian GNU/Linux 10 (buster)" NAME="Debian GNU/Linux" VERSION_ID="10" VERSION="10 (buster)" VERSION_CODENAME=buster ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/" #### s3fs command line used, if applicable ``` s3fs "$MINIO_BUCKET" /tmp/qe -o allow_other,umask=0002,uid=`id -u`,gid=`id -g` -o nonempty,passwd_file=/etc/passwd-s3fs,use_path_request_style,url=http://"$MINIO_ENDPOINT" ``` #### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs) did not see any output by these command. i did manage to get some log output by set dbglevel=info and curldbg, but they are too long and most of them are normal message. I just noticed that, in the log, Date was in GMT, but both my s3 server(which is minio) and my host machine are in UTC. I don't know if this matters. ``` < X-Amz-Meta-Gid: 0 < X-Amz-Meta-Mode: 33188 < X-Amz-Meta-Mtime: 1584602421 < X-Amz-Meta-Uid: 0 < X-Amz-Request-Id: 15FDA381B3445B26 < X-Xss-Protection: 1; mode=block < Date: Thu, 19 Mar 2020 07:20:21 GMT ``` ### Details about issue I built a docker environment, with devices: dev/fuse, cap_add: sys_admin, successfully I mounted my bucket to /tmp/qe and write some a .sqlite file (db file from sqlite) into disk with no error. I wrote the file in my program, via python sqlite api and also i tried to use gdal create sqlite datasource, both worked for me. I was able to read that sqlite file after download it, but everytime i try to read it via sqlite3 (sqlite client) in docker container, i got an error ``` root@d86f3abcc8ad:/# mount | grep s3fs s3fs on /tmp/qe type fuse.s3fs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other) root@d86f3abcc8ad:/# cd tmp/qe/ root@d86f3abcc8ad:/tmp/qe# ls 41d9a041-170c-4411-ae1c-29f869df2b5f.sqlite f6545143-1e8a-4060-b4c1-2d16444a79e4.sqlite root@d86f3abcc8ad:/tmp/qe# sqlite3 41d9a041-170c-4411-ae1c-29f869df2b5f.sqlite Error: unable to open database "41d9a041-170c-4411-ae1c-29f869df2b5f.sqlite": unable to open database file ``` I guess it might be problem from mount permission, but i'm not able to find out a solution, could anyone provide hints? update: I just find that I can touch create a txt file in bash, ``` touch test.txt ``` but even ``` echo 123 > test.txt ``` return IO error I updated this down below, seems I can create new empty file, or create new file with content, delete file. But I can't read existing file and I can't write to existing file.
kerem closed this issue 2026-03-04 01:47:45 +03:00
kerem commented 2026-03-04 01:47:45 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (Mar 21, 2020):

It looks like some error has occurred.
To find out the exact cause, you could run s3fs with the "-d" option for debug message, and you could get more communication information by "-o curldbg" option.
Please check the debug messages for any errors, and report it to us.

Thanks in advance for your assistance.

<!-- gh-comment-id:602022455 --> @ggtakec commented on GitHub (Mar 21, 2020): It looks like some error has occurred. To find out the exact cause, you could run s3fs with the "-d" option for debug message, and you could get more communication information by "-o curldbg" option. Please check the debug messages for any errors, and report it to us. Thanks in advance for your assistance.
kerem commented 2026-03-04 01:47:46 +03:00
Author
Owner
Copy link

@kathur2rain commented on GitHub (Mar 26, 2020):

hi, thanks for the reply, sorry for being late.
here's some of the debug information I copied from docker logs. I just selected a piece of them since there's no warning and no error just info pop up and I select the most recent ones. I think these logs may be related. there's a lot of logs, and all of them seem similar, I can't figure out the crucial ones.
will it because of the connection not released?

I can create new file with

root@462dcb97ebd0:/tmp/qe_solidify# echo '123' > test2.txt

and i can also delete it

root@462dcb97ebd0:/tmp/qe_solidify# rm test2.txt

however, read it is forbiddent

root@462dcb97ebd0:/tmp/qe_solidify# cat test.txt
cat: test.txt: Input/output error

< HTTP/1.1 404 Not Found
< Accept-Ranges: bytes
< Content-Length: 0
< Content-Security-Policy: block-all-mixed-content
< Server: MinIO/RELEASE.2020-03-09T18-26-53Z
< Vary: Origin
< X-Amz-Request-Id: 15FFCEEA7CA47556
< X-Xss-Protection: 1; mode=block
< Date: Thu, 26 Mar 2020 08:58:20 GMT
< 
* Connection #0 to host minio-minio left intact
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
* Expire in 300000 ms for 2 (transfer 0x7f25a00027d0)
* Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline]
* Could pipeline, but not asked to!
* Re-using existing connection! (#0) with host minio-minio
* Connected to minio-minio (172.29.0.3) port 9000 (#0)
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
> HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ HTTP/1.1
Host: minio-minio:9000
User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt))
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=dc83c3d6f0c46a434125d1b0f1aa8afaf2ccc860b68cd40a3890af70a67ffd26
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20200326T085820Z

< HTTP/1.1 404 Not Found
< Accept-Ranges: bytes
< Content-Length: 0
< Content-Security-Policy: block-all-mixed-content
< Server: MinIO/RELEASE.2020-03-09T18-26-53Z
< Vary: Origin
< X-Amz-Request-Id: 15FFCEEA7CAE2862
< X-Xss-Protection: 1; mode=block
< Date: Thu, 26 Mar 2020 08:58:20 GMT
< 
* Connection #0 to host minio-minio left intact
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
* Expire in 300000 ms for 2 (transfer 0x7f25a00027d0)
* Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline]
* Could pipeline, but not asked to!
* Re-using existing connection! (#0) with host minio-minio
* Connected to minio-minio (172.29.0.3) port 9000 (#0)
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
> HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_%24folder%24 HTTP/1.1
Host: minio-minio:9000
User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt))
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=10a12361586d55fccdf23ba0ecb108f16a97101eca1d89fb3628569d04ffd61f
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20200326T085820Z

< HTTP/1.1 404 Not Found
< Accept-Ranges: bytes
< Content-Length: 0
< Content-Security-Policy: block-all-mixed-content
< Server: MinIO/RELEASE.2020-03-09T18-26-53Z
< Vary: Origin
< X-Amz-Request-Id: 15FFCEEA7CB69374
< X-Xss-Protection: 1; mode=block
< Date: Thu, 26 Mar 2020 08:58:20 GMT
< 
* Connection #0 to host minio-minio left intact
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
* Expire in 300000 ms for 2 (transfer 0x7f25a00027d0)
* Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline]
* Could pipeline, but not asked to!
* Re-using existing connection! (#0) with host minio-minio
* Connected to minio-minio (172.29.0.3) port 9000 (#0)
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
> GET /datamap-qe-test/?delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ HTTP/1.1
Host: minio-minio:9000
User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt))
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c2e17e0d48eddb6adad8920ac113ecbfb6feb2060bac0327f38ad90be34f2c12
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20200326T085820Z

< HTTP/1.1 200 OK
< Accept-Ranges: bytes
< Content-Length: 310
< Content-Security-Policy: block-all-mixed-content
< Content-Type: application/xml
< Server: MinIO/RELEASE.2020-03-09T18-26-53Z
< Vary: Origin
< X-Amz-Request-Id: 15FFCEEA7CE41787
< X-Xss-Protection: 1; mode=block
< Date: Thu, 26 Mar 2020 08:58:20 GMT
< 
* Connection #0 to host minio-minio left intact
[INF]       cache.cpp:AddStat(356): add stat cache entry[path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite]
[INF] s3fs.cpp:s3fs_flush(2187): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5]
[INF]       fdcache.cpp:RowFlush(1441): [tpath=][path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5]
[INF] s3fs.cpp:s3fs_release(2240): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5]
[INF]       cache.cpp:DelStat(565): delete stat cache entry[path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite]
[INF]       fdcache.cpp:GetFdEntity(2020): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5]
[INF] s3fs.cpp:s3fs_getattr(843): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal]
[INF]       curl.cpp:HeadRequest(2716): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal]
[INF]       curl.cpp:PreHeadRequest(2665): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal
[INF]       curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal
[INF]       curl.cpp:insertV4Headers(2408): computing signature [HEAD] [/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal] [] []
[INF]       curl.cpp:url_to_host(101): url is http://minio-minio:9000
[INF]       curl.cpp:RequestPerform(2082): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(2716): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/]
[INF]       curl.cpp:PreHeadRequest(2665): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/
[INF]       curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/
[INF]       curl.cpp:insertV4Headers(2408): computing signature [HEAD] [/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/] [] []
[INF]       curl.cpp:url_to_host(101): url is http://minio-minio:9000
[INF]       curl.cpp:RequestPerform(2082): HTTP response code 404 was returned, returning ENOENT
[INF]       curl.cpp:HeadRequest(2716): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_$folder$]
[INF]       curl.cpp:PreHeadRequest(2665): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_$folder$][bpath=][save=][sseckeypos=-1]
[INF]       curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_%24folder%24
[INF]       curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_%24folder%24
[INF]       curl.cpp:insertV4Headers(2408): computing signature [HEAD] [/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_$folder$] [] []
[INF]       curl.cpp:url_to_host(101): url is http://minio-minio:9000
[INF]       curl.cpp:RequestPerform(2082): HTTP response code 404 was returned, returning ENOENT
[INF]   s3fs.cpp:list_bucket(2477): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal]
[INF]       curl.cpp:ListBucketRequest(3111): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal]
[INF]       curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test?delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/
[INF]       curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/?delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/
[INF]       curl.cpp:insertV4Headers(2408): computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/] []
[INF]       curl.cpp:url_to_host(101): url is http://minio-minio:9000
[INF]       curl.cpp:RequestPerform(2062): HTTP response code 200
[INF] s3fs.cpp:s3fs_open(2065): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][flags=32770]
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
* Expire in 300000 ms for 2 (transfer 0x7f25a00027d0)
* Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline]
* Could pipeline, but not asked to!
* Re-using existing connection! (#0) with host minio-minio
* Connected to minio-minio (172.29.0.3) port 9000 (#0)
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
> HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite HTTP/1.1
Host: minio-minio:9000
User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt))
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=8e8c8149b37b9427a73d42e2c4520c09d85e503439d24ff61c9d59969218327d
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20200326T085820Z

< HTTP/1.1 200 OK
< Accept-Ranges: bytes
< Content-Length: 24576
< Content-Security-Policy: block-all-mixed-content
< Content-Type: application/octet-stream
< ETag: "2038d9972fe78fdbe8853959f6c3ae02-1"
< Last-Modified: Thu, 26 Mar 2020 08:58:20 GMT
< Server: MinIO/RELEASE.2020-03-09T18-26-53Z
< Vary: Origin
< X-Amz-Meta-Gid: 0
< X-Amz-Meta-Mode: 33188
< X-Amz-Meta-Mtime: 1585213100
< X-Amz-Meta-Uid: 0
< X-Amz-Request-Id: 15FFCEEA84A5D989
< X-Xss-Protection: 1; mode=block
< Date: Thu, 26 Mar 2020 08:58:20 GMT
< 
* Connection #0 to host minio-minio left intact
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
* Expire in 300000 ms for 2 (transfer 0x7f25a00027d0)
* Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline]
* Could pipeline, but not asked to!
* Re-using existing connection! (#0) with host minio-minio
* Connected to minio-minio (172.29.0.3) port 9000 (#0)
* Expire in 0 ms for 6 (transfer 0x7f25a00027d0)
> HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite HTTP/1.1
Host: minio-minio:9000
User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt))
Accept: */*
Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=8e8c8149b37b9427a73d42e2c4520c09d85e503439d24ff61c9d59969218327d
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20200326T085820Z

< HTTP/1.1 200 OK
< Accept-Ranges: bytes
< Content-Length: 24576
< Content-Security-Policy: block-all-mixed-content
< Content-Type: application/octet-stream
< ETag: "2038d9972fe78fdbe8853959f6c3ae02-1"
< Last-Modified: Thu, 26 Mar 2020 08:58:20 GMT
< Server: MinIO/RELEASE.2020-03-09T18-26-53Z
< Vary: Origin
< X-Amz-Meta-Gid: 0
< X-Amz-Meta-Mode: 33188
< X-Amz-Meta-Mtime: 1585213100
< X-Amz-Meta-Uid: 0
< X-Amz-Request-Id: 15FFCEEA84F79A03
< X-Xss-Protection: 1; mode=block
< Date: Thu, 26 Mar 2020 08:58:20 GMT
< 
* Connection #0 to host minio-minio left intact
<!-- gh-comment-id:604313473 --> @kathur2rain commented on GitHub (Mar 26, 2020): hi, thanks for the reply, sorry for being late. here's some of the debug information I copied from docker logs. I just selected a piece of them since there's no warning and no error just info pop up and I select the most recent ones. I think these logs may be related. there's a lot of logs, and all of them seem similar, I can't figure out the crucial ones. will it because of the connection not released? I can create new file with ``` root@462dcb97ebd0:/tmp/qe_solidify# echo '123' > test2.txt ``` and i can also delete it ``` root@462dcb97ebd0:/tmp/qe_solidify# rm test2.txt ``` however, read it is forbiddent ``` root@462dcb97ebd0:/tmp/qe_solidify# cat test.txt cat: test.txt: Input/output error ``` ``` < HTTP/1.1 404 Not Found < Accept-Ranges: bytes < Content-Length: 0 < Content-Security-Policy: block-all-mixed-content < Server: MinIO/RELEASE.2020-03-09T18-26-53Z < Vary: Origin < X-Amz-Request-Id: 15FFCEEA7CA47556 < X-Xss-Protection: 1; mode=block < Date: Thu, 26 Mar 2020 08:58:20 GMT < * Connection #0 to host minio-minio left intact * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) * Expire in 300000 ms for 2 (transfer 0x7f25a00027d0) * Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline] * Could pipeline, but not asked to! * Re-using existing connection! (#0) with host minio-minio * Connected to minio-minio (172.29.0.3) port 9000 (#0) * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) > HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ HTTP/1.1 Host: minio-minio:9000 User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt)) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=dc83c3d6f0c46a434125d1b0f1aa8afaf2ccc860b68cd40a3890af70a67ffd26 x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20200326T085820Z < HTTP/1.1 404 Not Found < Accept-Ranges: bytes < Content-Length: 0 < Content-Security-Policy: block-all-mixed-content < Server: MinIO/RELEASE.2020-03-09T18-26-53Z < Vary: Origin < X-Amz-Request-Id: 15FFCEEA7CAE2862 < X-Xss-Protection: 1; mode=block < Date: Thu, 26 Mar 2020 08:58:20 GMT < * Connection #0 to host minio-minio left intact * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) * Expire in 300000 ms for 2 (transfer 0x7f25a00027d0) * Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline] * Could pipeline, but not asked to! * Re-using existing connection! (#0) with host minio-minio * Connected to minio-minio (172.29.0.3) port 9000 (#0) * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) > HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_%24folder%24 HTTP/1.1 Host: minio-minio:9000 User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt)) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=10a12361586d55fccdf23ba0ecb108f16a97101eca1d89fb3628569d04ffd61f x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20200326T085820Z < HTTP/1.1 404 Not Found < Accept-Ranges: bytes < Content-Length: 0 < Content-Security-Policy: block-all-mixed-content < Server: MinIO/RELEASE.2020-03-09T18-26-53Z < Vary: Origin < X-Amz-Request-Id: 15FFCEEA7CB69374 < X-Xss-Protection: 1; mode=block < Date: Thu, 26 Mar 2020 08:58:20 GMT < * Connection #0 to host minio-minio left intact * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) * Expire in 300000 ms for 2 (transfer 0x7f25a00027d0) * Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline] * Could pipeline, but not asked to! * Re-using existing connection! (#0) with host minio-minio * Connected to minio-minio (172.29.0.3) port 9000 (#0) * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) > GET /datamap-qe-test/?delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ HTTP/1.1 Host: minio-minio:9000 User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt)) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c2e17e0d48eddb6adad8920ac113ecbfb6feb2060bac0327f38ad90be34f2c12 x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20200326T085820Z < HTTP/1.1 200 OK < Accept-Ranges: bytes < Content-Length: 310 < Content-Security-Policy: block-all-mixed-content < Content-Type: application/xml < Server: MinIO/RELEASE.2020-03-09T18-26-53Z < Vary: Origin < X-Amz-Request-Id: 15FFCEEA7CE41787 < X-Xss-Protection: 1; mode=block < Date: Thu, 26 Mar 2020 08:58:20 GMT < * Connection #0 to host minio-minio left intact [INF] cache.cpp:AddStat(356): add stat cache entry[path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite] [INF] s3fs.cpp:s3fs_flush(2187): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5] [INF] fdcache.cpp:RowFlush(1441): [tpath=][path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5] [INF] s3fs.cpp:s3fs_release(2240): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5] [INF] cache.cpp:DelStat(565): delete stat cache entry[path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite] [INF] fdcache.cpp:GetFdEntity(2020): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][fd=5] [INF] s3fs.cpp:s3fs_getattr(843): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal] [INF] curl.cpp:HeadRequest(2716): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal] [INF] curl.cpp:PreHeadRequest(2665): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal [INF] curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal [INF] curl.cpp:insertV4Headers(2408): computing signature [HEAD] [/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal] [] [] [INF] curl.cpp:url_to_host(101): url is http://minio-minio:9000 [INF] curl.cpp:RequestPerform(2082): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(2716): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/] [INF] curl.cpp:PreHeadRequest(2665): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ [INF] curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ [INF] curl.cpp:insertV4Headers(2408): computing signature [HEAD] [/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/] [] [] [INF] curl.cpp:url_to_host(101): url is http://minio-minio:9000 [INF] curl.cpp:RequestPerform(2082): HTTP response code 404 was returned, returning ENOENT [INF] curl.cpp:HeadRequest(2716): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_$folder$] [INF] curl.cpp:PreHeadRequest(2665): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_$folder$][bpath=][save=][sseckeypos=-1] [INF] curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_%24folder%24 [INF] curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_%24folder%24 [INF] curl.cpp:insertV4Headers(2408): computing signature [HEAD] [/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal_$folder$] [] [] [INF] curl.cpp:url_to_host(101): url is http://minio-minio:9000 [INF] curl.cpp:RequestPerform(2082): HTTP response code 404 was returned, returning ENOENT [INF] s3fs.cpp:list_bucket(2477): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal] [INF] curl.cpp:ListBucketRequest(3111): [tpath=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal] [INF] curl.cpp:prepare_url(4265): URL is http://minio-minio:9000/datamap-qe-test?delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ [INF] curl.cpp:prepare_url(4297): URL changed is http://minio-minio:9000/datamap-qe-test/?delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/ [INF] curl.cpp:insertV4Headers(2408): computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite-wal/] [] [INF] curl.cpp:url_to_host(101): url is http://minio-minio:9000 [INF] curl.cpp:RequestPerform(2062): HTTP response code 200 [INF] s3fs.cpp:s3fs_open(2065): [path=/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite][flags=32770] * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) * Expire in 300000 ms for 2 (transfer 0x7f25a00027d0) * Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline] * Could pipeline, but not asked to! * Re-using existing connection! (#0) with host minio-minio * Connected to minio-minio (172.29.0.3) port 9000 (#0) * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) > HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite HTTP/1.1 Host: minio-minio:9000 User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt)) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=8e8c8149b37b9427a73d42e2c4520c09d85e503439d24ff61c9d59969218327d x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20200326T085820Z < HTTP/1.1 200 OK < Accept-Ranges: bytes < Content-Length: 24576 < Content-Security-Policy: block-all-mixed-content < Content-Type: application/octet-stream < ETag: "2038d9972fe78fdbe8853959f6c3ae02-1" < Last-Modified: Thu, 26 Mar 2020 08:58:20 GMT < Server: MinIO/RELEASE.2020-03-09T18-26-53Z < Vary: Origin < X-Amz-Meta-Gid: 0 < X-Amz-Meta-Mode: 33188 < X-Amz-Meta-Mtime: 1585213100 < X-Amz-Meta-Uid: 0 < X-Amz-Request-Id: 15FFCEEA84A5D989 < X-Xss-Protection: 1; mode=block < Date: Thu, 26 Mar 2020 08:58:20 GMT < * Connection #0 to host minio-minio left intact * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) * Expire in 300000 ms for 2 (transfer 0x7f25a00027d0) * Found bundle for host minio-minio: 0x7f25a0008860 [can pipeline] * Could pipeline, but not asked to! * Re-using existing connection! (#0) with host minio-minio * Connected to minio-minio (172.29.0.3) port 9000 (#0) * Expire in 0 ms for 6 (transfer 0x7f25a00027d0) > HEAD /datamap-qe-test/9e3b1e42-b326-42d5-8d3c-f6c4d8097b99.sqlite HTTP/1.1 Host: minio-minio:9000 User-Agent: s3fs/1.84 (commit hash unknown; GnuTLS(gcrypt)) Accept: */* Authorization: AWS4-HMAC-SHA256 Credential=test/20200326/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=8e8c8149b37b9427a73d42e2c4520c09d85e503439d24ff61c9d59969218327d x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 x-amz-date: 20200326T085820Z < HTTP/1.1 200 OK < Accept-Ranges: bytes < Content-Length: 24576 < Content-Security-Policy: block-all-mixed-content < Content-Type: application/octet-stream < ETag: "2038d9972fe78fdbe8853959f6c3ae02-1" < Last-Modified: Thu, 26 Mar 2020 08:58:20 GMT < Server: MinIO/RELEASE.2020-03-09T18-26-53Z < Vary: Origin < X-Amz-Meta-Gid: 0 < X-Amz-Meta-Mode: 33188 < X-Amz-Meta-Mtime: 1585213100 < X-Amz-Meta-Uid: 0 < X-Amz-Request-Id: 15FFCEEA84F79A03 < X-Xss-Protection: 1; mode=block < Date: Thu, 26 Mar 2020 08:58:20 GMT < * Connection #0 to host minio-minio left intact ```
kerem commented 2026-03-04 01:47:46 +03:00
Author
Owner
Copy link

@kathur2rain commented on GitHub (May 6, 2020):

I was using docker and as long as I map my program code to /tmp in docker, I'll encounter this problem. I accidentally solved this problem by map my program code to /data rather than /tmp in docker。 close for now~

<!-- gh-comment-id:624428495 --> @kathur2rain commented on GitHub (May 6, 2020): I was using docker and as long as I map my program code to /tmp in docker, I'll encounter this problem. I accidentally solved this problem by map my program code to /data rather than /tmp in docker。 close for now~
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#671
No description provided.