mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 05:16:00 +03:00
[GH-ISSUE #548] Debian: Files are zero bytes in size with use_cache option #315
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#315
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @berni421 on GitHub (Mar 22, 2017).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/548
Additional Information
The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all.
s3fs --version
Amazon Simple Storage Service File System V1.80(commit:unknown) with GnuTLS(gcrypt)
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Note this is the version in jessie backports.
elbournb@hp6715:~$ pkg-config --modversion fuse
2.9.3
elbournb@hp6715:~$ uname -a
Linux hp6715 3.16.0-4-amd64 #1 SMP Debian 3.16.39-1+deb8u1 (2017-02-22) x86_64 GNU/Linux
elbournb@hp6715:~$ cat /etc/issue
Debian GNU/Linux 8 \n \l
if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages
Details about issue
My simple test file ...
elbournb@hp6715:~$ cat test.txt
this is a small test file
copied to s3 mount point....
elbournb@hp6715:~$ cp test.txt /home/s3/data -v
‘test.txt’ -> ‘/home/s3/data/test.txt’
no errors, but ls shows empty files
elbournb@hp6715:~$ ls -l test.txt /home/s3/data/ /home/s3/cache/ecs01/
-rw-rw-r-- 1 elbournb users 26 Mar 22 16:58 test.txt
/home/s3/cache/ecs01/:
total 0
-rw------- 1 root root 0 Mar 22 17:00 test.txt
/home/s3/data/:
total 1
-rw-rw-r-- 1 elbournb users 0 Mar 22 17:00 test.txt
@berni421 commented on GitHub (Mar 22, 2017):
Just tried without the cache: works ....
/etc/fstab:-
ecs01 /home/s3 fuse.s3fs _netdev,allow_other,noauto 0 0
elbournb@hp6715:~ rm /home/s3/test.txt
elbournb@hp6715:~ cp test.txt /home/s3/ -v
‘test.txt’ -> ‘/home/s3/test.txt’
elbournb@hp6715:~ ls -l test.txt /home/s3/test.txt
-rw-rw-r-- 1 elbournb users 26 Mar 22 17:33 /home/s3/test.txt
-rw-rw-r-- 1 elbournb users 26 Mar 22 16:58 test.txt
elbournb@hp6715:~ diff test.txt /home/s3/test.txt
@ggtakec commented on GitHub (Apr 2, 2017):
@berni421
I think uploading the test.txt file seems to be successful.
Since the size of the cache file for uploading file is 0, then it seems that an cache object which size is 0 has been uploaded.
I think we need more information to solve this problem.
Could you test with the latest code of the master branch on github?
Several bugs have been fixed, so please try it with the latest one.
Thanks in advance for your assistance.
@berni421 commented on GitHub (Apr 2, 2017):
I can happily try the latest git.
To recap the evidence above shows that Debian s3fs version 1.8 with original test.txt file is 26 characters, and this is truncated when uploaded via s3fs to zero size with the cache enabled.
I can add though this is not a special case - all my files were truncated to zero size.
@ggtakec commented on GitHub (Apr 9, 2017):
@berni421 Thanks for your check.
But I have not yet reproduced this problem.
And we need s3fs's log(debug messages) to ascertain the cause of this problem.
It is a suggestion with assuming there is a cache problem.
Could you experiment with changing the cache directory on another file system?
Regards,
@berni421 commented on GitHub (Apr 10, 2017):
Attempting with cache on /tmp - separate to home
/etc/fstab:-
ecs02 /home/s3/ecs02 fuse.s3fs _netdev,allow_other,use_cache=/tmp,noauto,dbglevel=dbg,curldbg 0 0
elbournb@hp6715:~ rm /home/s3/ecs02/test.txt
elbournb@hp6715:~ sudo umount /home/s3/ecs02/
elbournb@hp6715:~ sudo rmdir /tmp/ecs02/
elbournb@hp6715:~ sudo mount /home/s3/ecs02/
elbournb@hp6715:~ echo 12345 > /home/s3/ecs02/test.txt
elbournb@hp6715:~ ls -l /home/s3/ecs02/test.txt /tmp/ecs02/test.txt
-rw-rw-r-- 1 elbournb users 0 Apr 10 20:43 /home/s3/ecs02/test.txt
-rw------- 1 root root 0 Apr 10 20:43 /tmp/ecs02/test.txt
Log with debug:-
Apr 10 20:42:36 hp6715 s3fs[1628]: PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40755)
Apr 10 20:42:36 hp6715 s3fs[1630]: check services.
Apr 10 20:42:36 hp6715 s3fs[1630]: check a bucket.
Apr 10 20:42:36 hp6715 s3fs[1630]: URL is http://s3.amazonaws.com/ecs02/
Apr 10 20:42:36 hp6715 s3fs[1630]: URL changed is http://ecs02.s3.amazonaws.com/
Apr 10 20:42:36 hp6715 s3fs[1630]: computing signature [GET] [/] [] []
Apr 10 20:42:36 hp6715 s3fs[1630]: url is http://s3.amazonaws.com
Apr 10 20:42:36 hp6715 s3fs[1630]: Libgcrypt warning: missing initialization - please fix the application
Apr 10 20:42:37 hp6715 s3fs[1630]: HTTP response code 400 was returned, returning EIO.
Apr 10 20:42:37 hp6715 s3fs[1630]: check a bucket.
Apr 10 20:42:37 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/
Apr 10 20:42:37 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/
Apr 10 20:42:37 hp6715 s3fs[1630]: computing signature [GET] [/] [] []
Apr 10 20:42:37 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:37 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:42:37 hp6715 s3fs[1630]: [path=/][mask=R_OK ]
Apr 10 20:42:37 hp6715 s3fs[1630]: [path=/.Trash]
Apr 10 20:42:37 hp6715 s3fs[1630]: [tpath=/.Trash]
Apr 10 20:42:37 hp6715 s3fs[1630]: [tpath=/.Trash][bpath=][save=][sseckeypos=-1]
Apr 10 20:42:37 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash
Apr 10 20:42:37 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash
Apr 10 20:42:37 hp6715 s3fs[1630]: computing signature [HEAD] [/.Trash] [] []
Apr 10 20:42:37 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:37 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:42:37 hp6715 s3fs[1630]: [tpath=/.Trash/]
Apr 10 20:42:37 hp6715 s3fs[1630]: [tpath=/.Trash/][bpath=][save=][sseckeypos=-1]
Apr 10 20:42:37 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash/
Apr 10 20:42:37 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash/
Apr 10 20:42:37 hp6715 s3fs[1630]: computing signature [HEAD] [/.Trash/] [] []
Apr 10 20:42:37 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash_$folder$]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 20:42:38 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash_%24folder%24
Apr 10 20:42:38 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash_%24folder%24
Apr 10 20:42:38 hp6715 s3fs[1630]: computing signature [HEAD] [/.Trash_$folder$] [] []
Apr 10 20:42:38 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:42:38 hp6715 s3fs[1630]: [path=/.Trash]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash]
Apr 10 20:42:38 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=.Trash/
Apr 10 20:42:38 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=.Trash/
Apr 10 20:42:38 hp6715 s3fs[1630]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=.Trash/] []
Apr 10 20:42:38 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:42:38 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:42:38 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:42:38 hp6715 s3fs[1630]: [path=/.Trash-1000]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000][bpath=][save=][sseckeypos=-1]
Apr 10 20:42:38 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash-1000
Apr 10 20:42:38 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash-1000
Apr 10 20:42:38 hp6715 s3fs[1630]: computing signature [HEAD] [/.Trash-1000] [] []
Apr 10 20:42:38 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000/]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000/][bpath=][save=][sseckeypos=-1]
Apr 10 20:42:38 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash-1000/
Apr 10 20:42:38 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash-1000/
Apr 10 20:42:38 hp6715 s3fs[1630]: computing signature [HEAD] [/.Trash-1000/] [] []
Apr 10 20:42:38 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000_$folder$]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 20:42:38 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash-1000_%24folder%24
Apr 10 20:42:38 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash-1000_%24folder%24
Apr 10 20:42:38 hp6715 s3fs[1630]: computing signature [HEAD] [/.Trash-1000_$folder$] [] []
Apr 10 20:42:38 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:42:38 hp6715 s3fs[1630]: [path=/.Trash-1000]
Apr 10 20:42:38 hp6715 s3fs[1630]: [tpath=/.Trash-1000]
Apr 10 20:42:38 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=.Trash-1000/
Apr 10 20:42:38 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=.Trash-1000/
Apr 10 20:42:38 hp6715 s3fs[1630]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=.Trash-1000/] []
Apr 10 20:42:38 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:42:38 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:42:38 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:42:38 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:43:12 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:12 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:43:12 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:43:12 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt] [] []
Apr 10 20:43:12 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:12 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt/]
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt/][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:12 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt/
Apr 10 20:43:12 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt/
Apr 10 20:43:12 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt/] [] []
Apr 10 20:43:12 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:12 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt_$folder$]
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:12 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt_%24folder%24
Apr 10 20:43:12 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt_%24folder%24
Apr 10 20:43:12 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt_$folder$] [] []
Apr 10 20:43:12 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:12 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:43:12 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:43:12 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=test.txt/] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:43:13 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:43:13 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][mode=100664][flags=33345]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt] [] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt/]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt/][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt/
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt/
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt/] [] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt_$folder$]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt_%24folder%24
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt_%24folder%24
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt_$folder$] [] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 404 was returned, returning ENOENT
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=test.txt/] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:43:13 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:43:13 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][mode=100664]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: create zero byte file object.
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [PUT] [/test.txt] [] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: uploading... [path=/test.txt][fd=-1][size=0]
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:43:13 hp6715 s3fs[1630]: delete stat cache entry[path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt] [] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:43:13 hp6715 s3fs[1630]: add stat cache entry[path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=][path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][name=security.capability][value=(nil)][size=0]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][flags=32768]
Apr 10 20:43:13 hp6715 s3fs[1630]: delete stat cache entry[path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt] [] []
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:43:13 hp6715 s3fs[1630]: add stat cache entry[path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][name=ntfs.streams.list][value=(nil)][size=0]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=][path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:43:13 hp6715 s3fs[1630]: computing signature [PUT] [/test.txt] [] [e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855]
Apr 10 20:43:13 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:43:13 hp6715 s3fs[1630]: uploading... [path=/test.txt][fd=8][size=0]
Apr 10 20:43:13 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: s3fs.cpp:s3fs_release(2224): file(/test.txt),fd(8) is still opened.
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [tpath=][path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: delete stat cache entry[path=/test.txt]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:43:13 hp6715 s3fs[1630]: [path=/test.txt][fd=8]
Apr 10 20:44:03 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:03 hp6715 s3fs[1630]: [path=/][flags=100352]
Apr 10 20:44:03 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:03 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:03 hp6715 s3fs[1630]: [tpath=/]
Apr 10 20:44:03 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=1000&prefix=
Apr 10 20:44:03 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=1000&prefix=
Apr 10 20:44:03 hp6715 s3fs[1630]: computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] []
Apr 10 20:44:03 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:44:04 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:44:04 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/][list=0]
Apr 10 20:44:04 hp6715 s3fs[1630]: [tpath=/test.txt][bpath=test.txt][save=/test.txt][sseckeypos=-1]
Apr 10 20:44:04 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 20:44:04 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 20:44:04 hp6715 s3fs[1630]: computing signature [HEAD] [/test.txt] [] []
Apr 10 20:44:04 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:44:04 hp6715 s3fs[1630]: [count=1]
Apr 10 20:44:04 hp6715 s3fs[1630]: add stat cache entry[path=/test.txt]
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/][flags=100352]
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:04 hp6715 s3fs[1630]: [tpath=/]
Apr 10 20:44:04 hp6715 s3fs[1630]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=1000&prefix=
Apr 10 20:44:04 hp6715 s3fs[1630]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=1000&prefix=
Apr 10 20:44:04 hp6715 s3fs[1630]: computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] []
Apr 10 20:44:04 hp6715 s3fs[1630]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 20:44:04 hp6715 s3fs[1630]: HTTP response code 200
Apr 10 20:44:04 hp6715 s3fs[1630]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/][list=0]
Apr 10 20:44:04 hp6715 s3fs[1630]: [count=0]
Apr 10 20:44:04 hp6715 s3fs[1630]: [path=/]
Apr 10 20:44:05 hp6715 s3fs[1630]: [path=/test.txt]
Apr 10 20:44:05 hp6715 s3fs[1630]: [path=/test.txt][name=security.selinux][value=0x7f34bc000990][size=255]
Apr 10 20:44:05 hp6715 s3fs[1630]: [path=/test.txt][name=system.posix_acl_access][value=(nil)][size=0]
Apr 10 20:44:05 hp6715 s3fs[1630]: [path=/test.txt][name=system.posix_acl_default][value=(nil)][size=0]
@berni421 commented on GitHub (Apr 10, 2017):
Git version, zero files with cache....
/etc/fstab:-
ecs02 /home/s3/ecs02 fuse.s3fs _netdev,allow_other,use_cache=/tmp,noauto,dbglevel=dbg,curldbg 0 0
elbournb@hp6715:
/s3fs-fuse sudo rm -r /tmp/ecs02//s3fs-fuse sudo mount /home/s3/ecs02/elbournb@hp6715:
elbournb@hp6715:
/s3fs-fuse echo 12345678 > /home/s3/ecs02/test.txt/s3fs-fuse ls /home/s3/ecs02/test.txt /tmp/ecs02/test.txt -lelbournb@hp6715:
-rw-rw-r-- 1 elbournb users 0 Apr 10 21:06 /home/s3/ecs02/test.txt
-rw------- 1 root root 0 Apr 10 21:06 /tmp/ecs02/test.txt
elbournb@hp6715:~/s3fs-fuse s3fs --version
Amazon Simple Storage Service File System V1.80(commit:94ddcb8) with OpenSSL
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Apr 10 21:06:45 hp6715 s3fs[11012]: PROC(uid=0, gid=0) - MountPoint(uid=0, gid=0, mode=40755)
Apr 10 21:06:45 hp6715 s3fs[11014]: check services.
Apr 10 21:06:45 hp6715 s3fs[11014]: check a bucket.
Apr 10 21:06:45 hp6715 s3fs[11014]: URL is http://s3.amazonaws.com/ecs02/
Apr 10 21:06:45 hp6715 s3fs[11014]: URL changed is http://ecs02.s3.amazonaws.com/
Apr 10 21:06:45 hp6715 s3fs[11014]: computing signature [GET] [/] [] []
Apr 10 21:06:45 hp6715 s3fs[11014]: url is http://s3.amazonaws.com
Apr 10 21:06:45 hp6715 s3fs[11014]: HTTP response code 400 was returned, returning EIO.
Apr 10 21:06:45 hp6715 s3fs[11014]: check a bucket.
Apr 10 21:06:45 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/
Apr 10 21:06:45 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/
Apr 10 21:06:45 hp6715 s3fs[11014]: computing signature [GET] [/] [] []
Apr 10 21:06:45 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:46 hp6715 s3fs[11014]: [path=/][mask=R_OK ]
Apr 10 21:06:46 hp6715 s3fs[11014]: [path=/.Trash]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [HEAD] [/.Trash] [] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash/]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash/][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash/
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash/
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [HEAD] [/.Trash/] [] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash_$folder$]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash_%24folder%24
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash_%24folder%24
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [HEAD] [/.Trash_$folder$] [] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:46 hp6715 s3fs[11014]: [path=/.Trash]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=.Trash/
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=.Trash/
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=.Trash/] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:46 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:46 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:46 hp6715 s3fs[11014]: [path=/.Trash-1000]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash-1000
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash-1000
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [HEAD] [/.Trash-1000] [] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000/]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000/][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash-1000/
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash-1000/
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [HEAD] [/.Trash-1000/] [] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000_$folder$]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/.Trash-1000_%24folder%24
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/.Trash-1000_%24folder%24
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [HEAD] [/.Trash-1000_$folder$] [] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:46 hp6715 s3fs[11014]: [path=/.Trash-1000]
Apr 10 21:06:46 hp6715 s3fs[11014]: [tpath=/.Trash-1000]
Apr 10 21:06:46 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=.Trash-1000/
Apr 10 21:06:46 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=.Trash-1000/
Apr 10 21:06:46 hp6715 s3fs[11014]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=.Trash-1000/] []
Apr 10 21:06:46 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:46 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:46 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:46 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:53 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:06:53 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:53 hp6715 s3fs[11014]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:53 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:53 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:53 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt] [] []
Apr 10 21:06:53 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt/]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt/][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt/] [] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt_$folder$]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt_%24folder%24
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt_%24folder%24
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt_$folder$] [] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:54 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=test.txt/] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:54 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:54 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:54 hp6715 s3fs[11014]: [path=/test.txt][mode=100664][flags=33345]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt] [] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt/]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt/][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt/] [] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt_$folder$]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt_$folder$][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt_%24folder%24
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt_%24folder%24
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt_$folder$] [] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:54 hp6715 s3fs[11014]: HTTP response code 404 was returned, returning ENOENT
Apr 10 21:06:54 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:06:54 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:54 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=2&prefix=test.txt/
Apr 10 21:06:54 hp6715 s3fs[11014]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=test.txt/] []
Apr 10 21:06:54 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:55 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:55 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:55 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:06:55 hp6715 s3fs[11014]: [path=/test.txt][mode=100664]
Apr 10 21:06:55 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: create zero byte file object.
Apr 10 21:06:55 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:55 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:55 hp6715 s3fs[11014]: computing signature [PUT] [/test.txt] [] []
Apr 10 21:06:55 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:55 hp6715 s3fs[11014]: uploading... [path=/test.txt][fd=-1][size=0]
Apr 10 21:06:55 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:55 hp6715 s3fs[11014]: delete stat cache entry[path=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:55 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:55 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:55 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt] [] []
Apr 10 21:06:55 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:55 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:55 hp6715 s3fs[11014]: add stat cache entry[path=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [path=/]
Apr 10 21:06:55 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:55 hp6715 s3fs[11014]: [tpath=][path=/test.txt][fd=9]
Apr 10 21:06:55 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [path=/test.txt][flags=32768]
Apr 10 21:06:55 hp6715 s3fs[11014]: delete stat cache entry[path=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:55 hp6715 s3fs[11014]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:55 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:55 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:55 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt] [] []
Apr 10 21:06:55 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:55 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:55 hp6715 s3fs[11014]: add stat cache entry[path=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [tpath=][path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:56 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:56 hp6715 s3fs[11014]: computing signature [PUT] [/test.txt] [] [e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855]
Apr 10 21:06:56 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:56 hp6715 s3fs[11014]: uploading... [path=/test.txt][fd=9][size=0]
Apr 10 21:06:56 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: s3fs.cpp:s3fs_release(2265): file(/test.txt),fd(9) is still opened.
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][flags=32768]
Apr 10 21:06:56 hp6715 s3fs[11014]: delete stat cache entry[path=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: [tpath=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: [tpath=/test.txt][bpath=][save=][sseckeypos=-1]
Apr 10 21:06:56 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:06:56 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:06:56 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt] [] []
Apr 10 21:06:56 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:06:56 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:06:56 hp6715 s3fs[11014]: add stat cache entry[path=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [tpath=][path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: s3fs.cpp:s3fs_release(2265): file(/test.txt),fd(9) is still opened.
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [tpath=][path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: delete stat cache entry[path=/test.txt]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:06:56 hp6715 s3fs[11014]: [path=/test.txt][fd=9]
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/]
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/][flags=100352]
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/]
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/]
Apr 10 21:07:14 hp6715 s3fs[11014]: [tpath=/]
Apr 10 21:07:14 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02?delimiter=/&max-keys=1000&prefix=
Apr 10 21:07:14 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com?delimiter=/&max-keys=1000&prefix=
Apr 10 21:07:14 hp6715 s3fs[11014]: computing signature [GET] [/] [delimiter=/&max-keys=1000&prefix=] []
Apr 10 21:07:14 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:07:14 hp6715 s3fs[11014]: HTTP response code 200
Apr 10 21:07:14 hp6715 s3fs[11014]: s3fs.cpp:append_objects_from_xml_ex(2572): contents_xp->nodesetval is empty.
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/][list=0]
Apr 10 21:07:14 hp6715 s3fs[11014]: [tpath=/test.txt][bpath=test.txt][save=/test.txt][sseckeypos=-1]
Apr 10 21:07:14 hp6715 s3fs[11014]: URL is http://s3-eu-central-1.amazonaws.com/ecs02/test.txt
Apr 10 21:07:14 hp6715 s3fs[11014]: URL changed is http://ecs02.s3-eu-central-1.amazonaws.com/test.txt
Apr 10 21:07:14 hp6715 s3fs[11014]: computing signature [HEAD] [/test.txt] [] []
Apr 10 21:07:14 hp6715 s3fs[11014]: url is http://s3-eu-central-1.amazonaws.com
Apr 10 21:07:14 hp6715 s3fs[11014]: [count=1]
Apr 10 21:07:14 hp6715 s3fs[11014]: add stat cache entry[path=/test.txt]
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/]
Apr 10 21:07:14 hp6715 s3fs[11014]: [path=/test.txt]
Apr 10 21:07:22 hp6715 s3fs[11014]: [path=/test.txt]
@berni421 commented on GitHub (Apr 10, 2017):
Here is s3fs (debian version) in foreground mode, in my shell:-
s3fs --version
Amazon Simple Storage Service File System V1.80(commit:unknown) with GnuTLS(gcrypt)
Copyright (C) 2010 Randy Rizun rrizun@gmail.com
License GPL2: GNU GPL version 2 http://gnu.org/licenses/gpl.html
This is free software: you are free to change and redistribute it.
s3fs -f ecs02 ecs02 -ouse_cache=/home/elbournb/s3-cache/ #-odbglevel=dbg -ocurldbg
[CRT] s3fs.cpp:s3fs_init(3334): init v1.80(commit:unknown) with GnuTLS(gcrypt)
[CRT] s3fs.cpp:s3fs_check_service(3729): Could not connect wrong region us-east-1, so retry to connect region eu-central-1.
elbournb@hp6715:~ echo 12345678 > ecs02/test.txt
elbournb@hp6715:~ ls -l ecs02/test.txt s3-cache/
ecs02/ .ecs02.stat/
elbournb@hp6715:~ ls -l ecs02/test.txt s3-cache/ecs02/test.txt
-rw-rw-r-- 1 elbournb users 9 Apr 10 21:36 ecs02/test.txt
-rw------- 1 elbournb users 9 Apr 10 21:36 s3-cache/ecs02/test.txt
elbournb@hp6715:~ diff ecs02/test.txt s3-cache/ecs02/test.txt
Works!
@berni421 commented on GitHub (Apr 10, 2017):
Again foreground version as root, for the /etc/fstab usage...
sudo s3fs -f ecs02 /ecs02 -ouse_cache=/tmp -oallow_other
elbournb@hp6715:~ echo 9875dd4342 > /ecs02/test1.txt
elbournb@hp6715:~ ls /ecs02/ -l
total 1
-rw-rw-r-- 1 elbournb users 0 Apr 10 21:52 test1.txt
elbournb@hp6715:~ echo 9875dd4342 |sudo tee /ecs02/test2.txt
9875dd4342
elbournb@hp6715:~ ls /ecs02/ -l
total 1
-rw-rw-r-- 1 elbournb users 0 Apr 10 21:52 test1.txt
-rw-r--r-- 1 root root 11 Apr 10 21:52 test2.txt
elbournb@hp6715:~ cat /ecs02/test2.txt
9875dd4342
so cache with root works, yet others users files are truncated.
@bimandika commented on GitHub (Jun 6, 2018):
any update about this case ? so i need to disable caching on s3fs ?
@7IUe4Ks4vF commented on GitHub (May 11, 2019):
@bimandika could you try a cat on the 0byte file and see if the size is right one?
other possibility im trying is to just set expire for stat cache to 10 minutes or so.
because i have the same for directories ... some show up as 0byte files.
if i exec a "cat /dir/that/shows/as/0byte/file" and do ls after that all shows up as intended.
@gaul commented on GitHub (Jun 25, 2019):
Could you retest with the latest 1.85 version? It includes many data corruption fixes.
@7IUe4Ks4vF commented on GitHub (Jun 26, 2019):
I will retest with the lastest version from git.
@7IUe4Ks4vF commented on GitHub (Jul 5, 2019):
so far no more problems with 0byte files.
@gaul commented on GitHub (Jul 9, 2019):
@7IUe4Ks4vF thank you for testing this!