mirror of
https://github.com/s3fs-fuse/s3fs-fuse.git
synced 2026-04-25 05:16:00 +03:00
[GH-ISSUE #230] Input / Output Errors on writing files #127
Labels
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/s3fs-fuse#127
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @niklasenB on GitHub (Aug 14, 2015).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/230
Hi there,
since I have recently pulled from master branch, I cannot access files in my S3 buckets anymore. They mount properly, I can touch files but trying to edit and add anything returns and I/O error.
The EC2 instance has no possibility to write files.
My setup runs in the Frankfurt Region. An older version of the s3fs is working fine.
So there must be an issue after all the recent pull requests.
@RobbKistler commented on GitHub (Aug 14, 2015):
Heya.
It might help to be specific with what you pulled from master. If you cloned the repo, please provide the output of
git rev-parse HEADThe command line for invoking s3fs-fuse or the /etc/fstab line would be useful.
If you can re-run the failure scenario invoking s3fs-fuse on the command line, please add these flags and collect the additional log output.:
-d -d -ocurldbg -f@niklasenB commented on GitHub (Aug 14, 2015):
My installation script looks like this
and it actually looks like since I have added the retry parameter to the mount string, it seems to be back working again:
But is it possible, the missing retry parameter can cause I/O errors?
@RobbKistler commented on GitHub (Aug 14, 2015):
The default value for retries is 3. If you are having some sort of network connectivity issue, increasing it might solve the problem. If you enable the debug output I mentioned above,
-d -d -ocurldbg -fit will be fairly clear if retries are occurring. If you revert to not using the retries parameter, what results do you get now?@karthikkrishnanv commented on GitHub (Aug 16, 2015):
I seem to have similar issue and can't figure out why. The issue is a bit random for me. Some files existing in the bucket are read as 0 byte file during copy locally (and vice versa). In here, I copy a local file to the S3 mounted dir.
The brief error is -
cp: error writing ‘/mnt/tmp/media/catalog/category/httpd.conf’: Input/output error
cp: failed to extend ‘/mnt/tmp/media/catalog/category/httpd.conf’: Input/output error
The details are -
[root@ip-10-0-74-19 scripts]# cp httpd.conf /mnt/tmp/media/catalog/category/ > log 2>&1
unique: 130, opcode: LOOKUP (1), nodeid: 1, insize: 44, pid: 21880
LOOKUP /tmp
getattr /tmp
s3fs_getattr(740): [path=/tmp]
check_parent_object_access(605): [path=/tmp]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699368][hit count=102]
ExistOpen(1243): [path=/tmp][fd=-1]
Open(1192): [path=/tmp][size=-1][time=-1]
s3fs_getattr(763): [path=/tmp] uid=0, gid=0, mode=40755
NODEID: 2
unique: 130, success, outsize: 144
unique: 131, opcode: LOOKUP (1), nodeid: 2, insize: 46, pid: 21880
LOOKUP /tmp/media
getattr /tmp/media
s3fs_getattr(740): [path=/tmp/media]
check_parent_object_access(605): [path=/tmp/media]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=103]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699368][hit count=80]
ExistOpen(1243): [path=/tmp/media][fd=-1]
Open(1192): [path=/tmp/media][size=-1][time=-1]
s3fs_getattr(763): [path=/tmp/media] uid=0, gid=0, mode=40755
NODEID: 3
unique: 131, success, outsize: 144
unique: 132, opcode: LOOKUP (1), nodeid: 3, insize: 48, pid: 21880
LOOKUP /tmp/media/catalog
getattr /tmp/media/catalog
s3fs_getattr(740): [path=/tmp/media/catalog]
check_parent_object_access(605): [path=/tmp/media/catalog]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=81]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=104]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699368][hit count=66]
ExistOpen(1243): [path=/tmp/media/catalog][fd=-1]
Open(1192): [path=/tmp/media/catalog][size=-1][time=-1]
s3fs_getattr(763): [path=/tmp/media/catalog] uid=0, gid=0, mode=40755
NODEID: 4
unique: 132, success, outsize: 144
unique: 133, opcode: LOOKUP (1), nodeid: 4, insize: 49, pid: 21880
LOOKUP /tmp/media/catalog/category
getattr /tmp/media/catalog/category
s3fs_getattr(740): [path=/tmp/media/catalog/category]
check_parent_object_access(605): [path=/tmp/media/catalog/category]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=67]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=82]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=105]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699368][hit count=55]
ExistOpen(1243): [path=/tmp/media/catalog/category][fd=-1]
Open(1192): [path=/tmp/media/catalog/category][size=-1][time=-1]
s3fs_getattr(763): [path=/tmp/media/catalog/category] uid=0, gid=0, mode=40755
NODEID: 5
unique: 133, success, outsize: 144
unique: 134, opcode: LOOKUP (1), nodeid: 5, insize: 51, pid: 21880
LOOKUP /tmp/media/catalog/category/httpd.conf
getattr /tmp/media/catalog/category/httpd.conf
s3fs_getattr(740): [path=/tmp/media/catalog/category/httpd.conf]
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=56]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=68]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=83]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=106]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog/category/httpd.conf]
get_object_attribute(353): [path=/tmp/media/catalog/category/httpd.conf]
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
< HTTP/1.1 404 Not Found
< x-amz-request-id: B970C07A107BDF1B
< x-amz-id-2: wOyUa+YEvqDP4UBd4Q0JJL3BFR0uv8jMbz++oxbbMrntMyub1027laWwx0gLsOLoui95ZS+hrrE=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf/]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf/][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf/
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf/
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf/] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf/
< HTTP/1.1 404 Not Found
< x-amz-request-id: 405B7F45BCDAA8AF
< x-amz-id-2: dy/03P9uEPgWkLjqEWbQ4Oh1cW3NY8MmOsCOcKRPgYHbSfyMoom1pN56+qKCP6YoFCynB4odnzo=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf_$folder$]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf_$folder$][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf_%24folder%24
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf_%24folder%24
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf_$folder$] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf_%24folder%24
< HTTP/1.1 404 Not Found
< x-amz-request-id: 95D7B53EC60745D6
< x-amz-id-2: tY8Azi1RQDuPcWu3SrIqiI45RD7z+s3ABDGJsVQEU7l1C2/y7ES/367fJysWl2f18eCO/HaY07E=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
list_bucket(2352): [path=/tmp/media/catalog/category/httpd.conf]
ListBucketRequest(2585): [tpath=/tmp/media/catalog/category/httpd.conf]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
insertV4Headers(1973): computing signature [GET] [delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
< HTTP/1.1 200 OK
< x-amz-id-2: +wnCEQEmSyS4fkwo0MkMz6fmqomRYOxMbyUPQy9ruR/yE4mILfWdENXTbHb5ND25hNJ0FWKcCLs=
< x-amz-request-id: 6064BA4DB2348DBB
< Date: Sun, 16 Aug 2015 04:29:39 GMT
< x-amz-bucket-region: us-west-2
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Server: AmazonS3
<
RequestPerform(1648): HTTP response code 200
append_objects_from_xml_ex(2448): contents_xp->nodesetval is empty.
append_objects_from_xml_ex(2448): contents_xp->nodesetval is empty.
unique: 134, error: -2 (No such file or directory), outsize: 16
unique: 135, opcode: LOOKUP (1), nodeid: 5, insize: 51, pid: 21880
LOOKUP /tmp/media/catalog/category/httpd.conf
getattr /tmp/media/catalog/category/httpd.conf
s3fs_getattr(740): [path=/tmp/media/catalog/category/httpd.conf]
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=57]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=69]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=84]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=107]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog/category/httpd.conf]
get_object_attribute(353): [path=/tmp/media/catalog/category/httpd.conf]
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
< HTTP/1.1 404 Not Found
< x-amz-request-id: 9D3B22AC9768B2EB
< x-amz-id-2: 5XJKbB2+SjiA0Z7ro8FYAjaLy6QGLhlr/EqPEnCwnhI5vYiBvHu1V2KW18s1AINXNoweBOEEdN0=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf/]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf/][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf/
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf/
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf/] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf/
< HTTP/1.1 404 Not Found
< x-amz-request-id: F1AE10E7E6EB5C6C
< x-amz-id-2: s0X57XXnCNLqhV2Rv+0/G4ObzEcvtJW8vb47C/I7fIM42GMr2II/eh+fGFemGvvMikuKcEMt1YI=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf_$folder$]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf_$folder$][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf_%24folder%24
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf_%24folder%24
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf_$folder$] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf_%24folder%24
< HTTP/1.1 404 Not Found
< x-amz-request-id: 952D0EF4D9F9E960
< x-amz-id-2: 87QECnDh9Q4w7eWMmktKz0hztYcz/GX99LzDvsp7PchSKhzKTvwr864Iyza/R2oIMBBW7y++QQg=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:38 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
list_bucket(2352): [path=/tmp/media/catalog/category/httpd.conf]
ListBucketRequest(2585): [tpath=/tmp/media/catalog/category/httpd.conf]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
insertV4Headers(1973): computing signature [GET] [delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
< HTTP/1.1 200 OK
< x-amz-id-2: B3UxYgmyPMWD/Wt7ZecNmDHRXJ+Ad1/x7wylXuafvOhV3IVNTH+g6KjVIzMdjdDqGngJH5k0gJY=
< x-amz-request-id: 49B7DC2D2C40F47C
< Date: Sun, 16 Aug 2015 04:29:39 GMT
< x-amz-bucket-region: us-west-2
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Server: AmazonS3
<
RequestPerform(1648): HTTP response code 200
append_objects_from_xml_ex(2448): contents_xp->nodesetval is empty.
append_objects_from_xml_ex(2448): contents_xp->nodesetval is empty.
unique: 135, error: -2 (No such file or directory), outsize: 16
unique: 136, opcode: CREATE (35), nodeid: 5, insize: 67, pid: 21880
create flags: 0x80c1 /tmp/media/catalog/category/httpd.conf 0100644 umask=0022
s3fs_create(872): [path=/tmp/media/catalog/category/httpd.conf][mode=100644][flags=32961]
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=58]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=70]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=85]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=108]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog/category/httpd.conf]
get_object_attribute(353): [path=/tmp/media/catalog/category/httpd.conf]
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
< HTTP/1.1 404 Not Found
< x-amz-request-id: 90E2EDCA447816C5
< x-amz-id-2: XpfUuyHGgxD04iMPFuBdB3ztc/nV9rJHIVAaddPlh827qVQZK06o7ChpaN2aMMA0B116nWP1hdM=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:38 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf/]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf/][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf/
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf/
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf/] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf/
< HTTP/1.1 404 Not Found
< x-amz-request-id: 314ED8CE6CC054CD
< x-amz-id-2: 1XY9O3F3d5NJ8O23IxYgPzNxABLWSevjy5g4r35oX2WiZZCnvuzMPXBhLo2Ivbz92zo4U6QPlE8=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf_$folder$]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf_$folder$][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf_%24folder%24
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf_%24folder%24
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf_$folder$] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf_%24folder%24
< HTTP/1.1 404 Not Found
< x-amz-request-id: B9381429957B6CE5
< x-amz-id-2: UgZIP8fRr2UNjxFT0t1dpW3f+L31zAlWlUvvQGmrG4QukSHf+y5pCj46XXUV+KQplyqhXWZycR4=
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Sun, 16 Aug 2015 04:29:37 GMT
< Server: AmazonS3
<
RequestPerform(1670): HTTP response code 404 was returned, returning ENOENT
RequestPerform(1671): Body Text:
list_bucket(2352): [path=/tmp/media/catalog/category/httpd.conf]
ListBucketRequest(2585): [tpath=/tmp/media/catalog/category/httpd.conf]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
insertV4Headers(1973): computing signature [GET] [delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com?delimiter=/&max-keys=1&prefix=tmp/media/catalog/category/httpd.conf/
< HTTP/1.1 200 OK
< x-amz-id-2: Q5VI/DKvJwGtDEGTHb0c1lR/g47GpxcexDYbWeQwP7NprMCnwfberMLZTgfzpOvMj74vJbqy1cc=
< x-amz-request-id: E4C884C0AB1B61E6
< Date: Sun, 16 Aug 2015 04:29:39 GMT
< x-amz-bucket-region: us-west-2
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Server: AmazonS3
<
RequestPerform(1648): HTTP response code 200
append_objects_from_xml_ex(2448): contents_xp->nodesetval is empty.
append_objects_from_xml_ex(2448): contents_xp->nodesetval is empty.
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=59]
create_file_object(831): [path=/tmp/media/catalog/category/httpd.conf][mode=100644]
PutRequest(2322): [tpath=/tmp/media/catalog/category/httpd.conf]
PutRequest(2339): create zero byte file object.
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
insertV4Headers(1973): computing signature [PUT] [/tmp/media/catalog/category/httpd.conf] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
PutRequest(2431): uploading... [path=/tmp/media/catalog/category/httpd.conf][fd=-1][size=0]
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
< HTTP/1.1 200 OK
< x-amz-id-2: WnkREa78+Kzy5Us8aeea4a6+1fz8OzvV73ckK+zqXcQqMA0+mOyVTRlAEjCpZjZn50lNWFx5vlU=
< x-amz-request-id: FB2C1C8D56EAD00F
< Date: Sun, 16 Aug 2015 04:29:39 GMT
< ETag: "d41d8cd98f00b204e9800998ecf8427e"
< Content-Length: 0
< Server: AmazonS3
<
RequestPerform(1648): HTTP response code 200
DelStat(370): delete stat cache entry[path=/tmp/media/catalog/category/httpd.conf]
Open(1192): [path=/tmp/media/catalog/category/httpd.conf][size=0][time=-1]
Open(582): [path=/tmp/media/catalog/category/httpd.conf][fd=-1][size=0][time=-1]
Open(147): failed to open cache stat file path(/tmp/media/catalog/category/httpd.conf) - errno(2)
Open(147): failed to open cache stat file path(/tmp/media/catalog/category/httpd.conf) - errno(2)
Open(623): failed to open file(/s3fscache/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf). errno(2)
create[18446744073709551615] flags: 0x80c1 /tmp/media/catalog/category/httpd.conf
getattr /tmp/media/catalog/category/httpd.conf
s3fs_getattr(740): [path=/tmp/media/catalog/category/httpd.conf]
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=60]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=71]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=86]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=109]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog/category/httpd.conf]
get_object_attribute(353): [path=/tmp/media/catalog/category/httpd.conf]
HeadRequest(2169): [tpath=/tmp/media/catalog/category/httpd.conf]
PreHeadRequest(2108): [tpath=/tmp/media/catalog/category/httpd.conf][bpath=][save=]
prepare_url(3974): URL is http://s3-us-west-2.amazonaws.com/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf
prepare_url(4006): URL changed is http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
insertV4Headers(1973): computing signature [HEAD] [/tmp/media/catalog/category/httpd.conf] [] []
url_to_host(99): url is http://s3-us-west-2.amazonaws.com
RequestPerform(1631): connecting to URL http://avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com/tmp/media/catalog/category/httpd.conf
< HTTP/1.1 200 OK
< x-amz-id-2: LA9VXaTyAAu/12C7LHyDnxsJ8JQ+stusJiLPpKlJ7rTL+y5mDCPvHomadVASjlDpu7e4IHAV4T8=
< x-amz-request-id: 998F1604823754A4
< Date: Sun, 16 Aug 2015 04:29:39 GMT
< x-amz-meta-gid: 0
< x-amz-meta-mtime: 1439699377
< x-amz-meta-uid: 0
< x-amz-meta-mode: 33188
< Last-Modified: Sun, 16 Aug 2015 04:29:39 GMT
< ETag: "d41d8cd98f00b204e9800998ecf8427e"
< Accept-Ranges: bytes
< Content-Type: application/octet-stream
< Content-Length: 0
< Server: AmazonS3
<
Connection #0 to host avumindxdsmagentomediavpc-8e493deb.s3-us-west-2.amazonaws.com left intact
RequestPerform(1648): HTTP response code 200
AddStat(248): add stat cache entry[path=/tmp/media/catalog/category/httpd.conf]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/httpd.conf][time=1439699377][hit count=0]
ExistOpen(1243): [path=/tmp/media/catalog/category/httpd.conf][fd=-1]
Open(1192): [path=/tmp/media/catalog/category/httpd.conf][size=-1][time=-1]
Open(582): [path=/tmp/media/catalog/category/httpd.conf][fd=-1][size=-1][time=-1]
Open(147): failed to open cache stat file path(/tmp/media/catalog/category/httpd.conf) - errno(2)
Open(147): failed to open cache stat file path(/tmp/media/catalog/category/httpd.conf) - errno(2)
Open(623): failed to open file(/s3fscache/avumindxdsmagentomediavpc-8e493deb/tmp/media/catalog/category/httpd.conf). errno(2)
Close(1287): [ent->file=/tmp/media/catalog/category/httpd.conf][ent->fd=-1]
Close(542): [path=/tmp/media/catalog/category/httpd.conf][fd=-1][refcnt=0]
s3fs_getattr(763): [path=/tmp/media/catalog/category/httpd.conf] uid=0, gid=0, mode=100644
NODEID: 9
unique: 136, success, outsize: 160
unique: 137, opcode: GETXATTR (22), nodeid: 9, insize: 68, pid: 21880
getxattr /tmp/media/catalog/category/httpd.conf security.capability 0
s3fs_getxattr(2988): [path=/tmp/media/catalog/category/httpd.conf][name=security.capability][value=(nil)][size=0]
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=61]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=72]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=87]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=110]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
get_object_attribute(353): [path=/tmp/media/catalog/category/httpd.conf]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/httpd.conf][time=1439699377][hit count=1]
unique: 137, error: -61 (No data available), outsize: 16
unique: 138, opcode: WRITE (16), nodeid: 9, insize: 266, pid: 21880
write[18446744073709551615] 186 bytes to 0 flags: 0x8001
s3fs_write(2016): [path=/tmp/media/catalog/category/httpd.conf][size=186][offset=0][fd=18446744073709551615]
ExistOpen(1243): [path=/tmp/media/catalog/category/httpd.conf][fd=-1]
Open(1192): [path=/tmp/media/catalog/category/httpd.conf][size=-1][time=-1]
s3fs_write(2020): could not find opened fd(/tmp/media/catalog/category/httpd.conf)
unique: 138, error: -5 (Input/output error), outsize: 16
unique: 139, opcode: FLUSH (25), nodeid: 9, insize: 64, pid: 21880
flush[18446744073709551615]
s3fs_flush(2049): [path=/tmp/media/catalog/category/httpd.conf][fd=18446744073709551615]
check_parent_object_access(605): [path=/tmp/media/catalog/category/httpd.conf]
check_object_access(499): [path=/tmp/media/catalog/category]
get_object_attribute(353): [path=/tmp/media/catalog/category]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/][time=1439699377][hit count=62]
check_object_access(499): [path=/tmp/media/catalog]
get_object_attribute(353): [path=/tmp/media/catalog]
GetStat(171): stat cache hit [path=/tmp/media/catalog/][time=1439699377][hit count=73]
check_object_access(499): [path=/tmp/media]
get_object_attribute(353): [path=/tmp/media]
GetStat(171): stat cache hit [path=/tmp/media/][time=1439699377][hit count=88]
check_object_access(499): [path=/tmp]
get_object_attribute(353): [path=/tmp]
GetStat(171): stat cache hit [path=/tmp/][time=1439699377][hit count=111]
check_object_access(499): [path=/]
get_object_attribute(353): [path=/]
check_object_access(499): [path=/tmp/media/catalog/category/httpd.conf]
get_object_attribute(353): [path=/tmp/media/catalog/category/httpd.conf]
GetStat(171): stat cache hit [path=/tmp/media/catalog/category/httpd.conf][time=1439699377][hit count=2]
ExistOpen(1243): [path=/tmp/media/catalog/category/httpd.conf][fd=-1]
Open(1192): [path=/tmp/media/catalog/category/httpd.conf][size=-1][time=-1]
unique: 139, success, outsize: 16
unique: 140, opcode: RELEASE (18), nodeid: 9, insize: 64, pid: 0
release[18446744073709551615] flags: 0x8001
s3fs_release(2121): [path=/tmp/media/catalog/category/httpd.conf][fd=18446744073709551615]
DelStat(370): delete stat cache entry[path=/tmp/media/catalog/category/httpd.conf]
GetFdEntity(1160): [path=/tmp/media/catalog/category/httpd.conf][fd=-1]
s3fs_release(2135): could not find fd(file=/tmp/media/catalog/category/httpd.conf)
unique: 140, success, outsize: 16
[root@ip-10-0-74-19 scripts]#
@bpascard commented on GitHub (Aug 18, 2015):
I recently had a similar problem (issue #244). So far the 2 solutions that solved it for me are :
Either disabling cache by removing the use_cache option
... or downgrading to v1.79
@niklasenB commented on GitHub (Aug 18, 2015):
I thought I would have solved it by increasing the retry parameter, but after building a new instance and running the installation script above, I am getting same I/O errors as before.
Will try to mount it without cache option
But there seems to be a bug in the latest release.
@karthikkrishnanv commented on GitHub (Aug 18, 2015):
@bpascard : That's what I ended up doing. Downgrading to last archived release worked for me as well.
@niklasenB commented on GitHub (Aug 18, 2015):
how do you do that on a running environment?
Do I need to remove s3fs first and the switch branch to v1.79 and install it from there again?
@karthikkrishnanv commented on GitHub (Aug 18, 2015):
@niklasenB - unmount the drive, reinstall and mount. I didn't need to explicitly remove s3fs binary as the new build will overwrite.
@aleandros commented on GitHub (Aug 18, 2015):
It doesn't work for me with version 1.79, but, same as @bpascard , removing the
use_cacheoption seems to work.@fbarrocal commented on GitHub (Aug 18, 2015):
Same here. Never updated from v1.79 but had same error recently. Removing use_cache parameter fixed it.
@niklasenB commented on GitHub (Aug 19, 2015):
Okay, I can confirm without cache parameter it's working.
There's another issue for that already so I will close this one.