starred/s3fs-fuse
1
0
Fork 0
mirror of https://github.com/s3fs-fuse/s3fs-fuse.git synced 2026-04-25 13:26:00 +03:00
Code Issues 305 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #591] HTTP 404 error #336

New issue
Closed
opened 2026-03-04 01:44:30 +03:00 by kerem · 1 comment
kerem commented 2026-03-04 01:44:30 +03:00
Owner
Copy link

Originally created by @vgadhadaran on GitHub (May 10, 2017).
Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/591

FFFFFFFFFFFFFF

Originally created by @vgadhadaran on GitHub (May 10, 2017). Original GitHub issue: https://github.com/s3fs-fuse/s3fs-fuse/issues/591 FFFFFFFFFFFFFF
kerem closed this issue 2026-03-04 01:44:30 +03:00
kerem commented 2026-03-04 01:44:31 +03:00
Author
Owner
Copy link

@ggtakec commented on GitHub (May 13, 2017):

@vgadhadaran
These are errors that occur when s3fs is able to recognize the object created by another S3 tool, so it attaches an object path that does not exist.

 May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat
 May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.xxx.xxx.xxx/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat
 May 10 14:26:41 k0001808 s3fs[2213]: computing signature [HEAD] [/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat] [] []
 May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net
 May 10 14:26:41 k0001808 s3fs[2213]: [path=/SI_MODELING_TIME_OLD/PIF/PIF_test/SASDATA/premium_exposure.sas7bdat][fd=8]
 May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 404 was returned, returning ENOENT
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/]
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/][bpath=][save=][sseckeypos=-1]
 May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/
 May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.xxx.xxx.xxx/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/
 May 10 14:26:41 k0001808 s3fs[2213]: computing signature [HEAD] [/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/] [] []
 May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net
 May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 404 was returned, returning ENOENT
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_$folder$]
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_$folder$][bpath=][save=][sseckeypos=-1]
 May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_%24folder%24
 May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.xxx.xxx.xxx/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_%24folder%24
 May 10 14:26:41 k0001808 s3fs[2213]: computing signature [HEAD] [/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_$folder$] [] []
 May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net
 May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 404 was returned, returning ENOENT
 May 10 14:26:41 k0001808 s3fs[2213]: [path=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat]
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat]
 May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1?delimiter=/&max-keys=2&prefix=SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/
 May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.hcpdevn1.travt.net?delimiter=/&max-keys=2&prefix=SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/
 May 10 14:26:41 k0001808 s3fs[2213]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/] []
 May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net
 May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 200
 May 10 14:26:41 k0001808 s3fs[2213]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
 May 10 14:26:41 k0001808 s3fs[2213]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty.
 May 10 14:26:41 k0001808 s3fs[2213]: [path=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat][mode=100777][flags=32962]
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat]
 May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat][bpath=][save=][sseckeypos=-1]

For example, the above message is a request that occurred to check the existence of the "premium_exposure_5pct_sample.sas7bdat" object.
S3fs confirms the existence of the object in the following order.

  • premium_exposure_5pct_sample.sas7bdat
  • premium_exposure_5pct_sample.sas7bdat/
  • premium_exposure_5pct_sample.sas7bdat_folder
  • premium_exposure_5pct_sample.sas7bdat does not exist but confirms the existence of an object containing this path name
    In order to reduce the request to confirm the existence of the object many times, you can have a cache of stat information by max_stat_cache_size/enable_noobj_cache/etc(please see man page).
Please post Additional Information about your environment when posting issue, example: version/s3fs option/etc. You can see them as templates when posting issues. It will help us to solve issues.
<!-- gh-comment-id:301234859 --> @ggtakec commented on GitHub (May 13, 2017): @vgadhadaran These are errors that occur when s3fs is able to recognize the object created by another S3 tool, so it attaches an object path that does not exist. ``` May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.xxx.xxx.xxx/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat May 10 14:26:41 k0001808 s3fs[2213]: computing signature [HEAD] [/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat] [] [] May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net May 10 14:26:41 k0001808 s3fs[2213]: [path=/SI_MODELING_TIME_OLD/PIF/PIF_test/SASDATA/premium_exposure.sas7bdat][fd=8] May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 404 was returned, returning ENOENT May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/] May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/][bpath=][save=][sseckeypos=-1] May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/ May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.xxx.xxx.xxx/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/ May 10 14:26:41 k0001808 s3fs[2213]: computing signature [HEAD] [/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/] [] [] May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 404 was returned, returning ENOENT May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_$folder$] May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_$folder$][bpath=][save=][sseckeypos=-1] May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_%24folder%24 May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.xxx.xxx.xxx/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_%24folder%24 May 10 14:26:41 k0001808 s3fs[2213]: computing signature [HEAD] [/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat_$folder$] [] [] May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 404 was returned, returning ENOENT May 10 14:26:41 k0001808 s3fs[2213]: [path=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat] May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat] May 10 14:26:41 k0001808 s3fs[2213]: URL is https://phase1.awspoc.xxx.xxx.xxx/phase1?delimiter=/&max-keys=2&prefix=SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/ May 10 14:26:41 k0001808 s3fs[2213]: URL changed is https://phase1.awspoc.hcpdevn1.travt.net?delimiter=/&max-keys=2&prefix=SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/ May 10 14:26:41 k0001808 s3fs[2213]: computing signature [GET] [/] [delimiter=/&max-keys=2&prefix=SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat/] [] May 10 14:26:41 k0001808 s3fs[2213]: url is https://awspoc.hcpdevn1.travt.net May 10 14:26:41 k0001808 s3fs[2213]: HTTP response code 200 May 10 14:26:41 k0001808 s3fs[2213]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty. May 10 14:26:41 k0001808 s3fs[2213]: s3fs.cpp:append_objects_from_xml_ex(2531): contents_xp->nodesetval is empty. May 10 14:26:41 k0001808 s3fs[2213]: [path=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat][mode=100777][flags=32962] May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat] May 10 14:26:41 k0001808 s3fs[2213]: [tpath=/SI_MODELING_TIME_OLD/STARDATA/premium_exposure_5pct_sample.sas7bdat][bpath=][save=][sseckeypos=-1] ``` For example, the above message is a request that occurred to check the existence of the "premium_exposure_5pct_sample.sas7bdat" object. S3fs confirms the existence of the object in the following order. - premium_exposure_5pct_sample.sas7bdat - premium_exposure_5pct_sample.sas7bdat/ - premium_exposure_5pct_sample.sas7bdat_$folder$ - premium_exposure_5pct_sample.sas7bdat does not exist but confirms the existence of an object containing this path name In order to reduce the request to confirm the existence of the object many times, you can have a cache of stat information by max_stat_cache_size/enable_noobj_cache/etc(please see man page). ##### Please post Additional Information about your environment when posting issue, example: version/s3fs option/etc. You can see them as templates when posting issues. It will help us to solve issues.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v1.97
v1.96
v1.95
v1.94
v1.93
v1.92
v1.91
v1.90
v1.89
v1.88
v1.87
v1.86
v1.85
v1.84
v1.83
v1.82
v1.81
v1.80
v1.79
v1.78
Pre-v1.78
v1.77
v1.76
v1.75
v1.74
Labels
Clear labels   
bug

   
bug

   
dataloss

   
duplicate

   
enhancement

   
feature request

   
help wanted

   
invalid

   
need info

   
performance

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
testing
No labels
bug
bug
dataloss
duplicate
enhancement
feature request
help wanted
invalid
need info
performance
pull-request
question
question
testing
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/s3fs-fuse#336
No description provided.