starred/shiori

Fork 0

mirror of https://github.com/go-shiori/shiori.git synced 2026-04-25 06:25:54 +03:00

[GH-ISSUE #712] 403 forbidden request forbidden by administrative rules #350

New issue

Closed

opened 2026-02-25 23:34:01 +03:00 by kerem · 8 comments

kerem commented

2026-02-25 23:34:01 +03:00

Owner

Originally created by @Tataukee on GitHub (Sep 3, 2023).
Original GitHub issue: https://github.com/go-shiori/shiori/issues/712

Unable to save this article , the link either displaying the error message indicated in the title of this issue or opening the link to its original source page .
The article is easily saved to other read later / bookmarks apps .

Originally created by @Tataukee on GitHub (Sep 3, 2023). Original GitHub issue: https://github.com/go-shiori/shiori/issues/712 Unable to save [this article](https://actu.fr/normandie/rouen_76540/rouen-des-familles-au-tribunal-pour-defendre-l-ecole-a-la-maison-on-nous-taxe-de-separatistes_59971016.html) , the link either displaying the error message indicated in the title of this issue or opening the link to its original source page . The article is easily saved to other read later / bookmarks apps .

kerem

2026-02-25 23:34:01 +03:00

closed this issue
added the
tag:stale
label

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@Monirzadeh commented on GitHub (Sep 3, 2023):

more context:
go-readability itself can paras that without problem.

@Monirzadeh commented on GitHub (Sep 3, 2023): more context: [go-readability](https://github.com/go-shiori/go-readability) itself can paras that without problem.

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@Tataukee commented on GitHub (Sep 3, 2023):

Thank you .
Im using Portainer stack to deploy Shiori .
Do you have an idea how to deploy/integrate go-readability ?

@Tataukee commented on GitHub (Sep 3, 2023): Thank you . Im using Portainer stack to deploy Shiori . Do you have an idea how to deploy/integrate [go-readability](https://github.com/go-shiori/go-readability) ?

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@Monirzadeh commented on GitHub (Sep 3, 2023):

it is problem in shioiri side (shiori use go-readability to get readable version)
if you need to test that just clone repository update example/main.go and add url you want than run go run example/main.go
i am not sure but somthing should be different between request of go-shiori and go-readability (maybe in header) that website detect that and return 403
do you have same problem with any other website?

@Monirzadeh commented on GitHub (Sep 3, 2023): it is problem in shioiri side (shiori use go-readability to get readable version) if you need to test that just clone repository update `example/main.go` and add url you want than run `go run example/main.go` i am not sure but somthing should be different between request of `go-shiori` and `go-readability` (maybe in header) that website detect that and return 403 do you have same problem with any other website?

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@Tataukee commented on GitHub (Sep 3, 2023):

yes I do actually have a similar problem with another site getting this error this time : Please enable JS and disable any ad blocker .
I do not have any ad blocker .

@Tataukee commented on GitHub (Sep 3, 2023): yes I do actually have a similar problem with [another site](https://www.names.org/n/huset/about) getting this error this time : Please enable JS and disable any ad blocker . I do not have any ad blocker .

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@Monirzadeh commented on GitHub (Sep 3, 2023):

this one is a little different first one just block when request send from shiori
but the second happen because that site detect you robot (because of IP or can't fingerprint you) that detect my normal browser as robot too. Please enable JS and disable any ad blocker is part of page that show you to solve CAPTCHA that go-readability extract that.

@fmartingr if i remember correctly you change header request on one of the recent commit is it possible to cause this?

@Monirzadeh commented on GitHub (Sep 3, 2023): this one is a little different first one just block when request send from shiori but the second happen because that site detect you robot (because of IP or can't fingerprint you) that detect my normal browser as robot too. `Please enable JS and disable any ad blocker` is part of page that show you to solve CAPTCHA that `go-readability` extract that. @fmartingr if i remember correctly you change header request on one of the recent commit is it possible to cause this?

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@fmartingr commented on GitHub (Sep 9, 2023):

The first article is failing because of the unrecognised user agent we send when downloading a page:

$ curl --user-agent "Shiori/2.0.0 (+https://github.com/go-shiori/shiori)" https://actu.fr/normandie/rouen_76540/rouen-des-familles-au-tribunal-pour-defendre-l-ecole-a-la-maison-on-nous-taxe-de-separatistes_59971016.html
<html><body><h1>403 Forbidden</h1>
Request forbidden by administrative rules.
</body></html>

The second one is probably failing because we do not use a browser for archiving, so javascript is not executed when doing archive. That page may have something in place to detect JS in the browser or something like that.

This raises the old issue of... should we use a browser to create archives? I have, like with everything, ideas around my head, but nothing specific nor in the roadmap at the moment.

The idea of allowing plugins into Shiori is starting to make more sense to me, but it would be an enormous effort to put through, considering there are only two active contributors at the moment.

@fmartingr commented on GitHub (Sep 9, 2023): The first article is failing because of the unrecognised user agent we send when downloading a page: ``` $ curl --user-agent "Shiori/2.0.0 (+https://github.com/go-shiori/shiori)" https://actu.fr/normandie/rouen_76540/rouen-des-familles-au-tribunal-pour-defendre-l-ecole-a-la-maison-on-nous-taxe-de-separatistes_59971016.html <html><body><h1>403 Forbidden</h1> Request forbidden by administrative rules. </body></html> ``` The second one is probably failing because we do not use a browser for archiving, so javascript is not executed when doing archive. That page may have something in place to detect JS in the browser or something like that. This raises the old issue of... should we use a browser to create archives? I have, like with everything, ideas around my head, but nothing specific nor in the roadmap at the moment. The idea of allowing plugins into Shiori is starting to make more sense to me, but it would be an enormous effort to put through, considering there are only two active contributors at the moment.

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@Monirzadeh commented on GitHub (Sep 9, 2023):

about the second link i get that on my regular browser too.
i think it is still so soon to add them. maybe first step is to make them easier to debug.

@Monirzadeh commented on GitHub (Sep 9, 2023): about the second link i get that on my regular browser too. i think it is still so soon to add them. maybe first step is to make them easier to debug.

kerem commented

2026-02-25 23:34:01 +03:00

Author

Owner

@stale[bot] commented on GitHub (Oct 10, 2023):

This issue has been automatically marked as stale because it has not had any activity for quite some time.
It will be closed if no further activity occurs.
Thank you for your contributions.

@stale[bot] commented on GitHub (Oct 10, 2023): This issue has been automatically marked as stale because it has not had any activity for quite some time. It will be closed if no further activity occurs. Thank you for your contributions.