[GH-ISSUE #127] "Too Many Requests" when bookmarking Reddit links #88

New issue

Closed

opened 2026-02-25 23:33:25 +03:00 by kerem · 1 comment

kerem commented

2026-02-25 23:33:25 +03:00

Owner

Originally created by @disposedtrolley on GitHub (Apr 7, 2019).
Original GitHub issue: https://github.com/go-shiori/shiori/issues/127

When attempting to bookmark a Reddit link, shiori is immediately blocked and a "Too Many Requests" error is returned, shown below.

It appears that Reddit is taking measures to prevent content from being scraped, and the workaround is to set a custom user-agent header for any requests destined for Reddit - https://www.reddit.com/r/redditdev/comments/3qbll8/429_too_many_requests/

One possible solution might be to feed the PID or Docker container ID into the readability module to be set as part of the user-agent header. This way each instance of shiori is identified separately which should prevent any rate limiting.

Originally created by @disposedtrolley on GitHub (Apr 7, 2019). Original GitHub issue: https://github.com/go-shiori/shiori/issues/127 When attempting to bookmark a Reddit link, shiori is immediately blocked and a "Too Many Requests" error is returned, shown below. ![Screenshot from 2019-04-07 10-55-50](https://user-images.githubusercontent.com/4476568/55677088-08559800-5925-11e9-84a3-58e320fdb444.png) It appears that Reddit is taking measures to prevent content from being scraped, and the workaround is to set a custom `user-agent` header for any requests destined for Reddit - https://www.reddit.com/r/redditdev/comments/3qbll8/429_too_many_requests/ One possible solution might be to feed the PID or Docker container ID into the `readability` module to be set as part of the `user-agent` header. This way each instance of shiori is identified separately which should prevent any rate limiting.

kerem closed this issue

2026-02-25 23:33:25 +03:00

kerem commented

2026-02-25 23:33:25 +03:00

Author

Owner

@RadhiFadlillah commented on GitHub (Aug 27, 2019):

Since the ramadhan branch is merged, this issue should be fixed now. Now Shiori uses its own user agent :

User-Agent: Shiori/2.0.0 (+https://github.com/go-shiori/shiori)

Now it should works fine as can be seen in screenshot on readme.

With that said, I will close this issue for now. Feel free to reopen it if needed.

@RadhiFadlillah commented on GitHub (Aug 27, 2019): Since the ramadhan branch is merged, this issue should be fixed now. Now Shiori uses its own user agent : ``` User-Agent: Shiori/2.0.0 (+https://github.com/go-shiori/shiori) ``` Now it should works fine as can be seen in [screenshot](https://raw.githubusercontent.com/go-shiori/shiori/master/docs/cover.png) on readme. With that said, I will close this issue for now. Feel free to reopen it if needed.

kerem referenced this issue

2026-02-25 23:34:34 +03:00

[PR #89] [MERGED] Adding indexes in the web view (#88) #514

kerem referenced this issue

2026-02-25 23:34:34 +03:00

[PR #90] [CLOSED] This pull request contains both PR #89 (close #88) and PR #85 (close #73) #515