[PR #2227] [MERGED] fix: Spread feed fetch requests throughout the hour #2029

New issue

Closed

opened 2026-03-02 12:00:16 +03:00 by kerem · 0 comments

kerem commented

2026-03-02 12:00:16 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/2227
Author: @MohamedBassem
Created: 12/6/2025
Status: ✅ Merged
Merged: 12/8/2025
Merged by: @MohamedBassem

Base: main ← Head: claude/spread-feed-fetch-scheduling-01EihUtmZSyqeE1HfRMessxW

📝 Commits (1)

ad07c9c feat: spread feed fetch scheduling deterministically over the hour

📊 Changes

1 file changed (+31 additions, -0 deletions)

View changed files

📝 apps/workers/workers/feedWorker.ts (+31 -0)

📄 Description

Previously, all RSS feeds were fetched at the top of each hour (minute 0), which could cause load spikes. This change spreads feed fetches evenly throughout the hour using a deterministic hash of the feed ID.

Each feed is assigned a target minute (0-59) based on its ID hash, ensuring consistent scheduling across restarts while distributing the load evenly.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/2227 **Author:** [@MohamedBassem](https://github.com/MohamedBassem) **Created:** 12/6/2025 **Status:** ✅ Merged **Merged:** 12/8/2025 **Merged by:** [@MohamedBassem](https://github.com/MohamedBassem) **Base:** `main` ← **Head:** `claude/spread-feed-fetch-scheduling-01EihUtmZSyqeE1HfRMessxW` --- ### 📝 Commits (1) - [`ad07c9c`](https://github.com/karakeep-app/karakeep/commit/ad07c9ce4d5585816d923ffeedaf2004f53c89ef) feat: spread feed fetch scheduling deterministically over the hour ### 📊 Changes **1 file changed** (+31 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `apps/workers/workers/feedWorker.ts` (+31 -0) </details> ### 📄 Description Previously, all RSS feeds were fetched at the top of each hour (minute 0), which could cause load spikes. This change spreads feed fetches evenly throughout the hour using a deterministic hash of the feed ID. Each feed is assigned a target minute (0-59) based on its ID hash, ensuring consistent scheduling across restarts while distributing the load evenly. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

kerem

2026-03-02 12:00:16 +03:00

closed this issue
added the
pull-request
label

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/karakeep#2029

No description provided.

Rows
Columns