[GH-ISSUE #1721] System resource overuse #1072

Closed
opened 2026-03-02 11:54:48 +03:00 by kerem · 1 comment
Owner

Originally created by @maxtheaxe on GitHub (Jul 11, 2025).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/1721

Describe the Bug

I've been trying to import my pocket export for about three or four days now, and I pretty regularly have to kill my server (hosted on pikapods). It continues to run out of RAM, which causes it to stop functioning altogether, requiring manual intervention. I assume this is because it tries to do too much of the backlog at once, but I'm not really sure.

For reference, I have about 12,000 article saves to import from pocket, and I'm doing LLM-generated tagging and full archival for all of them. I realize this is quite a bit of work, and I don't mind it taking some time, but it shouldn't necessarily require my manual intervention.

I'm open to taking a look at this myself, particularly since I realize this is relatively low-priority, though if possible, I'd appreciate if someone could point me in the right direction. There are a few other possible import-related UX improvements that I'll write up when I have the time as well.

Steps to Reproduce

  1. Enable full archival, LLM-tagging
  2. Import a large list of saves

Expected Behaviour

  • Eventual consumption of all available resources
  • Server grinds to a halt

Screenshots or Additional Context

No response

Device Details

No response

Exact Karakeep Version

v0.25.0

Have you checked the troubleshooting guide?

  • I have checked the troubleshooting guide and I haven't found a solution to my problem
Originally created by @maxtheaxe on GitHub (Jul 11, 2025). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/1721 ### Describe the Bug I've been trying to import my pocket export for about three or four days now, and I pretty regularly have to kill my server (hosted on pikapods). It continues to run out of RAM, which causes it to stop functioning altogether, requiring manual intervention. I assume this is because it tries to do too much of the backlog at once, but I'm not really sure. For reference, I have about 12,000 article saves to import from pocket, and I'm doing LLM-generated tagging and full archival for all of them. I realize this is quite a bit of work, and I don't mind it taking some time, but it shouldn't necessarily require my manual intervention. I'm open to taking a look at this myself, particularly since I realize this is relatively low-priority, though if possible, I'd appreciate if someone could point me in the right direction. There are a few other possible import-related UX improvements that I'll write up when I have the time as well. ### Steps to Reproduce 1. Enable full archival, LLM-tagging 2. Import a large list of saves ### Expected Behaviour - Eventual consumption of all available resources - Server grinds to a halt ### Screenshots or Additional Context _No response_ ### Device Details _No response_ ### Exact Karakeep Version v0.25.0 ### Have you checked the troubleshooting guide? - [x] I have checked the troubleshooting guide and I haven't found a solution to my problem
kerem 2026-03-02 11:54:48 +03:00
Author
Owner

@MohamedBassem commented on GitHub (Sep 7, 2025):

Let's track this in #1721.

<!-- gh-comment-id:3263719395 --> @MohamedBassem commented on GitHub (Sep 7, 2025): Let's track this in #1721.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#1072
No description provided.