[GH-ISSUE #55] Add a rate-limiter setting #51

New issue

Closed

opened 2026-03-02 11:46:05 +03:00 by kerem · 1 comment

kerem commented

2026-03-02 11:46:05 +03:00

Owner

Originally created by @Reledia on GitHub (Mar 30, 2024).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/55

I am currently using OpenRouter with a free model as they provide a compatible OpenAI API. Problem is, as they are free models they often get the json format wrong, so the output has to be discarded.

But by looking at the logs, I see that after three tries the inference stops, and there are no more pending jobs of any type in the admin panel. My suggestion is then to add a rate-limiter setting in order to use such free options without DDOS'ing any site and to keep trying for unresolved tag.

In addition, it would be cool if in the admin section we could modify the base prompt and reset it to base value, as different models react very differently to the same templates and prompts

Originally created by @Reledia on GitHub (Mar 30, 2024). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/55 I am currently using OpenRouter with a free model as they provide a compatible OpenAI API. Problem is, as they are free models they often get the json format wrong, so the output has to be discarded. But by looking at the logs, I see that after three tries the inference stops, and there are no more pending jobs of any type in the admin panel. My suggestion is then to add a rate-limiter setting in order to use such free options without DDOS'ing any site and to keep trying for unresolved tag. In addition, it would be cool if in the admin section we could modify the base prompt and reset it to base value, as different models react very differently to the same templates and prompts

kerem closed this issue

2026-03-02 11:46:05 +03:00

kerem commented

2026-03-02 11:46:06 +03:00

Author

Owner

@kamtschatka commented on GitHub (Oct 19, 2024):

is that still an issue? there were some changes to the prompt, which made the problem go away for me (on ollama)

@kamtschatka commented on GitHub (Oct 19, 2024): is that still an issue? there were some changes to the prompt, which made the problem go away for me (on ollama)

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/karakeep#51

No description provided.

Rows
Columns