[GH-ISSUE #1856] AI tags inference stopped working after a while #1156

Closed
opened 2026-03-02 11:55:24 +03:00 by kerem · 1 comment
Owner

Originally created by @Crazy-Unicooorn on GitHub (Aug 19, 2025).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/1856

Describe the Bug

The tags stopped being generated unexpectedly. I was on vacation when it happened so I'm quite sure it can't be from upgrading to a new release or changing configuration.

I tried changing my config many times when I discovered this, thinking this was a misbehavior with my LLM API service. I did restart the container after each change and click "Regenerate AI tags for failed favorites only". Nothing worked... I was hopeful that the newest release might fix my issue so I updated today, but the bug is still there...

I looked at the logs now, they are not very helpful (or I'm just unsure what it means). I have attached it below.

Steps to Reproduce

I have no idea how to reproduce. I have added supporting info below (screenshot, logs...)

Expected Behaviour

Karakeep to be able to call OPENAI_BASE_URL and get tags in return.

Screenshots or Additional Context

Image

My settings.env

OPENAI_BASE_URL=https://api.ppq.ai/chat/completions
OPENAI_API_KEY=my-key
INFERENCE_TEXT_MODEL=gpt-4.1-mini
INFERENCE_LANG=french
DISABLE_SIGNUPS=true
DISABLE_NEW_RELEASE_CHECK=true

Portion of the container logs, that I assume is from one inference job (I'm getting several of those):

karakeep_web_1          | 2025-08-19T17:40:32.244Z info: [inference][678] Starting an inference job for bookmark with id "dcuyt337ct5o72sno239m4ju"
karakeep_web_1          | 2025-08-19T17:40:33.928Z error: [inference][678] inference job failed: Error: 500 <!DOCTYPE html>
karakeep_web_1          | <html lang="en">
karakeep_web_1          | <head>
karakeep_web_1          | <meta charset="utf-8">
karakeep_web_1          | <title>Error</title>
karakeep_web_1          | </head>
karakeep_web_1          | <body>
karakeep_web_1          | <pre>Internal Server Error</pre>
karakeep_web_1          | </body>
karakeep_web_1          | </html>
karakeep_web_1          | 
karakeep_web_1          | Error: 500 <!DOCTYPE html>
karakeep_web_1          | <html lang="en">
karakeep_web_1          | <head>
karakeep_web_1          | <meta charset="utf-8">
karakeep_web_1          | <title>Error</title>
karakeep_web_1          | </head>
karakeep_web_1          | <body>
karakeep_web_1          | <pre>Internal Server Error</pre>
karakeep_web_1          | </body>
karakeep_web_1          | </html>
karakeep_web_1          | 
karakeep_web_1          |     at APIError.generate (file:///app/apps/workers/dist/index.mjs:80792:29)
karakeep_web_1          |     at OpenAI.makeStatusError (file:///app/apps/workers/dist/index.mjs:81540:19)
karakeep_web_1          |     at OpenAI.makeRequest (file:///app/apps/workers/dist/index.mjs:81577:23)
karakeep_web_1          |     at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
karakeep_web_1          |     at async OpenAIInferenceClient.inferFromText (file:///app/apps/workers/dist/index.mjs:88694:26)
karakeep_web_1          |     at async inferTagsFromText (file:///app/apps/workers/dist/index.mjs:105717:9)
karakeep_web_1          |     at async inferTags (file:///app/apps/workers/dist/index.mjs:105724:49)
karakeep_web_1          |     at async runTagging (file:///app/apps/workers/dist/index.mjs:105807:15)
karakeep_web_1          |     at async Object.runOpenAI [as run] (file:///app/apps/workers/dist/index.mjs:105866:4)
karakeep_web_1          |     at async Runner.runOnce (file:///app/apps/workers/node_modules/.pnpm/liteque@0.5.0_@opentelemetry+api@1.9.0_@types+better-sqlite3@7.6.13_@types+react@19.1.8_bette_ammj2iozvucl57pkjye2g3eosq/node_modules/liteque/dist/index.js:204:4)

Device Details

No response

Exact Karakeep Version

v0.26.0 and v0.25.0

Have you checked the troubleshooting guide?

  • I have checked the troubleshooting guide and I haven't found a solution to my problem
Originally created by @Crazy-Unicooorn on GitHub (Aug 19, 2025). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/1856 ### Describe the Bug The tags stopped being generated unexpectedly. I was on vacation when it happened so I'm quite sure it can't be from upgrading to a new release or changing configuration. I tried changing my config many times when I discovered this, thinking this was a misbehavior with my LLM API service. I did restart the container after each change and click "Regenerate AI tags for failed favorites only". Nothing worked... I was hopeful that the newest release might fix my issue so I updated today, but the bug is still there... I looked at the logs now, they are not very helpful (or I'm just unsure what it means). I have attached it below. ### Steps to Reproduce I have no idea how to reproduce. I have added supporting info below (screenshot, logs...) ### Expected Behaviour Karakeep to be able to call OPENAI_BASE_URL and get tags in return. ### Screenshots or Additional Context <img width="689" height="541" alt="Image" src="https://github.com/user-attachments/assets/2548a847-0e4a-4356-9c83-81491d09f7de" /> ### My `settings.env` ```ENV OPENAI_BASE_URL=https://api.ppq.ai/chat/completions OPENAI_API_KEY=my-key INFERENCE_TEXT_MODEL=gpt-4.1-mini INFERENCE_LANG=french DISABLE_SIGNUPS=true DISABLE_NEW_RELEASE_CHECK=true ``` ### Portion of the container logs, that I assume is from one inference job (I'm getting several of those): ``` karakeep_web_1 | 2025-08-19T17:40:32.244Z info: [inference][678] Starting an inference job for bookmark with id "dcuyt337ct5o72sno239m4ju" karakeep_web_1 | 2025-08-19T17:40:33.928Z error: [inference][678] inference job failed: Error: 500 <!DOCTYPE html> karakeep_web_1 | <html lang="en"> karakeep_web_1 | <head> karakeep_web_1 | <meta charset="utf-8"> karakeep_web_1 | <title>Error</title> karakeep_web_1 | </head> karakeep_web_1 | <body> karakeep_web_1 | <pre>Internal Server Error</pre> karakeep_web_1 | </body> karakeep_web_1 | </html> karakeep_web_1 | karakeep_web_1 | Error: 500 <!DOCTYPE html> karakeep_web_1 | <html lang="en"> karakeep_web_1 | <head> karakeep_web_1 | <meta charset="utf-8"> karakeep_web_1 | <title>Error</title> karakeep_web_1 | </head> karakeep_web_1 | <body> karakeep_web_1 | <pre>Internal Server Error</pre> karakeep_web_1 | </body> karakeep_web_1 | </html> karakeep_web_1 | karakeep_web_1 | at APIError.generate (file:///app/apps/workers/dist/index.mjs:80792:29) karakeep_web_1 | at OpenAI.makeStatusError (file:///app/apps/workers/dist/index.mjs:81540:19) karakeep_web_1 | at OpenAI.makeRequest (file:///app/apps/workers/dist/index.mjs:81577:23) karakeep_web_1 | at process.processTicksAndRejections (node:internal/process/task_queues:105:5) karakeep_web_1 | at async OpenAIInferenceClient.inferFromText (file:///app/apps/workers/dist/index.mjs:88694:26) karakeep_web_1 | at async inferTagsFromText (file:///app/apps/workers/dist/index.mjs:105717:9) karakeep_web_1 | at async inferTags (file:///app/apps/workers/dist/index.mjs:105724:49) karakeep_web_1 | at async runTagging (file:///app/apps/workers/dist/index.mjs:105807:15) karakeep_web_1 | at async Object.runOpenAI [as run] (file:///app/apps/workers/dist/index.mjs:105866:4) karakeep_web_1 | at async Runner.runOnce (file:///app/apps/workers/node_modules/.pnpm/liteque@0.5.0_@opentelemetry+api@1.9.0_@types+better-sqlite3@7.6.13_@types+react@19.1.8_bette_ammj2iozvucl57pkjye2g3eosq/node_modules/liteque/dist/index.js:204:4) ``` ### Device Details _No response_ ### Exact Karakeep Version v0.26.0 and v0.25.0 ### Have you checked the troubleshooting guide? - [x] I have checked the troubleshooting guide and I haven't found a solution to my problem
kerem 2026-03-02 11:55:24 +03:00
Author
Owner

@MohamedBassem commented on GitHub (Sep 7, 2025):

According to the logs, your API server is returning 500s (internal server error), so not much karakeep can do here. Maybe try changing the LLM provider and see if it helps.

<!-- gh-comment-id:3263706166 --> @MohamedBassem commented on GitHub (Sep 7, 2025): According to the logs, your API server is returning 500s (internal server error), so not much karakeep can do here. Maybe try changing the LLM provider and see if it helps.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#1156
No description provided.