[GH-ISSUE #990] No inference client configured, nothing to do now #654

Closed
opened 2026-03-02 11:51:40 +03:00 by kerem · 1 comment
Owner

Originally created by @MarcoWel on GitHub (Feb 6, 2025).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/990

Describe the Bug

Running hoarder in the provided docker compose environment, which works well except AI tagging.

Set the following environment variables in the compose env_file:

OPENAI_API_KEY=gsk_xxxxxx
OPENAI_BASE_URL=https://api.groq.com/openai/v1
INFERENCE_TEXT_MODEL=llama-3.3-70b-versatile

Still in the hoarder logs, it is reporting:
hoarder-web-1 | 2025-02-06T17:12:28.672Z debug: [inference][170] No inference client configured, nothing to do now

Any ideas?

Steps to Reproduce

  1. Set env variables as shown
  2. Check logs

Expected Behaviour

Inferencing should work or throw a defined error

Screenshots or Additional Context

No response

Device Details

No response

Exact Hoarder Version

0.22.0

Have you checked the troubleshooting guide?

  • I have checked the troubleshooting guide and I haven't found a solution to my problem
Originally created by @MarcoWel on GitHub (Feb 6, 2025). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/990 ### Describe the Bug Running hoarder in the provided docker compose environment, which works well except AI tagging. Set the following environment variables in the compose env_file: ``` OPENAI_API_KEY=gsk_xxxxxx OPENAI_BASE_URL=https://api.groq.com/openai/v1 INFERENCE_TEXT_MODEL=llama-3.3-70b-versatile ``` Still in the hoarder logs, it is reporting: `hoarder-web-1 | 2025-02-06T17:12:28.672Z debug: [inference][170] No inference client configured, nothing to do now` Any ideas? ### Steps to Reproduce 1. Set env variables as shown 2. Check logs ### Expected Behaviour Inferencing should work or throw a defined error ### Screenshots or Additional Context _No response_ ### Device Details _No response_ ### Exact Hoarder Version 0.22.0 ### Have you checked the troubleshooting guide? - [x] I have checked the troubleshooting guide and I haven't found a solution to my problem
kerem closed this issue 2026-03-02 11:51:40 +03:00
Author
Owner

@MarcoWel commented on GitHub (Feb 6, 2025):

Solved! The configuration is exactly right as shown.

Issue was that after changing the env_file, it was not enough to restart the compose containers - they had to be fully stopped and then started again to re-read the env file.

<!-- gh-comment-id:2640613371 --> @MarcoWel commented on GitHub (Feb 6, 2025): Solved! The configuration is exactly right as shown. Issue was that after changing the env_file, it was not enough to restart the compose containers - they had to be fully stopped and then started again to re-read the env file.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#654
No description provided.