[PR #2374] [MERGED] Fix/docs for Ollama to recommend OpenAI-compatible endpoint #2087

New issue

Closed

opened 2026-03-02 12:00:30 +03:00 by kerem · 0 comments

kerem commented

2026-03-02 12:00:30 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/2374
Author: @Mxrk
Created: 1/11/2026
Status: ✅ Merged
Merged: 1/11/2026
Merged by: @MohamedBassem

Base: main ← Head: fix/docs-ollama

📝 Commits (2)

20c141d fix(docs): update Ollama instructions and clarify AI provider options
3254fb5 fix(docs): correct formatting of note on random string generation

📊 Changes

3 files changed (+29 additions, -27 deletions)

View changed files

📝 docs/docs/02-installation/01-docker.md (+1 -13)
📝 docs/docs/02-installation/04-kubernetes.md (+2 -14)
📝 docs/docs/03-configuration/02-different-ai-providers.md (+26 -0)

📄 Description

There was a bug report that since the latest version karakeep can't generate tags anymore with gpt-oss. The problem was that karakeep changed to using model.generate for Ollama, but gpt-oss is using the harmony format:

"If you use model.generate directly, you need to apply the harmony format manually using the chat template or use our openai-harmony package“ (https://github.com/openai/gpt-oss?tab=readme-ov-file#transformers)

In general it seems to be recommended to use the chat endpoint (more on discord if interested).

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/2374 **Author:** [@Mxrk](https://github.com/Mxrk) **Created:** 1/11/2026 **Status:** ✅ Merged **Merged:** 1/11/2026 **Merged by:** [@MohamedBassem](https://github.com/MohamedBassem) **Base:** `main` ← **Head:** `fix/docs-ollama` --- ### 📝 Commits (2) - [`20c141d`](https://github.com/karakeep-app/karakeep/commit/20c141d2512f65090cc6e2ef59545e856d88fd57) fix(docs): update Ollama instructions and clarify AI provider options - [`3254fb5`](https://github.com/karakeep-app/karakeep/commit/3254fb5f068f0d439822bdd82f1666f2b14161ef) fix(docs): correct formatting of note on random string generation ### 📊 Changes **3 files changed** (+29 additions, -27 deletions) <details> <summary>View changed files</summary> 📝 `docs/docs/02-installation/01-docker.md` (+1 -13) 📝 `docs/docs/02-installation/04-kubernetes.md` (+2 -14) 📝 `docs/docs/03-configuration/02-different-ai-providers.md` (+26 -0) </details> ### 📄 Description There was a bug report that since the latest version karakeep can't generate tags anymore with gpt-oss. The problem was that karakeep changed to using model.generate for Ollama, but gpt-oss is using the harmony format: "If you use model.generate directly, you need to apply the harmony format manually using the chat template or use our openai-harmony package“ (https://github.com/openai/gpt-oss?tab=readme-ov-file#transformers) In general it seems to be recommended to use the chat endpoint (more on discord if interested). --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

kerem

2026-03-02 12:00:30 +03:00

closed this issue
added the
pull-request
label

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/karakeep#2087

No description provided.

Rows
Columns