[GH-ISSUE #1240] Add OpenAI proxy support #804

Closed
opened 2026-03-02 11:52:52 +03:00 by kerem · 6 comments
Owner

Originally created by @Node815 on GitHub (Apr 12, 2025).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/1240

Describe the feature you'd like

While OpenAI is the cool kid on the block, I think we should also have the ability to add the ability to point to a custom URL for our choice of API. Or I suppose something like a proxy URL. I use 1min.ai for my choice of provider which we can self host the API endpoint. Taking this from Alpaca (A Flatpak Chat tool)

Image

Something similar would be great!

Describe the benefits this would bring to existing Hoarder users

Having the ability to add a custom OpenAI compatible instance would allow users to choose their desired AI provider. This will allow greater flexibility and more options in the end for those who would like to use their monthly credits toward this process and so forth. :)

Can the goal of this request already be achieved via other means?

No, since this is an enhancement request there is no other way to achieve this.

Have you searched for an existing open/closed issue?

  • I have searched for existing issues and none cover my fundamental request

Additional context

No response

Originally created by @Node815 on GitHub (Apr 12, 2025). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/1240 ### Describe the feature you'd like While OpenAI is the cool kid on the block, I think we should also have the ability to add the ability to point to a custom URL for our choice of API. Or I suppose something like a proxy URL. I use 1min.ai for my choice of provider which we can self host the API endpoint. Taking this from Alpaca (A Flatpak Chat tool) ![Image](https://github.com/user-attachments/assets/fd4a1127-2fc9-4220-ad6b-42b91f8a9bec) Something similar would be great! ### Describe the benefits this would bring to existing Hoarder users Having the ability to add a custom OpenAI compatible instance would allow users to choose their desired AI provider. This will allow greater flexibility and more options in the end for those who would like to use their monthly credits toward this process and so forth. :) ### Can the goal of this request already be achieved via other means? No, since this is an enhancement request there is no other way to achieve this. ### Have you searched for an existing open/closed issue? - [x] I have searched for existing issues and none cover my fundamental request ### Additional context _No response_
Author
Owner

@Mxrk commented on GitHub (Apr 12, 2025):

You can already do that via the config:
OPENAI_BASE_URL https://docs.karakeep.app/configuration#inference-configs-for-automatic-tagging

<!-- gh-comment-id:2798699710 --> @Mxrk commented on GitHub (Apr 12, 2025): You can already do that via the config: OPENAI_BASE_URL https://docs.karakeep.app/configuration#inference-configs-for-automatic-tagging
Author
Owner

@Node815 commented on GitHub (Apr 12, 2025):

You can already do that via the config: OPENAI_BASE_URL https://docs.karakeep.app/configuration#inference-configs-for-automatic-tagging

Ahh! Thank you! I installed this from this site which gave me an LXC in lieu of a docker image. https://community-scripts.github.io/ProxmoxVE/scripts?id=karakeep

I will install the Docker container instead and go from there, Thanks!

<!-- gh-comment-id:2798891222 --> @Node815 commented on GitHub (Apr 12, 2025): > You can already do that via the config: OPENAI_BASE_URL [ https://docs.karakeep.app/configuration#inference-configs-for-automatic-tagging ](https://docs.karakeep.app/configuration#inference-configs-for-automatic-tagging) Ahh! Thank you! I installed this from this site which gave me an LXC in lieu of a docker image. https://community-scripts.github.io/ProxmoxVE/scripts?id=karakeep I will install the Docker container instead and go from there, Thanks!
Author
Owner

@dzx-dzx commented on GitHub (Apr 13, 2025):

Congrats on Node815 for solving the issue. But I still wonder if there's any proxy setting for accessing the endpoint API? I haven't hosted a reverse proxy for LLM yet.

<!-- gh-comment-id:2799896194 --> @dzx-dzx commented on GitHub (Apr 13, 2025): Congrats on Node815 for solving the issue. But I still wonder if there's any proxy setting for accessing the endpoint API? I haven't hosted a reverse proxy for LLM yet.
Author
Owner

@dzx-dzx commented on GitHub (Apr 15, 2025):

Congrats on Node815 for solving the issue. But I still wonder if there's any proxy setting for accessing the endpoint API? I haven't hosted a reverse proxy for LLM yet.

@Mxrk In case if you missed my comment...?

<!-- gh-comment-id:2803793573 --> @dzx-dzx commented on GitHub (Apr 15, 2025): > Congrats on Node815 for solving the issue. But I still wonder if there's any proxy setting for accessing the endpoint API? I haven't hosted a reverse proxy for LLM yet. @Mxrk In case if you missed my comment...?
Author
Owner

@Mxrk commented on GitHub (Apr 15, 2025):

Congrats on Node815 for solving the issue. But I still wonder if there's any proxy setting for accessing the endpoint API? I haven't hosted a reverse proxy for LLM yet.

@Mxrk In case if you missed my comment...?

No, I just don’t have an answer. Sorry. Didn’t dig through the whole project yet.

<!-- gh-comment-id:2804194038 --> @Mxrk commented on GitHub (Apr 15, 2025): > > Congrats on Node815 for solving the issue. But I still wonder if there's any proxy setting for accessing the endpoint API? I haven't hosted a reverse proxy for LLM yet. > > [@Mxrk](https://github.com/Mxrk) In case if you missed my comment...? No, I just don’t have an answer. Sorry. Didn’t dig through the whole project yet.
Author
Owner

@dzx-dzx commented on GitHub (Apr 15, 2025):

Still thanks for commenting

<!-- gh-comment-id:2804236339 --> @dzx-dzx commented on GitHub (Apr 15, 2025): Still thanks for commenting
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#804
No description provided.