mirror of
https://github.com/zlwaterfield/scramble.git
synced 2026-04-27 00:16:00 +03:00
[GH-ISSUE #1] Add Local LLM support #1
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/scramble#1
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @NurvX on GitHub (Sep 18, 2024).
Original GitHub issue: https://github.com/zlwaterfield/scramble/issues/1
Would love to have local llm support through llmstudio or ollama
@praserocking commented on GitHub (Sep 18, 2024):
Please plan to include local LLM via https://lmstudio.ai/ should be easy. It exposes Open AI compatible API locally for any model, which will be an easy integration point. I am pulling this extension and re-writing api section with localhost for my local use. But proper support needs to be through options.
@Richard-Woessner commented on GitHub (Sep 18, 2024):
I think having a local LLM mimicking OpenAI API. Is the move but I don't have much browser experience is it typical for a browser extension to have a running service like a local LLM
@Richard-Woessner commented on GitHub (Sep 18, 2024):
But this also seems perfect for the job
https://github.com/mlc-ai/web-llm
I might try to plug it in later
@len-foss commented on GitHub (Sep 18, 2024):
Should be fixed by #5
@zlwaterfield commented on GitHub (Oct 14, 2024):
Ollama support is in there now but the requests are 403ing because of https://github.com/ollama/ollama/issues/6021 so looking into how to resolve.
@tcsenpai commented on GitHub (Oct 26, 2024):
I tested this on Firefox (Zen).
@FlashSkyNews commented on GitHub (Jan 10, 2025):
Hey! I came across this project a few months ago because I was interested in a locally hosted Grammarly alternative. Is there an update on this issue?
@theJayTea commented on GitHub (Jan 27, 2025):
it looks like this cool repo isn't being updated anymore. I've made something somewhat similar with support for multiple local LLMs, Gemini, etc, and it works system-wide and not just in the browser. Feel free to check it out!
https://github.com/theJayTea/WritingTools
@Dobidop commented on GitHub (May 25, 2025):
Added support for Ollama and LM studio in #15
Works fine for me locally so far at least
@zlwaterfield commented on GitHub (May 25, 2025):
Merged in @Dobidop's PR.
@zlwaterfield commented on GitHub (May 25, 2025):
This should be good now, thanks everyone.