[GH-ISSUE #43] Local LLM #14

Closed
opened 2026-02-27 07:19:59 +03:00 by kerem · 2 comments
Owner

Originally created by @ablito19 on GitHub (Jan 9, 2026).
Original GitHub issue: https://github.com/KeygraphHQ/shannon/issues/43

hi, how to use Local LLM with LM Studio for example ?

Originally created by @ablito19 on GitHub (Jan 9, 2026). Original GitHub issue: https://github.com/KeygraphHQ/shannon/issues/43 hi, how to use Local LLM with LM Studio for example ?
kerem closed this issue 2026-02-27 07:19:59 +03:00
Author
Owner

@Steake commented on GitHub (Jan 15, 2026):

Already implemented here: https://github.com/Steake/shannon-uncontained

<!-- gh-comment-id:3753757373 --> @Steake commented on GitHub (Jan 15, 2026): Already implemented here: https://github.com/Steake/shannon-uncontained
Author
Owner

@keygraphVarun commented on GitHub (Jan 22, 2026):

We now have experimental (but unsupported) support for other models via Claude Code Router (https://github.com/musistudio/claude-code-router):
https://github.com/KeygraphHQ/shannon?tab=readme-ov-file#experimental---unsupported-router-mode-alternative-providers

You can tweak the Claude Code Router setup to point to your local models (we don’t have official instructions yet, but it should be fairly straightforward).

A bit of commentary: we didn’t enable DeepSeek or other open-source models by default because the results were significantly worse than Anthropic. In our preliminary testing, none of them consistently made it past the Recon phase.

Shannon is built on top of the Anthropic Agent SDK and is optimized for Anthropic models. You shouldn’t expect comparable results when swapping in other providers, since the harness + model combination was tuned for Anthropic.

Anthropic models will be our primary focus going forward.

<!-- gh-comment-id:3787161640 --> @keygraphVarun commented on GitHub (Jan 22, 2026): We now have experimental (but unsupported) support for other models via Claude Code Router (https://github.com/musistudio/claude-code-router): https://github.com/KeygraphHQ/shannon?tab=readme-ov-file#experimental---unsupported-router-mode-alternative-providers You can tweak the Claude Code Router setup to point to your local models (we don’t have official instructions yet, but it should be fairly straightforward). A bit of commentary: we didn’t enable DeepSeek or other open-source models by default because the results were significantly worse than Anthropic. In our preliminary testing, none of them consistently made it past the Recon phase. Shannon is built on top of the Anthropic Agent SDK and is optimized for Anthropic models. You shouldn’t expect comparable results when swapping in other providers, since the harness + model combination was tuned for Anthropic. Anthropic models will be our primary focus going forward.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/shannon-KeygraphHQ#14
No description provided.