starred/ALwrity

Fork 0

mirror of https://github.com/AJaySi/ALwrity.git synced 2026-04-25 08:55:58 +03:00

[GH-ISSUE #117] Take advantage of increased LLM context window #92

New issue

Closed

opened 2026-03-02 23:33:33 +03:00 by kerem · 4 comments

kerem commented

2026-03-02 23:33:33 +03:00

Owner

Originally created by @AJaySi on GitHub (Sep 2, 2024).
Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/117

Originally assigned to: @AJaySi on GitHub.

RAG is dying as the context window keeps increasing exponentially.
With 1M tokens context windows, who needs RAG. Caching course material and doing vector search seems like the way to go.

We will need to implement concepts from this paper: https://ai.google.dev/gemini-api/docs/long-context

Originally created by @AJaySi on GitHub (Sep 2, 2024). Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/117 Originally assigned to: @AJaySi on GitHub. RAG is dying as the context window keeps increasing exponentially. With 1M tokens context windows, who needs RAG. Caching course material and doing vector search seems like the way to go. We will need to implement concepts from this paper: https://ai.google.dev/gemini-api/docs/long-context

kerem

2026-03-02 23:33:33 +03:00

closed this issue
added the
LLM

enhancement

RAG knowledgebase Memory

AI writer
labels

kerem commented

2026-03-02 23:33:34 +03:00

Author

Owner

@AJaySi commented on GitHub (Sep 24, 2024):

https://ai.google.dev/gemini-api/docs/long-context

@AJaySi commented on GitHub (Sep 24, 2024): https://ai.google.dev/gemini-api/docs/long-context

kerem commented

2026-03-02 23:33:34 +03:00

Author

Owner

@AJaySi commented on GitHub (Sep 24, 2024):

https://github.com/google-gemini/cookbook/blob/main/examples/Apollo_11.ipynb

@AJaySi commented on GitHub (Sep 24, 2024): https://github.com/google-gemini/cookbook/blob/main/examples/Apollo_11.ipynb

kerem commented

2026-03-02 23:33:34 +03:00

Author

Owner

@AJaySi commented on GitHub (Mar 13, 2025):

This needs attention for long form content generation.

@AJaySi commented on GitHub (Mar 13, 2025): This needs attention for long form content generation.

kerem commented

2026-03-02 23:33:34 +03:00

Author

Owner

@AJaySi commented on GitHub (Sep 25, 2025):

We have shifted to flash 2.5 and this feature is inheriently provided and needs no extra instrumentation on our part.
I still need to test, but the quality suffers a lot with longer content. Needs more experiementation.

@AJaySi commented on GitHub (Sep 25, 2025): We have shifted to flash 2.5 and this feature is inheriently provided and needs no extra instrumentation on our part. I still need to test, but the quality suffers a lot with longer content. Needs more experiementation.

kerem referenced this issue

2026-03-13 20:18:34 +03:00

[GH-ISSUE #92] Problem with the Story Writer Tool #412

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/ALwrity#92

No description provided.

Rows
Columns