[GH-ISSUE #91] IMplement Google Gemini Caching #72

Closed
opened 2026-03-02 23:33:24 +03:00 by kerem · 2 comments
Owner

Originally created by @AJaySi on GitHub (Jun 29, 2024).
Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/91

Originally assigned to: @AJaySi on GitHub.

https://ai.google.dev/gemini-api/docs/caching?lang=python

Originally created by @AJaySi on GitHub (Jun 29, 2024). Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/91 Originally assigned to: @AJaySi on GitHub. https://ai.google.dev/gemini-api/docs/caching?lang=python
kerem closed this issue 2026-03-02 23:33:25 +03:00
Author
Owner

@AJaySi commented on GitHub (Jul 1, 2024):

When to use context caching
Context caching is particularly well suited to scenarios where a substantial initial context is referenced repeatedly by shorter requests. Consider using context caching for use cases such as:

Chatbots with extensive system instructions
Repetitive analysis of lengthy video files
Recurring queries against large document sets
Frequent code repository analysis or bug fixing

<!-- gh-comment-id:2199188442 --> @AJaySi commented on GitHub (Jul 1, 2024): When to use context caching Context caching is particularly well suited to scenarios where a substantial initial context is referenced repeatedly by shorter requests. Consider using context caching for use cases such as: Chatbots with extensive [system instructions](https://ai.google.dev/gemini-api/docs/system-instructions) Repetitive analysis of lengthy video files Recurring queries against large document sets Frequent code repository analysis or bug fixing
Author
Owner

@AJaySi commented on GitHub (Jul 1, 2024):

Implemented with google gemini.
TBD for Openai and anthropic.

Helps save in billing, implemented for long form content.
TBD for large audio & video files.

<!-- gh-comment-id:2199852336 --> @AJaySi commented on GitHub (Jul 1, 2024): Implemented with google gemini. TBD for Openai and anthropic. Helps save in billing, implemented for long form content. TBD for large audio & video files.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/ALwrity#72
No description provided.