[PR #2068] [CLOSED] Add admin maintenance job to migrate large inline HTML #1966

Closed
opened 2026-03-02 11:59:58 +03:00 by kerem · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/2068
Author: @MohamedBassem
Created: 10/25/2025
Status: Closed

Base: codex/generalize-tidyassetsqueue-to-adminmaintenancequeueHead: codex/implement-admin-job-for-bookmark-links


📝 Commits (5)

  • 046c29d fix: update OpenAI API to use max_completion_tokens instead of max_tokens (#2000)
  • 6ea5dd1 refactor: generalize tidy assets queue into admin maintenance (#2059)
  • 1713600 fix(inferance): skip token slicing when content is already witin max length
  • e1f3c6f Add admin maintenance job to migrate large inline HTML
  • 2e9498b Merge branch 'main' into codex/implement-admin-job-for-bookmark-links

📊 Changes

17 files changed (+421 additions, -163 deletions)

View changed files

📝 apps/web/components/admin/BackgroundJobs.tsx (+41 -21)
📝 apps/web/lib/i18n/locales/en/translation.json (+4 -3)
📝 apps/web/lib/i18n/locales/en_US/translation.json (+1 -0)
apps/workers/constants.ts (+1 -0)
📝 apps/workers/index.ts (+2 -2)
apps/workers/workers/adminMaintenance/tasks/migrateLinkHtmlContent.ts (+155 -0)
apps/workers/workers/adminMaintenance/tasks/tidyAssets.ts (+78 -0)
apps/workers/workers/adminMaintenanceWorker.ts (+81 -0)
📝 apps/workers/workers/crawlerWorker.ts (+1 -2)
apps/workers/workers/tidyAssetsWorker.ts (+0 -110)
📝 docs/docs/03-configuration.md (+2 -1)
📝 packages/shared-server/src/queues.ts (+26 -6)
📝 packages/shared/config.ts (+2 -0)
📝 packages/shared/inference.ts (+6 -2)
📝 packages/shared/prompts.ts (+3 -0)
📝 packages/trpc/routers/admin.ts (+16 -14)
📝 packages/trpc/stats.ts (+2 -2)

📄 Description

Summary

  • add an admin maintenance queue task that migrates large inline bookmark HTML into asset storage and reuse the shared size threshold
  • expose the new task through the workers and queue wiring plus an admin UI action with copy updates

Testing

  • pnpm --filter @karakeep/workers lint
  • pnpm --filter @karakeep/web lint

https://chatgpt.com/codex/tasks/task_e_68f6170f6220832ca3fa3a251fea7f7a


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/2068 **Author:** [@MohamedBassem](https://github.com/MohamedBassem) **Created:** 10/25/2025 **Status:** ❌ Closed **Base:** `codex/generalize-tidyassetsqueue-to-adminmaintenancequeue` ← **Head:** `codex/implement-admin-job-for-bookmark-links` --- ### 📝 Commits (5) - [`046c29d`](https://github.com/karakeep-app/karakeep/commit/046c29dcf1083f0ab89b080f7696e6d642a6bd17) fix: update OpenAI API to use max_completion_tokens instead of max_tokens (#2000) - [`6ea5dd1`](https://github.com/karakeep-app/karakeep/commit/6ea5dd194e7be62c1a51566f31808be076d3b139) refactor: generalize tidy assets queue into admin maintenance (#2059) - [`1713600`](https://github.com/karakeep-app/karakeep/commit/17136006c77b5893ad112af6475b2355d346996e) fix(inferance): skip token slicing when content is already witin max length - [`e1f3c6f`](https://github.com/karakeep-app/karakeep/commit/e1f3c6fe1e694287625942f07f09dccda9a6a222) Add admin maintenance job to migrate large inline HTML - [`2e9498b`](https://github.com/karakeep-app/karakeep/commit/2e9498beb39e8819c2c3660f257d36d901beb0c6) Merge branch 'main' into codex/implement-admin-job-for-bookmark-links ### 📊 Changes **17 files changed** (+421 additions, -163 deletions) <details> <summary>View changed files</summary> 📝 `apps/web/components/admin/BackgroundJobs.tsx` (+41 -21) 📝 `apps/web/lib/i18n/locales/en/translation.json` (+4 -3) 📝 `apps/web/lib/i18n/locales/en_US/translation.json` (+1 -0) ➕ `apps/workers/constants.ts` (+1 -0) 📝 `apps/workers/index.ts` (+2 -2) ➕ `apps/workers/workers/adminMaintenance/tasks/migrateLinkHtmlContent.ts` (+155 -0) ➕ `apps/workers/workers/adminMaintenance/tasks/tidyAssets.ts` (+78 -0) ➕ `apps/workers/workers/adminMaintenanceWorker.ts` (+81 -0) 📝 `apps/workers/workers/crawlerWorker.ts` (+1 -2) ➖ `apps/workers/workers/tidyAssetsWorker.ts` (+0 -110) 📝 `docs/docs/03-configuration.md` (+2 -1) 📝 `packages/shared-server/src/queues.ts` (+26 -6) 📝 `packages/shared/config.ts` (+2 -0) 📝 `packages/shared/inference.ts` (+6 -2) 📝 `packages/shared/prompts.ts` (+3 -0) 📝 `packages/trpc/routers/admin.ts` (+16 -14) 📝 `packages/trpc/stats.ts` (+2 -2) </details> ### 📄 Description ## Summary - add an admin maintenance queue task that migrates large inline bookmark HTML into asset storage and reuse the shared size threshold - expose the new task through the workers and queue wiring plus an admin UI action with copy updates ## Testing - pnpm --filter @karakeep/workers lint - pnpm --filter @karakeep/web lint ------ https://chatgpt.com/codex/tasks/task_e_68f6170f6220832ca3fa3a251fea7f7a --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
kerem 2026-03-02 11:59:58 +03:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#1966
No description provided.