[PR #418] [MERGED] [Feature Request] Ability to select what to "crawl full page archive" #398 #1621

Closed
opened 2026-03-02 11:58:26 +03:00 by kerem · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/418
Author: @kamtschatka
Created: 9/24/2024
Status: Merged
Merged: 9/30/2024
Merged by: @MohamedBassem

Base: mainHead: selective-full-page-crawl


📝 Commits (3)

  • 06491c0 [Feature Request] Ability to select what to "crawl full page archive" #398
  • f264ff3 minor icon and wording changes
  • 72eade3 Merge branch 'main' into selective-full-page-crawl

📊 Changes

5 files changed (+89 additions, -6 deletions)

View changed files

📝 apps/web/components/dashboard/BulkBookmarksAction.tsx (+50 -1)
📝 apps/web/components/dashboard/bookmarks/BookmarkOptions.tsx (+25 -0)
📝 apps/workers/crawlerWorker.ts (+5 -3)
📝 packages/shared/queues.ts (+2 -1)
📝 packages/trpc/routers/bookmarks.ts (+7 -1)

📄 Description

Added the ability to start a full page crawl for links and also in bulk operations
added the ability to refresh links as a bulk operation as well

I have split the PR into 2 parts for now. This one is the easy part and will just allow triggering the full page archive. The next one will deal with the changes required to allow multiple archives to be stored, as we discussed in discord.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/418 **Author:** [@kamtschatka](https://github.com/kamtschatka) **Created:** 9/24/2024 **Status:** ✅ Merged **Merged:** 9/30/2024 **Merged by:** [@MohamedBassem](https://github.com/MohamedBassem) **Base:** `main` ← **Head:** `selective-full-page-crawl` --- ### 📝 Commits (3) - [`06491c0`](https://github.com/karakeep-app/karakeep/commit/06491c04cc0a0233d6b4d3af565df917b3847cc5) [Feature Request] Ability to select what to "crawl full page archive" #398 - [`f264ff3`](https://github.com/karakeep-app/karakeep/commit/f264ff3ff0ca0b9abb28e933dec82017095d9b27) minor icon and wording changes - [`72eade3`](https://github.com/karakeep-app/karakeep/commit/72eade3021812614750ca15d9190acb447117337) Merge branch 'main' into selective-full-page-crawl ### 📊 Changes **5 files changed** (+89 additions, -6 deletions) <details> <summary>View changed files</summary> 📝 `apps/web/components/dashboard/BulkBookmarksAction.tsx` (+50 -1) 📝 `apps/web/components/dashboard/bookmarks/BookmarkOptions.tsx` (+25 -0) 📝 `apps/workers/crawlerWorker.ts` (+5 -3) 📝 `packages/shared/queues.ts` (+2 -1) 📝 `packages/trpc/routers/bookmarks.ts` (+7 -1) </details> ### 📄 Description Added the ability to start a full page crawl for links and also in bulk operations added the ability to refresh links as a bulk operation as well I have split the PR into 2 parts for now. This one is the easy part and will just allow triggering the full page archive. The next one will deal with the changes required to allow multiple archives to be stored, as we discussed in discord. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
kerem 2026-03-02 11:58:26 +03:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#1621
No description provided.