[PR #320] [CLOSED] Allow downloading more content from a webpage and index it #215 #1602

Closed
opened 2026-03-02 11:58:21 +03:00 by kerem · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/320
Author: @kamtschatka
Created: 7/21/2024
Status: Closed

Base: mainHead: more-content


📝 Commits (5)

  • 1025395 refactoring asset types
  • 73e8a12 Added the bookmark type to the database
  • a702812 Allow downloading more content from a webpage and index it #215
  • 10bacbe fixed types
  • f2c97ac Allow downloading more content from a webpage and index it #215

📊 Changes

16 files changed (+457 additions, -125 deletions)

View changed files

📝 apps/web/app/api/assets/[assetId]/route.ts (+25 -6)
📝 apps/web/components/dashboard/preview/LinkContentSection.tsx (+19 -0)
📝 apps/workers/crawlerWorker.ts (+16 -76)
📝 apps/workers/index.ts (+4 -2)
📝 apps/workers/package.json (+1 -0)
apps/workers/videoWorker.ts (+221 -0)
apps/workers/workerUtils.ts (+55 -0)
📝 docs/docs/03-configuration.md (+15 -12)
📝 packages/db/schema.ts (+5 -9)
📝 packages/shared/assetdb.ts (+16 -0)
📝 packages/shared/config.ts (+6 -0)
📝 packages/shared/queues.ts (+23 -0)
📝 packages/shared/types/bookmarks.ts (+1 -0)
packages/shared/utils/bookmarkUtils.ts (+36 -0)
📝 packages/trpc/routers/bookmarks.ts (+1 -20)
📝 pnpm-lock.yaml (+13 -0)

📄 Description

Added a worker that allows downloading videos depending on the environment variables
refactored the code a bit
added new video asset
updated documentation


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/320 **Author:** [@kamtschatka](https://github.com/kamtschatka) **Created:** 7/21/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `more-content` --- ### 📝 Commits (5) - [`1025395`](https://github.com/karakeep-app/karakeep/commit/1025395ee76d7a9e152ab2a2dd8f77177baf380c) refactoring asset types - [`73e8a12`](https://github.com/karakeep-app/karakeep/commit/73e8a12ca8c8b84a7b1b46ab0e53725b9cc2ebf5) Added the bookmark type to the database - [`a702812`](https://github.com/karakeep-app/karakeep/commit/a7028125fea15001a38bb2d5064957906189d854) Allow downloading more content from a webpage and index it #215 - [`10bacbe`](https://github.com/karakeep-app/karakeep/commit/10bacbef2532995d44a3bfc9ae1bfcd02cc37d57) fixed types - [`f2c97ac`](https://github.com/karakeep-app/karakeep/commit/f2c97acd8312d3aeaea813a86a752e07e0586ff3) Allow downloading more content from a webpage and index it #215 ### 📊 Changes **16 files changed** (+457 additions, -125 deletions) <details> <summary>View changed files</summary> 📝 `apps/web/app/api/assets/[assetId]/route.ts` (+25 -6) 📝 `apps/web/components/dashboard/preview/LinkContentSection.tsx` (+19 -0) 📝 `apps/workers/crawlerWorker.ts` (+16 -76) 📝 `apps/workers/index.ts` (+4 -2) 📝 `apps/workers/package.json` (+1 -0) ➕ `apps/workers/videoWorker.ts` (+221 -0) ➕ `apps/workers/workerUtils.ts` (+55 -0) 📝 `docs/docs/03-configuration.md` (+15 -12) 📝 `packages/db/schema.ts` (+5 -9) 📝 `packages/shared/assetdb.ts` (+16 -0) 📝 `packages/shared/config.ts` (+6 -0) 📝 `packages/shared/queues.ts` (+23 -0) 📝 `packages/shared/types/bookmarks.ts` (+1 -0) ➕ `packages/shared/utils/bookmarkUtils.ts` (+36 -0) 📝 `packages/trpc/routers/bookmarks.ts` (+1 -20) 📝 `pnpm-lock.yaml` (+13 -0) </details> ### 📄 Description Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
kerem 2026-03-02 11:58:21 +03:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#1602
No description provided.