[PR #265] [CLOSED] Allow downloading more content from a webpage and index it #215 #1583

New issue

Closed

opened 2026-03-02 11:58:16 +03:00 by kerem · 0 comments

kerem commented

2026-03-02 11:58:16 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/265
Author: @kamtschatka
Created: 6/30/2024
Status: ❌ Closed

Base: main ← Head: more-content

📝 Commits (6)

18efca2 refactoring asset types
edec803 Added the bookmark type to the database
5ebb591 Allow downloading more content from a webpage and index it #215
62b9350 fixed types
1a5f1bd Allow downloading more content from a webpage and index it #215
c4d7fb6 Allow downloading more content from a webpage and index it #215

📊 Changes

18 files changed (+476 additions, -142 deletions)

View changed files

📝 apps/web/app/api/assets/[assetId]/route.ts (+25 -6)
📝 apps/web/components/dashboard/preview/LinkContentSection.tsx (+19 -0)
📝 apps/workers/crawlerWorker.ts (+17 -77)
📝 apps/workers/index.ts (+4 -2)
📝 apps/workers/openaiWorker.ts (+1 -1)
📝 apps/workers/package.json (+1 -0)
➕ apps/workers/videoWorker.ts (+221 -0)
➕ apps/workers/workerUtils.ts (+55 -0)
📝 docs/docs/03-configuration.md (+15 -12)
📝 packages/db/schema.ts (+5 -9)
📝 packages/shared/assetdb.ts (+16 -0)
📝 packages/shared/config.ts (+6 -0)
📝 packages/shared/queues.ts (+27 -4)
📝 packages/shared/types/bookmarks.ts (+1 -0)
➕ packages/shared/utils/bookmarkUtils.ts (+36 -0)
📝 packages/trpc/routers/bookmarks.ts (+6 -25)
📝 packages/trpc/routers/tags.ts (+8 -6)
📝 pnpm-lock.yaml (+13 -0)

📄 Description

Added a worker that allows downloading videos depending on the environment variables
refactored the code a bit
added new video asset
updated documentation

Depends on https://github.com/hoarder-app/hoarder/pull/256

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/265 **Author:** [@kamtschatka](https://github.com/kamtschatka) **Created:** 6/30/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `more-content` --- ### 📝 Commits (6) - [`18efca2`](https://github.com/karakeep-app/karakeep/commit/18efca2f04cd553c98c9117c33e63cd3ef80e756) refactoring asset types - [`edec803`](https://github.com/karakeep-app/karakeep/commit/edec803bbd6a469cdd5bc550b2481cd0f7d7914e) Added the bookmark type to the database - [`5ebb591`](https://github.com/karakeep-app/karakeep/commit/5ebb591368b474abc69a355a5c88e82130c160cd) Allow downloading more content from a webpage and index it #215 - [`62b9350`](https://github.com/karakeep-app/karakeep/commit/62b9350e440090af9687993f256c4590031d1b87) fixed types - [`1a5f1bd`](https://github.com/karakeep-app/karakeep/commit/1a5f1bda3294bf0a552213c28204d7e912e134b2) Allow downloading more content from a webpage and index it #215 - [`c4d7fb6`](https://github.com/karakeep-app/karakeep/commit/c4d7fb6f11b8de2bcd1a33d25caf72318b8a5098) Allow downloading more content from a webpage and index it #215 ### 📊 Changes **18 files changed** (+476 additions, -142 deletions) <details> <summary>View changed files</summary> 📝 `apps/web/app/api/assets/[assetId]/route.ts` (+25 -6) 📝 `apps/web/components/dashboard/preview/LinkContentSection.tsx` (+19 -0) 📝 `apps/workers/crawlerWorker.ts` (+17 -77) 📝 `apps/workers/index.ts` (+4 -2) 📝 `apps/workers/openaiWorker.ts` (+1 -1) 📝 `apps/workers/package.json` (+1 -0) ➕ `apps/workers/videoWorker.ts` (+221 -0) ➕ `apps/workers/workerUtils.ts` (+55 -0) 📝 `docs/docs/03-configuration.md` (+15 -12) 📝 `packages/db/schema.ts` (+5 -9) 📝 `packages/shared/assetdb.ts` (+16 -0) 📝 `packages/shared/config.ts` (+6 -0) 📝 `packages/shared/queues.ts` (+27 -4) 📝 `packages/shared/types/bookmarks.ts` (+1 -0) ➕ `packages/shared/utils/bookmarkUtils.ts` (+36 -0) 📝 `packages/trpc/routers/bookmarks.ts` (+6 -25) 📝 `packages/trpc/routers/tags.ts` (+8 -6) 📝 `pnpm-lock.yaml` (+13 -0) </details> ### 📄 Description Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation Depends on https://github.com/hoarder-app/hoarder/pull/256 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

kerem

2026-03-02 11:58:16 +03:00

closed this issue
added the
pull-request
label

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/karakeep#1583

No description provided.

Rows
Columns