[PR #525] [MERGED] Allow downloading more content from a webpage and index it #215 #1643

New issue

Closed

opened 2026-03-02 11:58:32 +03:00 by kerem · 0 comments

kerem commented

2026-03-02 11:58:32 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/karakeep-app/karakeep/pull/525
Author: @kamtschatka
Created: 10/11/2024
Status: ✅ Merged
Merged: 10/28/2024
Merged by: @MohamedBassem

Base: main ← Head: video-downloading

📝 Commits (7)

c7f5997 Allow downloading more content from a webpage and index it #215
a063bf5 Merge branch 'main' into video-downloading
2ca74ff Some tweaks
cd23f21 Drop the dependency on the yt-dlp wrapper
d7e9827 Update openapi specs
d88b2d2 Dont log an error when the url is not supported
38a607b Better handle supported websites that dont download anything

📊 Changes

17 files changed (+403 additions, -71 deletions)

View changed files

📝 apps/web/app/api/assets/[assetId]/route.ts (+26 -6)
📝 apps/web/components/dashboard/preview/AttachmentBox.tsx (+2 -0)
📝 apps/web/components/dashboard/preview/LinkContentSection.tsx (+19 -0)
📝 apps/workers/crawlerWorker.ts (+10 -49)
📝 apps/workers/index.ts (+12 -3)
➕ apps/workers/videoWorker.ts (+202 -0)
➕ apps/workers/workerUtils.ts (+48 -0)
📝 docker/Dockerfile (+1 -1)
📝 docs/docs/03-configuration.md (+15 -12)
📝 packages/db/schema.ts (+2 -0)
📝 packages/open-api/hoarder-openapi-spec.json (+9 -0)
📝 packages/shared/assetdb.ts (+16 -0)
📝 packages/shared/config.ts (+6 -0)
📝 packages/shared/queues.ts (+23 -0)
📝 packages/shared/types/bookmarks.ts (+2 -0)
📝 packages/trpc/lib/attachments.ts (+5 -0)
📝 packages/trpc/routers/bookmarks.ts (+5 -0)

📄 Description

Added a worker that allows downloading videos depending on the environment variables refactored the code a bit
added new video asset
updated documentation

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/karakeep-app/karakeep/pull/525 **Author:** [@kamtschatka](https://github.com/kamtschatka) **Created:** 10/11/2024 **Status:** ✅ Merged **Merged:** 10/28/2024 **Merged by:** [@MohamedBassem](https://github.com/MohamedBassem) **Base:** `main` ← **Head:** `video-downloading` --- ### 📝 Commits (7) - [`c7f5997`](https://github.com/karakeep-app/karakeep/commit/c7f599702ec24aed73d220ccf17a0202328dd731) Allow downloading more content from a webpage and index it #215 - [`a063bf5`](https://github.com/karakeep-app/karakeep/commit/a063bf5a1d01a3b306c26e56548a5a5b76b71cda) Merge branch 'main' into video-downloading - [`2ca74ff`](https://github.com/karakeep-app/karakeep/commit/2ca74ff257208f20b44bba2f75c22d2e1bf0d137) Some tweaks - [`cd23f21`](https://github.com/karakeep-app/karakeep/commit/cd23f2167ec20a47c9b55f7c4adf29c469bbe353) Drop the dependency on the yt-dlp wrapper - [`d7e9827`](https://github.com/karakeep-app/karakeep/commit/d7e98271f4b705c72cbec6ad5820b6fef17e8675) Update openapi specs - [`d88b2d2`](https://github.com/karakeep-app/karakeep/commit/d88b2d263f010a54c8af8f3f876a13831c49d2e8) Dont log an error when the url is not supported - [`38a607b`](https://github.com/karakeep-app/karakeep/commit/38a607b54fb690a84498ff009af4903c681e91a9) Better handle supported websites that dont download anything ### 📊 Changes **17 files changed** (+403 additions, -71 deletions) <details> <summary>View changed files</summary> 📝 `apps/web/app/api/assets/[assetId]/route.ts` (+26 -6) 📝 `apps/web/components/dashboard/preview/AttachmentBox.tsx` (+2 -0) 📝 `apps/web/components/dashboard/preview/LinkContentSection.tsx` (+19 -0) 📝 `apps/workers/crawlerWorker.ts` (+10 -49) 📝 `apps/workers/index.ts` (+12 -3) ➕ `apps/workers/videoWorker.ts` (+202 -0) ➕ `apps/workers/workerUtils.ts` (+48 -0) 📝 `docker/Dockerfile` (+1 -1) 📝 `docs/docs/03-configuration.md` (+15 -12) 📝 `packages/db/schema.ts` (+2 -0) 📝 `packages/open-api/hoarder-openapi-spec.json` (+9 -0) 📝 `packages/shared/assetdb.ts` (+16 -0) 📝 `packages/shared/config.ts` (+6 -0) 📝 `packages/shared/queues.ts` (+23 -0) 📝 `packages/shared/types/bookmarks.ts` (+2 -0) 📝 `packages/trpc/lib/attachments.ts` (+5 -0) 📝 `packages/trpc/routers/bookmarks.ts` (+5 -0) </details> ### 📄 Description Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

kerem

2026-03-02 11:58:32 +03:00

closed this issue
added the
pull-request
label

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/karakeep#1643

No description provided.

Rows
Columns