starred/karakeep

Fork 0

mirror of https://github.com/karakeep-app/karakeep.git synced 2026-04-25 16:06:04 +03:00

[GH-ISSUE #385] SqliteError: database is locked #254

New issue

Closed

opened 2026-03-02 11:48:05 +03:00 by kerem · 4 comments

kerem commented

2026-03-02 11:48:05 +03:00

Owner

Originally created by @Dakad on GitHub (Sep 10, 2024).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/385

Description

We recently transitioned from Raindrop to Hoarder and using a custom script with the hoarder-cli, we were able to import my Raindrop collections and link them to the matching list on Hoarder but a lot of jobs are stuck in the Queued state.

And checking the docker-compose logs, we can see a lot of crawling errors but the most concerning are these:

hoarder        | 2024-09-10T10:46:46.386869950Z SqliteError: database is locked
hoarder        | 2024-09-10T10:46:46.386927650Z     at w.values (/app/apps/web/.next/server/chunks/917.js:51:42087)
hoarder        | 2024-09-10T10:46:46.386935631Z     ... 3 lines matching cause stack trace ...
hoarder        | 2024-09-10T10:46:46.386941353Z     at m.then (/app/apps/web/.next/server/chunks/917.js:51:45895) {
hoarder        | 2024-09-10T10:46:46.386946297Z   code: 'INTERNAL_SERVER_ERROR',
hoarder        | 2024-09-10T10:46:46.386950667Z   name: 'TRPCError',
hoarder        | 2024-09-10T10:46:46.386960185Z   [cause]: SqliteError: database is locked
hoarder        | 2024-09-10T10:46:46.386964851Z       at w.values (/app/apps/web/.next/server/chunks/917.js:51:42087)
hoarder        | 2024-09-10T10:46:46.386969425Z       at w.all (/app/apps/web/.next/server/chunks/917.js:51:41676)
hoarder        | 2024-09-10T10:46:46.386974091Z       at m.all (/app/apps/web/.next/server/chunks/917.js:51:66818)
hoarder        | 2024-09-10T10:46:46.386978683Z       at m.execute (/app/apps/web/.next/server/chunks/917.js:51:66919)
hoarder        | 2024-09-10T10:46:46.386983405Z       at m.then (/app/apps/web/.next/server/chunks/917.js:51:45895) {
hoarder        | 2024-09-10T10:46:46.386987924Z     code: 'SQLITE_BUSY'
hoarder        | 2024-09-10T10:46:46.386992646Z   }
hoarder        | 2024-09-10T10:46:46.386996942Z }

Details:

Device:

product: Raspberry Pi 5 Model B Rev 1.0
Distributor ID: Debian
Description:    Debian GNU/Linux 12 (bookworm)
Release:        12
Codename:       bookworm

docker-compose.yml

hoarder:
  image: ghcr.io/hoarder-app/hoarder:${HOARDER_VERSION:-release}
  container_name: hoarder
  restart: unless-stopped
  env_file:
    - ~/.env
  environment:
    DATA_DIR: /data
    HOSTNAME: "0.0.0.0"
    NEXTAUTH_SECRET: "${NEXTAUTH_SECRET}"
    MEILI_MASTER_KEY: "${MEILI_MASTER_KEY}"
  volumes:
    - ${CONFIGS_DIR}/hoarder/app:/data
  ports:
    - 3000:3000
  depends_on:
    - chrome
    - meilisearch

.ENV file

HOARDER_VERSION=0.16.0
DISABLE_SIGNUPS=true
# API_URL=http://hoarder:3000
# NEXTAUTH_URL=http://hoarder-app:3000
NEXTAUTH_SECRET="************"
MEILI_ADDR="http://meilisearch:7700"
BROWSER_WEB_URL="http://alpine-chrome:9222"
CRAWLER_NUM_WORKERS=4

OPENAI_API_KEY="sk-*****"
MAX_ASSET_SIZE_MB=30
CRAWLER_STORE_SCREENSHOT=true
CRAWLER_FULL_PAGE_SCREENSHOT=true
CRAWLER_NAVIGATE_TIMEOUT_SEC=90
CRAWLER_FULL_PAGE_ARCHIVE=true

Originally created by @Dakad on GitHub (Sep 10, 2024). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/385 ## Description We recently transitioned from Raindrop to Hoarder and using a custom script with the `hoarder-cli`, we were able to import my Raindrop collections and link them to the matching list on Hoarder but a lot of jobs are stuck in the `Queued` state. And checking the `docker-compose` logs, we can see a lot of crawling errors but the most concerning are these: ``` hoarder | 2024-09-10T10:46:46.386869950Z SqliteError: database is locked hoarder | 2024-09-10T10:46:46.386927650Z at w.values (/app/apps/web/.next/server/chunks/917.js:51:42087) hoarder | 2024-09-10T10:46:46.386935631Z ... 3 lines matching cause stack trace ... hoarder | 2024-09-10T10:46:46.386941353Z at m.then (/app/apps/web/.next/server/chunks/917.js:51:45895) { hoarder | 2024-09-10T10:46:46.386946297Z code: 'INTERNAL_SERVER_ERROR', hoarder | 2024-09-10T10:46:46.386950667Z name: 'TRPCError', hoarder | 2024-09-10T10:46:46.386960185Z [cause]: SqliteError: database is locked hoarder | 2024-09-10T10:46:46.386964851Z at w.values (/app/apps/web/.next/server/chunks/917.js:51:42087) hoarder | 2024-09-10T10:46:46.386969425Z at w.all (/app/apps/web/.next/server/chunks/917.js:51:41676) hoarder | 2024-09-10T10:46:46.386974091Z at m.all (/app/apps/web/.next/server/chunks/917.js:51:66818) hoarder | 2024-09-10T10:46:46.386978683Z at m.execute (/app/apps/web/.next/server/chunks/917.js:51:66919) hoarder | 2024-09-10T10:46:46.386983405Z at m.then (/app/apps/web/.next/server/chunks/917.js:51:45895) { hoarder | 2024-09-10T10:46:46.386987924Z code: 'SQLITE_BUSY' hoarder | 2024-09-10T10:46:46.386992646Z } hoarder | 2024-09-10T10:46:46.386996942Z } ``` ![image](https://github.com/user-attachments/assets/6900cefd-74a7-48e1-b298-2350ed1c7894) ## Details: Device: ``` txt product: Raspberry Pi 5 Model B Rev 1.0 Distributor ID: Debian Description: Debian GNU/Linux 12 (bookworm) Release: 12 Codename: bookworm ``` docker-compose.yml ``` yaml hoarder: image: ghcr.io/hoarder-app/hoarder:${HOARDER_VERSION:-release} container_name: hoarder restart: unless-stopped env_file: - ~/.env environment: DATA_DIR: /data HOSTNAME: "0.0.0.0" NEXTAUTH_SECRET: "${NEXTAUTH_SECRET}" MEILI_MASTER_KEY: "${MEILI_MASTER_KEY}" volumes: - ${CONFIGS_DIR}/hoarder/app:/data ports: - 3000:3000 depends_on: - chrome - meilisearch ``` .ENV file ``` bash HOARDER_VERSION=0.16.0 DISABLE_SIGNUPS=true # API_URL=http://hoarder:3000 # NEXTAUTH_URL=http://hoarder-app:3000 NEXTAUTH_SECRET="************" MEILI_ADDR="http://meilisearch:7700" BROWSER_WEB_URL="http://alpine-chrome:9222" CRAWLER_NUM_WORKERS=4 OPENAI_API_KEY="sk-*****" MAX_ASSET_SIZE_MB=30 CRAWLER_STORE_SCREENSHOT=true CRAWLER_FULL_PAGE_SCREENSHOT=true CRAWLER_NAVIGATE_TIMEOUT_SEC=90 CRAWLER_FULL_PAGE_ARCHIVE=true ```

kerem

2026-03-02 11:48:05 +03:00

closed this issue
added the
question
label

kerem commented

2026-03-02 11:48:06 +03:00

Author

Owner

@MohamedBassem commented on GitHub (Sep 14, 2024):

did this get resolved by any chance or are you still seeing database is locked?

@MohamedBassem commented on GitHub (Sep 14, 2024): did this get resolved by any chance or are you still seeing database is locked?

kerem commented

2026-03-02 11:48:06 +03:00

Author

Owner

@shlajin commented on GitHub (Sep 17, 2024):

I'm observing the same problem, but I quickly realized mine is because I'm trying to run SQLite over an SMB share.

@shlajin commented on GitHub (Sep 17, 2024): I'm observing the same problem, but I quickly realized mine is because I'm trying to run SQLite over an SMB share.

kerem commented

2026-03-02 11:48:06 +03:00

Author

Owner

@MohamedBassem commented on GitHub (Sep 19, 2024):

@shlajin for what it's worth. I've been running my own hoarder instance with sqlite over a network share for months now without issues. I'm using NFS though not SMB. But yeah, sqlite recommends running it over network shares so I wouldn't be surprised if that's the issue.

This stackoverflow answer seems to provide some mitigations to fix the locked sqlite problem (https://stackoverflow.com/questions/151026/how-do-i-unlock-a-sqlite-database).

@MohamedBassem commented on GitHub (Sep 19, 2024): @shlajin for what it's worth. I've been running my own hoarder instance with sqlite over a network share for months now without issues. I'm using NFS though not SMB. But yeah, sqlite recommends running it over network shares so I wouldn't be surprised if that's the issue. This stackoverflow answer seems to provide some mitigations to fix the locked sqlite problem (https://stackoverflow.com/questions/151026/how-do-i-unlock-a-sqlite-database).

kerem commented

2026-03-02 11:48:06 +03:00

Author

Owner

@kamtschatka commented on GitHub (Oct 3, 2024):

no response so far, so I am assuming it has been solved?

@kamtschatka commented on GitHub (Oct 3, 2024): no response so far, so I am assuming it has been solved?

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/karakeep#254

No description provided.

Rows
Columns