starred/gitea-mirror
1
0
Fork 0
mirror of https://github.com/RayLabsHQ/gitea-mirror.git synced 2026-04-24 23:05:53 +03:00
Code Issues 11 Projects Releases 10 Packages Wiki Activity

[GH-ISSUE #35] A Series of Error I Encountered #16

New issue
Closed
opened 2026-02-27 15:54:34 +03:00 by kerem · 8 comments
kerem commented 2026-02-27 15:54:34 +03:00
Owner
Copy link

Originally created by @dangjinghao on GitHub (Jun 28, 2025).
Original GitHub issue: https://github.com/RayLabsHQ/gitea-mirror/issues/35

My docker-compose.yml:

services:
  // ...
  gitea-mirror:
    image: ghcr.io/arunavo4/gitea-mirror:latest
    restart: always
    container_name: gitea-mirror
    volumes:
      - gitea-mirror-data:/app/data
volumes:
  gitea-mirror-data:

The caddy in docker container can reverse proxy this service in same network, so don't worry the access problem, I can access it's website as usual.

My classical PAT scopes: repo,admin:org,user.

When I started, it prints

gitea-mirror  | Checking if recovery is needed...
gitea-mirror  | Error finding interrupted jobs: 5185 | async function findInterruptedJobs() {
gitea-mirror  | 5186 |   try {
gitea-mirror  | 5187 |     const cutoffTime = new Date;
gitea-mirror  | 5188 |     cutoffTime.setMinutes(cutoffTime.getMinutes() - 10);
gitea-mirror  | 5189 |     const staleCutoffTime = new Date;
gitea-mirror  | 5190 |     const interruptedJobs = await db2.select().from(mirrorJobs).where(and(eq(mirrorJobs.inProgress, true), or(or(isNull(mirrorJobs.lastCheckpoint), lt(mirrorJobs.lastCheckpoint, cutoffTime)), lt(mirrorJobs.startedAt, staleCutoffTime))));
gitea-mirror  |                                             ^
gitea-mirror  | TypeError: undefined is not an object (evaluating 'db2.select')
gitea-mirror  |       at findInterruptedJobs (/app/dist/scripts/startup-recovery.js:5190:38)
gitea-mirror  |       at findInterruptedJobs (/app/dist/scripts/startup-recovery.js:5184:36)
gitea-mirror  |       at hasJobsNeedingRecovery (/app/dist/scripts/startup-recovery.js:13955:54)
gitea-mirror  |       at hasJobsNeedingRecovery (/app/dist/scripts/startup-recovery.js:13953:39)
gitea-mirror  |       at runStartupRecovery (/app/dist/scripts/startup-recovery.js:13985:55)
gitea-mirror  |       at runStartupRecovery (/app/dist/scripts/startup-recovery.js:13972:35)
gitea-mirror  |       at /app/dist/scripts/startup-recovery.js:14034:19
gitea-mirror  |       at loadAndEvaluateModule (1:11)

Then, This is the configuration.

Image

Enable Enable automatic repository syncing and Enable automatic database cleanup.

It imported github data successfully.

If I enable Skip forked repositories, and import github data again. Check the Repositories page, It pops up a message An internal server error occurred, then the backend prints

gitea-mirror  | Error in repositories fetch: 15 |   logger;
gitea-mirror  | 16 |   exec(query) {
gitea-mirror  | 17 |     this.client.exec(query);
gitea-mirror  | 18 |   }
gitea-mirror  | 19 |   prepareQuery(query, fields, executeMethod, isResponseInArrayMode, customResultMapper) {
gitea-mirror  | 20 |     const stmt = this.client.prepare(query.sql);
gitea-mirror  |                                   ^
gitea-mirror  | SQLiteError: near "=": syntax error
gitea-mirror  |       errno: 1,
gitea-mirror  |  byteOffset: 490,
gitea-mirror  | 
gitea-mirror  |       at prepare (bun:sqlite:313:37)
gitea-mirror  |       at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30)
gitea-mirror  |       at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73)
gitea-mirror  |       at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17)
gitea-mirror  |       at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19)
gitea-mirror  |       at then (/app/node_modules/drizzle-orm/query-promise.js:21:17)
gitea-mirror  | 
gitea-mirror  | Error name: SQLiteError
gitea-mirror  | Error message: near "=": syntax error
gitea-mirror  | Error stack: SQLiteError: near "=": syntax error
gitea-mirror  |     at prepare (unknown)
gitea-mirror  |     at prepare (bun:sqlite:313:37)
gitea-mirror  |     at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30)
gitea-mirror  |     at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73)
gitea-mirror  |     at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17)
gitea-mirror  |     at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19)
gitea-mirror  |     at then (/app/node_modules/drizzle-orm/query-promise.js:21:17)
gitea-mirror  |     at processTicksAndRejections (native:7:39)

However, in Repositories,dashboard page, I can preview some repositories. That's too wired.

Then, in Organizations page, it pops up {"error":"An internal server error occurred","timestamp":"2025-06-28T06:01:09.153Z"}, and the backend prints

gitea-mirror  | Error in organizations fetch: 15 |   logger;
gitea-mirror  | 16 |   exec(query) {
gitea-mirror  | 17 |     this.client.exec(query);
gitea-mirror  | 18 |   }
gitea-mirror  | 19 |   prepareQuery(query, fields, executeMethod, isResponseInArrayMode, customResultMapper) {
gitea-mirror  | 20 |     const stmt = this.client.prepare(query.sql);
gitea-mirror  |                                   ^
gitea-mirror  | SQLiteError: near "=": syntax error
gitea-mirror  |       errno: 1,
gitea-mirror  |  byteOffset: 151,
gitea-mirror  | 
gitea-mirror  |       at prepare (bun:sqlite:313:37)
gitea-mirror  |       at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30)
gitea-mirror  |       at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73)
gitea-mirror  |       at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17)
gitea-mirror  |       at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19)
gitea-mirror  |       at then (/app/node_modules/drizzle-orm/query-promise.js:21:17)
gitea-mirror  | 
gitea-mirror  | Error name: SQLiteError
gitea-mirror  | Error message: near "=": syntax error
gitea-mirror  | Error stack: SQLiteError: near "=": syntax error
gitea-mirror  |     at prepare (unknown)
gitea-mirror  |     at prepare (bun:sqlite:313:37)
gitea-mirror  |     at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30)
gitea-mirror  |     at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73)
gitea-mirror  |     at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17)
gitea-mirror  |     at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19)
gitea-mirror  |     at then (/app/node_modules/drizzle-orm/query-promise.js:21:17)
gitea-mirror  |     at processTicksAndRejections (native:7:39)

Type of mirrored repositories: all public repo I owned(I don't have private repo), uclipboard organization(no private repo), and 2 private repos from another user and he grained me all permissions on those repos. gitea-mirror can find the last type repos, that's amazing!

I don't know what should I do now, I'm not good at this technology stack.

Thank you for your help!

By the way, is it possible to add a new exclude feature in Filtering & Behavior? It's very useful for the situation that some repos I forked are too large that I can't save them in my gitea but for others I still want to save.

Originally created by @dangjinghao on GitHub (Jun 28, 2025). Original GitHub issue: https://github.com/RayLabsHQ/gitea-mirror/issues/35 My `docker-compose.yml`: ```yml services: // ... gitea-mirror: image: ghcr.io/arunavo4/gitea-mirror:latest restart: always container_name: gitea-mirror volumes: - gitea-mirror-data:/app/data volumes: gitea-mirror-data: ``` The caddy in docker container can reverse proxy this service in same network, so don't worry the access problem, I can access it's website as usual. My classical PAT scopes: repo,admin:org,user. When I started, it prints ```txt gitea-mirror | Checking if recovery is needed... gitea-mirror | Error finding interrupted jobs: 5185 | async function findInterruptedJobs() { gitea-mirror | 5186 | try { gitea-mirror | 5187 | const cutoffTime = new Date; gitea-mirror | 5188 | cutoffTime.setMinutes(cutoffTime.getMinutes() - 10); gitea-mirror | 5189 | const staleCutoffTime = new Date; gitea-mirror | 5190 | const interruptedJobs = await db2.select().from(mirrorJobs).where(and(eq(mirrorJobs.inProgress, true), or(or(isNull(mirrorJobs.lastCheckpoint), lt(mirrorJobs.lastCheckpoint, cutoffTime)), lt(mirrorJobs.startedAt, staleCutoffTime)))); gitea-mirror | ^ gitea-mirror | TypeError: undefined is not an object (evaluating 'db2.select') gitea-mirror | at findInterruptedJobs (/app/dist/scripts/startup-recovery.js:5190:38) gitea-mirror | at findInterruptedJobs (/app/dist/scripts/startup-recovery.js:5184:36) gitea-mirror | at hasJobsNeedingRecovery (/app/dist/scripts/startup-recovery.js:13955:54) gitea-mirror | at hasJobsNeedingRecovery (/app/dist/scripts/startup-recovery.js:13953:39) gitea-mirror | at runStartupRecovery (/app/dist/scripts/startup-recovery.js:13985:55) gitea-mirror | at runStartupRecovery (/app/dist/scripts/startup-recovery.js:13972:35) gitea-mirror | at /app/dist/scripts/startup-recovery.js:14034:19 gitea-mirror | at loadAndEvaluateModule (1:11) ``` Then, This is the configuration. <img width="1130" alt="Image" src="https://github.com/user-attachments/assets/007a56c3-2dac-429c-a2b0-100f81c33d6b" /> Enable `Enable automatic repository syncing` and `Enable automatic database cleanup`. It imported github data successfully. If I enable `Skip forked repositories`, and import github data again. Check the `Repositories` page, It pops up a message `An internal server error occurred`, then the backend prints ```txt gitea-mirror | Error in repositories fetch: 15 | logger; gitea-mirror | 16 | exec(query) { gitea-mirror | 17 | this.client.exec(query); gitea-mirror | 18 | } gitea-mirror | 19 | prepareQuery(query, fields, executeMethod, isResponseInArrayMode, customResultMapper) { gitea-mirror | 20 | const stmt = this.client.prepare(query.sql); gitea-mirror | ^ gitea-mirror | SQLiteError: near "=": syntax error gitea-mirror | errno: 1, gitea-mirror | byteOffset: 490, gitea-mirror | gitea-mirror | at prepare (bun:sqlite:313:37) gitea-mirror | at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30) gitea-mirror | at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73) gitea-mirror | at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17) gitea-mirror | at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19) gitea-mirror | at then (/app/node_modules/drizzle-orm/query-promise.js:21:17) gitea-mirror | gitea-mirror | Error name: SQLiteError gitea-mirror | Error message: near "=": syntax error gitea-mirror | Error stack: SQLiteError: near "=": syntax error gitea-mirror | at prepare (unknown) gitea-mirror | at prepare (bun:sqlite:313:37) gitea-mirror | at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30) gitea-mirror | at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73) gitea-mirror | at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17) gitea-mirror | at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19) gitea-mirror | at then (/app/node_modules/drizzle-orm/query-promise.js:21:17) gitea-mirror | at processTicksAndRejections (native:7:39) ``` However, in Repositories,dashboard page, I can preview some repositories. That's too wired. Then, in Organizations page, it pops up `{"error":"An internal server error occurred","timestamp":"2025-06-28T06:01:09.153Z"}`, and the backend prints ```txt gitea-mirror | Error in organizations fetch: 15 | logger; gitea-mirror | 16 | exec(query) { gitea-mirror | 17 | this.client.exec(query); gitea-mirror | 18 | } gitea-mirror | 19 | prepareQuery(query, fields, executeMethod, isResponseInArrayMode, customResultMapper) { gitea-mirror | 20 | const stmt = this.client.prepare(query.sql); gitea-mirror | ^ gitea-mirror | SQLiteError: near "=": syntax error gitea-mirror | errno: 1, gitea-mirror | byteOffset: 151, gitea-mirror | gitea-mirror | at prepare (bun:sqlite:313:37) gitea-mirror | at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30) gitea-mirror | at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73) gitea-mirror | at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17) gitea-mirror | at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19) gitea-mirror | at then (/app/node_modules/drizzle-orm/query-promise.js:21:17) gitea-mirror | gitea-mirror | Error name: SQLiteError gitea-mirror | Error message: near "=": syntax error gitea-mirror | Error stack: SQLiteError: near "=": syntax error gitea-mirror | at prepare (unknown) gitea-mirror | at prepare (bun:sqlite:313:37) gitea-mirror | at prepareQuery (/app/node_modules/drizzle-orm/bun-sqlite/session.js:20:30) gitea-mirror | at _prepare (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:615:73) gitea-mirror | at all (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:641:17) gitea-mirror | at execute (/app/node_modules/drizzle-orm/sqlite-core/query-builders/select.js:649:19) gitea-mirror | at then (/app/node_modules/drizzle-orm/query-promise.js:21:17) gitea-mirror | at processTicksAndRejections (native:7:39) ``` Type of mirrored repositories: all public repo I owned(I don't have private repo), uclipboard organization(no private repo), and 2 private repos from another user and he grained me all permissions on those repos. `gitea-mirror` can find the last type repos, that's amazing! I don't know what should I do now, I'm not good at this technology stack. Thank you for your help! By the way, is it possible to add a new exclude feature in `Filtering & Behavior`? It's very useful for the situation that some repos I forked are too large that I can't save them in my gitea but for others I still want to save.
kerem closed this issue 2026-02-27 15:54:34 +03:00
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@arunavo4 commented on GitHub (Jul 5, 2025):

Hi @dangjinghao sorry for the late reply this week has been very hectic. I am planning to make this install a lot more painless. Will have a lot of new features also added soon. Please wait for next week

<!-- gh-comment-id:3039369898 --> @arunavo4 commented on GitHub (Jul 5, 2025): Hi @dangjinghao sorry for the late reply this week has been very hectic. I am planning to make this install a lot more painless. Will have a lot of new features also added soon. Please wait for next week
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@arunavo4 commented on GitHub (Jul 6, 2025):

@dangjinghao Please try 2.18 tag rather than latest

<!-- gh-comment-id:3042208778 --> @arunavo4 commented on GitHub (Jul 6, 2025): @dangjinghao Please try `2.18` tag rather than latest
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@arunavo4 commented on GitHub (Jul 7, 2025):

Let me know if you still have issues with the latest release

<!-- gh-comment-id:3043541991 --> @arunavo4 commented on GitHub (Jul 7, 2025): Let me know if you still have issues with the latest release
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@dangjinghao commented on GitHub (Jul 7, 2025):

I can't pull ghcr.io/arunavo4/gitea-mirror:2.18.0 or ghcr.io/raylabshq/gitea-mirror:2.18.0. It seems that I can't access this new organization raylabshq directly.

Image
<!-- gh-comment-id:3043571439 --> @dangjinghao commented on GitHub (Jul 7, 2025): I can't pull `ghcr.io/arunavo4/gitea-mirror:2.18.0` or `ghcr.io/raylabshq/gitea-mirror:2.18.0`. It seems that I can't access this new organization `raylabshq` directly. <img width="1344" height="369" alt="Image" src="https://github.com/user-attachments/assets/1d2e6fd5-25e0-4e5a-b6ac-1befe13f0b2e" />
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@arunavo4 commented on GitHub (Jul 7, 2025):

@dangjinghao Sorry my bad I had the pakage private by mistake. Please try the latest verison

docker pull ghcr.io/raylabshq/gitea-mirror:v2.20.0
<!-- gh-comment-id:3043585371 --> @arunavo4 commented on GitHub (Jul 7, 2025): @dangjinghao Sorry my bad I had the pakage `private` by mistake. Please try the latest verison ```sh docker pull ghcr.io/raylabshq/gitea-mirror:v2.20.0 ```
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@dangjinghao commented on GitHub (Jul 7, 2025):

All the previously mentioned bugs appear to have been fixed, great work!

However, I have encountered some new issues:

After switching from Single Organization to Mixed Mode and waiting for the POST /api/config request to return a successful response, refreshing the page still displays the Single Organization mode.

When selecting all metadata options in Repository Metadata and waiting for the request to complete, refreshing the page shows "2 of 5 selected". Additionally, if I select PR, labels or milestone, wait, and then refresh the page, the "Repository Metadata" options become unselected. It seems that only issues and wiki could be remembered.

Image Image
<!-- gh-comment-id:3043691221 --> @dangjinghao commented on GitHub (Jul 7, 2025): All the previously mentioned bugs appear to have been fixed, great work! However, I have encountered some new issues: After switching from `Single Organization` to `Mixed Mode` and waiting for the `POST /api/config` request to return a successful response, refreshing the page still displays the `Single Organization` mode. When selecting all metadata options in `Repository Metadata` and waiting for the request to complete, refreshing the page shows "2 of 5 selected". Additionally, if I select `PR`, `labels` or `milestone`, wait, and then refresh the page, the "Repository Metadata" options become unselected. It seems that only `issues` and `wiki` could be remembered. <img width="964" height="818" alt="Image" src="https://github.com/user-attachments/assets/424639a0-976e-4334-a60b-c69d0e30f710" /> <img width="979" height="806" alt="Image" src="https://github.com/user-attachments/assets/2e9c25b1-936d-4821-901c-103f52fdaf07" />
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@arunavo4 commented on GitHub (Jul 7, 2025):

@arunavo4 Thanks for reporting this let me take a look.

<!-- gh-comment-id:3043706115 --> @arunavo4 commented on GitHub (Jul 7, 2025): @arunavo4 Thanks for reporting this let me take a look.
kerem commented 2026-02-27 15:54:35 +03:00
Author
Owner
Copy link

@arunavo4 commented on GitHub (Jul 7, 2025):

@dangjinghao Its fixed in the version v2.20.1. Close the Issue once you have verified that its resolved

<!-- gh-comment-id:3044266460 --> @arunavo4 commented on GitHub (Jul 7, 2025): @dangjinghao Its fixed in the version `v2.20.1`. Close the Issue once you have verified that its resolved
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
fix/mirror-sync-bugs-262-263-264
v3.15.5
v3.15.4
v3.15.3
v3.15.2
v3.15.1
v3.15.0
v3.14.2
v3.14.1
v3.14.0
v3.13.4
v3.13.3
v3.13.2
v3.13.1
v3.13.0
v3.12.5
v3.12.4
v3.12.3
v3.12.2
v3.12.1
v3.12.0
v3.11.0
v3.10.1
v3.10.0
v3.9.6
v3.9.5
v3.9.4
v3.9.3
v3.9.2
v3.9.0
v3.8.11
v3.8.10
v3.8.9
v3.8.8
v3.8.7
v3.8.6
v3.8.5
v3.8.4
v3.8.3
v3.8.2
v3.8.1
v3.8.0
v3-sso
v3.7.2
v3.7.1
v3.7.0
v3.6.0
v3.5.4
v3.5.3
v3.5.2
v3.5.1
v3.5.0
v3.4.0
v3.3.0
v3.2.6
v3.2.5
v3.2.4
v3.2.3
v3.2.2
v3.2.1
v3.2.0
v3.1.1
v3.1.0
v3.0.1
v3.0.0
v2.22.0
v2.21.0
v2.20.1
v2.20.0
v2.18.0
v2.17.0
v2.16.3
v2.16.2
v2.16.1
v2.16.0
v2.15.0
v2.14.0
v2.13.2
v2.13.1
v2.13.0
v2.12.0
v2.11.2
v2.11.1
v2.11.0
v2.10.0
v2.9.3
v2.9.2
v2.9.1
v2.9.0
v2.8.0
v2.7.0
v2.6.0
v2.5.4
v2.5.3
v2.5.2
v2.5.1
v2.5.0
v2.1.0
v2.0.0
v1.0.0
Labels
Clear labels   
bug

   
documentation

   
enhancement

   
help wanted

   
pull-request

Mirrored from GitHub Pull Request

  
question
No labels
bug
documentation
enhancement
help wanted
pull-request
question
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/gitea-mirror#16
No description provided.