starred/ArchiveBox

Fork 0

mirror of https://github.com/ArchiveBox/ArchiveBox.git synced 2026-04-25 17:16:00 +03:00

[GH-ISSUE #994] Feature Request: Limits for parallel processes of chrome #619

New issue

Closed

opened 2026-03-01 14:45:04 +03:00 by kerem · 1 comment

kerem commented

2026-03-01 14:45:04 +03:00

Owner

Originally created by @juev on GitHub (Jun 28, 2022).
Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/994

Type

General question or discussion
Propose a brand new feature
Request modification of existing behavior or design

What is the problem that your feature request solves

In this time Archive box will run many chrome processes. How many processes we don't know. We have situation, when chrome processes eats all system resources.

Some backgrounds:

ArchiveBox running in docker
I imported ~500 links
I see a lot processes in system monitor

Describe the ideal specific solution you'd want, and whether it fits into any broader scope of changes

We have separate options, which limits how many links will processed in parallel. It will limit number of running chrome processes.

What hacks or alternative solutions have you tried to solve the problem?

Just restart docker compose. :(

How badly do you want this new feature?

It's an urgent deal-breaker, I can't live without it
It's important to add it in the near-mid term future
It would be nice to have eventually

I'm willing to contribute dev time / money to fix this issue
I like ArchiveBox so far / would recommend it to a friend
I've had a lot of difficulty getting ArchiveBox set up

Originally created by @juev on GitHub (Jun 28, 2022). Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/994 ## Type - [ ] General question or discussion - [ ] Propose a brand new feature - [x] Request modification of existing behavior or design ## What is the problem that your feature request solves In this time Archive box will run many chrome processes. How many processes we don't know. We have situation, when chrome processes eats all system resources. Some backgrounds: - ArchiveBox running in docker - I imported ~500 links - I see a lot processes in system monitor <img width="1440" alt="archivebox" src="https://user-images.githubusercontent.com/114635/176170127-faa0e5d8-7ee2-4508-8c44-8d5b0676f716.png"> ## Describe the ideal specific solution you'd want, and whether it fits into any broader scope of changes We have separate options, which limits how many links will processed in parallel. It will limit number of running chrome processes. ## What hacks or alternative solutions have you tried to solve the problem? Just restart docker compose. :( ## How badly do you want this new feature? - [ ] It's an urgent deal-breaker, I can't live without it - [x] It's important to add it in the near-mid term future - [ ] It would be nice to have eventually --- - [ ] I'm willing to contribute [dev time](https://github.com/ArchiveBox/ArchiveBox#archivebox-development) / [money](https://github.com/sponsors/pirate) to fix this issue - [x] I like ArchiveBox so far / would recommend it to a friend - [ ] I've had a lot of difficulty getting ArchiveBox set up

kerem

2026-03-01 14:45:04 +03:00

closed this issue
added the
status: needs followup

why: performance

touches: dependencies/packaging
labels

kerem commented

2026-03-01 14:45:05 +03:00

Author

Owner

@pirate commented on GitHub (Jan 19, 2024):

Going to close this as stale for now since I haven't seen this happen in a while.

Let me know if you're still seeing this issue in version >=0.7.2 or :dev. Chrome headless is much improved since the time this ticket was open.

@pirate commented on GitHub (Jan 19, 2024): Going to close this as stale for now since I haven't seen this happen in a while. Let me know if you're still seeing this issue in version >=`0.7.2` or `:dev`. Chrome headless is much improved since the time this ticket was open.

kerem referenced this issue

2026-03-01 17:54:43 +03:00

[GH-ISSUE #619] Question: index.html completly gone? #1894

kerem referenced this issue

2026-03-14 22:40:26 +03:00

[GH-ISSUE #619] Question: index.html completly gone? #3402

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/ArchiveBox#619

No description provided.

Rows
Columns