mirror of
https://github.com/ArchiveBox/ArchiveBox.git
synced 2026-04-25 17:16:00 +03:00
[GH-ISSUE #842] Feature Request: SNAPSHOT_MAX_TOTAL_SIZE option to cap total snapshot size at some limit #522
Labels
No labels
expected: maybe someday
expected: next release
expected: release after next
expected: unlikely unless contributed
good first ticket
help wanted
pull-request
scope: all users
scope: windows users
size: easy
size: hard
size: medium
size: medium
status: backlog
status: blocked
status: done
status: idea-phase
status: needs followup
status: wip
status: wontfix
touches: API/CLI/Spec
touches: configuration
touches: data/schema/architecture
touches: dependencies/packaging
touches: docs
touches: js
touches: views/replayers/html/css
why: correctness
why: functionality
why: performance
why: security
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
starred/ArchiveBox#522
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Valporaena on GitHub (Sep 7, 2021).
Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/842
Type
What is the problem that your feature request solves
Due to the recent wipe of my collection I would be archiving all of it again at some point, and this option, if it can be implemented, would be appreciated. Some of the pages I'm archiving turn out to be 100mb+, and I don't really need all of that.
Describe the ideal specific solution you'd want, and whether it fits into any broader scope of changes
'MEDIA_MAX_SIZE'-type option you can put in the .conf file would be nice.
How badly do you want this new feature?
@pirate commented on GitHub (Sep 8, 2021):
AFAIK there does not exist any option on wget to limit media size like YOUTUBEDL has. I'm not sure if this can be implemented easily.
@Valporaena commented on GitHub (Sep 9, 2021):
Oh, no problem. Maybe it would be easier to implement something like: if the total size of wget/singlefile snapshot exceeds user specified size, do not use these or delete the result? In my workflow I regularly find myself looking through the list of pages I just archived for big files, deleting them and archiving them again with wget/singlefile turned off. Web interface even shows you the total size of these big files in bold - so it seems like it's implied user would be looking for those anyway! I thing it would be cool to automate/eliminate this kind of task for the user.