[PR #1740] Add real-world use cases to CLI pipeline plan #3000

New issue

Closed

opened 2026-03-01 18:01:22 +03:00 by kerem · 0 comments

kerem commented

2026-03-01 18:01:22 +03:00

Owner

Original Pull Request: https://github.com/ArchiveBox/ArchiveBox/pull/1740

State: closed
Merged: Yes

Summary

Changes these areas

Bugfixes
Feature behavior
Command line interface
Configuration options
Internal architecture
Snapshot data layout on disk

Summary by cubic

Added eight real-world examples to the CLI pipeline plan to show JSONL piping with archivebox run. Documents auto-cascade (Crawl → Snapshots → ArchiveResults) and that run emits JSONL for chained retries, transforms, and recursive crawling.

New Features
- Eight examples: basic archive, retry failures, Pinboard import, selective extraction, bulk tags, RSS archiving, recursive link following, chained retries with overrides.
- Clarifies efficient filtering via CLI args (--status, --plugin, --url__icontains) and using jq for transforms.
- Adds a pattern summary to illustrate common pipelines.

^{Written for commit 1c85b4daa3. Summary will update on new commits.}

**Original Pull Request:** https://github.com/ArchiveBox/ArchiveBox/pull/1740 **State:** closed **Merged:** Yes ---  # Summary  # Related issues  # Changes these areas - [ ] Bugfixes - [ ] Feature behavior - [ ] Command line interface - [ ] Configuration options - [ ] Internal architecture - [ ] Snapshot data layout on disk  --- ## Summary by cubic Added eight real-world examples to the CLI pipeline plan to show JSONL piping with archivebox run. Documents auto-cascade (Crawl → Snapshots → ArchiveResults) and that run emits JSONL for chained retries, transforms, and recursive crawling. - **New Features** - Eight examples: basic archive, retry failures, Pinboard import, selective extraction, bulk tags, RSS archiving, recursive link following, chained retries with overrides. - Clarifies efficient filtering via CLI args (--status, --plugin, --url__icontains) and using jq for transforms. - Adds a pattern summary to illustrate common pipelines. <sup>Written for commit 1c85b4daa35f55c9dd2de8bf27ab3e29c7629045. Summary will update on new commits.</sup>

kerem

2026-03-01 18:01:22 +03:00

closed this issue
added the
pull-request
label

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/ArchiveBox#3000

No description provided.

Rows
Columns