[PR #1748] Add DNS traffic recorder plugin #3007

New issue

Closed

opened 2026-03-01 18:01:23 +03:00 by kerem · 0 comments

kerem commented

2026-03-01 18:01:23 +03:00

Owner

Original Pull Request: https://github.com/ArchiveBox/ArchiveBox/pull/1748

State: closed
Merged: Yes

Records hostname → IP resolutions during page load using Chrome CDP.
Uses Network.responseReceived events to capture DNS resolution data
and writes one JSON line per record to dns.jsonl.

Features:

Captures hostname to IP address mappings (A/AAAA records)
Records failed DNS lookups (NXDOMAIN)
Deduplicates resolution records per page load
Integrates with existing Chrome plugin infrastructure

Summary by cubic

Adds a DNS traffic recorder plugin that logs hostname → IP resolutions during page load via Chrome CDP and writes to dns.jsonl. Also refactors Chrome CDP-based plugins to use shared utilities, reducing duplicate code and standardizing navigation waits.

New Features
- Captures A/AAAA records and NXDOMAIN failures.
- Deduplicates hostname → IP mappings per page load.
- Configurable via DNS_ENABLED and DNS_TIMEOUT.
- Integrates with existing Chrome plugin infrastructure.
Migration
- SSL output is now ssl.jsonl (was ssl.json).
- Hooks no longer write listener.pid files.
- DNS plugin is enabled by default; control with DNS_ENABLED and DNS_TIMEOUT.

^{Written for commit 483929391d. Summary will update on new commits.}

**Original Pull Request:** https://github.com/ArchiveBox/ArchiveBox/pull/1748 **State:** closed **Merged:** Yes --- Records hostname → IP resolutions during page load using Chrome CDP. Uses Network.responseReceived events to capture DNS resolution data and writes one JSON line per record to dns.jsonl. Features: - Captures hostname to IP address mappings (A/AAAA records) - Records failed DNS lookups (NXDOMAIN) - Deduplicates resolution records per page load - Integrates with existing Chrome plugin infrastructure  --- ## Summary by cubic Adds a DNS traffic recorder plugin that logs hostname → IP resolutions during page load via Chrome CDP and writes to dns.jsonl. Also refactors Chrome CDP-based plugins to use shared utilities, reducing duplicate code and standardizing navigation waits. - **New Features** - Captures A/AAAA records and NXDOMAIN failures. - Deduplicates hostname → IP mappings per page load. - Configurable via DNS_ENABLED and DNS_TIMEOUT. - Integrates with existing Chrome plugin infrastructure. - **Migration** - SSL output is now ssl.jsonl (was ssl.json). - Hooks no longer write listener.pid files. - DNS plugin is enabled by default; control with DNS_ENABLED and DNS_TIMEOUT. <sup>Written for commit 483929391d16418a890b5d7fcc9b12971eea4edc. Summary will update on new commits.</sup>

kerem

2026-03-01 18:01:23 +03:00

closed this issue
added the
pull-request
label

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/ArchiveBox#3007

No description provided.

Rows
Columns