[GH-ISSUE #956] Documentation: Document how search works

kerem commented

2026-03-01 14:44:51 +03:00

Owner

Originally created by @bbkane on GitHub (Mar 27, 2022).
Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/956

Wiki Page URL

https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#explanation-of-buttons-in-the-web-ui---admin-snapshots-list

Suggested Edit

Document how search works in Archivebox. It looks like https://github.com/ArchiveBox/ArchiveBox/pull/721 and https://github.com/ArchiveBox/ArchiveBox/pull/543 add full text search using Sonic, but I can't find advanced usage details. Can it do boolean queries ("rabbits" AND NOT "racoons") for example? Would someone more familiar with the project add a few sentences describing what the capabilities of the search are and maybe some examples explaining how to use it?

Originally created by @bbkane on GitHub (Mar 27, 2022). Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/956 ## Wiki Page URL  https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#explanation-of-buttons-in-the-web-ui---admin-snapshots-list ## Suggested Edit  Document how search works in Archivebox. It looks like https://github.com/ArchiveBox/ArchiveBox/pull/721 and https://github.com/ArchiveBox/ArchiveBox/pull/543 add full text search using Sonic, but I can't find advanced usage details. Can it do boolean queries (`"rabbits" AND NOT "racoons"`) for example? Would someone more familiar with the project add a few sentences describing what the capabilities of the search are and maybe some examples explaining how to use it?

kerem

2026-03-01 14:44:51 +03:00

closed this issue
added the
touches: docs

size: easy
labels

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@bbkane commented on GitHub (Mar 27, 2022):

Does it search the body as well as the title? Can I order by fields in the query?

@bbkane commented on GitHub (Mar 27, 2022): Does it search the body as well as the title? Can I order by fields in the query?

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@rcarmo commented on GitHub (Sep 13, 2022):

It would be great to have this documented. Right now it feels like I can't do full text search on page contents, and it is mostly because search is inscrutable.

@rcarmo commented on GitHub (Sep 13, 2022): It would be great to have this documented. Right now it feels like I can't do full text search on page contents, and it is mostly because search is inscrutable.

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@pirate commented on GitHub (Sep 28, 2022):

I don't believe it can do Boolean queries but if you have Sonic you can do full-text search of the article bodies with fuzzy matching.

@pirate commented on GitHub (Sep 28, 2022): I don't believe it can do Boolean queries but if you have Sonic you can do full-text search of the article bodies with fuzzy matching.

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@rcarmo commented on GitHub (Sep 28, 2022):

I’m using the container image (which I assume includes it). Yet the lack of documentation still applies.

@rcarmo commented on GitHub (Sep 28, 2022): I’m using the container image (which I assume includes it). Yet the lack of documentation still applies.

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@pirate commented on GitHub (Nov 18, 2022):

I've added a line to the Usage docs and a screenshot explaining search slightly more here: https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#explanation-of-buttons-in-the-web-ui---admin-snapshots-list

I still have to add instructions on how to set up Sonic/ripgrep and configure them later.

add short description of search functionality to Wiki usage page + screenshot of search in use
add wiki page explaining ripgrep vs sonic, their tradeoffs, and how to set them up
add entries to the wiki configuration page for SEARCH_BACKEND_ENGINE, SEARCH_BACKEND_HOST, and SEARCH_BACKEND_PASSWORD
add README quick summary explaining that Sonic is available for full-text search, but ripgrep is used by default + link to wiki pages for more info
add docs on how to use ripgrep-all instead of ripgrep https://github.com/phiresky/ripgrep-all

In summary for people arriving here via Google the setup instructions for Sonic are as follows:

🔍 Sonic Search Setup Instructions

Download the sonic.cfg file into your data/ folder: curl -O https://raw.githubusercontent.com/ArchiveBox/ArchiveBox/master/etc/sonic.cfg
Uncomment the sonic: container config in docker-compose.yml: https://github.com/ArchiveBox/ArchiveBox/blob/dev/docker-compose.yml#:~:text=sonic.cfg
Set the SEARCH_BACKEND_ENGINE, SEARCH_BACKEND_HOST, and SEARCH_BACKEND_PASSWORD config vars in ArchiveBox to point to the new container: https://github.com/ArchiveBox/ArchiveBox/blob/dev/docker-compose.yml#:~:text=SEARCH_BACKEND_ENGINE
Restart the Docker compose project with docker-compose down; docker-compose down; docker-compose up
Add any previously archived data into the Sonic index by running docker compose run archivebox update --index-only
Verify Search works from the Snapshot admin page by searching for some text only present in an archived article's body text

If anyone wants to contribute the wiki page with these instructions + screenshots + links to the README I'm happy to review a documentation improvement PR.

@pirate commented on GitHub (Nov 18, 2022): I've added a line to the Usage docs and a screenshot explaining search slightly more here: https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#explanation-of-buttons-in-the-web-ui---admin-snapshots-list I still have to add instructions on how to set up Sonic/ripgrep and configure them later. - [X] add short description of search functionality to Wiki usage page + screenshot of search in use - [x] add wiki page explaining ripgrep vs sonic, their tradeoffs, and how to set them up - [ ] add entries to the wiki configuration page for `SEARCH_BACKEND_ENGINE`, `SEARCH_BACKEND_HOST`, and `SEARCH_BACKEND_PASSWORD` - [ ] add README quick summary explaining that Sonic is available for full-text search, but ripgrep is used by default + link to wiki pages for more info - [x] add docs on how to use ripgrep-all instead of ripgrep https://github.com/phiresky/ripgrep-all In summary **for people arriving here via Google the setup instructions for Sonic are as follows:** ## 🔍 Sonic Search Setup Instructions 1. Download the `sonic.cfg` file into your `data/` folder: `curl -O https://raw.githubusercontent.com/ArchiveBox/ArchiveBox/master/etc/sonic.cfg` 2. Uncomment the `sonic:` container config in `docker-compose.yml`: https://github.com/ArchiveBox/ArchiveBox/blob/dev/docker-compose.yml#:~:text=sonic.cfg 3. Set the `SEARCH_BACKEND_ENGINE`, `SEARCH_BACKEND_HOST`, and `SEARCH_BACKEND_PASSWORD` config vars in ArchiveBox to point to the new container: https://github.com/ArchiveBox/ArchiveBox/blob/dev/docker-compose.yml#:~:text=SEARCH_BACKEND_ENGINE 4. Restart the Docker compose project with `docker-compose down; docker-compose down; docker-compose up` 5. Add any previously archived data into the Sonic index by running `docker compose run archivebox update --index-only` 6. Verify Search works from the Snapshot admin page by searching for some text only present in an archived article's body text If anyone wants to contribute the wiki page with these instructions + screenshots + links to the README I'm happy to review a documentation improvement PR.

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@diego898 commented on GitHub (Jan 19, 2023):

Split out my comment into #1087

@diego898 commented on GitHub (Jan 19, 2023): Split out my comment into #1087

kerem commented

2026-03-01 14:44:52 +03:00

Author

Owner

@pirate commented on GitHub (May 7, 2024):

This is mostly done now! Check out our new documentation page here: https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search

I still have to document the config options on the Configuration page but it's a start.

For improvements / suggestions you can comment back here or open a PR with changes for this file:
https://github.com/ArchiveBox/docs/blob/master/Setting-up-Search.md

@pirate commented on GitHub (May 7, 2024): This is mostly done now! Check out our new documentation page here: https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search I still have to document the config options on the `Configuration` page but it's a start. For improvements / suggestions you can comment back here or open a PR with changes for this file: https://github.com/ArchiveBox/docs/blob/master/Setting-up-Search.md

kerem referenced this issue

2026-03-01 14:48:59 +03:00

[PR #593] [CLOSED] Replace Link with Snapshot (WIP) #1240

kerem referenced this issue

2026-03-01 18:00:38 +03:00

[PR #593] Replace Link with Snapshot (WIP) #2751

kerem referenced this issue

2026-03-15 01:34:43 +03:00

[PR #593] [CLOSED] Replace Link with Snapshot (WIP) #4255