[GH-ISSUE #31] Add Support for Site Logins #21

New issue

Closed

opened 2026-03-01 14:39:54 +03:00 by kerem · 4 comments

kerem commented

2026-03-01 14:39:54 +03:00

Owner

Originally created by @marlowe310 on GitHub (Jul 1, 2017).
Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/31

I'm trying to archive a few bookmarks that require I be logged in to the site itself for content to be visible -- which means BA is just outputting a page with the content concealed at this time.

Is there a way to log the chromium instance BA is using in, to prevent that from happening? Thanks much, very impressive work.

Originally created by @marlowe310 on GitHub (Jul 1, 2017). Original GitHub issue: https://github.com/ArchiveBox/ArchiveBox/issues/31 I'm trying to archive a few bookmarks that require I be logged in to the site itself for content to be visible -- which means BA is just outputting a page with the content concealed at this time. Is there a way to log the chromium instance BA is using in, to prevent that from happening? Thanks much, very impressive work.

kerem

2026-03-01 14:39:54 +03:00

closed this issue
added the
status: needs followup
label

kerem commented

2026-03-01 14:39:55 +03:00

Author

Owner

@pirate commented on GitHub (Jul 2, 2017):

Have you tried logging in to the sites using chrome normally before running the script? Headless chrome is just a command line interface to normal Chrome, ~~so it uses all the same cookies. Any sessions you log into via normal chrome should carry over in headless mode...~~ Edit: it's not supported yet

If that doesn't work, there is another way but it's quite difficult. You run headless chrome with the remote debugging port open, then send custom JS commands (which depend on the structure of the site) to issue a POST request which logs you in. It's quite tricky to do, because you'd have to run the commands within the initial time window before chrome takes the screenshot.

@pirate commented on GitHub (Jul 2, 2017): Have you tried logging in to the sites using chrome normally before running the script? Headless chrome is just a command line interface to normal Chrome, ~~so it uses all the same cookies. Any sessions you log into via normal chrome should carry over in headless mode...~~ Edit: [it's not supported yet](https://bugs.chromium.org/p/chromium/issues/detail?id=617931) If that doesn't work, there is another way but it's quite difficult. You run headless chrome with the remote debugging port open, then send custom JS commands (which depend on the structure of the site) to issue a POST request which logs you in. It's quite tricky to do, because you'd have to run the commands within the initial time window before chrome takes the screenshot.

kerem commented

2026-03-01 14:39:55 +03:00

Author

Owner

@pirate commented on GitHub (Jul 6, 2017):

Closing this for now, but comment back if you're still having trouble and I'd be happy to re-open this and help out!

Added a note to the docs as well: a7d1213

@pirate commented on GitHub (Jul 6, 2017): Closing this for now, but comment back if you're still having trouble and I'd be happy to re-open this and help out! Added a note to the docs as well: a7d1213

kerem commented

2026-03-01 14:39:55 +03:00

Author

Owner

@pirate commented on GitHub (Jul 22, 2017):

I stand corrected, apparently chrome --headless runs in incognito mode: https://bugs.chromium.org/p/chromium/issues/detail?id=617931

@pirate commented on GitHub (Jul 22, 2017): I stand corrected, apparently `chrome --headless` runs in incognito mode: https://bugs.chromium.org/p/chromium/issues/detail?id=617931

kerem commented

2026-03-01 14:39:55 +03:00

Author

Owner

@pirate commented on GitHub (Oct 30, 2017):

Done! https://github.com/pirate/bookmark-archiver/releases/tag/v0.0.3

@pirate commented on GitHub (Oct 30, 2017): Done! https://github.com/pirate/bookmark-archiver/releases/tag/v0.0.3

kerem referenced this issue

2026-03-01 14:44:24 +03:00

[GH-ISSUE #876] Failed to set up development environment #539

kerem referenced this issue

2026-03-01 14:48:10 +03:00