[GH-ISSUE #172] [Feature Request] Local Scraper (Use browser auth) #131

Closed
opened 2026-03-02 11:46:54 +03:00 by kerem · 52 comments
Owner

Originally created by @brucealdridge on GitHub (May 19, 2024).
Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/172

There are a number of sites that I visit that I would like to bookmark that require authentication. A good example of this is news sites with content behind paywalls.

Using a scraper on a server won't work and will instead just save a login screen.

Can the browser extensions pass a copy of the page via the API and save that?

Originally created by @brucealdridge on GitHub (May 19, 2024). Original GitHub issue: https://github.com/karakeep-app/karakeep/issues/172 There are a number of sites that I visit that I would like to bookmark that require authentication. A good example of this is news sites with content behind paywalls. Using a scraper on a server won't work and will instead just save a login screen. Can the browser extensions pass a copy of the page via the API and save that?
kerem 2026-03-02 11:46:54 +03:00
Author
Owner

@kamtschatka commented on GitHub (May 21, 2024):

Yes, taking screenshots is possible with chrome extensions.
One issue would be that rescraping the page would not be possible as you would go to the login screen again, so there would need to be some kind of "prevent rescraping" flag.
Another option would probably be to use your locally installed chrome instance for scraping the data by running a worker locally. I am not sure how user friendly that would be^^.

<!-- gh-comment-id:2123283269 --> @kamtschatka commented on GitHub (May 21, 2024): Yes, taking screenshots is possible with chrome extensions. One issue would be that rescraping the page would not be possible as you would go to the login screen again, so there would need to be some kind of "prevent rescraping" flag. Another option would probably be to use your locally installed chrome instance for scraping the data by running a worker locally. I am not sure how user friendly that would be^^.
Author
Owner

@MohamedBassem commented on GitHub (May 22, 2024):

This makes a lot of sense. The extension itself can capture the page content so that hoarder doesn't need to crawl it. This is a reasonable feature request, will add it to our todo list :)

<!-- gh-comment-id:2124154582 --> @MohamedBassem commented on GitHub (May 22, 2024): This makes a lot of sense. The extension itself can capture the page content so that hoarder doesn't need to crawl it. This is a reasonable feature request, will add it to our todo list :)
Author
Owner

@kureta commented on GitHub (May 27, 2024):

This would be a great feature. Also tubearchivist has a browser extension that syncs your youtube cookies with the tube archivist server. An extension that automatically shares all your cookies, or let's you choose which cookies to share, or sends the cookies of current page to hoarder before it starts scraping might be an option.

<!-- gh-comment-id:2134013014 --> @kureta commented on GitHub (May 27, 2024): This would be a great feature. Also [tubearchivist](https://github.com/tubearchivist/browser-extensionl) has a browser extension that syncs your youtube cookies with the tube archivist server. An extension that automatically shares all your cookies, or let's you choose which cookies to share, or sends the cookies of current page to hoarder before it starts scraping might be an option.
Author
Owner

@javydekoning commented on GitHub (Oct 3, 2024):

A similar solution to Evernote Web clipper would be awesome.

Select some text/images -> right click -> hoard.

https://chromewebstore.google.com/detail/evernote-web-clipper/pioclpoplcdbaefihamjohnefbikjilc?hl=en

<!-- gh-comment-id:2391946986 --> @javydekoning commented on GitHub (Oct 3, 2024): A similar solution to Evernote Web clipper would be awesome. Select some text/images -> right click -> hoard. https://chromewebstore.google.com/detail/evernote-web-clipper/pioclpoplcdbaefihamjohnefbikjilc?hl=en
Author
Owner

@huyz commented on GitHub (Oct 7, 2024):

See also https://github.com/webclipper/web-clipper

<!-- gh-comment-id:2396088762 --> @huyz commented on GitHub (Oct 7, 2024): See also https://github.com/webclipper/web-clipper
Author
Owner

@NotChristianGarcia commented on GitHub (Nov 10, 2024):

^ web-clipper does exist and work. I didn't like the flow too much.

SingleFile is another project to check. It outputs .html (or an archive). I think it's easier to manage and quick to run. It has an Upload to a REST form API option in settings that sets a destination that hoarder could use if hoarder doesn't want to re-implement scraping.

<!-- gh-comment-id:2466978354 --> @NotChristianGarcia commented on GitHub (Nov 10, 2024): ^ web-clipper does exist and work. I didn't like the flow too much. [SingleFile](https://github.com/gildas-lormeau/SingleFile) is another project to check. It outputs .html (or an archive). I think it's easier to manage and quick to run. It has an `Upload to a REST form API` option in settings that sets a destination that hoarder could use if hoarder doesn't want to re-implement scraping.
Author
Owner

@errorsandwarnings commented on GitHub (Nov 21, 2024):

@NotChristianGarcia I agree, and came looking for similar functionality. All it needs is a REST API endpoint which single file can send to and the API endpoint parses the archive and puts it in hoarder. This will help solve so many problems. Local scrape is a really needed feature.

<!-- gh-comment-id:2492302702 --> @errorsandwarnings commented on GitHub (Nov 21, 2024): @NotChristianGarcia I agree, and came looking for similar functionality. All it needs is a REST API endpoint which single file can send to and the API endpoint parses the archive and puts it in hoarder. This will help solve so many problems. Local scrape is a really needed feature.
Author
Owner

@yinan-c commented on GitHub (Nov 21, 2024):

That's what I have in mind as well.

<!-- gh-comment-id:2492305318 --> @yinan-c commented on GitHub (Nov 21, 2024): That's what I have in mind as well.
Author
Owner

@MohamedBassem commented on GitHub (Nov 21, 2024):

Hey folks, I know how important this feature is and it's on top of my todo list! I'll see if I can get it in the next release!

<!-- gh-comment-id:2492443291 --> @MohamedBassem commented on GitHub (Nov 21, 2024): Hey folks, I know how important this feature is and it's on top of my todo list! I'll see if I can get it in the next release!
Author
Owner

@freakshock88 commented on GitHub (Dec 17, 2024):

I tried uploading a hosted HTML file that I downloaded with singlefile. Hoarder does not seem to be able to process these HTML archive files. Did anyone try that before?

<!-- gh-comment-id:2548904942 --> @freakshock88 commented on GitHub (Dec 17, 2024): I tried uploading a hosted HTML file that I downloaded with singlefile. Hoarder does not seem to be able to process these HTML archive files. Did anyone try that before?
Author
Owner

@kamtschatka commented on GitHub (Dec 17, 2024):

if someone else has tried it, they would get the same result, as this is not supported

<!-- gh-comment-id:2548912329 --> @kamtschatka commented on GitHub (Dec 17, 2024): if someone else has tried it, they would get the same result, as this is not supported
Author
Owner

@freakshock88 commented on GitHub (Dec 18, 2024):

Actually, I was wrong. Hoarder was able to process my selfhosted HTML archive files generated by Singlefile. It just took more time than I expected. I see a few timeouts in the logs for the Hoarder worker, but after like 10 minutes the page has been successfully added to hoarder.

<!-- gh-comment-id:2551500889 --> @freakshock88 commented on GitHub (Dec 18, 2024): Actually, I was wrong. Hoarder was able to process my selfhosted HTML archive files generated by Singlefile. It just took more time than I expected. I see a few timeouts in the logs for the Hoarder worker, but after like 10 minutes the page has been successfully added to hoarder.
Author
Owner

@kamtschatka commented on GitHub (Dec 18, 2024):

what exactly are you doing? I don't understand what the worker has to do with you adding a html file? how are you even adding the html file?

<!-- gh-comment-id:2551786293 --> @kamtschatka commented on GitHub (Dec 18, 2024): what exactly are you doing? I don't understand what the worker has to do with you adding a html file? how are you even adding the html file?
Author
Owner

@agruen commented on GitHub (Jan 6, 2025):

@MohamedBassem -- I just wanted to add that if you offered a way to pass content of a page through the API, there are opportunities to make this work with Mac/iOS shortcuts. (Which is particularly important for Safari on Mac users... as that's how we can currently save! e.g. see this Shortcut I built -- I could use Safari's built-in reader mode to pass page contents...)

<!-- gh-comment-id:2572212769 --> @agruen commented on GitHub (Jan 6, 2025): @MohamedBassem -- I just wanted to add that if you offered a way to pass content of a page through the API, there are opportunities to make this work with Mac/iOS shortcuts. (Which is particularly important for Safari on Mac users... as that's how we can currently save! e.g. see this [Shortcut](https://www.icloud.com/shortcuts/a012e1a0145f4d5a8f6011202791b9d0) I built -- I could use Safari's built-in reader mode to pass page contents...)
Author
Owner

@MohamedBassem commented on GitHub (Jan 11, 2025):

So folks, as a stopgap until this is supported natively in hoarder's extension, I've just published 10506173cd which exposes an API from hoarder that's compatible with the singleFile extension directly.

It should be available in the nightly build in ~15mins. If you move to the nightly release track, you can use it by following this guide. Please give it a try and let me know how it goes.

Keep in mind that once you go to the nightly track, it's not safe to go back to the stable release until the next release.

<!-- gh-comment-id:2585364075 --> @MohamedBassem commented on GitHub (Jan 11, 2025): So folks, as a stopgap until this is supported natively in hoarder's extension, I've just published 10506173cd5309e7c63d83055243abc67cecad4f which exposes an API from hoarder that's compatible with the singleFile extension directly. It should be available in the nightly build in ~15mins. If you move to the nightly release track, you can use it by following this [guide](https://docs.hoarder.app/next/Guides/singlefile). Please give it a try and let me know how it goes. Keep in mind that once you go to the nightly track, it's not safe to go back to the stable release until the next release.
Author
Owner

@freakshock88 commented on GitHub (Jan 12, 2025):

what exactly are you doing? I don't understand what the worker has to do with you adding a html file? how are you even adding the html file?

I am downloading a singlefile generated html file, and then hosting that file on my own domain. Then I send that url to hoarder. I first thought hoarder was incompatible with the singlefile generated html files, but that is not the case. But @MohamedBassem's solution will be way easier :)

<!-- gh-comment-id:2585673207 --> @freakshock88 commented on GitHub (Jan 12, 2025): > what exactly are you doing? I don't understand what the worker has to do with you adding a html file? how are you even adding the html file? I am downloading a singlefile generated html file, and then hosting that file on my own domain. Then I send that url to hoarder. I first thought hoarder was incompatible with the singlefile generated html files, but that is not the case. But @MohamedBassem's solution will be way easier :)
Author
Owner

@huyz commented on GitHub (Jan 12, 2025):

So folks, as a stopgap until this is supported natively in hoarder's extension, I've just published github.com/hoarder-app/hoarder@10506173cd which exposes an API from hoarder that's compatible with the singleFile extension directly.

Gamechanger alert! 😄

<!-- gh-comment-id:2585673732 --> @huyz commented on GitHub (Jan 12, 2025): > So folks, as a stopgap until this is supported natively in hoarder's extension, I've just published https://github.com/hoarder-app/hoarder/commit/10506173cd5309e7c63d83055243abc67cecad4f which exposes an API from hoarder that's compatible with the singleFile extension directly. Gamechanger alert! 😄
Author
Owner

@dionorgua commented on GitHub (Jan 12, 2025):

Wow. Thanks!. This is huge improvement.

<!-- gh-comment-id:2585724823 --> @dionorgua commented on GitHub (Jan 12, 2025): Wow. Thanks!. This is huge improvement.
Author
Owner

@errorsandwarnings commented on GitHub (Jan 12, 2025):

@MohamedBassem When is the next stable planned to release?

<!-- gh-comment-id:2585971888 --> @errorsandwarnings commented on GitHub (Jan 12, 2025): @MohamedBassem When is the next stable planned to release?
Author
Owner

@MohamedBassem commented on GitHub (Jan 12, 2025):

@errorsandwarnings We've had a release last week, so I'd expect the next release to be at least a couple of weeks away unfortunately.

<!-- gh-comment-id:2585972414 --> @MohamedBassem commented on GitHub (Jan 12, 2025): @errorsandwarnings We've had a release last week, so I'd expect the next release to be at least a couple of weeks away unfortunately.
Author
Owner

@errorsandwarnings commented on GitHub (Jan 13, 2025):

@MohamedBassem Is it safe to switch to nightly and then to the next stable when released? I want to avoid loosing any data if there is any chance.

<!-- gh-comment-id:2585975856 --> @errorsandwarnings commented on GitHub (Jan 13, 2025): @MohamedBassem Is it safe to switch to nightly and then to the next stable when released? I want to avoid loosing any data if there is any chance.
Author
Owner

@errorsandwarnings commented on GitHub (Jan 13, 2025):

@MohamedBassem Just tried it, it can archive small pages but it started hitting too big to store limit on some pages.

<!-- gh-comment-id:2585996665 --> @errorsandwarnings commented on GitHub (Jan 13, 2025): @MohamedBassem Just tried it, it can archive small pages but it started hitting too big to store limit on some pages.
Author
Owner

@brucealdridge commented on GitHub (Jan 13, 2025):

@MohamedBassem Just tried it, it can archive small pages but it started hitting too big to store limit on some pages.

Default is set to 4MB, looks like its set by ENV vars.

<!-- gh-comment-id:2586035000 --> @brucealdridge commented on GitHub (Jan 13, 2025): > @MohamedBassem Just tried it, it can archive small pages but it started hitting too big to store limit on some pages. [Default is set to 4MB, looks like its set by ENV vars.](https://github.com/hoarder-app/hoarder/blob/bbbf33536c6c1a73fdfe76c42ff19cd08aabcc6f/docs/docs/03-configuration.md?plain=1#L12)
Author
Owner

@MohamedBassem commented on GitHub (Jan 13, 2025):

@errorsandwarnings yes, you can go to nightly and back to stable in the next release.

@brucealdridge Yeah, I probably should change the default to 50MB. 4MB is going to cause a lot of hassle to a lot of people using this feature.

<!-- gh-comment-id:2586059957 --> @MohamedBassem commented on GitHub (Jan 13, 2025): @errorsandwarnings yes, you can go to nightly and back to stable in the next release. @brucealdridge Yeah, I probably should change the default to 50MB. 4MB is going to cause a lot of hassle to a lot of people using this feature.
Author
Owner

@errorsandwarnings commented on GitHub (Jan 13, 2025):

@MohamedBassem After changing the limit, it starting working. However I do see there is quite a lot of lag, the link in hoarder shows up but the actual archive file is taking 5-10 minutes to populate and become visible.

<!-- gh-comment-id:2586077393 --> @errorsandwarnings commented on GitHub (Jan 13, 2025): @MohamedBassem After changing the limit, it starting working. However I do see there is quite a lot of lag, the link in hoarder shows up but the actual archive file is taking 5-10 minutes to populate and become visible.
Author
Owner

@MohamedBassem commented on GitHub (Jan 13, 2025):

please share the logs if possible :)

<!-- gh-comment-id:2586078238 --> @MohamedBassem commented on GitHub (Jan 13, 2025): please share the logs if possible :)
Author
Owner

@errorsandwarnings commented on GitHub (Jan 13, 2025):

@MohamedBassem Log location?

<!-- gh-comment-id:2586087069 --> @errorsandwarnings commented on GitHub (Jan 13, 2025): @MohamedBassem Log location?
Author
Owner

@MohamedBassem commented on GitHub (Jan 13, 2025):

just from 'docker compose logs', if you're using docker

<!-- gh-comment-id:2586421873 --> @MohamedBassem commented on GitHub (Jan 13, 2025): just from 'docker compose logs', if you're using docker
Author
Owner

@errorsandwarnings commented on GitHub (Jan 13, 2025):

@MohamedBassem Try this : http://0x0.st/8-Ff.txt

<!-- gh-comment-id:2586519610 --> @errorsandwarnings commented on GitHub (Jan 13, 2025): @MohamedBassem Try this : http://0x0.st/8-Ff.txt
Author
Owner

@errorsandwarnings commented on GitHub (Jan 13, 2025):

The reddit archive I have tried to upload never shows up. I think the other urls are likely being scraped and not coming from singlefile upload.

<!-- gh-comment-id:2586520513 --> @errorsandwarnings commented on GitHub (Jan 13, 2025): The reddit archive I have tried to upload never shows up. I think the other urls are likely being scraped and not coming from singlefile upload.
Author
Owner

@ironicbadger commented on GitHub (Jan 17, 2025):

Singlefile gives the following error when attempting to save to Hoarder via the nightly release.

Image

Followed these instructions for configuration.
https://docs.hoarder.app/next/Guides/singlefile/

<!-- gh-comment-id:2598633697 --> @ironicbadger commented on GitHub (Jan 17, 2025): Singlefile gives the following error when attempting to save to Hoarder via the nightly release. <img width="273" alt="Image" src="https://github.com/user-attachments/assets/85e40044-f15b-4b51-9fe2-223f02a14665" /> Followed these instructions for configuration. https://docs.hoarder.app/next/Guides/singlefile/
Author
Owner

@DarthDobber commented on GitHub (Jan 18, 2025):

@ironicbadger I had that same error, in my case I haven't yet setup SSL for my hoarder instance so I had the change it from https (as it says in the instructions) to http and then it started working.

<!-- gh-comment-id:2599484503 --> @DarthDobber commented on GitHub (Jan 18, 2025): @ironicbadger I had that same error, in my case I haven't yet setup SSL for my hoarder instance so I had the change it from https (as it says in the instructions) to http and then it started working.
Author
Owner

@DarthDobber commented on GitHub (Jan 18, 2025):

Image

I am getting this error when attempting to hoard this URL

https://www.msn.com/en-us/news/us/ar-AA1xovTT

<!-- gh-comment-id:2599484901 --> @DarthDobber commented on GitHub (Jan 18, 2025): ![Image](https://github.com/user-attachments/assets/9970596e-58df-4880-bd64-c3dd1778f143) I am getting this error when attempting to hoard this URL https://www.msn.com/en-us/news/us/ar-AA1xovTT
Author
Owner

@ironicbadger commented on GitHub (Jan 18, 2025):

@ironicbadger I had that same error, in my case I haven't yet setup SSL for my hoarder instance so I had the change it from https (as it says in the instructions) to http and then it started working.

i tried both http to the IP or my reverse proxy https url as well

<!-- gh-comment-id:2599485376 --> @ironicbadger commented on GitHub (Jan 18, 2025): > @ironicbadger I had that same error, in my case I haven't yet setup SSL for my hoarder instance so I had the change it from https (as it says in the instructions) to http and then it started working. > > i tried both http to the IP or my reverse proxy https url as well
Author
Owner

@psjay commented on GitHub (Jan 19, 2025):

handy feature! a small suggestion here: hoarder could automatically enable the archive version of the uploaded singfile since it's already an archive.

<!-- gh-comment-id:2600758804 --> @psjay commented on GitHub (Jan 19, 2025): handy feature! a small suggestion here: hoarder could automatically enable the archive version of the uploaded singfile since it's already an archive.
Author
Owner

@dwayne-hu commented on GitHub (Jan 22, 2025):

Image

I am getting this error when attempting to hoard this URL

https://www.msn.com/en-us/news/us/ar-AA1xovTT

I am having the same problem, despite i already set the maximum asset size to 50 MB. Does anybody have a solution?

Edit:
I checked the file size of the created singlefile. It is about 160MB for some reddit sites. This problem is adressed in this issue. My problem is solved when enabling Stylesheets > group duplicate stylesheets together

<!-- gh-comment-id:2608042891 --> @dwayne-hu commented on GitHub (Jan 22, 2025): > ![Image](https://github.com/user-attachments/assets/9970596e-58df-4880-bd64-c3dd1778f143) > > I am getting this error when attempting to hoard this URL > > https://www.msn.com/en-us/news/us/ar-AA1xovTT I am having the same problem, despite i already set the maximum asset size to 50 MB. Does anybody have a solution? Edit: I checked the file size of the created singlefile. It is about 160MB for some reddit sites. This problem is adressed in this [issue](https://github.com/gildas-lormeau/SingleFile/issues/1387). My problem is solved when enabling `Stylesheets > group duplicate stylesheets together`
Author
Owner

@errorsandwarnings commented on GitHub (Jan 24, 2025):

I have tried this multiple times, can't get this working properly. The link is created in hoarder but the sent singlefile archive is never visible or attached. @MohamedBassem Can you please investigate? Do you see any reasons? I did attach docker logs for your review previously.

<!-- gh-comment-id:2611293844 --> @errorsandwarnings commented on GitHub (Jan 24, 2025): I have tried this multiple times, can't get this working properly. The link is created in hoarder but the sent singlefile archive is never visible or attached. @MohamedBassem Can you please investigate? Do you see any reasons? I did attach docker logs for your review previously.
Author
Owner

@DarthDobber commented on GitHub (Jan 25, 2025):

I am having the same problem, despite i already set the maximum asset size to 50 MB. Does anybody have a solution?

Edit: I checked the file size of the created singlefile. It is about 160MB for some reddit sites. This problem is adressed in this issue. My problem is solved when enabling Stylesheets > group duplicate stylesheets together

Thank you for this! I made the stylesheet config change and it helped with some articles. However, not all. For example, this url still returns the error:

https://www.thefp.com/p/dont-free-ross-ulbricht-clemency-trump

<!-- gh-comment-id:2614030048 --> @DarthDobber commented on GitHub (Jan 25, 2025): > I am having the same problem, despite i already set the maximum asset size to 50 MB. Does anybody have a solution? > > Edit: I checked the file size of the created singlefile. It is about 160MB for some reddit sites. This problem is adressed in this [issue](https://github.com/gildas-lormeau/SingleFile/issues/1387). My problem is solved when enabling `Stylesheets > group duplicate stylesheets together` Thank you for this! I made the stylesheet config change and it helped with some articles. However, not all. For example, this url still returns the error: https://www.thefp.com/p/dont-free-ross-ulbricht-clemency-trump
Author
Owner

@jasonyang-ee commented on GitHub (Jan 31, 2025):

Singlefile gives the following error when attempting to save to Hoarder via the nightly release.
Image

Followed these instructions for configuration. https://docs.hoarder.app/next/Guides/singlefile/

I have the same issue. I feel this is due to the update is still in "next" branch which is not yet released.

This is unreleased documentation for Hoarder Docs Next version.
<!-- gh-comment-id:2626656153 --> @jasonyang-ee commented on GitHub (Jan 31, 2025): > Singlefile gives the following error when attempting to save to Hoarder via the nightly release. > <img alt="Image" width="273" src="https://private-user-images.githubusercontent.com/2773080/404358152-85e40044-f15b-4b51-9fe2-223f02a14665.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzgzMTI3NDUsIm5iZiI6MTczODMxMjQ0NSwicGF0aCI6Ii8yNzczMDgwLzQwNDM1ODE1Mi04NWU0MDA0NC1mMTViLTRiNTEtOWZlMi0yMjNmMDJhMTQ2NjUucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDEzMSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAxMzFUMDgzNDA1WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjkxNDQ0YTNjNzg2MDc4ODZlZTY2ZTVmZmVkMDZlNTk1ZTBlOGJjN2Y4MmZjODY0MjU5ZDE1NTUwNGQwMzBkYiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.k8aJQU1YGJP8o4iFagcvXgghaL61zBKaBrqCVdGMlaA"> > > Followed these instructions for configuration. https://docs.hoarder.app/next/Guides/singlefile/ I have the same issue. I feel this is due to the update is still in "next" branch which is not yet released. ``` This is unreleased documentation for Hoarder Docs Next version. ```
Author
Owner

@huyz commented on GitHub (Feb 9, 2025):

TIPs:

In SingleFile options

  • You can make use of profiles to have one set to direct to Hoarder.
  • Make sure that the File Format is set to HTML and not Zip file.
<!-- gh-comment-id:2646580085 --> @huyz commented on GitHub (Feb 9, 2025): TIPs: In SingleFile options - You can make use of profiles to have one set to direct to Hoarder. - Make sure that the File Format is set to HTML and not Zip file.
Author
Owner

@ctschach commented on GitHub (Feb 11, 2025):

So I tried to setup SingleFile on iPadOS and it doesn‘t work. I mean I can get SingleFile to work inside the browser, but using the REST API and push this to hoarder does not work.

The strange thing is: I didn‘t even get an error message. So this file is just vacuumed into a black hole…

I increased the upload limit to 200MB, so this should be enough.

The is the page I try to save:

https://www.etsy.com/de/listing/1702261359/fiat-ducato-kleiderhaken-the-hooks

<!-- gh-comment-id:2651591402 --> @ctschach commented on GitHub (Feb 11, 2025): So I tried to setup SingleFile on iPadOS and it doesn‘t work. I mean I can get SingleFile to work inside the browser, but using the REST API and push this to hoarder does not work. The strange thing is: I didn‘t even get an error message. So this file is just vacuumed into a black hole… I increased the upload limit to 200MB, so this should be enough. The is the page I try to save: https://www.etsy.com/de/listing/1702261359/fiat-ducato-kleiderhaken-the-hooks
Author
Owner

@errorsandwarnings commented on GitHub (Feb 14, 2025):

The same is happening to me, it goes somewhere, but where I don't know.

<!-- gh-comment-id:2660307776 --> @errorsandwarnings commented on GitHub (Feb 14, 2025): The same is happening to me, it goes somewhere, but where I don't know.
Author
Owner

@errorsandwarnings commented on GitHub (Feb 14, 2025):

Just used the latest version and it seems to be working now.

<!-- gh-comment-id:2660354686 --> @errorsandwarnings commented on GitHub (Feb 14, 2025): Just used the latest version and it seems to be working now.
Author
Owner

@brucealdridge commented on GitHub (Feb 14, 2025):

I opened the issue to avoid browser auth. The fix in 1050617 works for me.

I've been using this for about a week without any problems.

If you are having errors or it's not working as expected I'd recommend opening a new issue.

<!-- gh-comment-id:2660354882 --> @brucealdridge commented on GitHub (Feb 14, 2025): I opened the issue to avoid browser auth. The fix in [1050617](https://github.com/hoarder-app/hoarder/commit/10506173cd5309e7c63d83055243abc67cecad4f) works for me. I've been using this for about a week without any problems. If you are having errors or it's not working as expected I'd recommend opening a new issue.
Author
Owner

@errorsandwarnings commented on GitHub (Feb 15, 2025):

@brucealdridge Does the search work inside the archive ? Also, I don't see it picking title correctly

<!-- gh-comment-id:2660568461 --> @errorsandwarnings commented on GitHub (Feb 15, 2025): @brucealdridge Does the search work inside the archive ? Also, I don't see it picking title correctly
Author
Owner

@brucealdridge commented on GitHub (Feb 15, 2025):

@brucealdridge Does the search work inside the archive ? Also, I don't see it picking title correctly

If something isn't working open a new issue. It helps if you have clear reproduction steps.

<!-- gh-comment-id:2660643211 --> @brucealdridge commented on GitHub (Feb 15, 2025): > @brucealdridge Does the search work inside the archive ? Also, I don't see it picking title correctly If something isn't working open a new issue. It helps if you have clear reproduction steps.
Author
Owner

@bbrendon commented on GitHub (Feb 16, 2025):

If anyone is wondering why this was closed. I believe it's because of this new feature : See https://docs.hoarder.app/next/Guides/singlefile/

<!-- gh-comment-id:2661593118 --> @bbrendon commented on GitHub (Feb 16, 2025): If anyone is wondering why this was closed. I believe it's because of this new feature : See https://docs.hoarder.app/next/Guides/singlefile/
Author
Owner

@AlejandroAkbal commented on GitHub (May 25, 2025):

I think this should be reopened and implement single file natively into Karakeep extension, as realistically no one is going to learn about single file extension, install it and configure it

Similar to how Wallabag does it natively in their extension

<!-- gh-comment-id:2907680647 --> @AlejandroAkbal commented on GitHub (May 25, 2025): I think this should be reopened and implement single file natively into Karakeep extension, as realistically no one is going to learn about single file extension, install it and configure it Similar to how Wallabag does it natively in their extension
Author
Owner

@huyz commented on GitHub (May 25, 2025):

realistically no one is going to learn about single file extension, install it and configure it

That isn't even remotely realistic. The Singlefile extension is hugely popular and has other purposes besides Karakeep.

<!-- gh-comment-id:2907686339 --> @huyz commented on GitHub (May 25, 2025): > realistically no one is going to learn about single file extension, install it and configure it That isn't even remotely realistic. The Singlefile extension is hugely popular and has other purposes besides Karakeep.
Author
Owner

@AlejandroAkbal commented on GitHub (May 25, 2025):

Talking from my experience as a developer and common user; I think less than 10% of Karakeep users are going to handle this case by installing another extension and configuring it, while I do believe many users would use it if it was natively integrated

Has nothing to do with singlefile's popularity and more with the laziness of using and maintaining yet another extension for a specific use case

<!-- gh-comment-id:2907689083 --> @AlejandroAkbal commented on GitHub (May 25, 2025): Talking from my experience as a developer and common user; I think less than 10% of Karakeep users are going to handle this case by installing another extension and configuring it, while I do believe many users would use it if it was natively integrated Has nothing to do with singlefile's popularity and more with the laziness of using and maintaining yet another extension for a specific use case
Author
Owner

@huyz commented on GitHub (May 25, 2025):

Talking as a developer and user, the mere fact that Karakeep requires self-hosting narrows down the type of users and their tech proficiency in quite obvious ways.
You really think people who install the SingleFile extension are more technically proficient and motivated than people who self-host complex pieces of software?

<!-- gh-comment-id:2907692546 --> @huyz commented on GitHub (May 25, 2025): Talking as a developer and user, the mere fact that Karakeep requires self-hosting narrows down the type of users and their tech proficiency in quite obvious ways. You really think people who install the SingleFile extension are more technically proficient and motivated than people who self-host complex pieces of software?
Author
Owner

@AlejandroAkbal commented on GitHub (May 25, 2025):

You are right, it narrows down the type of users, still, doesn’t make it less true, I could self host Karakeep for my family, and they wouldn’t know how to setup other extensions, or why/when would they use it

I was simply suggesting that the more native it is, the easier and better for the end user

But I withdraw from this conversation, I expressed my opinion and hope it sparks different perspectives about this case, thank you for the debate :)

<!-- gh-comment-id:2907703886 --> @AlejandroAkbal commented on GitHub (May 25, 2025): You are right, it narrows down the type of users, still, doesn’t make it less true, I could self host Karakeep for my family, and they wouldn’t know how to setup other extensions, or why/when would they use it I was simply suggesting that the more native it is, the easier and better for the end user But I withdraw from this conversation, I expressed my opinion and hope it sparks different perspectives about this case, thank you for the debate :)
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/karakeep#131
No description provided.