[GH-ISSUE #15] How does this deal with duplicates? #7

Closed
opened 2026-02-25 23:33:14 +03:00 by kerem · 4 comments
Owner

Originally created by @karanrajpal14 on GitHub (Mar 2, 2018).
Original GitHub issue: https://github.com/go-shiori/shiori/issues/15

I often find a couple of duplicate links on my Pocket account. It doesn't happen with links that I've added recently but there are quite a few old links that have a lot of duplicates and no easy means to remove them.

Just wanted to know about this before I considered moving over. Thank you!

Originally created by @karanrajpal14 on GitHub (Mar 2, 2018). Original GitHub issue: https://github.com/go-shiori/shiori/issues/15 I often find a couple of duplicate links on my Pocket account. It doesn't happen with links that I've added recently but there are quite a few old links that have a lot of duplicates and no easy means to remove them. Just wanted to know about this before I considered moving over. Thank you!
kerem closed this issue 2026-02-25 23:33:14 +03:00
Author
Owner

@peteretelej commented on GitHub (Mar 2, 2018):

doesn't allow duplicate bookmark urls github.com/RadhiFadlillah/shiori@df7d08a75b/database/sqlite.go (L57)

<!-- gh-comment-id:369826830 --> @peteretelej commented on GitHub (Mar 2, 2018): doesn't allow duplicate bookmark urls https://github.com/RadhiFadlillah/shiori/blob/df7d08a75bb8207915bdd06696c9b835b84d9b3d/database/sqlite.go#L57
Author
Owner

@karanrajpal14 commented on GitHub (Mar 2, 2018):

Great! Thank you very much!

<!-- gh-comment-id:369869669 --> @karanrajpal14 commented on GitHub (Mar 2, 2018): Great! Thank you very much!
Author
Owner

@codeanpeace commented on GitHub (Mar 2, 2018):

Assuming shiori doesn't automatically strip UTM params from the url before persisiting, a unique constraint on url doesn't equate to a unique constraint on content. The same page can map to many unique URLs because of UTM params. Pocket has this problem too...

<!-- gh-comment-id:370047243 --> @codeanpeace commented on GitHub (Mar 2, 2018): Assuming shiori doesn't automatically strip UTM params from the url before persisiting, a unique constraint on url doesn't equate to a unique constraint on content. The same page can map to many unique URLs because of UTM params. Pocket has this problem too...
Author
Owner

@heliostatic commented on GitHub (Mar 3, 2018):

@codeanpeace It doesn't yet, but #26 is to address that issue.

<!-- gh-comment-id:370148551 --> @heliostatic commented on GitHub (Mar 3, 2018): @codeanpeace It doesn't yet, but #26 is to address that issue.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/shiori#7
No description provided.