starred/spamscanner
1
0
Fork 0
mirror of https://github.com/spamscanner/spamscanner.git synced 2026-04-27 04:36:09 +03:00
Code Issues 2 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #1] v2.0.0 #2

New issue
Open
opened 2026-03-04 00:58:09 +03:00 by kerem · 6 comments
kerem commented 2026-03-04 00:58:09 +03:00
Owner
Copy link

Originally created by @niftylettuce on GitHub (Apr 24, 2020).
Original GitHub issue: https://github.com/spamscanner/spamscanner/issues/1

  • When we're parsing tokens, striptags implementation needs to additionally be pre-processed with sanitize-html to remove blocks like <style>, <stylesheet>, <meta>, <head> etc.
  • Modify scanner.getPhishingResults to check against OpenPhish and PhishTank datasets.
  • Tokenize and stem other mail headers (e.g. to, from, cc, bcc, reply-to, in-reply-to, etc.)
  • Determine solution to performance issue with classifier.train() in classifier.js per NaturalNode/natural#520.
  • Headers should NOT get converted and preserved for URL/Received-By purposes - only content should be converted
  • Get inspiration from ls /usr/share/spamassassin if needed
Originally created by @niftylettuce on GitHub (Apr 24, 2020). Original GitHub issue: https://github.com/spamscanner/spamscanner/issues/1 - [x] When we're parsing tokens, `striptags` implementation needs to additionally be pre-processed with `sanitize-html` to remove blocks like `<style>`, `<stylesheet>`, `<meta>`, `<head>` etc. - [x] Modify `scanner.getPhishingResults` to check against ~[OpenPhish][]~ and [PhishTank][] datasets. - [x] Tokenize and stem other mail headers (e.g. to, from, cc, bcc, reply-to, in-reply-to, etc.) - [x] Determine solution to performance issue with `classifier.train()` in `classifier.js` per [NaturalNode/natural#520](https://github.com/NaturalNode/natural/issues/520). - [x] Headers should NOT get converted and preserved for URL/Received-By purposes - only content should be converted - [x] Get inspiration from `ls /usr/share/spamassassin` if needed [openphish]: https://openphish.com/ [phishtank]: https://phishtank.com/ [nsfw]: https://github.com/infinitered/nsfwjs [toxicity]: https://github.com/tensorflow/tfjs-models/tree/master/toxicity
kerem commented 2026-03-04 00:58:17 +03:00
Author
Owner
Copy link

@niftylettuce commented on GitHub (May 4, 2020):

  • Add more tests
<!-- gh-comment-id:623461784 --> @niftylettuce commented on GitHub (May 4, 2020): - [x] Add more tests
kerem commented 2026-03-04 00:58:17 +03:00
Author
Owner
Copy link

@niftylettuce commented on GitHub (May 8, 2020):

  • Phishing protection is too strict (e.g. sendgrid link tracker/click trackers won't work)
<!-- gh-comment-id:626067573 --> @niftylettuce commented on GitHub (May 8, 2020): - [x] Phishing protection is too strict (e.g. sendgrid link tracker/click trackers won't work)
kerem commented 2026-03-04 00:58:17 +03:00
Author
Owner
Copy link

@niftylettuce commented on GitHub (May 29, 2020):

  • Add SpamAssassin and rspam clamav integration
<!-- gh-comment-id:635749992 --> @niftylettuce commented on GitHub (May 29, 2020): - [X] Add ~SpamAssassin and rspam~ clamav integration
kerem commented 2026-03-04 00:58:17 +03:00
Author
Owner
Copy link

@niftylettuce commented on GitHub (Jun 18, 2020):

  • Test against ARF abuse.zip
  • Track reputation of links (e.g. ham sent but with spammy links)
<!-- gh-comment-id:645874446 --> @niftylettuce commented on GitHub (Jun 18, 2020): - [ ] Test against ARF abuse.zip - [ ] Track reputation of links (e.g. ham sent but with spammy links)
kerem commented 2026-03-04 00:58:17 +03:00
Author
Owner
Copy link

@niftylettuce commented on GitHub (Jun 18, 2020):

  • When ARF parses message, strip out the replacement tokens to get a pure content-only tokens array
  • We may want to do PG approach of looking at (n) most interesting words
  • Gibberish detection with Wikimedia and Google AI datasets
<!-- gh-comment-id:645875328 --> @niftylettuce commented on GitHub (Jun 18, 2020): - [ ] When ARF parses message, strip out the replacement tokens to get a pure content-only tokens array - [x] We may want to do PG approach of looking at (n) most interesting words - [ ] Gibberish detection with Wikimedia and Google AI datasets
kerem commented 2026-03-04 00:58:17 +03:00
Author
Owner
Copy link

@niftylettuce commented on GitHub (Jun 18, 2020):

<!-- gh-comment-id:646321981 --> @niftylettuce commented on GitHub (Jun 18, 2020): - [x] Methods need wrapped with universalify https://github.com/spamscanner/spamscanner/blob/master/index.js#L352-L360
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
snyk-fix-e485913811a1a5163568193c35fd37b4
snyk-fix-e976c8078925d2a26cf9558096aee49e
snyk-fix-191b5fbf534d95b549ecc570f62e6ce3
refactor/workers
test/perf
v6.1.5
v6.1.4
v6.1.3
v6.1.2
v6.1.1
v6.1.0
v6.0.1
v6.0.0
v5.1.5
v5.1.4
v5.1.3
v5.1.2
v5.1.1
v5.1.0
v5.0.0
v4.0.0
v3.0.7
v3.0.6
v3.0.5
v3.0.4
v3.0.3
v3.0.2
v3.0.1
v3.0.0
v2.3.0
v2.2.2
v2.2.1
v2.2.0
v2.1.0
v2.0.0
v1.2.5
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.5
v1.1.4
v1.1.3
v1.1.2
v1.1.1
v1.1.0
v1.0.8
v1.0.7
v1.0.6
v1.0.5
v1.0.4
v1.0.3
v1.0.2
v1.0.1
v1.0.0
v0.0.10
v0.0.7
v0.0.8
v0.0.9
v0.0.6
v0.0.5
v0.0.4
v0.0.3
v0.0.2
v0.0.1
Labels
Clear labels   
bug

   
bug

   
enhancement

   
help wanted

   
pull-request

Mirrored from GitHub Pull Request

No labels
bug
bug
enhancement
help wanted
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/spamscanner#2
No description provided.