starred/frontail
1
0
Fork 0
mirror of https://github.com/mthenw/frontail.git synced 2026-04-26 02:05:57 +03:00
Code Issues 58 Projects Releases 5 Packages Wiki Activity

[GH-ISSUE #37] Huge number of requests when following nginx logs #22

New issue
Closed
opened 2026-03-03 16:03:46 +03:00 by kerem · 3 comments
kerem commented 2026-03-03 16:03:46 +03:00
Owner
Copy link

Originally created by @mkonecny on GitHub (Nov 25, 2014).
Original GitHub issue: https://github.com/mthenw/frontail/issues/37

Currently have an issue where if I follow nginx logs (which is reverse-proxying frontail), it seems like there is a positive-feedback effect happening where frontail polls after each new log event, which generates a nginx log event, which in turn causes frontail to poll again faster and faster, until I'm seeing well over 50 requests per second.

x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067224 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067254 HTTP/1.1" 200 320 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067297 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067326 HTTP/1.1" 200 322 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067356 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067399 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067428 HTTP/1.1" 200 322 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067458 HTTP/1.1" 200 320 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067502 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067531 HTTP/1.1" 200 320 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067560 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067604 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067634 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067663 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067707 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067736 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067768 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36"
Originally created by @mkonecny on GitHub (Nov 25, 2014). Original GitHub issue: https://github.com/mthenw/frontail/issues/37 Currently have an issue where if I follow nginx logs (which is reverse-proxying frontail), it seems like there is a positive-feedback effect happening where frontail polls after each new log event, which generates a nginx log event, which in turn causes frontail to poll again faster and faster, until I'm seeing well over 50 requests per second. ``` x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067224 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067254 HTTP/1.1" 200 320 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067297 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067326 HTTP/1.1" 200 322 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067356 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067399 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067428 HTTP/1.1" 200 322 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067458 HTTP/1.1" 200 320 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067502 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067531 HTTP/1.1" 200 320 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067560 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067604 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067634 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067663 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067707 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067736 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" x.x.x.x - example [25/Nov/2014:05:57:47 +0000] "GET /socket.io/1/xhr-polling/HIHz5d0gC9QFQKfFhm-7?t=1416895067768 HTTP/1.1" 200 321 "https://logger-dev.example.com/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.65 Safari/537.36" ``` ``` ```
kerem closed this issue 2026-03-03 16:03:47 +03:00
kerem commented 2026-03-03 16:03:47 +03:00
Author
Owner
Copy link

@mthenw commented on GitHub (Nov 25, 2014):

frontail uses socket.io underneath and, as you can see in your case, long polling is used. I'm not sure if it's wrong that there are so many requests? Why exactly is it a problem?

<!-- gh-comment-id:64381437 --> @mthenw commented on GitHub (Nov 25, 2014): frontail uses socket.io underneath and, as you can see in your case, long polling is used. I'm not sure if it's wrong that there are so many requests? Why exactly is it a problem?
kerem commented 2026-03-03 16:03:47 +03:00
Author
Owner
Copy link

@mkonecny commented on GitHub (Nov 25, 2014):

I was thinking it may be useful to have a max request rate of 1-2 requests per second - assuming that each request can get all recent log entries, the end result would be similar to the current implementation, and a bit less taxing on the browser + server.

<!-- gh-comment-id:64418247 --> @mkonecny commented on GitHub (Nov 25, 2014): I was thinking it may be useful to have a max request rate of 1-2 requests per second - assuming that each request can get all recent log entries, the end result would be similar to the current implementation, and a bit less taxing on the browser + server.
kerem commented 2026-03-03 16:03:47 +03:00
Author
Owner
Copy link

@mkonecny commented on GitHub (Nov 25, 2014):

Seems like this issue is resolved when I enable websockets in my nginx proxy. Thanks for the help, and great project.

<!-- gh-comment-id:64422209 --> @mkonecny commented on GitHub (Nov 25, 2014): Seems like this issue is resolved when I enable websockets in my nginx proxy. Thanks for the help, and great project.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
dependabot/npm_and_yarn/qs-6.5.3
dependabot/npm_and_yarn/socket.io-parser-4.0.5
dependabot/npm_and_yarn/jsdom-16.5.0
dependabot/npm_and_yarn/engine.io-4.1.2
dependabot/npm_and_yarn/path-parse-1.0.7
dependabot/npm_and_yarn/ws-5.2.3
dependabot/npm_and_yarn/hosted-git-info-2.8.9
v4.9.2
v4.9.1
v4.9.0
v4.8.0
v4.7.0
v4.6.0
v4.5.4
v4.5.3
v4.5.2
v4.5.1
v4.5.0
v4.4.0
v4.3.3
v4.3.2
v4.2.2
v4.2.1
4.2.0
v4.1.1
v4.1.0
v4.0.4
v4.0.3
4.0.2
v4.0.1
v4.0.0
v3.1.2
v3.1.1
v3.1.0
v3.0.0
v2.3.0
v2.2.1
v2.2.0
2.1.2
v2.1.1
v2.1.0
v2.0.0
v1.4.1
v1.4.0
v1.3.0
v1.2.1
v1.2.0
v1.1.0
v1.0.0
v0.7.0
v0.6.0
v0.5.0
v0.4.2
v0.4.1
v0.4.0
v0.3.1
v0.3.0
v0.2.12
v0.2.11
v0.2.10
v0.2.9
v0.2.8
v0.2.7
v0.2.6
v0.2.5
v0.2.4
v0.2.3
v0.2.0
Labels
Clear labels   
accepted

   
bug

   
discussion

   
documentation

   
enhancement

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
wontfix
No labels
accepted
bug
discussion
documentation
enhancement
pull-request
question
wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/frontail#22
No description provided.