[GH-ISSUE #76] 谷歌爬虫误判 #191

Closed
opened 2026-03-13 16:54:12 +03:00 by kerem · 2 comments
Owner

Originally created by @purplegrape on GitHub (Dec 14, 2021).
Original GitHub issue: https://github.com/ADD-SP/ngx_waf/issues/76

1、环境:
amazon 2
nginx 1.20.2
ngx_http_waf 10.0.1

2、配置
waf_captcha on GoogleBot BingBot BaiduSpider YandexBot ;

3、日志
2021/12/14 11:29:32 [alert] 30774#30774: *13 ngx_waf: [FAKE-BOT][GoogleBot] while logging request, client: 66.249.72.160, server: www.abc.com, request: "GET /xxx/ HTTP/1.1", subrequest: "/index.php", upstream: "fastcgi://unix:/var/run/php-fpm/php-fpm.sock", host: "www.abc.com"

4、谷歌爬虫地址表
https://developers.google.com/search/apis/ipranges/googlebot.json

Originally created by @purplegrape on GitHub (Dec 14, 2021). Original GitHub issue: https://github.com/ADD-SP/ngx_waf/issues/76 1、环境: amazon 2 nginx 1.20.2 ngx_http_waf 10.0.1 2、配置 waf_captcha on GoogleBot BingBot BaiduSpider YandexBot ; 3、日志 2021/12/14 11:29:32 [alert] 30774#30774: *13 ngx_waf: [FAKE-BOT][GoogleBot] while logging request, client: 66.249.72.160, server: www.abc.com, request: "GET /xxx/ HTTP/1.1", subrequest: "/index.php", upstream: "fastcgi://unix:/var/run/php-fpm/php-fpm.sock", host: "www.abc.com" 4、谷歌爬虫地址表 https://developers.google.com/search/apis/ipranges/googlebot.json
kerem 2026-03-13 16:54:12 +03:00
  • closed this issue
  • added the
    bug
    label
Author
Owner

@ADD-SP commented on GitHub (Dec 14, 2021):

并未误判,只是错误地打印了日志,并不影响爬虫的访问。你可以改用 current-dev 分支的代码,已经修复了。

<!-- gh-comment-id:993464149 --> @ADD-SP commented on GitHub (Dec 14, 2021): 并未误判,只是错误地打印了日志,并不影响爬虫的访问。你可以改用 `current-dev` 分支的代码,已经修复了。
Author
Owner

@ADD-SP commented on GitHub (Dec 14, 2021):

Fixed on v10.1.0.

<!-- gh-comment-id:993505267 --> @ADD-SP commented on GitHub (Dec 14, 2021): Fixed on `v10.1.0`.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/ngx_waf#191
No description provided.