[GH-ISSUE #674] [WhoScored] Chrome freeze after package update #138

Closed
opened 2026-03-02 15:56:06 +03:00 by kerem · 8 comments
Owner

Originally created by @adlihs on GitHub (Aug 14, 2024).
Original GitHub issue: https://github.com/probberechts/soccerdata/issues/674

Hello,

After update the package to the new version, when I run my scripts to get data from WhoScored, chrome explorer freeze and after 12-15 minutes the next message error appears:

[08/14/24 11:05:35] ERROR    Error while scraping https://www.whoscored.com/Regions/252/Tournaments/2. Retrying in 0 seconds... (attempt 1 of 5).                                                                                                                                                                                                                                                                  _common.py:655
                             Traceback (most recent call last):                                                                                                                                                                                                                                                                                                                                                                  
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/soccerdata/_common.py", line 631, in _download_and_save                                                                                                                                                                                                                                                                         
                                 self._driver.get(url)                                                                                                                                                                                                                                                                                                                                                                           
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/undetected_chromedriver/__init__.py", line 665, in get                                                                                                                                                                                                                                                                          
                                 return super().get(url)                                                                                                                                                                                                                                                                                                                                                                         
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 356, in get                                                                                                                                                                                                                                                                       
                                 self.execute(Command.GET, {"url": url})                                                                                                                                                                                                                                                                                                                                                         
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 347, in execute                                                                                                                                                                                                                                                                   
                                 self.error_handler.check_response(response)                                                                                                                                                                                                                                                                                                                                                     
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 229, in check_response                                                                                                                                                                                                                                                         
                                 raise exception_class(message, screen, stacktrace)                                                                                                                                                                                                                                                                                                                                              
                             selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 296.883                                                                                                                                                                                                                                                                                   
                               (Session info: chrome=127.0.6533.120)                                                                                                                                                                                                                                                                                                                                                             
                             Stacktrace:                                                                                                                                                                                                                                                                                                                                                                                         
                             0   undetected_chromedriver             0x0000000104af18b8 undetected_chromedriver + 5179576                                                                                                                                                                                                                                                                                                        
                             1   undetected_chromedriver             0x0000000104ae92ea undetected_chromedriver + 5145322                                                                                                                                                                                                                                                                                                        
                             2   undetected_chromedriver             0x00000001046602b0 undetected_chromedriver + 389808                                                                                                                                                                                                                                                                                                         
                             3   undetected_chromedriver             0x0000000104648afa undetected_chromedriver + 293626                                                                                                                                                                                                                                                                                                         
                             4   undetected_chromedriver             0x000000010464881a undetected_chromedriver + 292890                                                                                                                                                                                                                                                                                                         
                             5   undetected_chromedriver             0x0000000104646d1b undetected_chromedriver + 285979                                                                                                                                                                                                                                                                                                         
                             6   undetected_chromedriver             0x00000001046471df undetected_chromedriver + 287199                                                                                                                                                                                                                                                                                                         
                             7   undetected_chromedriver             0x000000010465622b undetected_chromedriver + 348715                                                                                                                                                                                                                                                                                                         
                             8   undetected_chromedriver             0x000000010466c50d undetected_chromedriver + 439565                                                                                                                                                                                                                                                                                                         
                             9   undetected_chromedriver             0x00000001046718eb undetected_chromedriver + 461035                                                                                                                                                                                                                                                                                                         
                             10  undetected_chromedriver             0x0000000104647867 undetected_chromedriver + 288871                                                                                                                                                                                                                                                                                                         
                             11  undetected_chromedriver             0x000000010466c36f undetected_chromedriver + 439151                                                                                                                                                                                                                                                                                                         
                             12  undetected_chromedriver             0x00000001046ebdfe undetected_chromedriver + 962046                                                                                                                                                                                                                                                                                                         
                             13  undetected_chromedriver             0x00000001046ce553 undetected_chromedriver + 841043                                                                                                                                                                                                                                                                                                         
                             14  undetected_chromedriver             0x000000010469f7f6 undetected_chromedriver + 649206                                                                                                                                                                                                                                                                                                         
                             15  undetected_chromedriver             0x00000001046a005e undetected_chromedriver + 651358                                                                                                                                                                                                                                                                                                         
                             16  undetected_chromedriver             0x0000000104ab4b20 undetected_chromedriver + 4930336                                                                                                                                                                                                                                                                                                        
                             17  undetected_chromedriver             0x0000000104ab9a36 undetected_chromedriver + 4950582                                                                                                                                                                                                                                                                                                        
                             18  undetected_chromedriver             0x0000000104aba105 undetected_chromedriver + 4952325                                                                                                                                                                                                                                                                                                        
                             19  undetected_chromedriver             0x0000000104a96ee9 undetected_chromedriver + 4808425                                                                                                                                                                                                                                                                                                        
                             20  undetected_chromedriver             0x0000000104aba3f9 undetected_chromedriver + 4953081                                                                                                                                                                                                                                                                                                        
                             21  undetected_chromedriver             0x0000000104a88844 undetected_chromedriver + 4749380                                                                                                                                                                                                                                                                                                        
                             22  undetected_chromedriver             0x0000000104ad95c8 undetected_chromedriver + 5080520                                                                                                                                                                                                                                                                                                        
                             23  undetected_chromedriver             0x0000000104ad9787 undetected_chromedriver + 5080967                                                                                                                                                                                                                                                                                                        
                             24  undetected_chromedriver             0x0000000104ae8ece undetected_chromedriver + 5144270                                                                                                                                                                                                                                                                                                        
                             25  libsystem_pthread.dylib             0x00007ff807ae018b _pthread_start + 99                                                                                                                                                                                                                                                                                                                      
                             26  libsystem_pthread.dylib             0x00007ff807adbae3 thread_start + 15      

Any help?! Thanks in advance...

Originally created by @adlihs on GitHub (Aug 14, 2024). Original GitHub issue: https://github.com/probberechts/soccerdata/issues/674 Hello, After update the package to the new version, when I run my scripts to get data from WhoScored, chrome explorer freeze and after 12-15 minutes the next message error appears: ``` [08/14/24 11:05:35] ERROR Error while scraping https://www.whoscored.com/Regions/252/Tournaments/2. Retrying in 0 seconds... (attempt 1 of 5). _common.py:655 Traceback (most recent call last): File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/soccerdata/_common.py", line 631, in _download_and_save self._driver.get(url) File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/undetected_chromedriver/__init__.py", line 665, in get return super().get(url) File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 356, in get self.execute(Command.GET, {"url": url}) File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 347, in execute self.error_handler.check_response(response) File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 229, in check_response raise exception_class(message, screen, stacktrace) selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 296.883 (Session info: chrome=127.0.6533.120) Stacktrace: 0 undetected_chromedriver 0x0000000104af18b8 undetected_chromedriver + 5179576 1 undetected_chromedriver 0x0000000104ae92ea undetected_chromedriver + 5145322 2 undetected_chromedriver 0x00000001046602b0 undetected_chromedriver + 389808 3 undetected_chromedriver 0x0000000104648afa undetected_chromedriver + 293626 4 undetected_chromedriver 0x000000010464881a undetected_chromedriver + 292890 5 undetected_chromedriver 0x0000000104646d1b undetected_chromedriver + 285979 6 undetected_chromedriver 0x00000001046471df undetected_chromedriver + 287199 7 undetected_chromedriver 0x000000010465622b undetected_chromedriver + 348715 8 undetected_chromedriver 0x000000010466c50d undetected_chromedriver + 439565 9 undetected_chromedriver 0x00000001046718eb undetected_chromedriver + 461035 10 undetected_chromedriver 0x0000000104647867 undetected_chromedriver + 288871 11 undetected_chromedriver 0x000000010466c36f undetected_chromedriver + 439151 12 undetected_chromedriver 0x00000001046ebdfe undetected_chromedriver + 962046 13 undetected_chromedriver 0x00000001046ce553 undetected_chromedriver + 841043 14 undetected_chromedriver 0x000000010469f7f6 undetected_chromedriver + 649206 15 undetected_chromedriver 0x00000001046a005e undetected_chromedriver + 651358 16 undetected_chromedriver 0x0000000104ab4b20 undetected_chromedriver + 4930336 17 undetected_chromedriver 0x0000000104ab9a36 undetected_chromedriver + 4950582 18 undetected_chromedriver 0x0000000104aba105 undetected_chromedriver + 4952325 19 undetected_chromedriver 0x0000000104a96ee9 undetected_chromedriver + 4808425 20 undetected_chromedriver 0x0000000104aba3f9 undetected_chromedriver + 4953081 21 undetected_chromedriver 0x0000000104a88844 undetected_chromedriver + 4749380 22 undetected_chromedriver 0x0000000104ad95c8 undetected_chromedriver + 5080520 23 undetected_chromedriver 0x0000000104ad9787 undetected_chromedriver + 5080967 24 undetected_chromedriver 0x0000000104ae8ece undetected_chromedriver + 5144270 25 libsystem_pthread.dylib 0x00007ff807ae018b _pthread_start + 99 26 libsystem_pthread.dylib 0x00007ff807adbae3 thread_start + 15 ``` Any help?! Thanks in advance...
kerem 2026-03-02 15:56:06 +03:00
  • closed this issue
  • added the
    WhoScored
    label
Author
Owner

@ds-oliver commented on GitHub (Aug 20, 2024):

This happening to me as well.

<!-- gh-comment-id:2297856686 --> @ds-oliver commented on GitHub (Aug 20, 2024): This happening to me as well.
Author
Owner

@ds-oliver commented on GitHub (Aug 21, 2024):

Any updates on this?

<!-- gh-comment-id:2303275145 --> @ds-oliver commented on GitHub (Aug 21, 2024): Any updates on this?
Author
Owner

@probberechts commented on GitHub (Aug 23, 2024):

I cannot reproduce this. Make sure Chrome is up-to-date and that you have installed the latest version of undetected-chromedriver. If you still experience isssues after checking these things, it is better to look for help in the issue tracker of undetected-chromedriver.

<!-- gh-comment-id:2307381456 --> @probberechts commented on GitHub (Aug 23, 2024): I cannot reproduce this. Make sure Chrome is up-to-date and that you have installed the latest version of undetected-chromedriver. If you still experience isssues after checking these things, it is better to look for help in [the issue tracker of undetected-chromedriver](https://github.com/ultrafunkamsterdam/undetected-chromedriver/issues).
Author
Owner

@ds-oliver commented on GitHub (Aug 23, 2024):

Have tried all things from fresh chrome download, downgrading selenium/undetected-chromedriver, etc.

You're having no issue running ws.read_schedule() and ws.read_events() for current 2425 season?

<!-- gh-comment-id:2307392806 --> @ds-oliver commented on GitHub (Aug 23, 2024): Have tried all things from fresh chrome download, downgrading selenium/undetected-chromedriver, etc. You're having no issue running ws.read_schedule() and ws.read_events() for current 2425 season?
Author
Owner

@adlihs commented on GitHub (Aug 23, 2024):

@probberechts Mate, first of all thank you for time and help.
Mate I used the same script for the last 6 months, I just change the value for current season and update the version of the package.
And as @ds-oliver mentioned before I thing the issue is in ws.read_schedule() and ws.read_events() functions.

<!-- gh-comment-id:2307445837 --> @adlihs commented on GitHub (Aug 23, 2024): @probberechts Mate, first of all thank you for time and help. Mate I used the same script for the last 6 months, I just change the value for current season and update the version of the package. And as @ds-oliver mentioned before I thing the issue is in ws.read_schedule() and ws.read_events() functions.
Author
Owner

@ds-oliver commented on GitHub (Sep 17, 2024):

This is still occurring in a script that worked perfectly fine before.

Happens across all seasons and leagues.

<!-- gh-comment-id:2354388259 --> @ds-oliver commented on GitHub (Sep 17, 2024): This is still occurring in a script that worked perfectly fine before. Happens across all seasons and leagues.
Author
Owner

@ds-oliver commented on GitHub (Sep 17, 2024):

It's a massive bummer. I was relying on these scripts for ongoing projects, and now I am completely dead in the water. I've tried a lot of troubleshooting steps.

<!-- gh-comment-id:2354394750 --> @ds-oliver commented on GitHub (Sep 17, 2024): It's a massive bummer. I was relying on these scripts for ongoing projects, and now I am completely dead in the water. I've tried a lot of troubleshooting steps.
Author
Owner

@ilyacherevkov commented on GitHub (Oct 28, 2024):

I think they found out how to block undetected chrome driver

<!-- gh-comment-id:2440736258 --> @ilyacherevkov commented on GitHub (Oct 28, 2024): I think they found out how to block undetected chrome driver
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/soccerdata#138
No description provided.