[PR #923] feat: Allow customization of delay and rate limit #915

New issue

Open

opened 2026-03-02 16:00:09 +03:00 by kerem · 0 comments

kerem commented

2026-03-02 16:00:09 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/probberechts/soccerdata/pull/923
Author: @DownD
Created: 2/3/2026
Status: 🔄 Open

Base: master ← Head: master

📝 Commits (1)

7ed7f57 feat: Allow customization of delay and rate limit

📊 Changes

11 files changed (+122 additions, -9 deletions)

View changed files

📝 soccerdata/_common.py (+16 -2)
📝 soccerdata/clubelo.py (+14 -1)
📝 soccerdata/espn.py (+8 -0)
📝 soccerdata/fbref.py (+8 -1)
📝 soccerdata/match_history.py (+13 -1)
📝 soccerdata/sofascore.py (+8 -0)
📝 soccerdata/sofifa.py (+8 -1)
📝 soccerdata/understat.py (+8 -0)
📝 soccerdata/whoscored.py (+8 -2)
📝 tests/test_common.py (+30 -0)
📝 uv.lock (+1 -1)

📄 Description

Allows customization of the rate_limit and max_delay parameters for all the scrappers, which can be used to make scrappers faster (in the case of WhoScored) or slower to bypass some restrictions.

Unfortunately the tests for fbref and sofifa fails on my system even without this commit.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/probberechts/soccerdata/pull/923 **Author:** [@DownD](https://github.com/DownD) **Created:** 2/3/2026 **Status:** 🔄 Open **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (1) - [`7ed7f57`](https://github.com/probberechts/soccerdata/commit/7ed7f577eeb07c033e0bdcb8944c969844e64478) feat: Allow customization of delay and rate limit ### 📊 Changes **11 files changed** (+122 additions, -9 deletions) <details> <summary>View changed files</summary> 📝 `soccerdata/_common.py` (+16 -2) 📝 `soccerdata/clubelo.py` (+14 -1) 📝 `soccerdata/espn.py` (+8 -0) 📝 `soccerdata/fbref.py` (+8 -1) 📝 `soccerdata/match_history.py` (+13 -1) 📝 `soccerdata/sofascore.py` (+8 -0) 📝 `soccerdata/sofifa.py` (+8 -1) 📝 `soccerdata/understat.py` (+8 -0) 📝 `soccerdata/whoscored.py` (+8 -2) 📝 `tests/test_common.py` (+30 -0) 📝 `uv.lock` (+1 -1) </details> ### 📄 Description Allows customization of the rate_limit and max_delay parameters for all the scrappers, which can be used to make scrappers faster (in the case of WhoScored) or slower to bypass some restrictions. Unfortunately the tests for fbref and sofifa fails on my system even without this commit. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>