[GH-ISSUE #581] [WhoScored] Broken read_schedule() method #104

Closed
opened 2026-03-02 15:55:49 +03:00 by kerem · 5 comments
Owner

Originally created by @probberechts on GitHub (May 14, 2024).
Original GitHub issue: https://github.com/probberechts/soccerdata/issues/581

Originally assigned to: @probberechts on GitHub.

WhoScored has updated the HTML structure of their fixture pages. The scraper must be updated accordingly.

Originally created by @probberechts on GitHub (May 14, 2024). Original GitHub issue: https://github.com/probberechts/soccerdata/issues/581 Originally assigned to: @probberechts on GitHub. WhoScored has updated the HTML structure of their fixture pages. The scraper must be updated accordingly.
kerem 2026-03-02 15:55:49 +03:00
Author
Owner

@ds-oliver commented on GitHub (May 20, 2024):

Hey - are we getting WS scraper back up?

<!-- gh-comment-id:2119565466 --> @ds-oliver commented on GitHub (May 20, 2024): Hey - are we getting WS scraper back up?
Author
Owner

@probberechts commented on GitHub (May 20, 2024):

I am working on it. You can already use the version in the fix/whoscored-schedule branch. I need to do a bit more testing before releasing it.

<!-- gh-comment-id:2120014795 --> @probberechts commented on GitHub (May 20, 2024): I am working on it. You can already use the version in the `fix/whoscored-schedule` branch. I need to do a bit more testing before releasing it.
Author
Owner

@ds-oliver commented on GitHub (May 20, 2024):

I am working on it. You can already use the version in the fix/whoscored-schedule branch. I need to do a bit more testing before releasing it.

I'll check that out. Cheers.

<!-- gh-comment-id:2121067312 --> @ds-oliver commented on GitHub (May 20, 2024): > I am working on it. You can already use the version in the `fix/whoscored-schedule` branch. I need to do a bit more testing before releasing it. I'll check that out. Cheers.
Author
Owner

@ds-oliver commented on GitHub (May 23, 2024):

I am working on it. You can already use the version in the fix/whoscored-schedule branch. I need to do a bit more testing before releasing it.

I tried to follow your advice with this and have encountered an issue while trying to check out and install the fix/whoscored-schedule branch. Here are the steps I followed and the errors I encountered:

  1. Cloned the repository:

    git clone https://github.com/probberechts/soccerdata.git soccerdata_whoscored_schedule
    cd soccerdata_whoscored_schedule
    
  2. Checked out the specific branch:

    git fetch --all
    git checkout fix/whoscored-schedule
    
  3. Created and activated a virtual environment:

    python -m venv venv
    source venv/bin/activate
    
  4. Upgraded pip, setuptools, and wheel:

    pip install --upgrade pip setuptools wheel
    
  5. Attempted to install the package in editable mode:

    pip install -e .
    

Despite these steps, I received the following error:

ERROR: Can not execute `setup.py` since setuptools is not available in the build environment.

I also tried creating a pyproject.toml file with the following content, but the issue persisted:

[build-system]
requires = ["setuptools", "wheel"]
build-backend = "setuptools.build_meta"

Additionally, I attempted to bypass the isolated build environment:

pip install --no-build-isolation -e .

However, the error still persists. Could you please provide guidance on how to resolve this issue? Is there a known problem with the setup.py or any dependencies in this branch that I should be aware of?

<!-- gh-comment-id:2128190398 --> @ds-oliver commented on GitHub (May 23, 2024): > I am working on it. You can already use the version in the `fix/whoscored-schedule` branch. I need to do a bit more testing before releasing it. I tried to follow your advice with this and have encountered an issue while trying to check out and install the `fix/whoscored-schedule` branch. Here are the steps I followed and the errors I encountered: 1. **Cloned the repository:** ```bash git clone https://github.com/probberechts/soccerdata.git soccerdata_whoscored_schedule cd soccerdata_whoscored_schedule ``` 2. **Checked out the specific branch:** ```bash git fetch --all git checkout fix/whoscored-schedule ``` 3. **Created and activated a virtual environment:** ```bash python -m venv venv source venv/bin/activate ``` 4. **Upgraded pip, setuptools, and wheel:** ```bash pip install --upgrade pip setuptools wheel ``` 5. **Attempted to install the package in editable mode:** ```bash pip install -e . ``` Despite these steps, I received the following error: ``` ERROR: Can not execute `setup.py` since setuptools is not available in the build environment. ``` I also tried creating a `pyproject.toml` file with the following content, but the issue persisted: ```toml [build-system] requires = ["setuptools", "wheel"] build-backend = "setuptools.build_meta" ``` Additionally, I attempted to bypass the isolated build environment: ```bash pip install --no-build-isolation -e . ``` However, the error still persists. Could you please provide guidance on how to resolve this issue? Is there a known problem with the `setup.py` or any dependencies in this branch that I should be aware of?
Author
Owner

@probberechts commented on GitHub (May 24, 2024):

Simply running the following works for me:

pip install git+https://github.com/probberechts/soccerdata.git@fix/whoscored-schedule

You could also try to install it using poetry.

<!-- gh-comment-id:2128838114 --> @probberechts commented on GitHub (May 24, 2024): Simply running the following works for me: ```sh pip install git+https://github.com/probberechts/soccerdata.git@fix/whoscored-schedule ``` You could also try to install it using poetry.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/soccerdata#104
No description provided.