[GH-ISSUE #1] Only download the information for first 30 songs for a playlist. #59

New issue

Closed

opened 2026-03-13 22:57:00 +03:00 by kerem · 1 comment

kerem commented

2026-03-13 22:57:00 +03:00

Owner

Originally created by @yuhaian on GitHub (Jul 2, 2020).
Original GitHub issue: https://github.com/AliAkhtari78/SpotifyScraper/issues/1

Originally assigned to: @AliAkhtari78 on GitHub.

Describe the bug
get_playlist_url_info() only download first 30 songs (first page?) for a given playlist. My playlist has 192 songs, and this function only downloaded the information for first 30 songs.

To Reproduce
Steps to reproduce the behavior:

from SpotifyScraper.scraper import Scraper, Request
request = Request().request()
s = Scraper(session=request)
url='https://open.spotify.com/playlist/37i9dQZF1DXebGqmpCVcEO?si=DWloNa88RcGyoyaxzfb1Lw'
pl = s.get_playlist_url_info(url=url)
print( len(pl['tracks_list']))   
#  The result here is 30 or 31.

Use the same URL on browser, you can see 50 songs
Scroll down you can see all other songs.

Expected behavior
Expected all 50 songs in pl variable, not first 30.

Screenshots
Not applicable.

Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: VM
OS: Linux ubuntu 4.15.0-106-generic #107~16.04.1-Ubuntu SMP x86_64
Browser: Google Chrome Version 83.0.4103.116 (Official Build) (64-bit)
Version: Python 3.6.10 :: Anaconda, Inc.

Additional context
None

Originally created by @yuhaian on GitHub (Jul 2, 2020). Original GitHub issue: https://github.com/AliAkhtari78/SpotifyScraper/issues/1 Originally assigned to: @AliAkhtari78 on GitHub. **Describe the bug** get_playlist_url_info() only download first 30 songs (first page?) for a given playlist. My playlist has 192 songs, and this function only downloaded the information for first 30 songs. **To Reproduce** Steps to reproduce the behavior: ``` from SpotifyScraper.scraper import Scraper, Request request = Request().request() s = Scraper(session=request) url='https://open.spotify.com/playlist/37i9dQZF1DXebGqmpCVcEO?si=DWloNa88RcGyoyaxzfb1Lw' pl = s.get_playlist_url_info(url=url) print( len(pl['tracks_list'])) # The result here is 30 or 31. ``` 2. Use the same URL on browser, you can see 50 songs 3. Scroll down you can see all other songs. **Expected behavior** Expected all 50 songs in pl variable, not first 30. **Screenshots** Not applicable. **Desktop (please complete the following information):** - OS: [e.g. iOS] - Browser [e.g. chrome, safari] - Version [e.g. 22] **Smartphone (please complete the following information):** - Device: VM - OS: Linux ubuntu 4.15.0-106-generic #107~16.04.1-Ubuntu SMP x86_64 - Browser: Google Chrome Version 83.0.4103.116 (Official Build) (64-bit) - Version: Python 3.6.10 :: Anaconda, Inc. **Additional context** None

kerem

2026-03-13 22:57:00 +03:00

closed this issue
added the
enhancement
label

kerem commented

2026-03-13 22:57:16 +03:00

Author

Owner

@AliAkhtari78 commented on GitHub (Jul 11, 2020):

@yuhaian Hi.
I am very happy you used my library and I appreciate your feedback base on your experience.

Spotify Scraper uses requests to get web pages and it can load as much as tracks received by requests.

In order to load all tracks of each playlist, the page should be scrolled by a web browser so I have to add a selenium based scraper beside of request based scraper.

It isn't a problem!
It's an additional feature that I can add as a further capability using selenium beside of request to get web pages.

I will release a new version of the library soon,
So you can download and use it.

@AliAkhtari78 commented on GitHub (Jul 11, 2020): @yuhaian Hi. I am very happy you used my library and I appreciate your feedback base on your experience. **Spotify Scraper** uses requests to get web pages and it can load as much as tracks received by **requests**. In order to load all tracks of each playlist, the page should be scrolled by a **web browser** so I have to add a **selenium based scraper** beside of **request based scraper**. It isn't a problem! It's an additional feature that I can add as a further capability using **selenium** beside of **request** to get web pages. I will release a new version of the library soon, So you can download and use it.

kerem referenced this issue

2026-03-13 23:00:09 +03:00

[GH-ISSUE #58] set the COPILOT_AGENT_FIREWALL_ENABLED GitHub Actions variable to false #78

kerem referenced this issue

2026-03-13 23:03:37 +03:00

[PR #59] [MERGED] Set COPILOT_AGENT_FIREWALL_ENABLED to false in GitHub Actions workflow #124