Constant API Rate Limit Exceeded Error 429

[the-vainglory-consensus]

Zotify Version
v0.10.30

Bug Description
Getting API ERROR messages reading "429: API rate limit exceeded" whenever I try to do anything with Zotify. Just getting my list of favorited artists or playlists does this.

Bug Triggering Command
The command that caused the error/crash, including relevant url arguments.

Error Traceback / Logs

WARNING: API ERROR (TRY 0) - RETRYING

429: API rate limit exceeded

WARNING: API ERROR (TRY 1) - RETRYING

429: API rate limit exceeded

API_ERROR: API ERROR (TRY 2) - RETRY LIMIT EXCEDED

429: API rate limit exceeded

WARNING: Key "items" not found in API response: {'error': {'status': 429, 'message': 'API rate limit exceeded'}}

Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "c:\users\pr4yi.local\bin\zotify.exe_main.py", line 6, in
sys.exit(main())
~~~~^^
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify_main.py", line 140, in main
args.func(args, modes)
~~~~~~~~~^^^^^^^^^^^^^
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 78, in client
perform_query(args)
~~~~~~~~~~~~~^^^^^^
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 69, in perform_query
raise e
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 50, in perform_query
UserPlaylist(Zotify.DATETIME_LAUNCH).execute()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify\api.py", line 1760, in execute
user_item_resps = self.fetch_user_items()
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify\api.py", line 1742, in fetch_user_items
user_item_resps = Zotify.invoke_url_nextable(f"{self.url}?{MARKET_APPEND}", stripper=self.outer_stripper)
File "C:\Users\pr4yi\pipx\venvs\zotify\Lib\site-packages\zotify\config.py", line 812, in invoke_url_nextable
return items[strip] if len(strippers) == 1 and not isinstance(stripper, tuple) else items
~~~~~^^^^^^^
KeyError: None

Config File
{
"DEBUG": "False",
"ROOT_PATH": "",
"SAVE_CREDENTIALS": "True",
"CREDENTIALS_LOCATION": "",
"OUTPUT": "",
"OUTPUT_SINGLE": "{artist}/{album}/{artist}{song_name}",
"OUTPUT_ALBUM": "{artist}/{album}/{album_num}{artist}{song_name}",
"OUTPUT_PLAYLIST_EXT": "{playlist}/{playlist_num}{artist}{song_name}",
"OUTPUT_LIKED_SONGS": "Liked Songs/{artist}{song_name}",
"ROOT_PODCAST_PATH": "",
"SPLIT_ALBUM_DISCS": "False",
"MAX_FILENAME_LENGTH": "0",
"OPTIMIZED_DOWNLOADING": "True",
"BULK_WAIT_TIME": "45",
"DOWNLOAD_REAL_TIME": "False",
"TEMP_DOWNLOAD_DIR": "",
"DOWNLOAD_PARENT_ALBUM": "False",
"NO_COMPILATION_ALBUMS": "False",
"REGEX_ENABLED": "False",
"REGEX_TRACK_SKIP": "",
"REGEX_EPISODE_SKIP": "",
"REGEX_ALBUM_SKIP": "",
"DOWNLOAD_FORMAT": "ogg",
"DOWNLOAD_QUALITY": "very_high",
"TRANSCODE_BITRATE": "auto",
"CUSTOM_FFMEPG_ARGS": "",
"SONG_ARCHIVE_LOCATION": "",
"DISABLE_SONG_ARCHIVE": "False",
"DISABLE_DIRECTORY_ARCHIVES": "False",
"SKIP_EXISTING": "True",
"SKIP_PREVIOUSLY_DOWNLOADED": "False",
"EXPORT_M3U8": "False",
"M3U8_LOCATION": "",
"M3U8_REL_PATHS": "True",
"LIKED_SONGS_ARCHIVE_M3U8": "True",
"DOWNLOAD_LYRICS": "True",
"LYRICS_LOCATION": "",
"LYRICS_FILENAME": "{artist}_{song_name}",
"ALWAYS_CHECK_LYRICS": "False",
"LYRICS_MD_HEADER": "False",
"LANGUAGE": "en",
"STRICT_LIBRARY_VERIFY": "True",
"MD_DISC_TRACK_TOTALS": "True",
"MD_SAVE_GENRES": "False",
"MD_ALLGENRES": "False",
"MD_GENREDELIMITER": ",",
"MD_ARTISTDELIMITER": ", ",
"MD_SAVE_LYRICS": "True",
"ALBUM_ART_JPG_FILE": "False",
"SEARCH_QUERY_SIZE": "10",
"RETRY_ATTEMPTS": "1",
"CHUNK_SIZE": "20000",
"REDIRECT_ADDRESS": "127.0.0.1",
"PRINT_SPLASH": "False",
"PRINT_PROGRESS_INFO": "True",
"PRINT_SKIPS": "True",
"PRINT_DOWNLOADS": "False",
"PRINT_DOWNLOAD_PROGRESS": "True",
"PRINT_URL_PROGRESS": "True",
"PRINT_ALBUM_PROGRESS": "True",
"PRINT_ARTIST_PROGRESS": "True",
"PRINT_PLAYLIST_PROGRESS": "True",
"PRINT_WARNINGS": "True",
"PRINT_ERRORS": "True",
"PRINT_API_ERRORS": "True",
"STANDARD_INTERFACE": "False",
"FFMPEG_LOG_LEVEL": "error",
"vvv___DEPRECIATED_BELOW_HERE___vvv": "vvv___REMOVE_THESE___vvv",
"SONG_ARCHIVE": "",
"OVERRIDE_AUTO_WAIT": "False"
}

[the-vainglory-consensus]

I should add that I've tried using both the regular zotify and the efficient API branch and have gotten the same error.

[SapientAsh]

Getting the same error on efficient-api

[thatguyuno]

Have the same issue

[IsaacAgulhas]

@Googolplexed0 I have a working solution on my fork of the main zotify, the issue is that zotify uses a shared api credential, and this is exceeding the limit, the solution of course for everyone to use their own api credentials, this of course does require everyone to sign up to the spotify developer portal and create an api app (which will then generate the client id and client secret). From there that can be used for accessing the spotify api.

Below is my patch, this implements a new file called tokenmananger.py which has the token manager class which will perform the request for a token as well as manage the lifecycle of that token (since api tokens expire). The patch also has a replacement for the get_song_info function in the track.py file. Since my uses are only for downloading songs I have only made a patch for this directly, to do it system wide (since many feature of this repo perform api calls for metadata) and more indepth implementation is required, I provide this mainly as a starting point to guide you in the right direction.

tokenmanager.py

import base64
import requests
import time

SPOTIFY_TOKEN_URL = "https://accounts.spotify.com/api/token"

class SpotifyTokenManager:
    def __init__(self, client_id, client_secret):
        self.client_id = client_id
        self.client_secret = client_secret
        self.access_token = None
        self.expires_at = 0

    def get_token(self):
        if self.access_token and time.time() < self.expires_at:
            return self.access_token

        auth_header = base64.b64encode(
            f"{self.client_id}:{self.client_secret}".encode()
        ).decode()

        response = requests.post(
            SPOTIFY_TOKEN_URL,
            headers={
                "Authorization": f"Basic {auth_header}",
                "Content-Type": "application/x-www-form-urlencoded",
            },
            data={"grant_type": "client_credentials"},
        )

        response.raise_for_status()
        data = response.json()

        self.access_token = data["access_token"]
        self.expires_at = time.time() + data["expires_in"] - 30
        return self.access_token

get_song_info function in track.py

from zotify.tokenmanager import SpotifyTokenManager

token_manager = SpotifyTokenManager(
    client_id="",
    client_secret=""
)

def get_song_info(song_id) -> Tuple[List[str], List[Any], str, str, Any, Any, Any, Any, Any, Any, int]:
    """ Retrieves metadata for downloaded songs using own Spotify API credentials """

    with Loader(PrintChannel.PROGRESS_INFO, "Fetching track information..."):
        token = token_manager.get_token()

        response = requests.get(
            f"https://api.spotify.com/v1/tracks",
            params={"ids": song_id, "market": "US"},
            headers={
                "Authorization": f"Bearer {token}"
            }
        )

    if response.status_code == 429:
        raise RuntimeError("Spotify API rate limit exceeded (your app)")

    response.raise_for_status()
    info = response.json()

    if TRACKS not in info:
        raise ValueError(f'Invalid response from TRACKS_URL:\n{info}')

    try:
        track = info[TRACKS][0]

        artists = [a[NAME] for a in track[ARTISTS]]
        album = track[ALBUM]

        album_name = album[NAME]
        name = track[NAME]
        release_year = album[RELEASE_DATE].split('-')[0]
        disc_number = track[DISC_NUMBER]
        track_number = track[TRACK_NUMBER]
        scraped_song_id = track[ID]
        is_playable = track[IS_PLAYABLE]
        duration_ms = track[DURATION_MS]

        image = max(album[IMAGES], key=lambda i: i[WIDTH])
        image_url = image[URL]

        return (
            artists,
            track[ARTISTS],
            album_name,
            name,
            image_url,
            release_year,
            disc_number,
            track_number,
            scraped_song_id,
            is_playable,
            duration_ms,
        )

    except Exception as e:
        raise ValueError(f'Failed to parse TRACKS_URL response: {str(e)}\n{info}')

I hope this helps to solve the issue as well as improve this repo going forward, I admire the hard work you guys put in to keep this repo working and up to date, and I have gotten many fixes from here is the past as well so I'm happy to give back as well.

[RGPZ]

I'm getting a similar error with a couple of different statements.
` [∙∙∙] Fetching artist information...

WARNING: API ERROR (TRY 0) - RETRYING

429: API rate limit exceeded

    [∙∙●] Fetching artist information...                                                                            

WARNING: API ERROR (TRY 1) - RETRYING

429: API rate limit exceeded

    [∙∙∙] Fetching artist information...                                                                            

API_ERROR: API ERROR (TRY 2) - RETRY LIMIT EXCEDED

429: API rate limit exceeded

    [∙●∙] Fetching artist information...                                                                                    [∙∙∙] Parsing artist information...                                                                             

DEBUG
Total API Calls: 2

Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "c:\users\x.local\bin\zotify.exe_main.py", line 6, in
sys.exit(main())
~~~~^^
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify_main.py", line 140, in main
args.func(args, modes)
~~~~~~~~~^^^^^^^^^^^^^
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 78, in client
perform_query(args)
~~~~~~~~~~~~~^^^^^^
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 69, in perform_query
raise e
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 44, in perform_query
Query(Zotify.DATETIME_LAUNCH).request(urls).execute()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify\api.py", line 1686, in execute
self.parse_direct_metadata(*self.fetch_direct_metadata(direct_reqs_objs))
~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify\api.py", line 1510, in parse_direct_metadata
obj.parse_metadata(item_resp)
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
File "C:\Users\x\pipx\venvs\zotify\Lib\site-packages\zotify\api.py", line 1350, in parse_metadata
self.update_id(artist_resp[ID])
~~~~~~~~~~~^^^^
KeyError: 'id'`, this comes from specifically from the effective API branch.

[ThatElemental]

I'm experiencing the same issue

###   WARNING:  API ERROR (TRY 0) - RETRYING   ###
###   429: API rate limit exceeded   ###

###   WARNING:  API ERROR (TRY 1) - RETRYING   ###
###   429: API rate limit exceeded   ###

###   API_ERROR:  API ERROR (TRY 2) - RETRY LIMIT EXCEDED   ###
###   429: API rate limit exceeded   ###
                                                                                                                       Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "c:\users\xxxxx\.local\bin\zotify.exe\__main__.py", line 6, in <module>
    sys.exit(main())
             ~~~~^^
  File "C:\Users\xxxxx\pipx\venvs\zotify\Lib\site-packages\zotify\__main__.py", line 119, in main
    args.func(args)
    ~~~~~~~~~^^^^^^
  File "C:\Users\xxxxx\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 257, in client
    download_from_urls(args.urls)
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "C:\Users\xxxxx\pipx\venvs\zotify\Lib\site-packages\zotify\app.py", line 36, in download_from_urls
    download_album(album_id, pbar_stack)
    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\xxxxx\pipx\venvs\zotify\Lib\site-packages\zotify\album.py", line 51, in download_album
    album_name, album_artists, tracks, total_discs, compilation = get_album_info(album_id)
                                                                  ~~~~~~~~~~~~~~^^^^^^^^^^
  File "C:\Users\xxxxx\pipx\venvs\zotify\Lib\site-packages\zotify\album.py", line 13, in get_album_info
    album_name = fix_filename(resp[NAME])
                              ~~~~^^^^^^

[Melf11]

@Googolplexed0 I have a working solution on my fork of the main zotify, the issue is that zotify uses a shared api credential, and this is exceeding the limit, the solution of course for everyone to use their own api credentials, this of course does require everyone to sign up to the spotify developer portal and create an api app (which will then generate the client id and client secret). From there that can be used for accessing the spotify api.

Below is my patch, this implements a new file called tokenmananger.py which has the token manager class which will perform the request for a token as well as manage the lifecycle of that token (since api tokens expire). The patch also has a replacement for the get_song_info function in the track.py file. Since my uses are only for downloading songs I have only made a patch for this directly, to do it system wide (since many feature of this repo perform api calls for metadata) and more indepth implementation is required, I provide this mainly as a starting point to guide you in the right direction.

tokenmanager.py

import base64
import requests
import time

SPOTIFY_TOKEN_URL = "https://accounts.spotify.com/api/token"

class SpotifyTokenManager:
def init(self, client_id, client_secret):
self.client_id = client_id
self.client_secret = client_secret
self.access_token = None
self.expires_at = 0

def get_token(self):
    if self.access_token and time.time() < self.expires_at:
        return self.access_token

    auth_header = base64.b64encode(
        f"{self.client_id}:{self.client_secret}".encode()
    ).decode()

    response = requests.post(
        SPOTIFY_TOKEN_URL,
        headers={
            "Authorization": f"Basic {auth_header}",
            "Content-Type": "application/x-www-form-urlencoded",
        },
        data={"grant_type": "client_credentials"},
    )

    response.raise_for_status()
    data = response.json()

    self.access_token = data["access_token"]
    self.expires_at = time.time() + data["expires_in"] - 30
    return self.access_token

get_song_info function in track.py

from zotify.tokenmanager import SpotifyTokenManager

token_manager = SpotifyTokenManager(
client_id="",
client_secret=""
)

def get_song_info(song_id) -> Tuple[List[str], List[Any], str, str, Any, Any, Any, Any, Any, Any, int]:
""" Retrieves metadata for downloaded songs using own Spotify API credentials """

with Loader(PrintChannel.PROGRESS_INFO, "Fetching track information..."):
    token = token_manager.get_token()

    response = requests.get(
        f"https://api.spotify.com/v1/tracks",
        params={"ids": song_id, "market": "US"},
        headers={
            "Authorization": f"Bearer {token}"
        }
    )

if response.status_code == 429:
    raise RuntimeError("Spotify API rate limit exceeded (your app)")

response.raise_for_status()
info = response.json()

if TRACKS not in info:
    raise ValueError(f'Invalid response from TRACKS_URL:\n{info}')

try:
    track = info[TRACKS][0]

    artists = [a[NAME] for a in track[ARTISTS]]
    album = track[ALBUM]

    album_name = album[NAME]
    name = track[NAME]
    release_year = album[RELEASE_DATE].split('-')[0]
    disc_number = track[DISC_NUMBER]
    track_number = track[TRACK_NUMBER]
    scraped_song_id = track[ID]
    is_playable = track[IS_PLAYABLE]
    duration_ms = track[DURATION_MS]

    image = max(album[IMAGES], key=lambda i: i[WIDTH])
    image_url = image[URL]

    return (
        artists,
        track[ARTISTS],
        album_name,
        name,
        image_url,
        release_year,
        disc_number,
        track_number,
        scraped_song_id,
        is_playable,
        duration_ms,
    )

except Exception as e:
    raise ValueError(f'Failed to parse TRACKS_URL response: {str(e)}\n{info}')

I hope this helps to solve the issue as well as improve this repo going forward, I admire the hard work you guys put in to keep this repo working and up to date, and I have gotten many fixes from here is the past as well so I'm happy to give back as well.

i basicly fixed it but its no good code but its working, did it last night very late. I thins this are the changes:

add tokenmanager.py from @IsaacAgulhas and add this in album.py (replace get_album_info()):

import requests
from zotify.tokenmanager import SpotifyTokenManager

token_manager = SpotifyTokenManager(
    client_id="ID FROM SPOTIFY DEV API",
    client_secret="SECRET FROM SPOTIFY DEV API"
)

def get_album_info(album_id):
    # Album-Daten abrufen
    #resp = requests.get(
    #    f"{ALBUM_URL}/{album_id}",
    #    params={"market": "US"},
    #    headers={"Authorization": f"Bearer {token_manager.get_token()}"}
    #).json()
    token = token_manager.get_token()
    response = requests.get(
        f"https://api.spotify.com/v1/albums",
        params={"ids": album_id, "market": "US"},
        headers={
            "Authorization": f"Bearer {token}"
        }
    )
    response.raise_for_status()
    resp = response.json()

    album_data = resp['albums'][0]

    album_name = fix_filename(album_data['name'])
    album_artists = [artist['name'] for artist in album_data['artists']]
    compilation = album_data['album_type'] == 'compilation'

    # Track-IDs abrufen
    track_items = album_data['tracks']['items']
    track_ids = [track['id'] for track in track_items]

    # Metadaten für jeden Track abrufen
    tracks = []
    for tid in track_ids:
        try:
            track_meta = get_track_metadata(tid)
            tracks.append(track_meta)
        except Exception as e:
            print(f"Failed to fetch track {tid}: {e}")

    # Anzahl der Discs ermitteln
    total_discs = max(track['disc_number'] for track in tracks) if tracks else 1

    return album_name, album_artists, tracks, total_discs, compilation

and this in track.py (ore more replace get_track_metadata())

import requests
from typing import Tuple, List, Any

from zotify.tokenmanager import SpotifyTokenManager

token_manager = SpotifyTokenManager(
    client_id="ID FROM SPOTIFY DEV API",
    client_secret="SECRET FROM SPOTIFY DEV API"
)


def get_track_metadata(track_id) -> dict[str, list[str] | str | int | bool]:
    """ Retrieves metadata for downloaded songs """
    with Loader(PrintChannel.PROGRESS_INFO, "Fetching track information..."):
        token = token_manager.get_token()
        response = requests.get(
            f"https://api.spotify.com/v1/tracks",
            params={"ids": track_id, "market": "US"},
            headers={
                "Authorization": f"Bearer {token}"
            }
        )

        response.raise_for_status()
        info = response.json()

        #(raw, info) = Zotify.invoke_url(f'{TRACK_URL}?ids={track_id}&market=from_token')
        #print(info)
        if not TRACKS in info:
            raise ValueError(f'Invalid response from TRACK_URL:\n{raw}')

        try:
            return parse_track_metadata(info[TRACKS][0])
        except Exception as e:
            raise ValueError(f'Failed to parse TRACK_URL response: {str(e)}\n{raw}')

[alexing]

same :/ any solutions until now?

[dijoi]

@alexing for what exactly ?

[ddxy]

@Melf11 can you fork this project so we can downlaod your fork directly? :-)

[satonotdead]

Looking for a clean solution, thank you all for your contributions as always.

[Googolplexed0]

@Googolplexed0 I have a working solution on my fork of the main zotify, the issue is that zotify uses a shared api credential, and this is exceeding the limit, the solution of course for everyone to use their own api credentials

I created a path to authorize with any Developer API Client ID, which accepts a --client-id argument via the command line (like for a user's token). I can publish this method once librespot-python adopts a small pull request.

You say it is working for you, but even after authorizing with another Developer API Client ID the 429 API Rate Limit error is still occurring for me. My guess was that the API isn't actually experiencing rate limits, but that the parent company has shutdown metadata/search API functionality after the announcement of the Anna's Archive mega-rip.