TypeError: 'NoneType' object is not callable when initializing ChatterboxTTS

[biraj-outspeed]

TypeError: 'NoneType' object is not callable when initializing ChatterboxTTS

Environment

• Setup via uv.
• Python 3.11
• AWS g5.2xlarge instance (A10G GPU)
• Ubuntu with CUDA available
• chatterbox-tts installed via uv.

nvcc --version

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Fri_Jan__6_16:45:21_PST_2023
Cuda compilation tools, release 12.0, V12.0.140
Build cuda_12.0.r12.0/compiler.32267302_0

Issue

ChatterboxTTS.from_pretrained() fails with TypeError: 'NoneType' object is not callable

Error Traceback

Using device: cuda
/home/ubuntu/biraj/chatterbox/.venv/lib/python3.11/site-packages/diffusers/models/lora.py:393: FutureWarning: `LoRACompatibleLinear` is deprecated and will be removed in version 1.0.0. Use of `LoRACompatibleLinear` is deprecated. Please switch to PEFT backend by installing PEFT: `pip install peft`.
  deprecate("LoRACompatibleLinear", "1.0.0", deprecation_message)
Traceback (most recent call last):
  File "/home/ubuntu/biraj/chatterbox/main.py", line 15, in <module>
    model = ChatterboxTTS.from_pretrained(device=device)  # this is failing
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/biraj/chatterbox/.venv/lib/python3.11/site-packages/chatterbox/tts.py", line 180, in from_pretrained
    return cls.from_local(Path(local_path).parent, device)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/biraj/chatterbox/.venv/lib/python3.11/site-packages/chatterbox/tts.py", line 165, in from_local
    return cls(t3, s3gen, ve, tokenizer, device, conds=conds)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/biraj/chatterbox/.venv/lib/python3.11/site-packages/chatterbox/tts.py", line 126, in __init__
    self.watermarker = perth.PerthImplicitWatermarker()
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not callable

Code

import torch
import torchaudio as ta
from chatterbox.tts import ChatterboxTTS

# Automatically detect the best available device
if torch.cuda.is_available():
    device = "cuda"
elif torch.backends.mps.is_available():
    device = "mps"
else:
    device = "cpu"

print(f"Using device: {device}")

model = ChatterboxTTS.from_pretrained(device=device)  # this is failing

text = "Ezreal and Jinx teamed up with Ahri, Yasuo, and Teemo to take down the enemy's Nexus in an epic late-game pentakill."
wav = model.generate(text)
ta.save("test-1.wav", wav, model.sr)

Investigation

The issue appears to be with the perth library. While perth is installed and importable, perth.PerthImplicitWatermarker returns None:

Investigation code:

import perth

print(dir(perth))
print(perth.PerthImplicitWatermarker)

output:

['DummyWatermarker', 'PerthImplicitWatermarker', 'WatermarkerBase', 'WatermarkingException', '__all__', '__author__', '__builtins__', '__cached__', '__doc__', '__file__', '__loader__', '__name__', '__package__', '__path__', '__spec__', '__version__', 'dummy_watermarker', 'watermarker']
None

As you can see, PerthImplicitWatermarker shows up on dir(perth), but is None when accessed.

I also faced the same issue when I ran the mac example on my macbook with M3.

[EvansJahja]

I encounter the same issue. I'm trying a workaround to replace it with

self.watermarker = perth.DummyWatermarker()

Seems like there's some dependency of perth that's not installed but I can't figure it out quite yet.

[biraj-outspeed]

i was getting this error only when i installed chatterbox-tts using uv pip install. i built from source and it worked just fine without making any change to the source code.

[BennisonDevadoss]

@biraj-outspeed, I am having the same issue when using uv pip install. Can anyone help me build from source?

[BennisonDevadoss]

@biraj-outspeed, I tried it using the source, still having the same issue.

[gvxcode]

As a work around I removed the water marking.

tts.py
Comment out (Line 126): self.watermarker = perth.PerthImplicitWatermarker()
Comment out (Line 271): watermarked_wav = self.watermarker.apply_watermark(wav, sample_rate=self.sr)
Update code to return the wav (Line 272): torch.from_numpy(wav).unsqueeze(0)

[BambinoPinguino]

@gvxcode Thanks a ton, I was pulling my hair out trying to get Chatterbox running and after hours with no luck, this fixed it immediately.

[onakatomi]

Getting the same issue with uv for a different model (neutts). If I use conda there's no issues.

Any insight as to why uv doesn't like this?

[boltomli]

resemble-ai/Perth#7 the workaround here is working, just install setuptools beforehand then pip install

[tsuus]

I encounter the same issue. I'm trying a workaround to replace it with

self.watermarker = perth.DummyWatermarker()

Seems like there's some dependency of perth that's not installed but I can't figure it out quite yet.

This works for me. Mate, you are a genius.

[stevelittlefish]

I know this is an old thread but this is another workaround:

class FakeWatermarker:
    def apply_watermark(self, wav, *args, **kwargs):
        return wav

# Stupid Monkeypatch thing
perth.PerthImplicitWatermarker = FakeWatermarker

Basically just create the watermarker yourself and make it do nothing!

[jnnnnn]

I fixed this by adding setuptools as a uv dependency

[stephanschielke]

---

TL;DR: If you are using uv as your package manager check out the above hint by @jnnnnn of a potentially missing setuptools. Also, double-check for cached and outdated venvs

---

I'm also using uv and now with --seed to get the setuptools:

uv venv --seed
Using CPython 3.11.14
Creating virtual environment with seed packages at: .venv
 + pip==25.3
 + setuptools==80.9.0
 + wheel==0.45.1
Activate with: source .venv/bin/activate

Then install the dependencies:

uv lock && uv sync
...
 + pandas==2.1.0
 + perth==1.0.0
 + pillow==11.3.0
...

But I still faced the same issue:

  File "/home/xxx/.cache/uv/environments-v2/tts-chatter-123123123/lib/python3.11/site-packages/chatterbox/tts_turbo.py", line 130, in __init__
    self.watermarker = perth.PerthImplicitWatermarker()
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not callable

until I realised the .cache in the path name:

ls -al /home/xxx/.cache/uv/environments-v2/tts-chatter-123123123
total 32
drwxrwxr-x 5 xxx xxx 4096 Dec 22 07:44 ./
drwxrwxr-x 3 xxx xxx 4096 Dec 22 07:44 ../
drwxrwxr-x 2 xxx xxx 4096 Dec 22 07:44 bin/
-rw-rw-r-- 1 xxx xxx   43 Dec 22 07:44 CACHEDIR.TAG
-rw-rw-r-- 1 xxx xxx    1 Dec 22 07:44 .gitignore
drwxrwxr-x 3 xxx xxx 4096 Dec 22 07:44 lib/
lrwxrwxrwx 1 xxx xxx    3 Dec 22 07:44 lib64 -> lib/
-rw-rw-rw- 1 xxx xxx    0 Dec 22 07:44 .lock
-rw-rw-r-- 1 xxx xxx  198 Dec 22 07:44 pyvenv.cfg
drwxrwxr-x 3 xxx xxx 4096 Dec 22 07:44 share/

with an outdated environment (probably stemming from before the --seed, but I reinstalled the venv multiple times by then, so who knows). After removing it:

rm -R /home/xxx/.cache/uv/environments-v2/tts-chatter-123123123

and trying again, it installed all packages and was using the new (cached) venv without issues.

Note: I'm using mise to manage uv, which in turn is managing python + venv, so there are many layers...