-
Notifications
You must be signed in to change notification settings - Fork 62
Description
python convert-pt-to-gguf.py --model ~/SenseTrained --output ~/SenseTrained/s.gguf
Loading model: SenseTrained
Set model parameters
Set model tokenizer
Exporting model to '/home/terry/SenseTrained/s.gguf'
| Layer name | n_dims | torch type | gguf type | parameters size|
|:|:|:|:|:|
gguf: loading model part 'model.pt'
gguf: loading vad model part 'silero_vad.pt'
|_model.stft.forward_basis_buffer.weight| n_dims = 3| torch.float32 | float16 | 66048|
|_model.encoder.0.reparam_conv.weight| n_dims = 3| torch.float32 | float16 | 49536|
|_model.encoder.0.reparam_conv.bias| n_dims = 1| torch.float32 | float32 | 128|
|_model.encoder.1.reparam_conv.weight| n_dims = 3| torch.float32 | float16 | 24576|
|_model.encoder.1.reparam_conv.bias| n_dims = 1| torch.float32 | float32 | 64|
|_model.encoder.2.reparam_conv.weight| n_dims = 3| torch.float32 | float16 | 12288|
|_model.encoder.2.reparam_conv.bias| n_dims = 1| torch.float32 | float32 | 64|
|_model.encoder.3.reparam_conv.weight| n_dims = 3| torch.float32 | float16 | 24576|
|_model.encoder.3.reparam_conv.bias| n_dims = 1| torch.float32 | float32 | 128|
|_model.decoder.rnn.weight_ih| n_dims = 2| torch.float32 | float32 | 65536|
|_model.decoder.rnn.weight_hh| n_dims = 2| torch.float32 | float32 | 65536|
|_model.decoder.rnn.bias_ih| n_dims = 1| torch.float32 | float32 | 512|
|_model.decoder.rnn.bias_hh| n_dims = 1| torch.float32 | float32 | 512|
|_model.decoder.decoder.2.weight| n_dims = 3| torch.float32 | float16 | 128|
|_model.decoder.decoder.2.bias| n_dims = 1| torch.float32 | float32 | 1|
Traceback (most recent call last):
File "/home/terry/SenseVoice.cpp/scripts/convert-pt_orig.py", line 429, in
main()
File "/home/terry/SenseVoice.cpp/scripts/convert-pt_orig.py", line 423, in main
model_instance.write()
File "/home/terry/SenseVoice.cpp/scripts/convert-pt_orig.py", line 147, in write
self.write_tensors()
File "/home/terry/SenseVoice.cpp/scripts/convert-pt_orig.py", line 339, in write_tensors
tensor_size += self.write_one_tensor(data_torch, name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/terry/SenseVoice.cpp/scripts/convert-pt_orig.py", line 267, in write_one_tensor
old_dtype = data_torch.dtype
^^^^^^^^^^^^^^^^
AttributeError: 'int' object has no attribute 'dtype'