You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on May 11, 2025. It is now read-only.
I'm using CUDA 11.8, it's work with: transformers, unsloth and peft. Impossible to use it with awq/awq_ext.
When I try to execute pip install git+https://github.com/casper-hansen/AutoAWQ_kernels.git the install is never stop it.
building 'awq_ext' extension
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/layernorm
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/position_embedding
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/quantization
creating /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/awq_ext/vllm
Emitting ninja build file /tmp/pip-req-build-qnotwc5q/build/temp.linux-x86_64-cpython-311/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
^C Building wheel for autoawq_kernels (setup.py) ... canceled
Hello
The module
awq_extcan't be load:I'm using CUDA 11.8, it's work with:
transformers,unslothandpeft. Impossible to use it withawq/awq_ext.When I try to execute
pip install git+https://github.com/casper-hansen/AutoAWQ_kernels.gitthe install is never stop it.How to fix this?
Thank you!