Skip to content

FT-CI enabled on torch-qaic-env #799

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
quic-akuruvil wants to merge 4 commits into
base: main
Choose a base branch
from
+19 −7
Open

FT-CI enabled on torch-qaic-env #799

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
42bed67
FT-CI enabled on torch-qaic-env
quic-akuruvil Feb 18, 2026
d68a553
Added additional stage for FT env set up in CI
quic-akuruvil Feb 19, 2026
c4ddbb8
Update
quic-akuruvil Feb 19, 2026
6344ff4
added junitparser
Feb 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion docs/source/finetune.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -127,7 +127,8 @@ In distributed ML setups, all nodes must resolve each other’s hostnames. If DN

2. Set QAIC Device Visibility

``` export QAIC_VISIBLE_DEVICES=$(seq -s, 0 63)
```
export QAIC_VISIBLE_DEVICES=$(seq -s, 0 63)
```

This exposes devices 0–63 to the training process.
Expand Down
23 changes: 17 additions & 6 deletions scripts/Jenkinsfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,11 +24,24 @@ pipeline {
pip install .[test] &&
pip install junitparser pytest-xdist &&
pip install librosa==0.10.2 soundfile==0.13.1 && #packages needed to load example for whisper testing
pip install --extra-index-url https://download.pytorch.org/whl/cpu timm==1.0.14 torchvision==0.22.0+cpu einops==0.8.1 && #packages to load VLMs
rm -rf QEfficient"
pip install --extra-index-url https://download.pytorch.org/whl/cpu timm==1.0.14 torchvision==0.22.0+cpu einops==0.8.1" #packages to load VLMs"
'''
}
}
stage('Setup Finetune env') {
Copy link
Contributor

@abukhoy abukhoy Feb 19, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@quic-rishinr wouldn't be better if this stage is combined with the finetune test stage itself ?

Copy link
Contributor Author

@quic-akuruvil quic-akuruvil Feb 19, 2026 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are removing the Qefficient, using rm -rf Qefficient after first installation stage is done. So it will error out, when we try to install QEfficient in torch-qaic-env post removing. That is why I added a new stage for FT env preparation, after AOT env preparation.

steps {
sh '''
sudo docker exec ${BUILD_TAG} bash -c "
cd /efficient-transformers &&
source /opt/torch-qaic-env/bin/activate &&
pip install --upgrade pip setuptools &&
pip install .[test] &&
pip install junitparser &&
pip install torch==2.9.1+cpu torchvision==0.24.1+cpu torchaudio==2.9.1+cpu --index-url https://download.pytorch.org/whl/cpu &&
rm -rf QEfficient"
'''
}
}
stage('HL APIs Tests') {
parallel {
stage('Model Export & ONNX Tests') {
Expand Down Expand Up @@ -201,10 +214,8 @@ pipeline {
sh '''
sudo docker exec ${BUILD_TAG} bash -c "
cd /efficient-transformers &&
. preflight_qeff/bin/activate &&
pip install /opt/qti-aic/integrations/torch_qaic/py310/torch_qaic-0.1.0-cp310-cp310-linux_x86_64.whl &&
pip install torch==2.9.0 torchvision==0.24.0 torchaudio==2.9.0 --index-url https://download.pytorch.org/whl/cpu &&
mkdir -p $PWD/cli_qaic_finetuning &&
source /opt/torch-qaic-env/bin/activate &&
mkdir -p \$PWD/cli_qaic_finetuning &&
export TOKENIZERS_PARALLELISM=false &&
export QEFF_HOME=$PWD/cli_qaic_finetuning &&
pytest tests -m '(cli) and (on_qaic) and (not qnn) and (not multimodal) and (finetune)' --ignore tests/vllm --junitxml=tests/tests_log_finetune.xml --durations=10 &&
Expand Down
Loading