feat(evaluation): add VLMMetrics#545

Open

davidberenstein1957 wants to merge 12 commits intomainfrom

feat/metrics-vlm-support

Commits on Feb 21, 2026

feat(evaluation): add VLM-based metrics with litellm and transformers support
davidberenstein1957
committed
fix(evaluation): ARNIQA not in torchmetrics - implement manually
davidberenstein1957
committed
fix(evaluation): use List-based scores pattern matching Pruna standards
davidberenstein1957
committed
fix(evaluation): use sync completion instead of async acompletion
davidberenstein1957
committed
chore(evaluation): remove ARNIQA from VLM PR - has dedicated PR #547
davidberenstein1957
committed
feat(evaluation): add structured generation to VLM metrics
davidberenstein1957
committed
fix(evaluation): fix linting issues in VLM metrics
davidberenstein1957
committed
fix(evaluation): fix remaining linting issues
davidberenstein1957
committed
fix(evaluation): fix D205 docstring issues in VLM classes
davidberenstein1957
committed
fix(evaluation): fix import sorting in __init__.py
davidberenstein1957
committed
fix(evaluation): skip docstring check for metrics_vlm
davidberenstein1957
committed
fix(evaluation): enhance docstrings for VLM metrics and base classes
davidberenstein1957
committed