Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
1,354 workflow runs
1,354 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Add LICA-Bench: graphic design VLM evaluation (39 tasks, 7 domains) Quality #3852: Pull request #1212 synchronize by purvanshi
Action required purvanshi:feature/lica-bench
purvanshi:feature/lica-bench
Action required
chore: bump doc-builder SHA for main doc build workflow Quality #3851: Pull request #1215 opened by rtrompier
2m 2s chore/update-doc-main-workflow-sha
chore/update-doc-main-workflow-sha
2m 2s
chore: bump doc-builder SHA for PR upload workflow (#1213) Quality #3849: Commit 10b9104 pushed by rtrompier
3m 37s main
main
3m 37s
chore: bump doc-builder SHA for PR upload workflow Quality #3848: Pull request #1213 opened by rtrompier
2m 12s chore/update-doc-workflow-sha
chore/update-doc-workflow-sha
2m 12s
Add LICA-Bench: graphic design VLM evaluation (39 tasks, 7 domains) Quality #3847: Pull request #1212 opened by purvanshi
Action required purvanshi:feature/lica-bench
purvanshi:feature/lica-bench
Action required
Add support for vllm >= 0.19.0 (#1211) Quality #3846: Commit 34889df pushed by NathanHB
2m 0s main
main
2m 0s
Add support for vllm >= 0.19.0 Quality #3845: Pull request #1211 synchronize by lewtun
2m 5s vllm-0.19-compat
vllm-0.19-compat
2m 5s
Add support for vllm >= 0.19.0 Quality #3844: Pull request #1211 synchronize by lewtun
2m 5s vllm-0.19-compat
vllm-0.19-compat
2m 5s
Add support for vllm >= 0.19.0 Quality #3843: Pull request #1211 synchronize by lewtun
2m 9s vllm-0.19-compat
vllm-0.19-compat
2m 9s
Add support for vllm >= 0.19.0 Quality #3842: Pull request #1211 synchronize by lewtun
2m 11s vllm-0.19-compat
vllm-0.19-compat
2m 11s
Add support for vllm >= 0.19.0 Quality #3841: Pull request #1211 opened by lewtun
2m 2s vllm-0.19-compat
vllm-0.19-compat
2m 2s
POLLUX LLM-Judge metric Quality #3840: Pull request #1210 opened by ulyanaisaeva
Action required ulyanaisaeva:main
ulyanaisaeva:main
Action required
Add omni-math benchmark Quality #3837: Pull request #1208 opened by thibautbar
Action required thibautbar:add-omni-math
thibautbar:add-omni-math
Action required
catch task has no docs instead of throw Quality #3836: Pull request #1207 opened by BuiHoangTu
Action required BuiHoangTu:catch-task-has-no-docs
BuiHoangTu:catch-task-has-no-docs
Action required
add multilingual flag to vllm Quality #3835: Pull request #1206 opened by BuiHoangTu
Action required BuiHoangTu:fix-vllm-no-multilingual
BuiHoangTu:fix-vllm-no-multilingual
Action required
🔒 Pin GitHub Actions to commit SHAs (#1201) Quality #3834: Commit e274b37 pushed by paulinebm
2m 0s main
main
2m 0s
fix(vllm): Enhance VLLMModel context size handling for batch inputs Quality #3833: Pull request #1205 opened by paulovsantanas
Action required paulovsantanas:main
paulovsantanas:main
Action required
Legal NLP tasks on Swiss data Quality #3832: Pull request #1032 synchronize by rolshoven
Action required rolshoven:community_task_slds
rolshoven:community_task_slds
Action required
examples: add RAIL Score responsible AI custom task template Quality #3831: Pull request #1203 opened by SumitVermakgp
Action required SumitVermakgp:feat/rail-score-custom-task
SumitVermakgp:feat/rail-score-custom-task
Action required
🔒 Pin GitHub Actions to commit SHAs Quality #3830: Pull request #1201 opened by paulinebm
1m 56s security/pin-actions-to-sha
security/pin-actions-to-sha
1m 56s
Add --load-tasks-multilingual and fix --custom-tasks for inspect backend Quality #3829: Pull request #1199 opened by dzautner
Action required LumiOpen:upstream-pr/inspect-load-multilingual
LumiOpen:upstream-pr/inspect-load-multilingual
Action required
Update vllm version requirement to 0.17.0 Quality #3813: Pull request #1183 opened by NathanHB
2m 45s NathanHB-patch-6
NathanHB-patch-6
2m 45s
Add test on main branch of vllm (#1175) Quality #3805: Commit 33acf35 pushed by NathanHB
2m 45s main
main
2m 45s
Add test on main branch of vllm Quality #3804: Pull request #1175 synchronize by NathanHB
2m 28s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
2m 28s
Add test on main branch of vllm Quality #3803: Pull request #1175 synchronize by NathanHB
2m 46s upgrade/vllm-0.14.1
upgrade/vllm-0.14.1
2m 46s