Skip to content

auto select evaluators correctly #1349

auto select evaluators correctly

auto select evaluators correctly #1349

Triggered via pull request November 9, 2025 03:12
Status Failure
Total duration 7m 35s
Artifacts 1

ci.yml

on: pull_request
Lint & Type Check
1m 3s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 15s
Batch Evaluation Tests
MCP End-to-End Tests
57s
MCP End-to-End Tests
Upload Coverage
0s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

9 errors and 3 warnings
Lint & Type Check
2 errors
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Core Tests (Python 3.11)
Process completed with exit code 1.
Core Tests (Python 3.12)
Process completed with exit code 1.
Core Tests (Python 3.10)
Process completed with exit code 1.
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
44.3 KB
sha256:554829e15c540929790ac614565595e86d4bf3ea47cb6822a120e982e2b9e24e