Skip to content

auto select evaluators correctly #1348

auto select evaluators correctly

auto select evaluators correctly #1348

Triggered via pull request November 9, 2025 02:43
Status Failure
Total duration 7m 19s
Artifacts 3

ci.yml

on: pull_request
Lint & Type Check
1m 9s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 19s
Batch Evaluation Tests
MCP End-to-End Tests
52s
MCP End-to-End Tests
Upload Coverage
0s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

4 errors and 3 warnings
Lint & Type Check
2 errors
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Core Tests (Python 3.11)
Process completed with exit code 1.
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
44.3 KB
sha256:60f0310ac3ac9115672617562912a64fba5732129f157ec32089a6207dea4193
coverage-core-3.10 Expired
54.2 KB
sha256:fb4a97e1c17ee45d84657713295884e85a6417a4bd037b90cb159637332a4a5b
coverage-core-3.12 Expired
54.2 KB
sha256:ddaa99795844f0c418c4ba444fe92fd108801d3569f0566998264dd1300f50d8