Skip to content

correlate evaluation logs with traces (#282) #1147

correlate evaluation logs with traces (#282)

correlate evaluation logs with traces (#282) #1147

Triggered via push October 16, 2025 19:13
Status Success
Total duration 6m 41s
Artifacts 4

ci.yml

on: push
Lint & Type Check
1m 12s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 16s
Batch Evaluation Tests
MCP End-to-End Tests
55s
MCP End-to-End Tests
Upload Coverage
5s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

5 errors and 3 warnings
Lint & Type Check
4 errors
Lint & Type Check: eval_protocol/proxy/proxy_core/redis_utils.py#L45
Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to return type "Set[str]"   Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Set[str]"     "Awaitable[Set[Unknown]]" is not assignable to "Set[str]" (reportReturnType)
Lint & Type Check: eval_protocol/proxy/proxy_core/redis_utils.py#L44
Argument of type "Awaitable[Set[Unknown]] | Set[Unknown]" cannot be assigned to parameter "obj" of type "Sized" in function "len"   Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Sized"     "Awaitable[Set[Unknown]]" is incompatible with protocol "Sized"       "__len__" is not present (reportArgumentType)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
41.4 KB
sha256:660d8ad0146fa2281161cb1698bfeeaa0340c6d530b24bad4840d24643cd1fcb
coverage-core-3.10 Expired
50.3 KB
sha256:9f34671a21945330ec62da061f85cffc6062bcf7e863d42b997ede239f525c5f
coverage-core-3.11 Expired
50.3 KB
sha256:86322766f61573cabeee0addca1bb0c31dc04720af5162f3c6044d3d87ca6d7f
coverage-core-3.12 Expired
50.3 KB
sha256:2208519ada6d5bc624a1706172e51d0e25ef0cd2e918ecc6b71df64ca9d0f926