correlate evaluation logs with traces #1144
benjibcci.yml
on: pull_request
Annotations
5 errors and 3 warnings
|
Lint & Type Check
4 errors
|
|
Lint & Type Check:
eval_protocol/proxy/proxy_core/redis_utils.py#L45
Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to return type "Set[str]"
Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Set[str]"
"Awaitable[Set[Unknown]]" is not assignable to "Set[str]" (reportReturnType)
|
|
Lint & Type Check:
eval_protocol/proxy/proxy_core/redis_utils.py#L44
Argument of type "Awaitable[Set[Unknown]] | Set[Unknown]" cannot be assigned to parameter "obj" of type "Sized" in function "len"
Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Sized"
"Awaitable[Set[Unknown]]" is incompatible with protocol "Sized"
"__len__" is not present (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"
Import from "langfuse._client.client" instead (reportPrivateImportUsage)
|
|
Lint & Type Check:
eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"
Import from "langfuse._client.client" instead (reportPrivateImportUsage)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
coverage-batch-eval
Expired
|
41.4 KB |
sha256:c640c96612734a831be106d267cc860dccc39ce890aff6ae8ce456d63d17c7d0
|
|
|
coverage-core-3.10
Expired
|
50.3 KB |
sha256:dbc7d1ac6181a92bf178ebfae23d618a876833ac3e47021327dd52c8f8805eb9
|
|
|
coverage-core-3.11
Expired
|
50.3 KB |
sha256:8857d95499590cae3bf4efc06e907fffaa194699e1ffefafa741b229ba6911d5
|
|
|
coverage-core-3.12
Expired
|
50.3 KB |
sha256:411877ce29bb8099a9c683f22b4d0ea40b00fbae1f0144743d3c91037b516881
|
|