Skip to content

Add streaming to SingleTurnRolloutProcessor and Agent/MCP RP #1132

Add streaming to SingleTurnRolloutProcessor and Agent/MCP RP

Add streaming to SingleTurnRolloutProcessor and Agent/MCP RP #1132

Triggered via pull request October 15, 2025 16:07
Status Cancelled
Total duration 1m 7s
Artifacts

ci.yml

on: pull_request
Lint & Type Check
1m 0s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
0s
Batch Evaluation Tests
MCP End-to-End Tests
0s
MCP End-to-End Tests
Upload Coverage
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 2 warnings
Lint & Type Check
4 errors
Lint & Type Check: eval_protocol/proxy/proxy_core/redis_utils.py#L45
Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to return type "Set[str]"   Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Set[str]"     "Awaitable[Set[Unknown]]" is not assignable to "Set[str]" (reportReturnType)
Lint & Type Check: eval_protocol/proxy/proxy_core/redis_utils.py#L44
Argument of type "Awaitable[Set[Unknown]] | Set[Unknown]" cannot be assigned to parameter "obj" of type "Sized" in function "len"   Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Sized"     "Awaitable[Set[Unknown]]" is incompatible with protocol "Sized"       "__len__" is not present (reportArgumentType)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Core Tests (Python 3.12)
Canceling since a higher priority waiting request for Python CI-refs/pull/278/merge exists
MCP End-to-End Tests
Canceling since a higher priority waiting request for Python CI-refs/pull/278/merge exists
Core Tests (Python 3.10)
Canceling since a higher priority waiting request for Python CI-refs/pull/278/merge exists
Core Tests (Python 3.11)
Canceling since a higher priority waiting request for Python CI-refs/pull/278/merge exists
Batch Evaluation Tests
Canceling since a higher priority waiting request for Python CI-refs/pull/278/merge exists
Python CI
Canceling since a higher priority waiting request for Python CI-refs/pull/278/merge exists
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)