Skip to content

Add streaming to SingleTurnRolloutProcessor and Agent/MCP RP #1126

Add streaming to SingleTurnRolloutProcessor and Agent/MCP RP

Add streaming to SingleTurnRolloutProcessor and Agent/MCP RP #1126

Triggered via pull request October 15, 2025 00:33
Status Success
Total duration 5m 55s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 8s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 17s
Batch Evaluation Tests
MCP End-to-End Tests
1m 14s
MCP End-to-End Tests
Upload Coverage
5s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 3 warnings
Lint & Type Check: eval_protocol/pytest/default_single_turn_rollout_process.py#L78
Cannot access attribute "message" for class "TextChoices"   Attribute "message" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_single_turn_rollout_process.py#L78
Cannot access attribute "message" for class "StreamingChoices"   Attribute "message" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_single_turn_rollout_process.py#L78
Cannot access attribute "message" for class "TextChoices"   Attribute "message" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_single_turn_rollout_process.py#L78
Cannot access attribute "message" for class "StreamingChoices"   Attribute "message" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_single_turn_rollout_process.py#L77
Cannot access attribute "message" for class "TextChoices"   Attribute "message" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_single_turn_rollout_process.py#L77
Cannot access attribute "message" for class "StreamingChoices"   Attribute "message" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/proxy/proxy_core/redis_utils.py#L45
Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to return type "Set[str]"   Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Set[str]"     "Awaitable[Set[Unknown]]" is not assignable to "Set[str]" (reportReturnType)
Lint & Type Check: eval_protocol/proxy/proxy_core/redis_utils.py#L44
Argument of type "Awaitable[Set[Unknown]] | Set[Unknown]" cannot be assigned to parameter "obj" of type "Sized" in function "len"   Type "Awaitable[Set[Unknown]] | Set[Unknown]" is not assignable to type "Sized"     "Awaitable[Set[Unknown]]" is incompatible with protocol "Sized"       "__len__" is not present (reportArgumentType)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
40.9 KB
sha256:9d36a7c7fbd9194ee2accbae21de3fc7c9cab8971c3583f6d68e5f161072b569
coverage-core-3.10 Expired
49.8 KB
sha256:edeb4ccd7074840e832cd09fa8884373371f06201ab19f0cb69d24f228b0d970
coverage-core-3.11 Expired
49.8 KB
sha256:7a9690d1484d04f2ef2bac9081c8a9ed63921329c69e933c86ce5ece295a181c
coverage-core-3.12 Expired
49.8 KB
sha256:d274bc5c64f663b9ded2753f98748d4191ad3256abafd21222e2253b00560df5