Skip to content

Fix MCP Rollout Processor #641

Fix MCP Rollout Processor

Fix MCP Rollout Processor #641

Triggered via push September 2, 2025 06:41
Status Success
Total duration 5m 8s
Artifacts 4

ci.yml

on: push
Lint & Type Check
55s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 14s
Batch Evaluation Tests
MCP End-to-End Tests
43s
MCP End-to-End Tests
Upload Coverage
6s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 3 warnings
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L5
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"   "langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"   Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1656
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1522
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1145
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L991
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L799
"reward_basis" is not a known attribute of "None" (reportOptionalMemberAccess)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L755
Argument missing for parameter "env_assertions" (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L751
Argument of type "str | None" cannot be assigned to parameter "id" of type "str" in function "__init__"   Type "str | None" is not assignable to type "str"     "None" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
33.8 KB
sha256:1ec1afc3f83231c287eef42dca79381bb913cd7768f12b556100e6168690faae
coverage-core-3.10 Expired
41.1 KB
sha256:615ac24f725a0d48dc3d567251a2f5c7899b66858e78a828df54edb4d1f900bf
coverage-core-3.11 Expired
41.1 KB
sha256:adb90febd5124bb2d8078e03ca2f5b7cf4a4856c41594bed28030c95c2b3adb0
coverage-core-3.12 Expired
41.1 KB
sha256:1f0360f6f10f4e3f3e17a5212f9a9342b15cacfbc0ccc336ae1a9e506d5b5d08