Skip to content

Adding unified semaphore #643

Adding unified semaphore

Adding unified semaphore #643

Triggered via pull request September 2, 2025 07:56
Status Failure
Total duration 5m 12s
Artifacts 1

ci.yml

on: pull_request
Lint & Type Check
1m 3s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 7s
Batch Evaluation Tests
MCP End-to-End Tests
45s
MCP End-to-End Tests
Upload Coverage
0s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

13 errors and 3 warnings
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L5
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"   "langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"   Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1656
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1522
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1145
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L991
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L799
"reward_basis" is not a known attribute of "None" (reportOptionalMemberAccess)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L755
Argument missing for parameter "env_assertions" (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L751
Argument of type "str | None" cannot be assigned to parameter "id" of type "str" in function "__init__"   Type "str | None" is not assignable to type "str"     "None" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Core Tests (Python 3.11)
Process completed with exit code 1.
Core Tests (Python 3.10)
Process completed with exit code 1.
Core Tests (Python 3.12)
Process completed with exit code 1.
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
33.8 KB
sha256:034aaefe9d8b0e230b51a4cf3130b27c750b3855092b41094d551fc5fd80f5d3