Skip to content

Adding unified semaphore (#153) #644

Adding unified semaphore (#153)

Adding unified semaphore (#153) #644

Triggered via push September 2, 2025 07:57
Status Failure
Total duration 5m 4s
Artifacts 1

ci.yml

on: push
Lint & Type Check
57s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 9s
Batch Evaluation Tests
MCP End-to-End Tests
50s
MCP End-to-End Tests
Upload Coverage
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

13 errors and 3 warnings
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L5
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"   "langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"   Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1656
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1522
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L1145
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L991
Expected 1 positional argument (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L799
"reward_basis" is not a known attribute of "None" (reportOptionalMemberAccess)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L755
Argument missing for parameter "env_assertions" (reportCallIssue)
Lint & Type Check: eval_protocol/mcp_servers/tau2/tests/test_tau2_e2e.py#L751
Argument of type "str | None" cannot be assigned to parameter "id" of type "str" in function "__init__"   Type "str | None" is not assignable to type "str"     "None" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Core Tests (Python 3.11)
Process completed with exit code 1.
Core Tests (Python 3.10)
Process completed with exit code 1.
Core Tests (Python 3.12)
Process completed with exit code 1.
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
33.8 KB
sha256:e75173dba09a8733a77f226df127754f9f2656af609b2c517663f089d572aff1