Skip to content

Run precommit and fix type errors #618

Run precommit and fix type errors

Run precommit and fix type errors #618

Triggered via pull request September 1, 2025 06:54
Status Success
Total duration 5m 23s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 1s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 14s
Batch Evaluation Tests
MCP End-to-End Tests
49s
MCP End-to-End Tests
Upload Coverage
8s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 3 warnings
Lint & Type Check: eval_protocol/benchmarks/test_gpqa.py#L63
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"   Attribute "startswith" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/benchmarks/test_aime25.py#L101
No parameter named "data" (reportCallIssue)
Lint & Type Check: eval_protocol/benchmarks/test_aime25.py#L85
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_boxed_text"   Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"     "List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/agent/task_manager.py#L925
Argument of type "str | None" cannot be assigned to parameter "args" of type "StrPath" in function "__new__"   Type "str | None" is not assignable to type "StrPath"     Type "None" is not assignable to type "StrPath"       "None" is not assignable to "str"       "None" is incompatible with protocol "PathLike[str]"         "__fspath__" is not present (reportArgumentType)
Lint & Type Check: eval_protocol/agent/task_manager.py#L923
Type "Path" is not assignable to declared type "str | None"   Type "Path" is not assignable to type "str | None"     "Path" is not assignable to "str"     "Path" is not assignable to "None" (reportAssignmentType)
Lint & Type Check: eval_protocol/agent/task_manager.py#L689
Argument of type "int" cannot be assigned to parameter "value" of type "str" in function "__setitem__"   "int" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/agent/task_manager.py#L688
Argument of type "int" cannot be assigned to parameter "value" of type "str" in function "__setitem__"   "int" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/agent/task_manager.py#L687
Argument of type "Dict[str, Any]" cannot be assigned to parameter "value" of type "str" in function "__setitem__"   "Dict[str, Any]" is not assignable to "str" (reportArgumentType)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
33.5 KB
sha256:a4b8a536c4d575db2e9dd81b68016e6be7b4f5cc5e2002eddcd13e9e381e2c7d
coverage-core-3.10 Expired
40.7 KB
sha256:21697d0f4893ad9e7080fbd3004d06bde1aa505fe463df863eed4d6923bf3333
coverage-core-3.11 Expired
40.7 KB
sha256:3505b5dcc59c8201c1af363145d6fa150d118c30374b1951497d40fd25ca6082
coverage-core-3.12 Expired
40.7 KB
sha256:34d8a02439e15a0e7809e9322a6cf56559b1f3ec088401e54d82f54ac0fdeff8