revert mcp gym issue #627
benjibcci.yml
on: pull_request
Annotations
17 errors and 3 warnings
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L108
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_abcd_letter"
Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"
"List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L85
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L82
"split" is not a known attribute of "None" (reportOptionalMemberAccess)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L82
Cannot access attribute "split" for class "List[ChatCompletionContentPartTextParam]"
Attribute "split" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L79
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L63
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_aime25.py#L101
No parameter named "data" (reportCallIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_aime25.py#L85
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_boxed_text"
Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"
"List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"
Import from "langfuse._client.client" instead (reportPrivateImportUsage)
|
|
Lint & Type Check:
eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled
"Exception" is a subclass of "Exception" (reportUnusedExcept)
|
|
Core Tests (Python 3.11)
The operation was canceled.
|
|
Core Tests (Python 3.11)
Canceling since a higher priority waiting request for Python CI-refs/pull/148/merge exists
|
|
Core Tests (Python 3.10)
The operation was canceled.
|
|
Core Tests (Python 3.10)
Canceling since a higher priority waiting request for Python CI-refs/pull/148/merge exists
|
|
Core Tests (Python 3.12)
The operation was canceled.
|
|
Core Tests (Python 3.12)
Canceling since a higher priority waiting request for Python CI-refs/pull/148/merge exists
|
|
Python CI
Canceling since a higher priority waiting request for Python CI-refs/pull/148/merge exists
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
coverage-batch-eval
Expired
|
33.5 KB |
sha256:2f8bef1c53f5d08695c505558efe51c40c0ffad47b52232b6dfbc03632a09ac8
|
|