revert mcp gym issue #628
benjibcci.yml
on: pull_request
Lint & Type Check
1m 2s
Matrix: test-core
Batch Evaluation Tests
2m 34s
MCP End-to-End Tests
1m 54s
Upload Coverage
5s
Annotations
10 errors and 3 warnings
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L108
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_abcd_letter"
Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"
"List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L85
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L82
"split" is not a known attribute of "None" (reportOptionalMemberAccess)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L82
Cannot access attribute "split" for class "List[ChatCompletionContentPartTextParam]"
Attribute "split" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L79
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_gpqa.py#L63
Cannot access attribute "startswith" for class "List[ChatCompletionContentPartTextParam]"
Attribute "startswith" is unknown (reportAttributeAccessIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_aime25.py#L101
No parameter named "data" (reportCallIssue)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_aime25.py#L85
Argument of type "str | List[ChatCompletionContentPartTextParam]" cannot be assigned to parameter "text" of type "str" in function "_extract_boxed_text"
Type "str | List[ChatCompletionContentPartTextParam]" is not assignable to type "str"
"List[ChatCompletionContentPartTextParam]" is not assignable to "str" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"
Import from "langfuse._client.client" instead (reportPrivateImportUsage)
|
|
Lint & Type Check:
eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled
"Exception" is a subclass of "Exception" (reportUnusedExcept)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
coverage-batch-eval
Expired
|
33.5 KB |
sha256:e89f51fdbbc0d4d3a3dc69f2bb48ae9e4535d241b18fe58bdcadea102b221ebf
|
|
|
coverage-core-3.10
Expired
|
40.8 KB |
sha256:2534ba595d7053ea7aaf17ac3f7f09f9c58625bfa17291130aa1c88f9b3f354f
|
|
|
coverage-core-3.11
Expired
|
40.8 KB |
sha256:4fad2dd58948f2565465d451f19c181f6a97447a4edca2b7858b56dabfb607a3
|
|
|
coverage-core-3.12
Expired
|
40.8 KB |
sha256:dafa5faeccdbceaf9b7f188110bdb12270a47824d23c0d189425c5e891c2028b
|
|