Skip to content

vision food reasoning eval #1490

vision food reasoning eval

vision food reasoning eval #1490

Triggered via pull request December 3, 2025 01:26
Status Success
Total duration 8m 44s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 17s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 10s
Batch Evaluation Tests
MCP End-to-End Tests
58s
MCP End-to-End Tests
Upload Coverage
6s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

13 errors and 3 warnings
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1423
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1352
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1270
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1196
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1124
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1006
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L914
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L837
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L738
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L682
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.6 KB
sha256:ca12b279a3abf59879081f345be80133279293efdbf29c0ad71cac32e15b96d3
coverage-core-3.10 Expired
62.7 KB
sha256:550908663852159dcb8ce0add0d5ce82adf7bababd2c041639d593993f45c4e9
coverage-core-3.11 Expired
62.7 KB
sha256:aa81b2bd0ebb3b79e6e83580bf8e81490619ea039f40e9908b4aad07f6d6e8d2
coverage-core-3.12 Expired
62.7 KB
sha256:b927e3feddcb801f3bf8f6c55aff8aee73d29528b05fc9863e113315c51a4b67