Skip to content

vision food reasoning eval #1480

vision food reasoning eval

vision food reasoning eval #1480

Triggered via pull request December 2, 2025 07:32
Status Success
Total duration 9m 37s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 11s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 17s
Batch Evaluation Tests
MCP End-to-End Tests
52s
MCP End-to-End Tests
Upload Coverage
5s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 3 warnings
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1423
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1352
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1270
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1196
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1124
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1006
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L914
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L837
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L738
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L682
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.5 KB
sha256:e17f89d2d1d0af09d80f01fbe5fa44765a02e1617b2d6d27c6454c3d9781cb1f
coverage-core-3.10 Expired
62.6 KB
sha256:069472dc10e7f284b9fc7a400d28dda3071ee0c1bd9c37d2e61156b1b534124e
coverage-core-3.11 Expired
62.6 KB
sha256:0563ca1d65ffcd8527135e2b138dd1252ba32f29e2426c80d0126c27950ce960
coverage-core-3.12 Expired
62.6 KB
sha256:818c011427fbd519fb98a68db00cc499adc2ad2e63d1dc5edd2acda77211d415