Skip to content

vision food reasoning eval #1492

vision food reasoning eval

vision food reasoning eval #1492

Triggered via pull request December 3, 2025 02:21
Status Success
Total duration 9m 16s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 11s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 14s
Batch Evaluation Tests
MCP End-to-End Tests
53s
MCP End-to-End Tests
Upload Coverage
6s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 3 warnings
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1423
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1352
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1270
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1196
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1124
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1006
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L914
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L837
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L738
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L682
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.6 KB
sha256:70b213f72bfebf03417031892ecd8519b86f8ba9d069efff2e7d54abe45ae52c
coverage-core-3.10 Expired
62.7 KB
sha256:6b0028269beaa858c738a2543d4157e4a326755ddf7e95d14c7f290094ff427b
coverage-core-3.11 Expired
62.7 KB
sha256:1eb94f180a9ce14a81a3dc9fb747415362aac743016fc77a3dfdacceb806bf5b
coverage-core-3.12 Expired
62.7 KB
sha256:881e15611b0063a8aaf151d7d8907926267eeff9164ee18b5c650833166669ca