Skip to content

vision food reasoning eval #1479

vision food reasoning eval

vision food reasoning eval #1479

Triggered via pull request December 2, 2025 07:26
Status Cancelled
Total duration 6m 36s
Artifacts 1

ci.yml

on: pull_request
Lint & Type Check
1m 11s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 14s
Batch Evaluation Tests
MCP End-to-End Tests
49s
MCP End-to-End Tests
Upload Coverage
0s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

17 errors and 3 warnings
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1423
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1352
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1270
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1196
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1124
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1006
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L914
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L837
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L738
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/benchmarks/test_glm_streaming_compliance.py#L682
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"   Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"     Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"       "List[ChatCompletionContentPartParam]" is not assignable to "str"       "List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"         Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"         Consider switching from "list" to "Sequence" which is covariant       "List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
Core Tests (Python 3.10)
Canceling since a higher priority waiting request for Python CI-refs/pull/331/merge exists
Core Tests (Python 3.10)
The operation was canceled.
Core Tests (Python 3.11)
Canceling since a higher priority waiting request for Python CI-refs/pull/331/merge exists
Core Tests (Python 3.11)
The operation was canceled.
Core Tests (Python 3.12)
Canceling since a higher priority waiting request for Python CI-refs/pull/331/merge exists
Core Tests (Python 3.12)
The operation was canceled.
Python CI
Canceling since a higher priority waiting request for Python CI-refs/pull/331/merge exists
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.5 KB
sha256:dc220e281ed5944cc5d6433a873f14d8a335c2f70fc0e24edd295174aa46e0b1