Skip to content

vision food reasoning eval #1386

vision food reasoning eval

vision food reasoning eval #1386

Triggered via pull request November 15, 2025 07:16
Status Failure
Total duration 12m 26s
Artifacts 1

ci.yml

on: pull_request
Lint & Type Check
1m 43s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 18s
Batch Evaluation Tests
MCP End-to-End Tests
58s
MCP End-to-End Tests
Upload Coverage
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

21 errors and 3 warnings
Lint & Type Check
8 errors
Lint & Type Check: eval_protocol/rewards/lean_prover.py#L236
Cannot access attribute "text" for class "ChatCompletionContentPartImageParam"   Attribute "text" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/rewards/lean_prover.py#L61
Cannot access attribute "text" for class "ChatCompletionContentPartImageParam"   Attribute "text" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/rewards/code_execution.py#L944
Cannot access attribute "text" for class "ChatCompletionContentPartImageParam"   Attribute "text" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/rewards/code_execution.py#L177
Cannot access attribute "text" for class "ChatCompletionContentPartImageParam"   Attribute "text" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_pydantic_ai_rollout_processor.py#L150
Cannot access attribute "text" for class "ChatCompletionContentPartImageParam"   Attribute "text" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_pydantic_ai_rollout_processor.py#L143
Cannot access attribute "text" for class "ChatCompletionContentPartImageParam"   Attribute "text" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L421
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/proxy/proxy_core/langfuse.py#L208
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Core Tests (Python 3.11)
Process completed with exit code 1.
Core Tests (Python 3.12)
Process completed with exit code 1.
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
44.6 KB
sha256:3af00dce72d9bd61669e6230124740fa159c925658763868cec64c817de7d5ef