Skip to content

Refactor Pydantic AI Rollout processor to use factory pattern #675

Refactor Pydantic AI Rollout processor to use factory pattern

Refactor Pydantic AI Rollout processor to use factory pattern #675

Triggered via pull request September 8, 2025 20:14
Status Cancelled
Total duration 4m 57s
Artifacts 1

ci.yml

on: pull_request
Lint & Type Check
1m 3s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 5s
Batch Evaluation Tests
MCP End-to-End Tests
51s
MCP End-to-End Tests
Upload Coverage
0s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

12 errors and 3 warnings
Lint & Type Check
4 errors
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L120
Argument of type "BaseMessage" cannot be assigned to parameter "msg" of type "BaseMessage" in function "serialize_lc_message_to_ep"   "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage" is not assignable to "langchain_core.messages.base.BaseMessage" (reportArgumentType)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L39
Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]"   "langchain_core.messages.human.HumanMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage"   Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L6
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"   "langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"   Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Core Tests (Python 3.10)
Process completed with exit code 1.
Core Tests (Python 3.10)
Canceling since a higher priority waiting request for Python CI-refs/pull/164/merge exists
Core Tests (Python 3.11)
Process completed with exit code 1.
Core Tests (Python 3.11)
Canceling since a higher priority waiting request for Python CI-refs/pull/164/merge exists
Core Tests (Python 3.12)
The operation was canceled.
Core Tests (Python 3.12)
Canceling since a higher priority waiting request for Python CI-refs/pull/164/merge exists
Python CI
Canceling since a higher priority waiting request for Python CI-refs/pull/164/merge exists
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
34 KB
sha256:3e61be6fcd4cc893fd82ee9d3f90d92dfde321dbaf2d93c006bff5d51f347d7b