Skip to content

Add tools to pydantic trace and make sure langfuse working (#168) #690

Add tools to pydantic trace and make sure langfuse working (#168)

Add tools to pydantic trace and make sure langfuse working (#168) #690

Triggered via push September 9, 2025 22:32
Status Success
Total duration 5m 48s
Artifacts 4

ci.yml

on: push
Lint & Type Check
1m 2s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 11s
Batch Evaluation Tests
MCP End-to-End Tests
43s
MCP End-to-End Tests
Upload Coverage
5s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

6 errors and 3 warnings
Lint & Type Check
5 errors
Lint & Type Check: eval_protocol/pytest/default_pydantic_ai_rollout_processor.py#L56
Cannot access attribute "_function_tools" for class "Agent[None, str]"   Attribute "_function_tools" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L120
Argument of type "BaseMessage" cannot be assigned to parameter "msg" of type "BaseMessage" in function "serialize_lc_message_to_ep"   "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage" is not assignable to "langchain_core.messages.base.BaseMessage" (reportArgumentType)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L39
Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]"   "langchain_core.messages.human.HumanMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage"   Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L6
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"   "langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"   Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
34.1 KB
sha256:07915b9f15acc377d7a9a12d2012700811c8254479d2d0d9f56b0a72fca1fa6b
coverage-core-3.10 Expired
41.4 KB
sha256:fb6a35908a95948cbe01924bd58b95fd7a9652cf10dca561c5be13661a74b098
coverage-core-3.11 Expired
41.5 KB
sha256:99bbf23957e4d2ce979d83f9c28c813ac71838e99e96804825133d0bfe7c4ad3
coverage-core-3.12 Expired
41.5 KB
sha256:479cf0080b4c8b4ffd9821ac283a16f04ad25f97e562c4c4df6a0ea3ccf9d405