Skip to content

Cost Metrics added (#156) #658

Cost Metrics added (#156)

Cost Metrics added (#156) #658

Triggered via push September 3, 2025 23:16
Status Success
Total duration 6m 26s
Artifacts 4

ci.yml

on: push
Lint & Type Check
1m 2s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
4m 58s
Batch Evaluation Tests
MCP End-to-End Tests
52s
MCP End-to-End Tests
Upload Coverage
5s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

6 errors and 3 warnings
Lint & Type Check
5 errors
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L117
Argument of type "BaseMessage" cannot be assigned to parameter "msg" of type "BaseMessage" in function "serialize_lc_message_to_ep"   "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage" is not assignable to "langchain_core.messages.base.BaseMessage" (reportArgumentType)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L36
Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]"   "langchain_core.messages.human.HumanMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage"   Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/pytest/default_langchain_rollout_processor.py#L5
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"   "langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"   Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled   "Exception" is a subclass of "Exception" (reportUnusedExcept)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
33.9 KB
sha256:5d422ab7ce46c447f5c98cc56abb29808d6e8697d346d2df858dc3098c3ea017
coverage-core-3.10 Expired
41.2 KB
sha256:1ceb7a0beb4d209f9bacbc1d60d6ad29c2ffe0f965a146db7b26d3ca5f4a2f50
coverage-core-3.11 Expired
41.2 KB
sha256:3963da46b7aaff2fe37b60e559961e9b90de7ce0d22d1ca6da6327e80dbe2e0f
coverage-core-3.12 Expired
41.2 KB
sha256:6ef888c267e9e939a114b7a842b35b613d564fb422b2c6b8710cc551bfee3836