Ground truth now a json serializable type #664
xzrderekci.yml
on: pull_request
Annotations
6 errors and 3 warnings
|
Lint & Type Check
5 errors
|
|
Lint & Type Check:
eval_protocol/pytest/default_langchain_rollout_processor.py#L120
Argument of type "BaseMessage" cannot be assigned to parameter "msg" of type "BaseMessage" in function "serialize_lc_message_to_ep"
"eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage" is not assignable to "langchain_core.messages.base.BaseMessage" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/pytest/default_langchain_rollout_processor.py#L39
Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]"
"langchain_core.messages.human.HumanMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage"
Type "type[langchain_core.messages.human.HumanMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.LangGraphRolloutProcessor.HumanMessage]" (reportAssignmentType)
|
|
Lint & Type Check:
eval_protocol/pytest/default_langchain_rollout_processor.py#L6
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to declared type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]"
"langchain_core.messages.base.BaseMessage" is not assignable to "eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage"
Type "type[langchain_core.messages.base.BaseMessage]" is not assignable to type "type[eval_protocol.pytest.default_langchain_rollout_processor.BaseMessage]" (reportAssignmentType)
|
|
Lint & Type Check:
eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"
Import from "langfuse._client.client" instead (reportPrivateImportUsage)
|
|
Lint & Type Check:
eval_protocol/adapters/bigquery.py#L197
Except clause is unreachable because exception is already handled
"Exception" is a subclass of "Exception" (reportUnusedExcept)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
coverage-batch-eval
Expired
|
34 KB |
sha256:e8b9c7784456e27a26794cf5b5d343e8780b6288ce2cea750fed9298427f14e9
|
|
|
coverage-core-3.10
Expired
|
41.3 KB |
sha256:73af9d47f076250ff5a78caf4072f0b77060dfceb95cffb6337d6b8271f3c613
|
|
|
coverage-core-3.11
Expired
|
41.3 KB |
sha256:d1b337528b74a6067679517fce95add2382223fa165c5e7c05f8c234f7503fe7
|
|
|
coverage-core-3.12
Expired
|
41.3 KB |
sha256:3ccc163dea8d52496d8660be050e892c6ff1ad48cf47deb96b8d594d8038cbd9
|
|