Skip to content

pyright round 4

pyright round 4 #608

Triggered via pull request August 31, 2025 22:43
Status Success
Total duration 5m 41s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
57s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 11s
Batch Evaluation Tests
MCP End-to-End Tests
45s
MCP End-to-End Tests
Upload Coverage
10s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 3 warnings
Lint & Type Check: eval_protocol/agent/orchestrator.py#L18
Type "type[openai.types.chat.chat_completion_message.ChatCompletionMessage]" is not assignable to declared type "type[eval_protocol.agent.orchestrator.ChatCompletionMessage]"   "openai.types.chat.chat_completion_message.ChatCompletionMessage" is not assignable to "eval_protocol.agent.orchestrator.ChatCompletionMessage"   Type "type[openai.types.chat.chat_completion_message.ChatCompletionMessage]" is not assignable to type "type[eval_protocol.agent.orchestrator.ChatCompletionMessage]" (reportAssignmentType)
Lint & Type Check: eval_protocol/agent/orchestrator.py#L17
Type "type[openai._client.OpenAI]" is not assignable to declared type "type[eval_protocol.agent.orchestrator.OpenAI]"   "openai._client.OpenAI" is not assignable to "eval_protocol.agent.orchestrator.OpenAI"   Type "type[openai._client.OpenAI]" is not assignable to type "type[eval_protocol.agent.orchestrator.OpenAI]" (reportAssignmentType)
Lint & Type Check: eval_protocol/agent/orchestrator.py#L17
Type "type[openai._client.AsyncOpenAI]" is not assignable to declared type "type[eval_protocol.agent.orchestrator.AsyncOpenAI]"   "openai._client.AsyncOpenAI" is not assignable to "eval_protocol.agent.orchestrator.AsyncOpenAI"   Type "type[openai._client.AsyncOpenAI]" is not assignable to type "type[eval_protocol.agent.orchestrator.AsyncOpenAI]" (reportAssignmentType)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L314
Cannot access attribute "host" for class "Langfuse"   Attribute "host" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L148
Cannot access attribute "get_observations" for class "Langfuse"   Attribute "get_observations" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L128
Cannot access attribute "get_trace" for class "Langfuse"   Attribute "get_trace" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L94
Cannot access attribute "get_traces" for class "Langfuse"   Attribute "get_traces" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/adapters/langfuse.py#L16
"Langfuse" is not exported from module "langfuse"   Import from "langfuse._client.client" instead (reportPrivateImportUsage)
Lint & Type Check: eval_protocol/adapters/langchain.py#L108
Argument of type "list[dict[Unknown, Unknown]] | None" cannot be assigned to parameter "tool_calls" of type "List[ChatCompletionMessageToolCall] | None" in function "__init__"   Type "list[dict[Unknown, Unknown]] | None" is not assignable to type "List[ChatCompletionMessageToolCall] | None"     Type "list[dict[Unknown, Unknown]]" is not assignable to type "List[ChatCompletionMessageToolCall] | None"       "list[dict[Unknown, Unknown]]" is not assignable to "List[ChatCompletionMessageToolCall]"         Type parameter "_T@list" is invariant, but "dict[Unknown, Unknown]" is not the same as "ChatCompletionMessageToolCall"         Consider switching from "list" to "Sequence" which is covariant       "list[dict[Unknown, Unknown]]" is not assignable to "None" (reportArgumentType)
Lint & Type Check: eval_protocol/_version.py#L124
Cannot access attribute "decode" for class "str"   Attribute "decode" is unknown (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
34.4 KB
sha256:54f34fe11a6a4b127a6aefd478ed95f8768d57bd4b1ceeb0912947f3a2561ae3
coverage-core-3.10 Expired
41.4 KB
sha256:8cca2b26f4a69532cfccd733d1b2cf8a0c44b8e1401f85e119493cadc02cbeec
coverage-core-3.11 Expired
41.4 KB
sha256:b6d3fc334243f2ab27e91dcfa1523f7877ddc67d70a02ee05f262ee61566d975
coverage-core-3.12 Expired
41.4 KB
sha256:df98f208303c8567df002d6fe0eb038af15d7d651f2fcf3c14cebe077e55deb7