Python CI

Add original example idx in input_metadata #1451

Sign in to view logs

Triggered via pull request November 25, 2025 06:58

mayinghan

synchronize #346

fix-stable-row-id-with-duplicate-content

Status Cancelled

Total duration 8m 43s

Artifacts 1

ci.yml

on: pull_request

Lint & Type Check

Matrix: test-core

Batch Evaluation Tests

MCP End-to-End Tests

Upload Coverage

Annotations

16 errors and 3 warnings

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163

"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162

Variable not allowed in type expression (reportInvalidTypeForm)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162

Variable not allowed in type expression (reportInvalidTypeForm)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155

Argument to class must be a base class (reportGeneralTypeIssues)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143

Variable not allowed in type expression (reportInvalidTypeForm)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115

Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__" "None" is not assignable to "DatasetLogger" (reportArgumentType)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74

Argument to class must be a base class (reportGeneralTypeIssues)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54

Variable not allowed in type expression (reportInvalidTypeForm)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36

Variable not allowed in type expression (reportInvalidTypeForm)

Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32

Argument to class must be a base class (reportGeneralTypeIssues)

Core Tests (Python 3.11)

Process completed with exit code 1.

Core Tests (Python 3.10)

Canceling since a higher priority waiting request for Python CI-refs/pull/346/merge exists

Core Tests (Python 3.10)

The operation was canceled.

Core Tests (Python 3.12)

Canceling since a higher priority waiting request for Python CI-refs/pull/346/merge exists

Core Tests (Python 3.12)

The operation was canceled.

Canceling since a higher priority waiting request for Python CI-refs/pull/346/merge exists

Lint & Type Check: eval_protocol/mcp/__init__.py#L49

Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)

Lint & Type Check: eval_protocol/mcp/__init__.py#L49

Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)

MCP End-to-End Tests

No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime

Name	Size	Digest
coverage-batch-eval Expired	48.3 KB	`sha256:c488776223dcbb4b4b2bb60c1eacf72d4f50e744048cec4223d48a2b4f7b24f2`