Skip to content
Python CI

Add original example idx in input_metadata #1453

Sign in to view logs

Add original example idx in input_metadata

Add original example idx in input_metadata #1453

Triggered via pull request November 25, 2025 07:40
@mayinghanmayinghan
synchronize #346
fix-stable-row-id-with-duplicate-content
Status Success
Total duration 9m 16s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 8s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 12s
Batch Evaluation Tests
MCP End-to-End Tests
54s
MCP End-to-End Tests
Upload Coverage
7s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 3 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.3 KB
sha256:88c764d42bb313abaf7486984f4d4316a94bb97f4ca79697b8bba1c3414cb513
coverage-core-3.10 Expired
62.4 KB
sha256:830b621af4f3726c757d5376479694e9879e3974907b9c3f6f4684f0f6c2c550
coverage-core-3.11 Expired
62.4 KB
sha256:10521df82fa55a0ca5bf8439830ea3512151e2188568a2bde7d8603ff3a1e1bb
coverage-core-3.12 Expired
62.4 KB
sha256:ce734c7c546071d4946d34d8137bb33e6f30ba7a753ddca3ccb849253695c79e