Skip to content
Python CI

Add original example idx in input_metadata #1448

Sign in to view logs

Add original example idx in input_metadata

Add original example idx in input_metadata #1448

Triggered via pull request November 25, 2025 06:16
@mayinghanmayinghan
opened #346
fix-stable-row-id-with-duplicate-content
Status Success
Total duration 9m 27s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 13s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 14s
Batch Evaluation Tests
MCP End-to-End Tests
47s
MCP End-to-End Tests
Upload Coverage
9s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 3 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.3 KB
sha256:943fd3820815a3ddeefc4d2f66dd5352e46173458d619b3715c1ed8b8981c0b2
coverage-core-3.10 Expired
62.4 KB
sha256:407e00e53f0d473c7760809f689570dd37554fe48fc522ffc5a52fa812d2b30f
coverage-core-3.11 Expired
62.4 KB
sha256:7097997044906ab302ce3ce35f189184dbb04e4c31d9d20da3f0cb39491c06b9
coverage-core-3.12 Expired
62.4 KB
sha256:80e7498976aa9b2aa01364f4ad992359ec14828db411a06432ab731621bb9b02