Skip to content
Python CI

Add original example idx in input_metadata #1449

Sign in to view logs

Add original example idx in input_metadata

Add original example idx in input_metadata #1449

Triggered via pull request November 25, 2025 06:40
@mayinghanmayinghan
synchronize #346
fix-stable-row-id-with-duplicate-content
Status Success
Total duration 8m 44s
Artifacts 4

ci.yml

on: pull_request
Lint & Type Check
1m 2s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 5s
Batch Evaluation Tests
MCP End-to-End Tests
48s
MCP End-to-End Tests
Upload Coverage
8s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 3 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.3 KB
sha256:310cbc82110d9cf5294f0e059f84fe29bc067a6dfea83fca23fcdbc9dde43715
coverage-core-3.10 Expired
62.4 KB
sha256:b8b1bab01ce7ba3dc1fcb36c9f15d20715bae8cac799690b7f2c22c0f8650e9d
coverage-core-3.11 Expired
62.4 KB
sha256:7ed7b824cc09014d7917bc635075a593f5a35bec9e3e5fcbf0372c9ea4d2b56c
coverage-core-3.12 Expired
62.4 KB
sha256:f24f0332d67e316abcb8af6a83271f9210968311b3ac770f6b43bdd1a0798963