Skip to content
Python CI

Add original example idx in input_metadata (#346) #1455

Sign in to view logs

Add original example idx in input_metadata (#346)

Add original example idx in input_metadata (#346) #1455

Triggered via push November 25, 2025 09:45
@mayinghanmayinghan
pushed 361369e
main
Status Success
Total duration 9m 14s
Artifacts 4

ci.yml

on: push
Lint & Type Check
1m 2s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 11s
Batch Evaluation Tests
MCP End-to-End Tests
52s
MCP End-to-End Tests
Upload Coverage
6s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 3 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.3 KB
sha256:03876144aa877f6bef4f54dcad21a0a63b7dd30042e3dcaea08bf04092d4c76d
coverage-core-3.10 Expired
62.4 KB
sha256:be1948ee5f4d4f0ab5449d0bfab0b362c2c076f7f5ae52e8b63fd16264629610
coverage-core-3.11 Expired
62.4 KB
sha256:cd1b0d99dac6240d1e88f742689c5d7ac5bf3e21ed9a3143239fc21b552d0979
coverage-core-3.12 Expired
62.4 KB
sha256:28f694f95dca39290bd358a1deb9bdb5052a2bdcbb0ee1dd97ed7de769bc9191