Skip to content

Response validation plugin (#351) #1481

Response validation plugin (#351)

Response validation plugin (#351) #1481

Triggered via push December 2, 2025 18:10
Status Success
Total duration 9m 7s
Artifacts 4

ci.yml

on: push
Lint & Type Check
1m 6s
Lint & Type Check
Matrix: test-core
Batch Evaluation Tests
1m 24s
Batch Evaluation Tests
MCP End-to-End Tests
53s
MCP End-to-End Tests
Upload Coverage
5s
Upload Coverage
Fit to window
Zoom out
Zoom in

Annotations

20 errors and 3 warnings
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L163
"get_tokenizer" is not a known attribute of module "tinker_cookbook" (reportAttributeAccessIssue)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L162
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L155
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L143
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L115
Argument of type "None" cannot be assigned to parameter "logger" of type "DatasetLogger" in function "__init__"   "None" is not assignable to "DatasetLogger" (reportArgumentType)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L74
Argument to class must be a base class (reportGeneralTypeIssues)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L54
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L36
Variable not allowed in type expression (reportInvalidTypeForm)
Lint & Type Check: eval_protocol/integrations/tinker_cookbook.py#L32
Argument to class must be a base class (reportGeneralTypeIssues)
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Core Tests (Python 3.10)
Event loop is closed
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
Lint & Type Check: eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size Digest
coverage-batch-eval Expired
48.4 KB
sha256:918101022360d4a26e33fb8baed43b82a162664ba4b84cbb96e539588a06f118
coverage-core-3.10 Expired
62.5 KB
sha256:1de09fa4e28eab65ec4fdab6b0d0ae95082781be5d43dbbd4c2962cd6e4f13a4
coverage-core-3.11 Expired
62.5 KB
sha256:3b66dba158be0b80336a86cfae3a2e77d8f56d91065a4532af25b5bd65b53f81
coverage-core-3.12 Expired
62.5 KB
sha256:c2d525b116229cff701dc1a96b3d962d97a67901d21f92f50035ceb8a1451005