Skip to content

Commit 05211a3

Browse files
committed
Reconcile conformance baselines after CacheableResult default change
The ttl_ms=0 / cache_scope="private" defaults make list and read results validate at the 2026-07-28 surface, so caching, the carried-forward list/read scenarios, and http-custom-header-server-validation now pass. tools-call-with-progress stays expected-fail (progress notifications are not yet delivered on the single-exchange path).
1 parent 3fcf832 commit 05211a3

2 files changed

Lines changed: 4 additions & 20 deletions

File tree

.github/actions/conformance/expected-failures.2026-07-28.yml

Lines changed: 4 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -82,20 +82,11 @@ client:
8282
# neither run nor evaluated on this leg.
8383

8484
server:
85-
# --- No stateless server path on main yet (carried-forward 2025-era scenarios) ---
86-
# mcp-everything-server only runs in 2025 stateful mode. With
87-
# --spec-version 2026-07-28 the harness sends stateless requests
88-
# (MCP-Protocol-Version: 2026-07-28, _meta envelope, no initialize), which
89-
# the server rejects before the handler runs. These scenarios all pass on
90-
# the 2025 legs; they unblock once mcp-everything-server routes 2026
91-
# requests through a stateless path.
92-
- tools-list
85+
# --- Carried-forward 2025-era scenarios still failing on the 2026 wire ---
86+
# The stateless 2026 path now reaches handlers for plain request/response
87+
# scenarios; tools-call-with-progress still fails because the stateless
88+
# server has no channel for server→client progress notifications.
9389
- tools-call-with-progress
94-
- resources-list
95-
- resources-read-text
96-
- resources-read-binary
97-
- resources-templates-read
98-
- prompts-list
9990
# SEP-2106 (JSON Schema 2020-12 in tool inputSchema): the fixture tool's
10091
# schema has none of the 2020-12 keywords the scenario checks. The scenario
10192
# is in `--suite all` but not `--suite active`, so this is the only leg that
@@ -118,12 +109,9 @@ server:
118109
- input-required-result-tampered-state
119110
- input-required-result-capability-check
120111
- input-required-result-validate-input
121-
# SEP-2549 (caching): no ttlMs/cacheScope support.
122-
- caching
123112
# SEP-2243 (HTTP header standardization): -32020 HeaderMismatch handling and
124113
# case-insensitive/whitespace-trimmed header validation not implemented.
125114
- http-header-validation
126-
- http-custom-header-server-validation
127115

128116
# --- WARNING-only entries ---
129117
# These scenarios emit no FAILURE checks, only SHOULD-level WARNINGs, but

.github/actions/conformance/expected-failures.yml

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -65,13 +65,9 @@ server:
6565
- input-required-result-result-type
6666
- input-required-result-tampered-state
6767
- input-required-result-capability-check
68-
# SEP-2549 (caching): no ttlMs/cacheScope support; scenario also hits the
69-
# stateful-mode "Missing session ID" error.
70-
- caching
7168
# SEP-2243 (HTTP header standardization): -32020 HeaderMismatch handling and
7269
# case-insensitive/whitespace-trimmed header validation not implemented.
7370
- http-header-validation
74-
- http-custom-header-server-validation
7571
# WARNING-only entries: these scenarios emit no FAILURE checks, only SHOULD-level
7672
# WARNINGs, but the expected-failures evaluator counts WARNINGs as failures.
7773
# SEP-2164: server returns -32600 (not -32602) and omits error.data.uri.

0 commit comments

Comments
 (0)