Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion docs/ci/runtime_intelligence_gitlab_artifacts.md
Original file line number Diff line number Diff line change
Expand Up @@ -165,6 +165,7 @@ AIGuard artifact.
The same manifest gate requires `expected_report_markers` to match the
Lab-owned Runtime Intelligence report contract before optional CI artifact
packaging runs. That marker set preserves `Runtime Intelligence Risk Summary`,
`Runtime replay duration scope`,
`Orchestrator operation feed context`, `Orchestrator task event rollup`,
`Lab EdgeEnv preservation context`,
`AIGuard task event rollup evidence`,
Expand All @@ -185,7 +186,7 @@ EdgeEnv handoff summary and AIGuard deterministic evidence agree on
producer-lineage guard-alignment run IDs. This keeps the cross-repo marker
check file-based and does not make AIGuard a deployment decision owner.

The artifact gate is implemented by `scripts/check_runtime_intelligence_artifact_bundle.py`. It checks the generated Markdown / HTML report for the required Runtime Intelligence rows, including Lab ownership, EdgeEnv comparability, telemetry coverage-gap markers, Orchestrator operation feed context, Orchestrator task event rollup, Lab EdgeEnv preservation context, Jetson/device-local preservation identity and detail labels, Orchestrator `operation_risk_summary` navigation context, AIGuard runtime operation anomalies, AIGuard `edgeenv_orchestrator_operation_risk_summary` evidence, AIGuard `edgeenv_orchestrator_task_event_rollup` evidence, remote dispatch starter event summary, `Remote fallback starter evidence`, `edgeenv_orchestrator_producer_lineage`, `runtime_history_seed_run_config_traceability`, `remote_execution_recovered_by_fallback`, and triggered deployment review rules.
The artifact gate is implemented by `scripts/check_runtime_intelligence_artifact_bundle.py`. It checks the generated Markdown / HTML report for the required Runtime Intelligence rows, including Lab ownership, EdgeEnv comparability, telemetry coverage-gap markers, Runtime replay duration scope, Orchestrator operation feed context, Orchestrator task event rollup, Lab EdgeEnv preservation context, Jetson/device-local preservation identity and detail labels, Orchestrator `operation_risk_summary` navigation context, AIGuard runtime operation anomalies, AIGuard `edgeenv_orchestrator_operation_risk_summary` evidence, AIGuard `edgeenv_orchestrator_task_event_rollup` evidence, remote dispatch starter event summary, `Remote fallback starter evidence`, `edgeenv_orchestrator_producer_lineage`, `runtime_history_seed_run_config_traceability`, `remote_execution_recovered_by_fallback`, and triggered deployment review rules.

The CI artifact gate is implemented by `scripts/check_runtime_intelligence_ci_artifacts.py`. It runs in the deployment-risk stage and verifies that the collected optional GitLab artifacts include the manifest gate summary, AIGuard handoff alignment artifact, report gate summary, Runtime Intelligence Risk Summary report, portfolio demo status, and the validated contract markers from the bundle manifest gate. This keeps the final CI gate file-based and deterministic without turning GitLab into a runtime control plane.
The same CI artifact gate also checks the copied
Expand Down
3 changes: 2 additions & 1 deletion docs/portfolio/edgeenv_runtime_regression_lab_handoff.md
Original file line number Diff line number Diff line change
Expand Up @@ -175,7 +175,7 @@ Expected Lab behavior:
- The same gate requires EdgeEnv-preserved Orchestrator producer markers to carry `source_repository=InferEdgeOrchestrator`, `artifact_role=orchestrator-supplemental-operation-context`, and `producer_contract=inferedge-orchestrator-edgeenv-runtime-telemetry-feed-v1`.
- When EdgeEnv preservation context is present, Lab renders `Lab EdgeEnv preservation context` with `lab_report_preservation_context_present=True`, `lab_preservation=present`, and `lab_context=present` so the Runtime Intelligence report gate and entrypoint evidence index use the same Lab-owned marker vocabulary.
- When an EdgeEnv handoff manifest is provided, the bundle gate requires EdgeEnv-produced file keys, external AIGuard file keys, source repository mapping, artifact roles, producer contracts, and boundary flags to match Lab's Runtime Intelligence bundle contract.
- The same manifest gate requires `expected_report_markers` to preserve these exact Lab-owned report markers: `Runtime Intelligence Risk Summary`, `Orchestrator operation feed context`, `Orchestrator task event rollup`, `Lab EdgeEnv preservation context`, `AIGuard task event rollup evidence`, `AIGuard runtime operation anomalies`, `AIGuard remote dispatch event summary`, `AIGuard remote event summary consistency`, `Remote fallback starter evidence`, `lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback`, `AIGuard producer-lineage guard alignment`, and `Lab remains the final deployment decision owner.`.
- The same manifest gate requires `expected_report_markers` to preserve these exact Lab-owned report markers: `Runtime Intelligence Risk Summary`, `Runtime replay duration scope`, `Orchestrator operation feed context`, `Orchestrator task event rollup`, `Lab EdgeEnv preservation context`, `AIGuard task event rollup evidence`, `AIGuard runtime operation anomalies`, `AIGuard remote dispatch event summary`, `AIGuard remote event summary consistency`, `Remote fallback starter evidence`, `lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback`, `AIGuard producer-lineage guard alignment`, and `Lab remains the final deployment decision owner.`.
- The same gate summary emits `expected_report_markers: remote fallback Lab context row declared`, keeping the remote fallback row-value marker visible in file-based CI artifacts without making CI a runtime control plane.
- The same handoff gate verifies that the referenced `runtime_telemetry_history` artifact exists and preserves EdgeEnv history schema, telemetry coverage, and Runtime history seed ownership markers.
- The same handoff gate verifies that missing telemetry entries remain evidence gaps while preserving Orchestrator producer markers, owner boundary flags, and EdgeEnv mapping hints when Orchestrator context is attached.
Expand All @@ -188,6 +188,7 @@ Expected Lab behavior:
- Additional Lab test fixtures under `tests/fixtures/edgeenv_regression/` mirror EdgeEnv replay examples for candidate telemetry gaps and execution sequence inversion. These fixture smokes verify that replay warnings become Lab-owned report context without making Lab recompute EdgeEnv comparability.
- Markdown/HTML reports include a `Runtime Intelligence Risk Summary` that summarizes EdgeEnv comparability/regression, telemetry replay gaps, Runtime history seed/run_config traceability, AIGuard deterministic evidence, and the Lab-owned deployment decision in one reviewer-facing table.
- When EdgeEnv includes preserved Orchestrator feed context, the `Runtime Intelligence Risk Summary` surfaces queue, thermal, throttling, memory, fallback context, and compact `operation_risk_summary` markers as supplemental runtime evidence.
- When EdgeEnv includes replay duration metadata, the same Risk Summary surfaces `Runtime replay duration scope` with `duration_label`, `duration_class`, and frame count as reviewer navigation context. This does not change EdgeEnv comparability or Lab deployment policy.
- The Jetson/device-local preservation row starts with `identity=jetson_device_local_preservation` and the device-local path marker such as `path=device_local_starter` when available, making the preserved Jetson EdgeEnv run easier to identify before reviewers inspect detailed queue/resource context.
- The detailed producer/source/stage/resource markers are rendered in a separate `Jetson/device-local EdgeEnv preservation details` row so the identity row stays short while preserving the same navigation context.
- Agent Runtime Reliability reports now mirror the same reviewer-facing split inside `Runtime Intelligence EdgeEnv Preservation`: `preservation_identity` keeps the run/path identity short, while `preservation_details` carries source, stage, device-local event, resource, and queue markers as navigation context.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -8,9 +8,10 @@
"guard_analysis_schema_version": "inferedge-aiguard-diagnosis-v1",
"required_evidence_type_count": 7,
"guard_evidence_type_count": 8,
"lab_expected_report_marker_count": 12,
"lab_expected_report_marker_count": 13,
"lab_expected_report_markers": [
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
"Orchestrator operation feed context",
"Orchestrator task event rollup",
"Lab EdgeEnv preservation context",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
- recommendation: alignment_satisfied
- decision_owner: lab
- diagnosis_owner: aiguard
- lab_expected_report_markers: Runtime Intelligence Risk Summary, Orchestrator operation feed context, Orchestrator task event rollup, Lab EdgeEnv preservation context, AIGuard task event rollup evidence, AIGuard runtime operation anomalies, AIGuard remote dispatch event summary, AIGuard remote event summary consistency, Remote fallback starter evidence, lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback, AIGuard producer-lineage guard alignment, Lab remains the final deployment decision owner.
- lab_expected_report_markers: Runtime Intelligence Risk Summary, Runtime replay duration scope, Orchestrator operation feed context, Orchestrator task event rollup, Lab EdgeEnv preservation context, AIGuard task event rollup evidence, AIGuard runtime operation anomalies, AIGuard remote dispatch event summary, AIGuard remote event summary consistency, Remote fallback starter evidence, lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback, AIGuard producer-lineage guard alignment, Lab remains the final deployment decision owner.
- report_marker_context_role: lab_report_contract_context
- aiguard_validates_expected_report_markers: False
- required_evidence_types: runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_task_event_rollup, runtime_history_seed_run_config_traceability, runtime_queue_overload, runtime_thermal_instability, remote_execution_recovered_by_fallback
Expand Down
1 change: 1 addition & 0 deletions examples/runtime_intelligence_chain/bundle_manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,7 @@
},
"expected_report_markers": [
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
"Orchestrator operation feed context",
"Orchestrator task event rollup",
"Lab EdgeEnv preservation context",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,7 @@
],
"expected_report_markers": [
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
"Orchestrator operation feed context",
"Orchestrator task event rollup",
"Lab EdgeEnv preservation context",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -123,6 +123,9 @@
"schema_version": "inferedge-runtime-telemetry.v1",
"telemetry_source": "synthetic_local_fixture",
"telemetry_timestamp": "2026-05-21T00:05:01Z",
"frames": 96,
"duration_class": "short_96_frame_class",
"duration_label": "short 96-frame-class replay (96 frames)",
"telemetry_coverage": {
"schema_version": "inferedge-runtime-telemetry-coverage-v1",
"expected_fields": [
Expand Down Expand Up @@ -233,6 +236,9 @@
},
"producer": {
"operation_context_role": "supplemental",
"frames": 96,
"duration_class": "short_96_frame_class",
"duration_label": "short 96-frame-class replay (96 frames)",
"producer_sources": [
"device_local_cli_override",
"orchestration_summary"
Expand Down
7 changes: 7 additions & 0 deletions scripts/check_runtime_intelligence_artifact_bundle.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,11 @@
"| Orchestrator operation risk summary | candidate: "
"queue=queue_backlog_threshold_exceeded"
),
"runtime_replay_duration_scope": (
"| Runtime replay duration scope | candidate: "
"label=short 96-frame-class replay (96 frames), "
"class=short_96_frame_class, frames=96 |"
),
"jetson_edgeenv_preservation_identity": (
"| Jetson/device-local EdgeEnv preservation run | candidate: "
"identity=jetson_device_local_preservation, path=device_local_starter, "
Expand Down Expand Up @@ -143,6 +148,8 @@
"remote_fallback_lab_context_marker": "lab=Remote fallback starter evidence",
"aiguard_orchestrator_handoff": "AIGuard Orchestrator context handoff",
"orchestrator_operation_risk_summary": "Orchestrator operation risk summary",
"runtime_replay_duration_scope": "Runtime replay duration scope",
"runtime_replay_duration_label": "short 96-frame-class replay (96 frames)",
"orchestrator_task_event_rollup": "Orchestrator task event rollup",
"lab_edgeenv_preservation_context": "Lab EdgeEnv preservation context",
"lab_edgeenv_preservation_context_marker": (
Expand Down
1 change: 1 addition & 0 deletions scripts/check_runtime_intelligence_bundle_manifest.py
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,7 @@
VALID_GUARD_EVIDENCE_SEVERITIES = {"low", "medium", "high", "critical"}
REQUIRED_EXPECTED_REPORT_MARKERS = {
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
"Orchestrator operation feed context",
"Orchestrator task event rollup",
"Lab EdgeEnv preservation context",
Expand Down
6 changes: 5 additions & 1 deletion scripts/check_runtime_intelligence_ci_artifacts.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,7 @@
)
REQUIRED_LAB_EXPECTED_REPORT_MARKERS = (
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
"Orchestrator operation feed context",
"Orchestrator task event rollup",
"Lab EdgeEnv preservation context",
Expand Down Expand Up @@ -150,6 +151,8 @@ def _validate_runtime_report(path: Path, errors: list[str]) -> None:
return
for marker in (
"## Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
"short 96-frame-class replay (96 frames)",
"Lab remains the final deployment decision owner.",
"AIGuard runtime operation anomalies",
"runtime_queue_overload, runtime_thermal_instability",
Expand Down Expand Up @@ -286,7 +289,8 @@ def _validate_aiguard_handoff_alignment(
"decision_owner: lab",
"diagnosis_owner: aiguard",
"lab_expected_report_markers: "
"Runtime Intelligence Risk Summary, Orchestrator operation feed context, "
"Runtime Intelligence Risk Summary, Runtime replay duration scope, "
"Orchestrator operation feed context, "
"Orchestrator task event rollup, "
"Lab EdgeEnv preservation context, "
"AIGuard task event rollup evidence, "
Expand Down
3 changes: 3 additions & 0 deletions tests/test_runtime_intelligence_artifact_gate.py
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,9 @@ def test_runtime_intelligence_artifact_gate_passes_for_chain_report(tmp_path):
assert "- Status: passed" in summary
assert "- Missing Markdown markers: 0" in summary
assert "- Missing HTML markers: 0" in summary
markdown = markdown_path.read_text(encoding="utf-8")
assert "Runtime replay duration scope" in markdown
assert "short 96-frame-class replay (96 frames)" in markdown


def test_runtime_intelligence_artifact_gate_cli_passes_for_chain_report(tmp_path):
Expand Down
Loading
Loading