Skip to content

feat(unic-pr-review): calibrate silent-failure-hunter for lost-signal/observability gaps #217

@orioltf

Description

@orioltf

What to build

Calibrate the silent-failure-hunter agent prompt (agents/silent-failure-hunter.md) to also surface lost-signal / observability gaps — fallback, early-return, or dev-only-log paths where a real event or error never reaches production observability (logs / Sentry / telemetry) — without inflating false positives.

This is the clearest behavioural-parity gap from the PR #5612 comparison: same agent name, same input, divergent output. The toolkit's silent-failure-hunter flagged that a cancelled-route transition which fails to complete loses the analytics page_view with no production trace; unic's silent-failure-hunter returned 0 findings. The agent is Markdown instructions to an LLM, so there is nothing to unit-test — verification is by example (re-run on the #5612 diff).

Acceptance criteria

  • The prompt instructs the agent to flag production-observability loss from fallbacks / early-returns / dev-only logging, distinct from deliberate, traced suppression.
  • Re-running on the PR #5612 diff surfaces the lost-page_view / observability finding; a before/after example is documented.
  • Calibration is guarded against false positives: deliberate suppression that IS traced (e.g. handling whose destination still fires its own event) does NOT get over-flagged.

Blocked by

None - can start immediately.

Metadata

Metadata

Assignees

No one assigned

    Labels

    app:unic-pr-reviewArea: apps/claude-code/unic-pr-reviewfeatureNew capabilityready-for-agentFully specified, ready for an AFK agent

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions