Skip to content

Surface PR author trust in the review prompt#483

Draft
vkodithala wants to merge 1 commit into
mainfrom
oz-agent/scope-visual-evidence-to-external
Draft

Surface PR author trust in the review prompt#483
vkodithala wants to merge 1 commit into
mainfrom
oz-agent/scope-visual-evidence-to-external

Conversation

@vkodithala

Copy link
Copy Markdown
Contributor

Summary

Threads an explicit author trust signal into the PR review prompt so the cloud review agent can tell whether a PR was authored by a Warp organization member or an external contributor.

The review agent is explicitly instructed not to call GitHub, so today it has no membership signal at all. This adds an Author line to the PR description the agent already reads (pr_description.txt):

- Author: @octocat [association=MEMBER, trust=TRUSTED]

trust is TRUSTED when the GitHub author_association is in ORG_MEMBER_ASSOCIATIONS (MEMBER/OWNER/COLLABORATOR), and UNVERIFIED otherwise.

Why

In #feedback-app, internal contributors ("warpers") have been getting Request changes on nearly every PR because the warp review-pr-local skill requires visual evidence (screenshots/recordings) for user-facing changes. The agreed fix is to keep that requirement for external contributors but drop it for org members. The skill had no way to distinguish the two — this change provides the signal. The companion skill change lives in warpdotdev/warp.

Testing

  • python -m pytest tests — 438 passed, 67 subtests passed.
  • Added tests asserting the Author trust line renders TRUSTED for MEMBER authors and UNVERIFIED for external (CONTRIBUTOR) authors.

Conversation: https://staging.warp.dev/conversation/484fda0c-894d-40f0-b9af-e9688acfb6fa
Run: https://oz.staging.warp.dev/runs/019ecd58-d020-7d93-9008-d5b4cb9fc0b2

This PR was generated with Oz.

The review agent is told not to call GitHub, so it has no way to tell
whether a PR author is a Warp org member or an external contributor.
This adds an `Author` line to the PR description the agent already reads
(`pr_description.txt`), tagging the author with their GitHub association
and a `trust=TRUSTED|UNVERIFIED` label derived from
`ORG_MEMBER_ASSOCIATIONS`.

This lets the warp `review-pr-local` skill scope its visual-evidence
requirement to external contributors only (companion change in warp).

Co-Authored-By: Oz <oz-agent@warp.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant