Skip to content

docs: PR test corpus design (WIP)#18

Merged
mpawliszyn merged 1 commit intomainfrom
worktree-pr-test-corpus
Feb 27, 2026
Merged

docs: PR test corpus design (WIP)#18
mpawliszyn merged 1 commit intomainfrom
worktree-pr-test-corpus

Conversation

@mpawliszyn
Copy link
Copy Markdown
Collaborator

Summary

  • Captures design decisions for building a real Kotlin/Misk test corpus for fowlcon agent and script testing
  • The corpus is a working bird sanctuary API ("Hawksbury") living as a subtree, extracted at test time via git filter-repo for full agent isolation
  • Documents ~10 PR scenario types, two testing modes (blind/aware), and the "fakes not mocks" philosophy

Status

Design in progress. Key open questions remain:

  • How agents receive PR data without real GitHub PRs
  • What defines "correct" output per scenario
  • Test harness invocation strategy

Test plan

  • Review design doc for completeness and sanitization
  • Resolve open questions before implementation begins

🤖 Generated with Claude Code

Captures design decisions from brainstorming session for a real
Kotlin/Misk test corpus that lives as a subtree in tests/corpus/hawksbury/.
Key decisions: fakes not mocks, subtree with git filter-repo extraction,
immutable main with narrative history, ~10 PR scenarios, blind/aware
testing modes. Several open questions remain (PR data delivery,
evaluation criteria, agent invocation).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@mpawliszyn mpawliszyn marked this pull request as ready for review February 27, 2026 02:24
@mpawliszyn mpawliszyn merged commit af5fa9a into main Feb 27, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant