Smoke Test: Claude - 21784684434 #14410
Description
Test Results
| Test | Status |
|---|---|
| GitHub MCP - Review last 2 merged PRs | ✅ |
| Safe Inputs GH CLI - Query 2 PRs | ✅ |
| Serena MCP - Activate project and find symbols | ✅ |
| Make Build - Build project | ✅ |
| Playwright - Navigate to GitHub | ✅ |
| Tavily - Search for GitHub Agentic Workflows | ✅ |
| File Writing - Create test file | ✅ |
| Bash Tool - Verify file creation | ✅ |
| Discussion Interaction - Comment on latest discussion | ✅ |
| Agentic Workflows MCP - Query workflow status | ✅ |
Overall Status
PASS - All 10 tests completed successfully.
Details
GitHub MCP Testing
Successfully retrieved last 2 merged pull requests from github/gh-aw:
- Fix agent import test for runtime-import macro behavior #14401: "Fix agent import test for runtime-import macro behavior"
- Support per-plugin MCP environment variable configuration #14381: "Support per-plugin MCP environment variable configuration"
Safe Inputs GH CLI Testing
Successfully queried 2 pull requests using the safeinputs-gh tool:
- [WIP] Investigate and fix transient failures of Security Guard Agent #14405: "[WIP] Investigate and fix transient failures of Security Guard Agent"
- Fix SC2086 shellcheck errors: Quote variables in generated shell scripts #14403: "Fix SC2086 shellcheck errors: Quote variables in generated shell scripts"
Serena MCP Testing
- Project activated at
/home/runner/work/gh-aw/gh-aw - Programming languages detected: go, typescript, bash
- Symbol search for "main" returned 180+ results across Go, JavaScript, and shell files
- ✅ Verified at least 3 symbols found
Make Build Testing
Build completed successfully:
- Action pins synced
- Action scripts synced
- Binary built:
gh-aw(version: 76469f9)
Playwright Testing
- Successfully navigated to https://github.com
- Page title verified: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub"
- ✅ Page title contains "GitHub"
Tavily Web Search Testing
Search for "GitHub Agentic Workflows" returned 5 results:
- arunpshankar/Agentic-Workflow-Patterns (score: 0.9999933)
- Agentic Workflows - GitHub Next (score: 0.9999895)
- github/gh-aw: GitHub Agentic Workflows (score: 0.99998856)
- githubnext/agentics samples (score: 0.9999789)
- GitHub Agentic Workflows docs (score: 0.9999627)
File Writing Testing
Created test file: /tmp/gh-aw/agent/smoke-test-claude-21784684434.txt
Content: "Smoke test passed for Claude at Sat Feb 7 18:21:19 UTC 2026"
Bash Tool Testing
Successfully verified file creation using cat command.
File content matches expected output with correct timestamp.
Discussion Interaction Testing
- Retrieved latest discussion ([copilot-cli-research] Copilot CLI Deep Research - February 2026 #14378) using github-discussion-query safe-input tool
- Successfully added a comic-book style comment to the discussion
- ✅ Discussion comment interaction successful
Agentic Workflows MCP Testing
Successfully queried workflow status for "smoke-claude":
- Workflow: smoke-claude
- Engine: claude
- Compiled: Yes
- Status: active
- Triggers: pull_request (labeled:smoke), reaction:heart, schedule (every 12h), workflow_dispatch
Status written to: /tmp/gh-aw/agent/smoke-claude-status-21784684434.txt
Run Information
- Run URL: https://github.com/github/gh-aw/actions/runs/21784684434
- Timestamp: February 7, 2026, 18:22 UTC
- Engine: Claude Sonnet 4.5 (claude-sonnet-4-5-20250929)
AI generated by Smoke Claude for #14403
- expires on Feb 7, 2026, 8:24 PM UTC