Smoke Test: Claude - 22734274394 #19763
Description
Summary
Smoke test run for Claude engine. Overall status: PARTIAL (some tests skipped).
Run URL: https://github.com/github/gh-aw/actions/runs/22734274394
Timestamp: 2026-03-05T20:08:00Z
PR used for review testing: #18403 (feat/opencode-engine)
Core Tests (#1–10)
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs (#19743, #19738) | ✅ |
| 2 | safeinputs-gh — pr list --limit 2 (#19755, #19753) |
✅ |
| 3 | Serena MCP — activate project + find_symbol (50+ symbols) | ✅ |
| 4 | Make build | ✅ |
| 5 | Playwright — navigate to github.com, title contains "GitHub" | ✅ |
| 6 | Tavily search — "GitHub Agentic Workflows" (3 results) | ✅ |
| 7 | File write — /tmp/gh-aw/agent/smoke-test-claude-22734274394.txt |
✅ |
| 8 | Bash — cat verified file content |
✅ |
| 9 | Discussion interaction — comment added to discussion #19758 | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude status: active, compiled |
✅ |
PR Review Safe Output Tests (#11–17)
| # | Test | Status |
|---|---|---|
| 11 | Update PR body — appended test message | ✅ |
| 12 | PR review comments — 2 comments on opencode_engine.go and opencode_mcp.go |
✅ |
| 13 | Submit PR review — COMMENT submitted | ✅ |
| 14 | Resolve review thread — skipped (PRRT node IDs unavailable without GraphQL) | |
| 15 | Add reviewer — copilot added to PR #18403 |
✅ |
| 16 | Push to PR branch — .github/smoke-tests/smoke-test-22734274394.md pushed |
✅ |
| 17 | Close PR — skipped (triggering PR, unsafe to close) |
Notes
- Test 14: GitHub review thread node IDs (PRRT_...) require GraphQL access not supported by available safeinputs-gh multi-arg commands.
- Test 17: PR feat: add OpenCode engine integration #18403 is the triggering PR — not closed per safety guidelines.
References: §22734274394
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 5, 2026, 10:10 PM UTC