Smoke Test: Claude - 22733626450 #19759
Description
Summary
Smoke test run for Claude engine validation. Overall status: PARTIAL (1 test failed, 1 skipped).
PR used for PR review testing: #18403 (feat/opencode-engine)
Core Test Results
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — list 2 merged PRs | ✅ Got #19743, #19738 |
| 2 | safeinputs-gh — query 2 PRs | ✅ Got #19755, #19753 |
| 3 | Serena MCP — activate project | ✅ Activated /home/runner/work/gh-aw/gh-aw |
| 3b | Serena MCP — find_symbol | ❌ EOF connection errors (3 attempts) |
| 4 | Make build | ✅ go build succeeded |
| 5 | Playwright — github.com title | ✅ Title: "GitHub · Change is constant..." |
| 6 | Tavily web search | ✅ 3 results for "GitHub Agentic Workflows" |
| 7 | File creation | ✅ /tmp/gh-aw/agent/smoke-test-claude-22733626450.txt |
| 8 | Bash verification | ✅ cat confirmed file contents |
| 9 | Discussion interaction | ✅ Added comic-book comment to #19752 |
| 10 | Agentic Workflows MCP status | ✅ smoke-claude: active, compiled=Yes, schedule=every 12h |
PR Review Test Results
| # | Test | Result |
|---|---|---|
| 11 | Update PR body | ✅ Appended test message to #18403 |
| 12 | PR Review Comments (2) | ✅ Comments on opencode_engine.go:28 and domains.go:157 |
| 13 | Submit PR Review | ✅ COMMENT review submitted |
| 14 | Resolve Review Thread | ✅ Resolved PRRT_kwDOPc1QR85wx5-7 |
| 15 | Add Reviewer | ✅ Added copilot as reviewer |
| 16 | Push to PR Branch | ✅ Pushed action_pins.json sync commit |
| 17 | Close PR |
Failure Details
Test 3b — Serena find_symbol: After successfully activating the project, all find_symbol calls returned EOF connection errors. The Serena language server appears to have closed its connection after project activation. Onboarding was not yet performed, which may have contributed.
Run Info
- Run URL: §22733626450
- Timestamp: 2026-03-05T19:49:00Z
- Branch:
feat/opencode-engine - Engine: Claude Sonnet 4.6
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 5, 2026, 9:54 PM UTC