Skip to content

Smoke Test: Claude - 22490809219 #18706

Description

@github-actions

Summary

Smoke test run for Claude engine validation. PR used for review tests: #18692 (feat: update command always updates core actions).

Overall Status: PARTIAL — all core tests passed; push to PR branch failed due to sandbox firewall restrictions.

Run: §22490809219
Timestamp: 2026-02-27T14:49:00Z


Core Test Results (#1–10)

# Test Status
1 GitHub MCP — last 2 merged PRs ✅ PR #18699, #18698 returned
2 SafeInputs GH CLI — pr list --limit 2 #18701, #18693 returned
3 Serena MCP — activate project + find_symbol (≥3) UpdateActionsInWorkflowFiles, isCoreAction, RunUpdateWorkflows + 2 test fns
4 Make build ✅ Build succeeded
5 Playwright — navigate to github.com, verify title ✅ Title: "GitHub · Change is constant..."
6 Tavily — search "GitHub Agentic Workflows" ✅ 3 results returned
7 File writing — create smoke test file /tmp/gh-aw/agent/smoke-test-claude-22490809219.txt created
8 Bash — cat verify file ✅ Content verified
9 Discussion interaction — query + comment ✅ Discussion #18697 found
10 Agentic Workflows MCP — status smoke-claude smoke-claude active, compiled, pull_request trigger
AW Status Details
{"workflow":"smoke-claude","engine_id":"claude","compiled":"Yes","status":"active","on":{"pull_request":{"names":["smoke"],"types":["labeled"]},"reaction":"heart","schedule":"every 12h"}}
```

</details>

---

### PR Review Test Results (#11–17)

PR used: **#18692**

| # | Test | Status |
|---|------|--------|
| 11 | Update PR body (append) | ✅ Appended "✨ PR Review Safe Output Test - Run 22490809219" |
| 12 | PR review comments (2 inline) | ✅ 2 comments on changeset files |
| 13 | Submit PR review | ✅ COMMENT review submitted |
| 14 | Resolve review thread | ✅ Thread `PRRT_kwDOPc1QR85xMROk` resolved |
| 15 | Add reviewer | ✅ `copilot` added as reviewer |
| 16 | Push to PR branch | ❌ Failed: firewall blocked fetch of remote ref |
| 17 | Close test PR | ⚠️ Skipped — no safe test PR to close |

<details>
<summary><b>Test #16 Error Details</b></summary>

```
Cannot generate incremental patch: failed to fetch origin/copilot/update-core-actions-to-latest.
fatal: couldn't find remote ref copilot/update-core-actions-to-latest

This is expected in the sandboxed environment where outbound git fetch is restricted by the network firewall.


References:

💥 [THE END] — Illustrated by Smoke Claude

  • expires on Feb 27, 2026, 4:55 PM UTC

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions