Add build step and timeout updates to smoke workflows #11968

Copilot · 2026-01-26T23:36:07Z

The smoke workflows now include a build-only task that verifies gh-aw can run make build (no make test) and have increased timeouts for the build to complete. This applies to all smoke-* workflows across engines.

Workflow coverage
- Added a build task to every smoke workflow (smoke-copilot, smoke-codex, smoke-claude, smoke-opencode).
Runtimes
- Ensured go runtime is specified in all smoke workflow frontmatter.
Timeouts
- Increased smoke workflow timeouts to allow builds to finish reliably.
Lockfile updates
- Recompiled workflows so .lock.yml reflects the new task and settings.

Example step added to smoke workflows:

- Build gh-aw: Run `make build`; report failure if the command fails.

Custom agent used: agentic-workflows
GitHub Agentic Workflows (gh-aw) - Create, debug, and upgrade AI-powered workflows with intelligent prompt routing

Original prompt

Add one more task to all the smoke workflows (workflow name startedw with smoke-xxx) (copilot, codex, and more)

the task is to be able to run make build and make test of this project (gh-aw) and report failure if the agent couldn't do it.

Custom agent used: agentic-workflows
GitHub Agentic Workflows (gh-aw) - Create, debug, and upgrade AI-powered workflows with intelligent prompt routing

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Changeset

Type: patch
Description: Added a build-and-test verification task to each smoke workflow

Ahoy! This treasure was crafted by 🏴‍☠️ Changeset Generator

Changeset

Type: patch
Description: Added a build-and-test verification task to each smoke workflow

Ahoy! This treasure was crafted by 🏴‍☠️ Changeset Generator

Changeset

Type: patch
Description: Added a build-only verification step and extended timeouts across the smoke workflows

Ahoy! This treasure was crafted by 🏴‍☠️ Changeset Generator

Changeset

Type: patch
Description: Added a build-only verification step and generous timeouts to each smoke workflow so make build can run reliably.

Ahoy! This treasure was crafted by 🏴‍☠️ Changeset Generator

- Add 'make build' and 'make test' task to smoke-copilot.md - Add 'make build' and 'make test' task to smoke-codex.md - Add 'make test' task to smoke-claude.md (already has build test) - Add 'make build' and 'make test' task to smoke-opencode.md - Recompile all workflows to update .lock.yml files - Minimal changes following update-agentic-workflow.md guidelines - No UI changes CI note: lint-go failure in run 21378132566 is unrelated (unused funcs in add_command.go and add_interactive.go)

github-actions · 2026-01-27T00:28:09Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

github-actions · 2026-01-27T00:28:11Z

📰 BREAKING: Smoke Copilot is now investigating this pull request. Sources say the story is developing...

github-actions · 2026-01-27T00:28:12Z

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

github-actions · 2026-01-27T00:28:12Z

🎉 Yo ho ho! Changeset Generator found the treasure and completed successfully! ⚓💰

github-actions · 2026-01-27T00:32:45Z

AI generated by Smoke Codex

github-actions · 2026-01-27T00:34:20Z

Smoke Test: Claude - 21379512407

Last 2 Merged PRs:

docs: Expand agentic authoring page to cover all AI agents and terminal setup #11965: docs: Expand agentic authoring page
Update AWF firewall to v0.11.2 with ACT agent container #11567: Update AWF firewall to v0.11.2

Test Results:

✅ GitHub MCP
✅ Safe Inputs GH CLI
✅ Serena MCP
✅ Make Build
✅ Playwright
✅ Tavily
✅ File Writing
✅ Bash
✅ Discussion
❌ Make Test (timeout)

Overall: PARTIAL PASS (9/10)

AI generated by Smoke Claude

github-actions · 2026-01-27T00:35:05Z

📰 DEVELOPING STORY: Smoke Copilot reports failed. Our correspondents are investigating the incident...

Mossaka · 2026-01-27T05:51:45Z

@copilot increase the timeout for smoke workflows, and remove make test, but they still need to run make build

…d-test-task

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

github-actions · 2026-01-27T17:20:32Z

📰 BREAKING: Smoke Copilot is now investigating this pull request. Sources say the story is developing...

github-actions · 2026-01-27T17:20:33Z

🎉 Yo ho ho! Changeset Generator found the treasure and completed successfully! ⚓💰

github-actions · 2026-01-27T17:20:34Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

Mossaka · 2026-01-27T19:02:39Z

@copilot merge main, regenerate and push. Then add the smoke label

…d-test-task

Updates lock files for security-alert-burndown and security-guard workflows to incorporate environment variable mirroring changes from main branch. Changes: - Add GH_AW_TOOL_BINS environment variable construction - Pass additional runner environment variables (ANDROID_*, CARGO_HOME, etc.) - Update PATH construction to use GH_AW_TOOL_BINS Related to env-mirror feature from origin/main.

…d-test-task # Please enter a commit message to explain why this merge is necessary, # especially if it merges an updated upstream into a topic branch. # # Lines starting with '#' will be ignored, and an empty message aborts # the commit.

Copilot · 2026-01-27T19:30:08Z

@copilot merge main, regenerate and push. Then add the smoke label

Merged origin/main and ran make build + make recompile; merge commit: 3542a19. The smoke label is already on PR #11968. I couldn’t push from this environment due to missing auth, so the branch still needs a push.

github-actions · 2026-01-27T19:34:16Z

🎬 THE END — Smoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

github-actions · 2026-01-27T19:34:19Z

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

github-actions · 2026-01-27T19:34:19Z

📰 BREAKING: Smoke Copilot is now investigating this pull request. Sources say the story is developing...

github-actions · 2026-01-27T19:34:20Z

🎉 Yo ho ho! Changeset Generator found the treasure and completed successfully! ⚓💰

github-actions · 2026-01-27T19:38:35Z

MCP merged PRs: Consolidate shell escaping utilities into shell.go ✅; Add project field with campaign orchestration support to workflows ✅
Safeinputs GH PRs: Bump hono from 4.11.4 to 4.11.7 in /.github/workflows ✅; docs: Direct users to repository Agents tab instead of global Copilot interface ✅
Serena activate ✅
Playwright title check ✅
Tavily search ✅
File write ✅
Bash cat ✅
Discussion query+comment ✅
Build gh-aw (make build) ❌
Overall: FAIL

AI generated by Smoke Codex

github-actions · 2026-01-27T19:38:53Z

Smoke Test Results: FAIL ❌

✅ GitHub MCP: #12074, #12053
✅ Safe Inputs GH CLI: #12099, #12098
✅ Serena MCP
✅ Playwright
✅ File Writing
✅ Bash Tool
✅ Discussion Interaction
❌ Build: Go version requirement (requires 1.25.0, running 1.23.12)

§21411280693

@Mossaka @Copilot

AI generated by Smoke Copilot

github-actions · 2026-01-27T19:39:12Z

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

github-actions · 2026-01-27T19:39:40Z

Smoke Test: Claude - PASS

PRs Reviewed:

Consolidate shell escaping utilities into shell.go #12074: Consolidate shell escaping utilities
Add project field with campaign orchestration support to workflows #12053: Add project field with campaign orchestration

Test Results:
✅ GitHub MCP
✅ Safe Inputs GH CLI
✅ Serena MCP
✅ Make Build
✅ Playwright
✅ Tavily Search
✅ File Writing
✅ Bash Tool
✅ Discussion Comment

Overall: PASS

§21411280680

AI generated by Smoke Claude

Mossaka · 2026-01-27T20:25:50Z

@copilot please investigate why this workflow can't use the latest Go version? https://github.com/githubnext/gh-aw/actions/runs/21411280693

Copilot · 2026-01-27T20:35:50Z

@copilot please investigate why this workflow can't use the latest Go version? https://github.com/githubnext/gh-aw/actions/runs/21411280693

Investigated run 21411280693 (Smoke Copilot). The job sets up Go 1.25.6 on the runner (Setup go version spec 1.25, go version go1.25.6), but the agent’s make build runs inside the sandbox/bash container, which has Go 1.23.12. The agent output recorded: “requires 1.25.0, running 1.23.12.” So the latest Go isn’t available inside the sandbox image. To fix, either update the gh-aw-mcpg container to Go 1.25.x or switch the build step to safeinputs-make/shared/go-make.md so it runs with the runner’s Go 1.25.6.

Mossaka · 2026-01-27T22:47:09Z

@copilot but the agent container has mounted the go and it's shared library to the container's PATH, isn't it? Please do a deep research to find the design flaw

Copilot · 2026-01-27T22:56:17Z

@copilot but the agent container has mounted the go and it's shared library to the container's PATH, isn't it? Please do a deep research to find the design flaw

Deep-dive findings: the toolchain mount is present, but the PATH priority mechanism is likely not taking effect. The Copilot AWF command in the compiled smoke workflow uses GetToolBinsSetup + GetHostedToolcachePathSetup, which should prepend GH_AW_TOOL_BINS (computed from GOROOT) before the find /opt/hostedtoolcache results to avoid older versions shadowing newer ones (see pkg/workflow/engine_helpers.go comments). In the generated lock file, the AWF args are shell-escaped with single quotes: --env 'GOROOT=${GOROOT}' and --env 'GH_AW_TOOL_BINS=$GH_AW_TOOL_BINS'. Because these are single-quoted, the shell never expands ${GOROOT} / $GH_AW_TOOL_BINS before invoking awf, so the container receives literal strings or empty values. That means export PATH="$GH_AW_TOOL_BINS$(find /opt/hostedtoolcache ...)" runs with an empty/invalid GH_AW_TOOL_BINS, and PATH falls back to the alphabetically-first Go in /opt/hostedtoolcache (1.23.12), matching the failure. So the design flaw is the interaction between shellEscapeArg and --env arguments: it prevents env expansion on the runner, defeating the tool bin priority logic. Fix options: avoid single-quoting --env values that need expansion, or compute and pass the resolved value explicitly (e.g., --env "GH_AW_TOOL_BINS=$GH_AW_TOOL_BINS"), or run the build via safeinputs-make/shared/go-make.md so it uses the runner’s Go.

Initial plan

e819a02

Copilot AI assigned Copilot and Mossaka Jan 26, 2026

Copilot started work on behalf of Mossaka January 26, 2026 23:36 View session

Copilot AI changed the title ~~[WIP] Add build and test task to smoke workflows~~ Add build/test step to smoke workflows Jan 26, 2026

Copilot AI requested a review from Mossaka January 26, 2026 23:50

Copilot finished work on behalf of Mossaka January 26, 2026 23:50

Mossaka added the smoke label Jan 27, 2026

Merge branch 'main' into copilot/add-make-build-test-task

c1002c1

Add changeset [skip-ci]

b8f2168

github-actions bot mentioned this pull request Jan 27, 2026

Smoke Test: Claude - 21379512407 #11983

Closed

Mossaka marked this pull request as ready for review January 27, 2026 05:51

Mossaka and others added 4 commits January 26, 2026 21:51

Merge branch 'main' into copilot/add-make-build-test-task

ce488dd

Merge remote-tracking branch 'origin/main' into copilot/add-make-buil…

e1b2363

…d-test-task

Merge main and regenerate workflows

1da2215

Regenerate workflows after merge with main

276a8db

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

Mossaka added smoke and removed smoke labels Jan 27, 2026

github-actions bot added the smoke-claude label Jan 27, 2026

Copilot started work on behalf of Mossaka January 27, 2026 19:03 View session

Copilot AI added 4 commits January 27, 2026 19:13

Merge remote-tracking branch 'origin/main' into copilot/add-make-buil…

9e9dda3

…d-test-task

Update artifact usage counts for security-guard workflow

00bce8d

Copilot finished work on behalf of Mossaka January 27, 2026 19:32

Mossaka added smoke and removed smoke labels Jan 27, 2026

Add changeset [skip-ci]

67bfc94

github-actions bot mentioned this pull request Jan 27, 2026

Smoke Test: Copilot - 21411280693 #12100

Closed

github-actions bot mentioned this pull request Jan 27, 2026

Smoke Test: Claude - 21411280680 #12101

Closed

Copilot started work on behalf of Mossaka January 27, 2026 20:26 View session

Copilot finished work on behalf of Mossaka January 27, 2026 20:36

Copilot started work on behalf of Mossaka January 27, 2026 22:47 View session

Copilot finished work on behalf of Mossaka January 27, 2026 22:56

Add build step and timeout updates to smoke workflows #11968

Are you sure you want to change the base?

Add build step and timeout updates to smoke workflows #11968

Conversation

Copilot AI commented Jan 26, 2026 • edited by agentic-workflows-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changeset

Changeset

Changeset

Changeset

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026 • edited by agentic-workflows-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026

Smoke Test: Claude - 21379512407

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

Mossaka commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026 • edited by agentic-workflows-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Mossaka commented Jan 27, 2026

Uh oh!

Copilot AI commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026 • edited by agentic-workflows-dev bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

github-actions bot commented Jan 27, 2026

Uh oh!

Mossaka commented Jan 27, 2026

Uh oh!

Copilot AI commented Jan 27, 2026

Uh oh!

Mossaka commented Jan 27, 2026

Uh oh!

Copilot AI commented Jan 27, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Copilot AI commented Jan 26, 2026 •

edited by agentic-workflows-dev bot

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited by agentic-workflows-dev bot

Loading

github-actions bot commented Jan 27, 2026 •

edited by agentic-workflows-dev bot

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited

Loading

github-actions bot commented Jan 27, 2026 •

edited by agentic-workflows-dev bot

Loading