Skip to content

Add end-to-end installation test to install.yml workflow - #6137

Merged
pelikhan merged 4 commits into
mainfrom
copilot/add-install-script-test
Dec 11, 2025
Merged

Add end-to-end installation test to install.yml workflow#6137
pelikhan merged 4 commits into
mainfrom
copilot/add-install-script-test

Conversation

Copilot AI commented Dec 11, 2025

Copy link
Copy Markdown
Contributor

Add Full Install Script Test

  • Understand the problem: The current workflow only tests with dummy version, needs full installation test
  • Add a new step in .github/workflows/install.yml to test the full installation without dummy version
  • Ensure the new step runs after the platform detection test
  • Verify the new step actually installs and validates the binary
  • Fix script error with retry logic for transient failures
  • Remove macOS-13 from matrix

Summary

Successfully added comprehensive end-to-end test for the install script and improved resilience:

New Test Step:

  • Runs full installation flow by executing install-gh-aw.sh without version argument
  • Downloads latest release from GitHub
  • Verifies binary installation, permissions, and functionality
  • Tests on all supported platforms

Install Script Improvements:

  • Added retry logic with exponential backoff (3 attempts: 2s, 4s, 8s delays)
  • Handles transient download failures like 503 errors gracefully
  • Clear warning messages on retry attempts

Test Matrix Updates:

  • Removed macOS-13 (Intel) as requested
  • Tests run on: ubuntu-latest, ubuntu-22.04, macos-latest (ARM), windows-latest

Reference: https://github.com/githubnext/gh-aw/actions/runs/20134752288/job/57788102877

Original prompt

Add step that runs the install script without a dummy version number to test full script.

Reference: https://github.com/githubnext/gh-aw/actions/runs/20134752288/job/57788102877


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 2 commits December 11, 2025 14:08
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Added a new test step that runs the full installation script without a dummy version number to test the complete installation flow. This step:
- Downloads the latest release from GitHub
- Installs the binary to the expected location
- Verifies the binary exists and is executable
- Tests the version and help commands work correctly

The test runs on all supported platforms (Ubuntu, macOS, Windows) after the platform detection test.

Reference: https://github.com/githubnext/gh-aw/actions/runs/20134752288/job/57788102877

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Add step to run install script without dummy version Add end-to-end installation test to install.yml workflow Dec 11, 2025
Copilot AI requested a review from pelikhan December 11, 2025 14:15
@pelikhan

Copy link
Copy Markdown
Collaborator

@copilot

- Add retry logic with exponential backoff (3 attempts, 2s/4s/8s delays) to handle transient download failures like 503 errors
- Remove macOS-13 from test matrix as requested
- Update test script to verify retry logic implementation

Fixes: https://github.com/githubnext/gh-aw/actions/runs/20135912025/job/57790530332

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI commented Dec 11, 2025

Copy link
Copy Markdown
Contributor Author

@copilot

Fixed in 8e90f85:

  1. Added retry logic - Install script now retries downloads 3 times with exponential backoff (2s, 4s, 8s delays) to handle transient 503 errors
  2. Removed macOS-13 - Eliminated from test matrix

The script will now gracefully handle temporary GitHub infrastructure issues instead of failing immediately.

@pelikhan
pelikhan marked this pull request as ready for review December 11, 2025 14:34
@pelikhan
pelikhan merged commit 473bce5 into main Dec 11, 2025
56 checks passed
@pelikhan
pelikhan deleted the copilot/add-install-script-test branch December 11, 2025 14:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants