Skip to content

Latest commit

 

History

History
152 lines (114 loc) · 6.45 KB

README.md

File metadata and controls

152 lines (114 loc) · 6.45 KB
Raw

actions-test build-test

setup-job-workspace-action

An action creating a virtual workspace directory for each job. It is useful when using self-hosted runner with large size of repository.

Usage

jobs:
  default:
    runs-on: [self-hosted]
    steps:
      # Must use before actions/checkout
      - uses: DeNA/setup-job-workspace-action@v2
      - uses: actions/checkout@v3

      # ... your build steps

  given_dir_name:
    runs-on: [self-hosted]
    steps:
      - uses: DeNA/setup-job-workspace-action@v2
        with:
          # You can change workspace name from default: ${workflow-yaml-name}-${job-name}
          workspace-name: foo_bar_workspace
      - uses: actions/checkout@v3

      # ... your build steps

  given_dir_name_dynamically:
    runs-on: [self-hosted]
    steps:
      # If you want to change workspace-name dynamically, actions/github-script or run bash script is useful.
      # This example changes workspace-name by branch name when triggered by "workflow_dispatch".
      - uses: actions/github-script@v6
        id: set-workspace-name
        with:
          result-encoding: string
          script: |
            const branch = context.ref.split('/').slice(2).join('/')
            return (context.eventName === "workflow_dispatch")
              ? `manual_trigger_${branch}`
              : "default"
      - uses: DeNA/setup-job-workspace-action@v2
        with:
          workspace-name: ${{ steps.set-workspace-name.outputs.result }}
      - uses: actions/checkout@v3

      # ... your build steps

  with_prefix_and_suffix:
    runs-on: [self-hosted]
    steps:
      - uses: DeNA/setup-job-workspace-action@v2
        with:
          # You can set prefix and suffix to default workspace name and also `workspace-name`.
          # ex: "prefix-${workflow-yaml-name}-${job-name}-suffix"
          prefix: "prefix-"
          suffix: "-suffix"
      - uses: actions/checkout@v3

      # ... your build steps

Example

Below is Unity build example. Unity build takes a long time if missing Library, so we want to keep it between jobs. This action can solve this problem by creating a virtual workspace directory per runner & workflow basis.

jobs:
  unity:
    runs-on: [self-hosted]
    steps:
      - name: Switch workspace
        uses: DeNA/setup-job-workspace-action@v2
        with:
          # Change path by build option
          suffix: "${{ (inputs.enable_XXX && '-XXX') || '' }}"
      - uses: actions/checkout@v3
        with:
          # Clean everything by build option
          clean: ${{ inputs.clean || false }}
      - name: Git clean without Library
        run: git clean -xffd --exclude Library
      # ... your build steps

Options

See action.yml

Notice

Default workspace name is different for older runner version.

workspace-name default is ${workflow-yaml-name}-${job-name}, but when self-hosted runner version is older than actions/[email protected] defalut is ${workflow-name}-${job-name}.

This defference comes from technical reason that how to get workflow yaml name. First, try to get yaml name from GITHUB_WORKFLOW_REF environment variable that exposed from runner version v2.300.0 . When this action detect runs on older runner case that like using GHES, this actions fallback to use GITHUB_WORKFLOW for create default workspace-name. GITHUB_WORKFLOW is equal to workflow name.

If you want to keep the same workspace name between different versions of the runner or for future version upgrades, specify the workspace-name option explicitly.

How it works

GitHub Actions runner only has one workspace directory per repository ($GITHUB_WORKSPACE). That path is defined by the repository name, for example the workspace path of this repository is /home/runner/work/setup-job-workspace-action/setup-job-workspace-action in GitHub hosted Ubuntu runner.

This action creates a new virtual workspace directory and replaces $GITHUB_WORKSPACE as symlink that target to it. So GitHub Actions runner treats the new virtual workspace as a job workspace, it is possible to separate workspace for each job like Jenkins by creating a virtual workspace per job.

That hack can make in two phases that have a few simple commands.

Phase 1: Create virtual workspace directory and symlink before actions/checkout.

mv ${GITHUB_WORKSPACE} ${GITHUB_WORKSPACE}.bak
TMP_DIR="${RUNNER_WORKSPACE}/${WORKFLOW_YAML}-${{ github.job }}"
mkdir -p ${TMP_DIR}
ln -s "${TMP_DIR}" ${GITHUB_WORKSPACE}

Phase 2: Restore original $GITHUB_WORKSPACE after complete job.

unlink ${GITHUB_WORKSPACE}
mv ${GITHUB_WORKSPACE}.bak ${GITHUB_WORKSPACE}

Why need it

When using GitHub-hosted runner, a new VM is given for each job. On the other hand, self-hosted runner runs on the same machine, a single workspace($GITHUB_WORKSPACE) is used for jobs that in the same repository. actions/checkout cleans workspace before checkout using git clean -ffdx in default, it works fine for a normal sized repository.

However, there are some problems when repository size is too large. Some of the workflows will download large binary tools for a current build and output large build cache for the next build, so actions/checkout default cleaning is inefficient sometimes.

And also some git options like sparse checkout are very efficient if your job only need a few files and size of repository is too large. However, git clone and git fetch performance can be problem because self-hosted runner has only one workspace and actions/checkout does not support some advanced git options.

This problem can be solved if each job has its own workspace and can reuse .git/ created by advanced git options. Jenkins has been successful in this way for a long time. setup-job-workspace-action also realizes it on GitHub Actions.

Development

npm run build
npm run test

You should bundle to update dist then commit them before create pull-request.

npm run package
#or
npm run all