|  | 
|  | 1 | +The `@cypress/extract-cloud-results` helper cross-references some environment variables from where it is executed with ones that were present when a Cypress Cloud run was recorded. This allows for automatically detecting the correct Cloud run when the Results API is invoked from the same CI context as a given run (as is the case in the above examples). | 
|  | 2 | + | 
|  | 3 | +For more complex setups, or for local iteration on your Results API handler code, it can be useful to know what variables Cypress is looking for so that you can make sure they are passed through where they are needed. | 
|  | 4 | + | 
|  | 5 | +Likewise, if you want to use the Results API locally to pull the data for a specific run (within the last 7 days), you can set these variables locally to match what was present in CI. | 
|  | 6 | + | 
|  | 7 | +## Local development example | 
|  | 8 | + | 
|  | 9 | +If you executed a run in GitHub Actions and it was recorded to Cypress Cloud, you would set these 4 environment variables to replicate the context of that run locally and execute your local handler script. This is a great way to iterate on your script and verify everything is working as expected, without having to integrate anything in CI. It's also useful for debugging. | 
|  | 10 | + | 
|  | 11 | +``` | 
|  | 12 | +CYPRESS_PROJECT_ID=AAA | 
|  | 13 | +CYPRESS_RECORD_KEY=BBB | 
|  | 14 | +GITHUB_ACTIONS=true | 
|  | 15 | +GITHUB_RUN_ID=111 | 
|  | 16 | +GITHUB_RUN_ATTEMPT=0 | 
|  | 17 | +node verifyAccessibilityResults.js | 
|  | 18 | +``` | 
|  | 19 | + | 
|  | 20 | +The Results API will then look for the Cypress Cloud run that matches this run ID. If there is more than one Cypress Cloud run found for that GitHub Actions Run, you can pass run tags to narrow down to one run's report. | 
|  | 21 | + | 
|  | 22 | +## Supported CI Provider Overview | 
|  | 23 | + | 
|  | 24 | +Each CI provider has a unique combination of components, patterns, and environment variables that must be interpreted by this module. | 
|  | 25 | + | 
|  | 26 | +### GitHub Actions | 
|  | 27 | + | 
|  | 28 | +Reference: https://docs.github.com/en/actions/learn-github-actions/understanding-github-actions | 
|  | 29 | + | 
|  | 30 | +#### Essential environment variables | 
|  | 31 | + | 
|  | 32 | +- `GITHUB_ACTIONS` - Presence identifies the environment as a GitHub Actions environment. | 
|  | 33 | +- `GITHUB_RUN_ID` - Value uniquely identifies a GitHub Actions workflow instance. Value does not change as jobs in the workflow are re-executed. | 
|  | 34 | +- `GITHUB_RUN_ATTEMPT` - Value identifies the workflow instance's attempt index. Value is incremented each time jobs are re-executed. | 
|  | 35 | + | 
|  | 36 | +Full environment variable reference: https://docs.github.com/en/actions/learn-github-actions/variables#default-environment-variables | 
|  | 37 | + | 
|  | 38 | +#### Prerequisites | 
|  | 39 | + | 
|  | 40 | +1. The run to validate and this module's validation script are being executed within the same workflow. | 
|  | 41 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by either: | 
|  | 42 | +   1. Executing the module script in a separate job that is dependent upon the job that records the run (using the `needs: [job-name]` option in the config), or | 
|  | 43 | +   2. Executing the module script in serial with the cypress recording in the same job. | 
|  | 44 | + | 
|  | 45 | +### GitLab Pipelines | 
|  | 46 | + | 
|  | 47 | +Reference: https://docs.gitlab.com/ee/ci/pipelines/ | 
|  | 48 | + | 
|  | 49 | +#### Essential environment variables | 
|  | 50 | + | 
|  | 51 | +- `GITLAB_CI` - Presence identifies the environment as a GitLab CI environment | 
|  | 52 | +- `CI_PIPELINE_ID` - Value uniquely identifies a GitLab pipeline workflow. This value does not change as jobs in the pipeline are retried. | 
|  | 53 | +- `CI_JOB_NAME` - Value uniquely identifies a single job name within a pipeline. Ex. `run-e2e` | 
|  | 54 | +- `CI_JOB_ID` - Value uniquely identifies an execution instance of a job. This value will change each time a job is executed/re-executed. | 
|  | 55 | + | 
|  | 56 | +Full environment variable reference: https://docs.gitlab.com/ee/ci/variables/predefined_variables.html | 
|  | 57 | + | 
|  | 58 | +#### Prerequisites | 
|  | 59 | + | 
|  | 60 | +1. The run to validate and this module's validation script are being executed within the same pipeline. | 
|  | 61 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by: | 
|  | 62 | +   1. Executing the module script in a separate job that is dependent upon the job that records the run (using the `needs: [job-name]` option in the config), or | 
|  | 63 | +   2. Executing the module script in a separate job that is executed in a lower stage than the job that records the Cypress run, or | 
|  | 64 | +   3. Executing the module script in serial with the cypress recording in the same job. | 
|  | 65 | + | 
|  | 66 | +### Jenkins | 
|  | 67 | + | 
|  | 68 | +Reference: https://www.jenkins.io/doc/ | 
|  | 69 | + | 
|  | 70 | +Jenkins is heavily customizable through the usage of plugins, which limits the amount of assumptions we can make about available environment variables and overall behavior. | 
|  | 71 | + | 
|  | 72 | +We have implemented Jenkins support within this module using the broadest set of available default values. For the purposes of this documentation, though, we will discuss terms related to Jenkins Pipeline support: https://www.jenkins.io/doc/book/pipeline/getting-started/ | 
|  | 73 | + | 
|  | 74 | +#### Essential terms | 
|  | 75 | + | 
|  | 76 | +#### Essential environment variables | 
|  | 77 | + | 
|  | 78 | +- `JENKINS_HOME` - Presence identifies the environment as a Jenkins environment | 
|  | 79 | +- `BUILD_URL` - Value uniquely identifies a Jenkins job execution, including name and id characteristics. | 
|  | 80 | + | 
|  | 81 | +Full environment variable reference: https://www.jenkins.io/doc/book/pipeline/jenkinsfile/#using-environment-variables | 
|  | 82 | + | 
|  | 83 | +#### Prerequisites | 
|  | 84 | + | 
|  | 85 | +1. The run to validate and this module's validation script are being executed within the same job. | 
|  | 86 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by executing the module script in serial with the cypress recording in the same job. | 
|  | 87 | + | 
|  | 88 | +### Azure | 
|  | 89 | + | 
|  | 90 | +Reference: https://learn.microsoft.com/en-us/azure/devops/pipelines/get-started/key-pipelines-concepts?view=azure-devops | 
|  | 91 | + | 
|  | 92 | +> Note: Cypress v13.13.1 is the earliest Cypress release that records the environment variables necessary for this module to identify runs in an Azure environment. Previous Cypress versions are not supported in Azure pipelines. | 
|  | 93 | +
 | 
|  | 94 | +#### Essential environment variables | 
|  | 95 | + | 
|  | 96 | +- `TF_BUILD` and `AZURE_HTTP_USER_AGENT` - Combined presence identifies the environment as a Azure pipeline environment. | 
|  | 97 | +- `SYSTEM_PLANID` - Value uniquely identifies a pipeline run. Value does not change as jobs within the pipeline are retried from failure. | 
|  | 98 | +- `SYSTEM_JOBID` - Value uniquely identifies a job execution. Value changes each time a job is retried from failure, in conjunction with the `SYSTEM_JOBATTEMPT` being incremented. | 
|  | 99 | +- `SYSTEM_JOBATTEMPT` - Value identifies the pipelines shared attempt index. Value is incremented when jobs are retried from failure. | 
|  | 100 | + | 
|  | 101 | +Full environment variable reference: https://learn.microsoft.com/en-us/azure/devops/pipelines/build/variables?view=azure-devops&tabs=yaml | 
|  | 102 | + | 
|  | 103 | +#### Prerequisites | 
|  | 104 | + | 
|  | 105 | +1. The run to validate and this module's validation script are being executed within the same pipeline run (i.e. they share a `SYSTEM_PLANID` value). | 
|  | 106 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by either: | 
|  | 107 | +   1. Executing the module script in a separate job that is dependent upon the job that records the run (using the `dependsOn: [job-name]` option in the config), or | 
|  | 108 | +   2. Executing the module script in serial with the Cypress recording in the same job. | 
|  | 109 | + | 
|  | 110 | +### CircleCI | 
|  | 111 | + | 
|  | 112 | +Reference: https://circleci.com/docs/about-circleci/ | 
|  | 113 | + | 
|  | 114 | +> Note: Cypress v13.13.1 is the earliest Cypress release that records the environment variables necessary for this module to identify runs in an CircleCI environment. Previous Cypress versions are not supported in CircleCI pipelines. | 
|  | 115 | +
 | 
|  | 116 | +#### Essential environment variables | 
|  | 117 | + | 
|  | 118 | +- `CIRCLECI` - Presence identifies the environment as a CircleCI environment | 
|  | 119 | +- `CIRCLE_PIPELINE_ID` - Value uniquely identifies a CircleCI pipeline, created on push or manually triggered through the UI. This value does not change as workflows within the pipeline are re-executed. | 
|  | 120 | +- `CIRCLE_WORKFLOW_ID` - Value uniquely identifies an instance of a workflow's execution within a pipeline. This value will be updated upon each workflow execution; in other words, retrying a workflow from failure from the Circle UI will create a new workflow with a new `CIRCLE_WORKFLOW_ID` value available to the jobs executed within it. | 
|  | 121 | +- `CIRCLE_WORKFLOW_JOB_ID` - Value uniquely identifies an execution instance of a named job within a workflow instance. | 
|  | 122 | + | 
|  | 123 | +Full environment variable reference: https://docs.gitlab.com/ee/ci/variables/predefined_variables.html | 
|  | 124 | + | 
|  | 125 | +#### Prerequisites | 
|  | 126 | + | 
|  | 127 | +1. The run to validate and this module's validation script are being executed within the same pipeline **and** workflow. | 
|  | 128 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by: | 
|  | 129 | +   1. Executing the module script in a separate job that is dependent upon the job that records the run (using the `requires: [job-name]` option in the config), or | 
|  | 130 | +   2. Executing the module script in serial with the cypress recording in the same job. | 
|  | 131 | + | 
|  | 132 | +### AWS CodeBuild | 
|  | 133 | + | 
|  | 134 | +Reference: https://docs.aws.amazon.com/codebuild/ | 
|  | 135 | + | 
|  | 136 | +#### Essential environment variables | 
|  | 137 | + | 
|  | 138 | +- `CODEBUILD_BUILD_ID` - Presence identifies the environment as an AWS CodeBuild environment. Value uniquely identifies a build. | 
|  | 139 | + | 
|  | 140 | +Full environment variable reference: https://docs.aws.amazon.com/codebuild/latest/userguide/build-env-ref-env-vars.html | 
|  | 141 | + | 
|  | 142 | +Prerequisites | 
|  | 143 | + | 
|  | 144 | +1. The run to validate and this module's validation script are being executed within the same build. | 
|  | 145 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by executing the module script in serial with the cypress recording in the same build. | 
|  | 146 | + | 
|  | 147 | +### Drone | 
|  | 148 | + | 
|  | 149 | +Reference: https://docs.drone.io/pipeline/overview/ | 
|  | 150 | + | 
|  | 151 | +#### Essential environment variables | 
|  | 152 | + | 
|  | 153 | +- `DRONE` - Presence identifies the environment as an Drone environment. | 
|  | 154 | +- `DRONE_BUILD_NUMBER` - Value uniquely identifies a Drone build. | 
|  | 155 | + | 
|  | 156 | +Full environment variable reference: https://docs.drone.io/pipeline/environment/reference/ | 
|  | 157 | + | 
|  | 158 | +#### Prerequisites | 
|  | 159 | + | 
|  | 160 | +1. The run to validate and this module's validation script are being executed within the same build. | 
|  | 161 | +2. The module script is always executed _after_ the run to validate has been created. This can be achieved by executing the module script in serial with the cypress recording in the same build. | 
|  | 162 | + | 
|  | 163 | +In order to iterate on your verification script and see everything working without putting code into your CI environment, it can be useful to simulate the CI context for a specific Cypress run locally. This can save a lot of time when getting started. | 
0 commit comments