Merge pull request #1243 from atlassian/release/8.0.0

Release 8.0.0
atlassian · Jan 18, 2024 · 9c4c301 · 9c4c301
2 parents 344c322 + e381203
commit 9c4c301
Show file tree

Hide file tree

Showing 62 changed files with 1,874 additions and 5,457 deletions.
diff --git a/.gitattributes b/.gitattributes
@@ -0,0 +1 @@
+*.sh        text eol=lf
diff --git a/README.md b/README.md
@@ -5,22 +5,22 @@ This repository contains Taurus scripts for performance testing of Atlassian Dat
 
 ## Supported versions
 * Supported Jira versions: 
-    * Jira [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `9.4.10` and `8.20.26`
+    * Jira [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `9.12.1` and `9.4.14`
 
 * Supported Jira Service Management versions: 
-    * Jira Service Management [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `5.4.10` and `4.20.26`
+    * Jira Service Management [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `5.12.1` and `5.4.14`
 
 * Supported Confluence versions:
-    * Confluence [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `7.19.14` and `8.5.1`
+    * Confluence [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `8.5.4` and `7.19.17`
 
 * Supported Bitbucket Server versions:
-    * Bitbucket Server [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `7.21.16` and `8.9.5`
+    * Bitbucket Server [Long Term Support release](https://confluence.atlassian.com/enterprise/atlassian-enterprise-releases-948227420.html): `8.9.8` and `7.21.20`
 
 * Supported Crowd versions:
-    * Crowd [release notes](https://confluence.atlassian.com/crowd/crowd-release-notes-199094.html): `5.1.4`
+    * Crowd [release notes](https://confluence.atlassian.com/crowd/crowd-release-notes-199094.html): `5.2.2`
 
 * Supported Bamboo versions:
-    * Bamboo [Long Term Support release](https://confluence.atlassian.com/bamboo/bamboo-release-notes-671089224.html): `9.2.5`
+    * Bamboo [Long Term Support release](https://confluence.atlassian.com/bamboo/bamboo-release-notes-671089224.html): `9.2.9`
 
 ## Support
 In case of technical questions, issues or problems with DC Apps Performance Toolkit, contact us for support in the [community Slack](http://bit.ly/dcapt_slack) **#data-center-app-performance-toolkit** channel.
@@ -29,7 +29,7 @@ In case of technical questions, issues or problems with DC Apps Performance Tool
 
 #### Dependencies
 * Python 3.8, 3.9, 3.10 or 3.11 and pip
-* JDK 11
+* JDK 17
 * Google Chrome web browser
 * Git client (only for Bitbucket DC)
 
@@ -41,7 +41,7 @@ If a first part of ChromeDriver version does not match with a first part of your
 Make sure that you have:
 * [Python](https://www.python.org/downloads/) (see [dependencies](#dependencies) section for supported versions)
 * pip
-* [JDK 11](https://www.oracle.com/java/technologies/downloads/#java11) installed
+* [JDK 17](https://www.oracle.com/java/technologies/downloads/#java17) installed
 * XCode Command Line Tools
 * Google Chrome web browser
 ```
@@ -81,7 +81,7 @@ pip install -r requirements.txt
 Make sure that you have:
 * [Python](https://www.python.org/downloads/) (see [dependencies](#dependencies) section for supported versions)
 * pip
-* [JDK 11](https://www.oracle.com/java/technologies/downloads/#java11) installed
+* [JDK 17](https://www.oracle.com/java/technologies/downloads/#java17) installed
 * Python developer package (e.g. `python3.9-dev` package for Python3.9)
 * Google Chrome web browser
 ```
@@ -99,7 +99,7 @@ We recommend using [virtualenv](https://virtualenv.pypa.io/en/latest/) for Tauru
 JDK setup (if missing):
 ```
 sudo apt-get update
-sudo apt-get install -y openjdk-11-jre-headless
+sudo apt-get install -y openjdk-17-jre-headless
 ```
 Chrome setup (if missing):
 ```
@@ -119,7 +119,7 @@ pip install -r requirements.txt
 
 ### Windows setup
 #### Installing Taurus manually
-Make sure you have [Python](https://www.python.org/downloads/) (see [dependencies](#dependencies) section for supported versions), pip, and [JDK 11](https://www.oracle.com/java/technologies/downloads/#java11) installed:
+Make sure you have [Python](https://www.python.org/downloads/) (see [dependencies](#dependencies) section for supported versions), pip, and [JDK 17](https://www.oracle.com/java/technologies/downloads/#java17) installed:
 ```
 python --version or python3 --version
 pip --version

diff --git a/app/bamboo.yml b/app/bamboo.yml
@@ -3,7 +3,7 @@ settings:
   artifacts-dir: results/bamboo/%Y-%m-%d_%H-%M-%S
   aggregator: consolidator
   verbose: false
-  check-updates: false    # disable bzt check for updates
+  check-updates: false                 # disable bzt check for updates
   env:
     application_hostname: test-bamboo.atlassian.com   # Bamboo DC hostname without protocol and port e.g. test-bamboo.atlassian.com or localhost
     application_protocol: http         # http or https
@@ -13,14 +13,15 @@ settings:
     admin_login: admin
     admin_password: admin
     load_executor: jmeter
-    concurrency: 200                   # number of Bamboo users for Selenium actions
+    concurrency: 200                   # number of Bamboo users for Jmeter actions
     test_duration: 45m
     ramp-up: 5m                        # time to spin all concurrent threads
     total_actions_per_hour: 2000       # number of total JMeter actions per hour
     WEBDRIVER_VISIBLE: False
     JMETER_VERSION: 5.5
     LANGUAGE: en_US.utf8
     allow_analytics: Yes               # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
+    environment_compliance_check: True # Pre-test environment compliance validation. Set to "False" to skip it.
     # Action percentage for JMeter load executor
     view_all_builds: 15
     view_build_result: 15
@@ -40,6 +41,7 @@ services:
   - module: shellexec
     prepare:
       - python util/pre_run/environment_checker.py
+      - python util/pre_run/environment_compliance_check.py bamboo
       - python util/data_preparation/bamboo_prepare_data.py
     shutdown:
       - python util/post_run/jmeter_post_check.py
@@ -49,7 +51,7 @@ services:
       - python util/post_run/cleanup_results_dir.py
   - module: pip-install
     packages:
-      - selenium==4.13.0
+      - selenium==4.16.0
 execution:
   - scenario: jmeter
     executor: jmeter
@@ -123,7 +125,7 @@ modules:
       httpsampler.ignore_failed_embedded_resources: "true"
   selenium:
     chromedriver:
-      version: "118.0.5993.70" # Supports Chrome version 118. You can refer to https://googlechromelabs.github.io/chrome-for-testing
+      version: "120.0.6099.109" # Supports Chrome version 120. You can refer to https://googlechromelabs.github.io/chrome-for-testing
 reporting:
 - data-source: sample-labels
   module: junit-xml
diff --git a/app/bitbucket.yml b/app/bitbucket.yml
@@ -3,29 +3,30 @@ settings:
   artifacts-dir: results/bitbucket/%Y-%m-%d_%H-%M-%S
   aggregator: consolidator
   verbose: false
-  check-updates: false    # disable bzt check for updates
+  check-updates: false                 # disable bzt check for updates
   env:
     application_hostname: test_bitbucket_instance.atlassian.com   # Bitbucket DC hostname without protocol and port e.g. test-bitbucket.atlassian.com or localhost
-    application_protocol: http        # http or https
-    application_port: 80              # 80, 443, 8080, 7990 etc
-    secure: True                      # Set False to allow insecure connections, e.g. when using self-signed SSL certificate
-    application_postfix: /bitbucket   # e.g. /bitbucket for TerraForm deployment url like `http://a1234-54321.us-east-2.elb.amazonaws.com/bitbucket`. Leave this value blank for url without postfix.
+    application_protocol: http         # http or https
+    application_port: 80               # 80, 443, 8080, 7990 etc
+    secure: True                       # Set False to allow insecure connections, e.g. when using self-signed SSL certificate
+    application_postfix: /bitbucket    # e.g. /bitbucket for TerraForm deployment url like `http://a1234-54321.us-east-2.elb.amazonaws.com/bitbucket`. Leave this value blank for url without postfix.
     admin_login: admin
     admin_password: admin
-    load_executor: jmeter             # only jmeter executor is supported
-    concurrency: 20                   # number of concurrent virtual users for jmeter scenario
+    load_executor: jmeter              # only jmeter executor is supported
+    concurrency: 20                    # number of concurrent virtual users for jmeter scenario
     test_duration: 50m
-    ramp-up: 10m                      # time to spin all concurrent users
+    ramp-up: 10m                       # time to spin all concurrent users
     total_actions_per_hour: 32700
     WEBDRIVER_VISIBLE: False
     JMETER_VERSION: 5.5
     LANGUAGE: en_US.utf8
-    allow_analytics: Yes              # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
+    allow_analytics: Yes               # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
+    environment_compliance_check: True # Pre-test environment compliance validation. Set to "False" to skip it.
 services:
   - module: shellexec
     prepare:
       - python util/pre_run/environment_checker.py
-      - python util/pre_run/check_for_updates.py
+      - python util/pre_run/environment_compliance_check.py bitbucket
       - python util/pre_run/git_client_check.py
       - python util/data_preparation/bitbucket_prepare_data.py
     shutdown:
@@ -36,7 +37,7 @@ services:
       - python util/post_run/cleanup_results_dir.py
   - module: pip-install
     packages:
-      - selenium==4.13.0
+      - selenium==4.16.0
 execution:
   - scenario: ${load_executor}
     concurrency: ${concurrency}
@@ -90,7 +91,7 @@ modules:
       httpsampler.ignore_failed_embedded_resources: "true"
   selenium:
     chromedriver:
-      version: "118.0.5993.70" # Supports Chrome version 118. You can refer to https://googlechromelabs.github.io/chrome-for-testing
+      version: "120.0.6099.109" # Supports Chrome version 120. You can refer to https://googlechromelabs.github.io/chrome-for-testing
 reporting:
 - data-source: sample-labels
   module: junit-xml
diff --git a/app/confluence.yml b/app/confluence.yml
@@ -3,26 +3,27 @@ settings:
   artifacts-dir: results/confluence/%Y-%m-%d_%H-%M-%S
   aggregator: consolidator
   verbose: false
-  check-updates: false    # disable bzt check for updates
+  check-updates: false                 # disable bzt check for updates
   env:
     application_hostname: test_confluence_instance.atlassian.com   # Confluence DC hostname without protocol, port and postfix e.g. test-confluence.atlassian.com or localhost
-    application_protocol: http        # http or https
-    application_port: 80              # 80, 443, 8080, 1990, etc
-    secure: True                      # Set False to allow insecure connections, e.g. when using self-signed SSL certificate
-    application_postfix: /confluence  # e.g. /confluence for TerraForm deployment url like `http://a1234-54321.us-east-2.elb.amazonaws.com/confluence`. Leave this value blank for url without postfix.
+    application_protocol: http         # http or https
+    application_port: 80               # 80, 443, 8080, 1990, etc
+    secure: True                       # Set False to allow insecure connections, e.g. when using self-signed SSL certificate
+    application_postfix: /confluence   # e.g. /confluence for TerraForm deployment url like `http://a1234-54321.us-east-2.elb.amazonaws.com/confluence`. Leave this value blank for url without postfix.
     admin_login: admin
     admin_password: admin
-    load_executor: jmeter             # jmeter and locust are supported. jmeter by default.
-    concurrency: 200                  # number of concurrent virtual users for jmeter or locust scenario
+    load_executor: jmeter              # jmeter and locust are supported. jmeter by default.
+    concurrency: 200                   # number of concurrent virtual users for jmeter or locust scenario
     test_duration: 45m
-    ramp-up: 5m                       # time to spin all concurrent users
+    ramp-up: 5m                        # time to spin all concurrent users
     total_actions_per_hour: 20000
     WEBDRIVER_VISIBLE: False
     JMETER_VERSION: 5.5
     LANGUAGE: en_US.utf8
-    allow_analytics: Yes              # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
-    # Action percentage for JMeter and Locust load executors
+    allow_analytics: Yes               # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
+    environment_compliance_check: True # Pre-test environment compliance validation. Set to "False" to skip it.
     extended_metrics: False
+    # Action percentage for JMeter and Locust load executors
     view_page: 33
     view_dashboard: 9
     view_blog: 13
@@ -41,7 +42,7 @@ services:
   - module: shellexec
     prepare:
       - python util/pre_run/environment_checker.py
-      - python util/pre_run/check_for_updates.py
+      - python util/pre_run/environment_compliance_check.py confluence
       - python util/data_preparation/confluence_prepare_data.py
     shutdown:
       - python util/post_run/jmeter_post_check.py
@@ -51,7 +52,7 @@ services:
       - python util/post_run/cleanup_results_dir.py
   - module: pip-install
     packages:
-      - selenium==4.13.0
+      - selenium==4.16.0
 execution:
   - scenario: ${load_executor}
     executor: ${load_executor}
@@ -117,7 +118,7 @@ modules:
       httpsampler.ignore_failed_embedded_resources: "true"
   selenium:
     chromedriver:
-      version: "118.0.5993.70" # Supports Chrome version 118. You can refer to https://googlechromelabs.github.io/chrome-for-testing
+      version: "120.0.6099.109" # Supports Chrome version 120. You can refer to https://googlechromelabs.github.io/chrome-for-testing
 reporting:
 - data-source: sample-labels
   module: junit-xml

diff --git a/app/crowd.yml b/app/crowd.yml
@@ -3,41 +3,42 @@ settings:
   artifacts-dir: results/crowd/%Y-%m-%d_%H-%M-%S
   aggregator: consolidator
   verbose: false
-  check-updates: false    # disable bzt check for updates
+  check-updates: false                 # disable bzt check for updates
   env:
     application_hostname: test_crowd_instance.atlassian.com    # Crowd DC hostname without protocol and port e.g. test-crowd.atlassian.com or localhost
-    application_protocol: http      # http or https
-    application_port: 80            # 80, 443, 8080, 4990, etc
-    secure: True                    # Set False to allow insecure connections, e.g. when using self-signed SSL certificate
-    application_postfix: /crowd     # e.g. /crowd in case of url like http://localhost:4990/crowd
+    application_protocol: http         # http or https
+    application_port: 80               # 80, 443, 8080, 4990, etc
+    secure: True                       # Set False to allow insecure connections, e.g. when using self-signed SSL certificate
+    application_postfix: /crowd        # e.g. /crowd in case of url like http://localhost:4990/crowd
     admin_login: admin
     admin_password: admin
     application_name: crowd
     application_password: 1111
     load_executor: jmeter            
-    concurrency: 1000               # number of concurrent threads to authenticate random users
+    concurrency: 1000                  # number of concurrent threads to authenticate random users
     test_duration: 45m
 
     # 1 node scenario parameters
-    ramp-up: 20s                    # time to spin all concurrent threads
-    total_actions_per_hour: 180000  # number of total JMeter actions per hour
+    ramp-up: 20s                       # time to spin all concurrent threads
+    total_actions_per_hour: 180000     # number of total JMeter actions per hour
 
     # 2 nodes scenario parameters
-    # ramp-up: 10s                    # time to spin all concurrent threads
-    # total_actions_per_hour: 360000  # number of total JMeter actions per hour
+    # ramp-up: 10s                     # time to spin all concurrent threads
+    # total_actions_per_hour: 360000   # number of total JMeter actions per hour
 
     # 4 nodes scenario parameters
-    # ramp-up: 5s                     # time to spin all concurrent threads
-    # total_actions_per_hour: 720000  # number of total JMeter actions per hour
+    # ramp-up: 5s                      # time to spin all concurrent threads
+    # total_actions_per_hour: 720000   # number of total JMeter actions per hour
 
     JMETER_VERSION: 5.5
     LANGUAGE: en_US.utf8
-    allow_analytics: Yes              # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
+    allow_analytics: Yes               # Allow sending basic run analytics to Atlassian. These analytics help us to understand how the tool is being used and help us to continue to invest in this tooling. For more details please see our README.
+    environment_compliance_check: True # Pre-test environment compliance validation. Set to "False" to skip it.
 services:
   - module: shellexec
     prepare:
       - python util/pre_run/environment_checker.py
-      - python util/pre_run/check_for_updates.py
+      - python util/pre_run/environment_compliance_check.py crowd
       - python util/data_preparation/crowd_prepare_data.py
       - python util/data_preparation/crowd_sync_check.py
     shutdown: