First commit

Author: ebattat

Dockerfile

@@ -0,0 +1,54 @@
+FROM centos:centos8
+
+# Update
+RUN dnf update -y
+
+# install python 3.9 - take several minutes
+RUN dnf install -y python3.9 \
+    && echo alias python=python3.9 >> ~/.bashrc
+
+# install & run benchmark-runner
+RUN python3.9 -m pip install --upgrade pip && pip install benchmark-runner
+
+# install oc Client tools for OpenShift
+ARG oc_version=4.7.0-0.okd-2021-05-22-050008
+RUN  curl -L https://github.com/openshift/okd/releases/download/${oc_version}/openshift-client-linux-${oc_version}.tar.gz -o ~/openshift-client-linux-${oc_version}.tar.gz \
+     && tar -xzvf ~/openshift-client-linux-${oc_version}.tar.gz -C ~/ \
+     && rm ~/openshift-client-linux-${oc_version}.tar.gz \
+     && echo alias oc=~/./oc >> ~/.bashrc
+
+# install virtctl for VNC
+ARG virtctl_version=0.34.2
+RUN curl -L https://github.com/kubevirt/kubevirt/releases/download/v${virtctl_version}/virtctl-v${virtctl_version}-linux-amd64 -o ~/virtctl \
+    && chmod +x ~/virtctl \
+    && echo alias virtctl=~/./virtctl >> ~/.bashrc
+
+# Activate alias
+RUN . ~/.bashrc
+
+# Create folder for config file (kubeconfig)
+RUN mkdir -p ~/.kube
+
+# benchmark-operator
+# install helm
+RUN curl -fsSL -o get_helm.sh https://raw.githubusercontent.com/helm/helm/master/scripts/get-helm-3 \
+    && chmod 700 get_helm.sh \
+    && ./get_helm.sh
+
+# download benchmark-operator
+RUN dnf install -y git \
+    && git clone https://github.com/cloud-bulldozer/benchmark-operator
+#   && cd benchmark-operator/charts/benchmark-operator \
+#    && helm install benchmark-operator . -n my-ripsaw --create-namespace
+#    && oc adm policy -n my-ripsaw add-scc-to-user privileged -z benchmark-operator
+
+# Add main
+ADD benchmark_runner/benchmark_operator/templates /usr/local/benchmark_runner/benchmark_operator/templates/
+COPY benchmark_runner/main/main.py /usr/local/benchmark_runner/main.py
+
+CMD [ "python3.9", "/usr/local/benchmark_runner/main.py"]
+
+
+# oc: https://www.ibm.com/docs/en/fci/6.5.1?topic=steps-setting-up-installation-server
+# sudo podman build -t quay.io/ebattat/benchmark-runner:latest . --no-cache
+# sudo podman run --rm -it -v /root/.kube/:/root/.kube/ -v /etc/hosts:/etc/hosts --privileged quay.io/ebattat/benchmark-runner:latest /bin/bash

MANIFEST.in

@@ -0,0 +1,8 @@
+include benchmark_runner/benchmark_operator/templates/hammerdb/*.yaml
+include benchmark_runner/benchmark_operator/templates/stressng/*.yaml
+include benchmark_runner/benchmark_operator/templates/uperf/*.yaml
+include tests/integrations/benchmark_runner/templates/*.yaml
+
+
+
+

README.md

@@ -0,0 +1,79 @@
+
+[![Actions Status](https://github.com/redhat-performance/cloud-governance/workflows/CI/badge.svg)](https://github.com/redhat-performance/cloud-governance/actions)
+[![Coverage Status](https://coveralls.io/repos/github/redhat-performance/cloud-governance/badge.svg?branch=master)](https://coveralls.io/github/redhat-performance/cloud-governance?branch=master)
+
+<h3 align="right">![](media/op.png)
+
+<h3 align="center">Benchmark-Runner ![](media/run.png) </h3>
+
+This tool provides a lightweight and flexible framework for running benchmark workloads 
+on Kubernetes/OpenShift Pod or VM.
+
+This tool support the following workloads:
+
+* [hammerdb](https://hammerdb.com/): running hammerdb workload on the following databases: MSSQL, Mariadb, Postgresql on Pod and VM with [Configuration](benchmark_runner/benchmark_operator/templates/hammerdb)
+* [stressng](https://wiki.ubuntu.com/Kernel/Reference/stress-ng): running stressng workload on Pod or VM with [Configuration](benchmark_runner/benchmark_operator/templates/stressng)
+* [uperf](http://uperf.org/): running uperf workload on Pod or VM with [Configuration](benchmark_runner/benchmark_operator/templates/uperf)
+
+** First Phase: support [benchmark-operator workload](https://github.com/cloud-bulldozer/benchmark-operator)
+ 
+![](media/kiban.png)
+
+Reference:
+* The benchmark-runner package is located in [PyPi](https://pypi.org/project/benchmark-runner)
+* The benchmark-runner container image is located in [Quay.io](https://quay.io/repository/ebattat/benchmark-runner)
+
+![](media/docker1.png)
+
+_**Table of Contents**_
+
+<!-- TOC -->
+- [Installation](#installation)
+- [Run workload using Docker/Podman](#run-policy-using-docker-podman)
+- [Run workload in Pod using Kubernetes/OpenShift](#run-policy-using-pod)
+- [Post Installation](#post-installation)
+
+<!-- /TOC -->
+
+## Installation
+
+#### Download benchmark-runner image from quay.io
+```sh
+sudo podman pull quay.io/ebattat/benchmark-runner:latest
+```
+
+#### Environment variables description:
+
+`mandatory:`KUBEADMIN_PASSWORD=$kubeadmin_password
+
+`mandatory:`WORKLOAD=$workload
+
+Choose one from the following list:
+
+`['stressng_pod', 'stressng_vm','uperf_pod', 'uperf_vm', 'hammerdb_pod_mariadb', 'hammerdb_pod_mssql', 'hammerdb_pod_postgres', 'hammerdb_vm_mariadb', 'hammerdb_vm_mssql', 'hammerdb_vm_postgres']`
+
+`mandatory:`ELASTICSEARCH=$elasticsearch
+
+`mandatory:`ELASTICSEARCH_PORT=$elasticsearch_port
+
+`optional:`PIN_NODE1=$pin_node1
+
+`optional:`PIN_NODE2=$pin_node2
+
+## Run workload using Podman/Docker 
+```sh
+sudo podman run --rm -it -e WORKLOAD=stressng_pod -e KUBEADMIN_PASSWORD=$kubeadmin_password -e ELASTICSEARCH=$elasticsearch -e ELASTICSEARCH_PORT=$elasticsearch_port -e PIN_NODE1=$pin_node1 -v /root/.kube/config:/root/.kube/config -e log_level=INFO --privileged quay.io/ebattat/benchmark-runner:latest
+
+# For custom workload data configuration add:
+-v /home/user/stressng/stressng_data.yaml:/benchmark_runner/benchmark_operator/template/stressng/stressng_data.yaml
+```
+![](media/demo1.gif)
+## Run workload in Pod using Kubernetes/OpenShift]
+[TBD]
+
+## Post Installation
+
+#### Delete benchmark-runner image
+```sh
+sudo podman rmi quay.io/ebattat/benchmark-runner:latest
+```

SECURITY.md

@@ -0,0 +1,5 @@
+# Security Policy
+
+## Supported Versions
+
+## Reporting a Vulnerability

__init__.py

@@ -0,0 +1,96 @@
+Metadata-Version: 2.1
+Name: benchmark-runner
+Version: 1.0.15
+Summary: Benchmark Runner Tool
+Home-page: UNKNOWN
+Author: Red Hat
+Author-email: [email protected]
+License: UNKNOWN
+Platform: UNKNOWN
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.6
+Classifier: Programming Language :: Python :: 3.7
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Description-Content-Type: text/markdown
+
+
+[![Actions Status](https://github.com/redhat-performance/cloud-governance/workflows/CI/badge.svg)](https://github.com/redhat-performance/cloud-governance/actions)
+[![Coverage Status](https://coveralls.io/repos/github/redhat-performance/cloud-governance/badge.svg?branch=master)](https://coveralls.io/github/redhat-performance/cloud-governance?branch=master)
+
+<h3 align="right">![](media/op.png)
+
+<h3 align="center">Benchmark-Runner ![](media/run.png) </h3>
+
+This tool provides a lightweight and flexible framework for running benchmark workloads 
+on Kubernetes/OpenShift Pod or VM.
+
+This tool support the following workloads:
+
+* [hammerdb](https://hammerdb.com/): running hammerdb workload on the following databases: MSSQL, Mariadb, Postgresql on Pod and VM with [Configuration](benchmark_runner/benchmark_operator/templates/hammerdb)
+* [stressng](https://wiki.ubuntu.com/Kernel/Reference/stress-ng): running stressng workload on Pod or VM with [Configuration](benchmark_runner/benchmark_operator/templates/stressng)
+* [uperf](http://uperf.org/): running uperf workload on Pod or VM with [Configuration](benchmark_runner/benchmark_operator/templates/uperf)
+
+** First Phase: support [benchmark-operator workload](https://github.com/cloud-bulldozer/benchmark-operator)
+ 
+![](media/kiban.png)
+
+Reference:
+* The benchmark-runner package is located in [PyPi](https://pypi.org/project/benchmark-runner)
+* The benchmark-runner container image is located in [Quay.io](https://quay.io/repository/ebattat/benchmark-runner)
+
+![](media/docker1.png)
+
+_**Table of Contents**_
+
+<!-- TOC -->
+- [Installation](#installation)
+- [Run workload using Docker/Podman](#run-policy-using-docker-podman)
+- [Run workload in Pod using Kubernetes/OpenShift](#run-policy-using-pod)
+- [Post Installation](#post-installation)
+
+<!-- /TOC -->
+
+## Installation
+
+#### Download benchmark-runner image from quay.io
+```sh
+sudo podman pull quay.io/ebattat/benchmark-runner:latest
+```
+
+#### Environment variables description:
+
+`mandatory:`KUBEADMIN_PASSWORD=$kubeadmin_password
+
+`mandatory:`WORKLOAD=$workload
+
+Choose one from the following list:
+
+`['stressng_pod', 'stressng_vm','uperf_pod', 'uperf_vm', 'hammerdb_pod_mariadb', 'hammerdb_pod_mssql', 'hammerdb_pod_postgres', 'hammerdb_vm_mariadb', 'hammerdb_vm_mssql', 'hammerdb_vm_postgres']`
+
+`mandatory:`ELASTICSEARCH=$elasticsearch
+
+`mandatory:`ELASTICSEARCH_PORT=$elasticsearch_port
+
+`optional:`PIN_NODE1=$pin_node1
+
+`optional:`PIN_NODE2=$pin_node2
+
+## Run workload using Podman/Docker 
+```sh
+sudo podman run --rm -it -e WORKLOAD=stressng_pod -e KUBEADMIN_PASSWORD=$kubeadmin_password -e ELASTICSEARCH=$elasticsearch -e ELASTICSEARCH_PORT=$elasticsearch_port -e PIN_NODE1=$pin_node1 -v /root/.kube/config:/root/.kube/config -v /etc/hosts:/etc/hosts -e log_level=INFO --privileged quay.io/ebattat/benchmark-runner:latest
+# for custom workload data configuration add:
+-v /home/user/stressng/stressng_data.yaml:/benchmark_runner/benchmark_operator/template/stressng/stressng_data.yaml
+```
+
+## Run workload in Pod using Kubernetes/OpenShift]
+[TBD]
+
+## Post Installation
+
+#### Delete benchmark-runner image
+```sh
+sudo podman rmi quay.io/ebattat/benchmark-runner:latest
+```
+
+

benchmark_runner.egg-info/PKG-INFO

@@ -0,0 +1,49 @@
+MANIFEST.in
+README.md
+setup.cfg
+setup.py
+benchmark_runner/__init__.py
+benchmark_runner.egg-info/PKG-INFO
+benchmark_runner.egg-info/SOURCES.txt
+benchmark_runner.egg-info/dependency_links.txt
+benchmark_runner.egg-info/not-zip-safe
+benchmark_runner.egg-info/requires.txt
+benchmark_runner.egg-info/top_level.txt
+benchmark_runner/benchmark_operator/__init__.py
+benchmark_runner/benchmark_operator/benchmark_operator_workloads.py
+benchmark_runner/benchmark_operator/current_run/__init__.py
+benchmark_runner/benchmark_operator/templates/__init__.py
+benchmark_runner/benchmark_operator/templates/generate_yaml_from_templates.py
+benchmark_runner/benchmark_operator/templates/hammerdb/hammerdb_data_template.yaml
+benchmark_runner/benchmark_operator/templates/hammerdb/hammerdb_pod_template.yaml
+benchmark_runner/benchmark_operator/templates/hammerdb/hammerdb_vm_template.yaml
+benchmark_runner/benchmark_operator/templates/hammerdb/mariadb_template.yaml
+benchmark_runner/benchmark_operator/templates/hammerdb/mssql_template.yaml
+benchmark_runner/benchmark_operator/templates/hammerdb/postgres_template.yaml
+benchmark_runner/benchmark_operator/templates/stressng/stressng_data_template.yaml
+benchmark_runner/benchmark_operator/templates/stressng/stressng_pod_template.yaml
+benchmark_runner/benchmark_operator/templates/stressng/stressng_vm_template.yaml
+benchmark_runner/benchmark_operator/templates/uperf/uperf_data_template.yaml
+benchmark_runner/benchmark_operator/templates/uperf/uperf_pod_template.yaml
+benchmark_runner/benchmark_operator/templates/uperf/uperf_vm_template.yaml
+benchmark_runner/common/__init__.py
+benchmark_runner/common/analyze/__init__.py
+benchmark_runner/common/analyze/analyze_data.py
+benchmark_runner/common/elasticshearch/__init__.py
+benchmark_runner/common/elasticshearch/elasticsearch_exceptions.py
+benchmark_runner/common/elasticshearch/es_operations.py
+benchmark_runner/common/logger/__init__.py
+benchmark_runner/common/logger/init_logger.py
+benchmark_runner/common/logger/logger_exceptions.py
+benchmark_runner/common/logger/logger_time_stamp.py
+benchmark_runner/common/oc/__init__.py
+benchmark_runner/common/oc/oc.py
+benchmark_runner/common/oc/oc_exceptions.py
+benchmark_runner/common/ssh/__init__.py
+benchmark_runner/common/ssh/ssh.py
+benchmark_runner/common/ssh/ssh_exceptions.py
+benchmark_runner/custom_workloads/__init__.py
+benchmark_runner/main/__init__.py
+benchmark_runner/main/environment_variables.py
+benchmark_runner/main/main.py
+benchmark_runner/main/update_data_template_yaml_with_environment_variables.py

benchmark_runner.egg-info/SOURCES.txt

@@ -0,0 +1 @@
+

benchmark_runner.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

benchmark_runner.egg-info/not-zip-safe

@@ -0,0 +1,8 @@
+typing==3.7.4.3
+typeguard
+elasticsearch==7.13.2
+elasticsearch_dsl==7.3.0
+pandas
+jinja2==3.0.1
+typeguard==2.12.1
+PyYAML==5.4.1

benchmark_runner.egg-info/requires.txt

@@ -0,0 +1 @@
+benchmark_runner

benchmark_runner.egg-info/top_level.txt

@@ -0,0 +1,41 @@
+Method name: main {} , Start time: 2021-07-14 01:21:10 
+Method name: login {} , Start time: 2021-07-14 01:21:10 
+Method name: login , End time: 2021-07-14 01:21:15 , Total time: 4.77 sec
+Method name: run_workload {'workload': 'stressng_pod'} , Start time: 2021-07-14 01:21:15 
+Method name: helm_install_benchmark_operator {} , Start time: 2021-07-14 01:21:15 
+Method name: wait_for_pod_create {'pod_name': 'benchmark-operator'} , Start time: 2021-07-14 01:21:26 
+Method name: wait_for_pod_create , End time: 2021-07-14 01:21:26 , Total time: 0.73 sec
+Method name: helm_install_benchmark_operator , End time: 2021-07-14 01:21:26 , Total time: 11.36 sec
+Method name: run_workload_func {'workload_full_name': 'stressng_pod'} , Start time: 2021-07-14 01:21:26 
+Method name: generate_workload_yamls {'workload': 'stressng_pod'} , Start time: 2021-07-14 01:21:26 
+Method name: generate_workload_yamls , End time: 2021-07-14 01:21:26 , Total time: 0.01 sec
+Method name: stressng_pod {} , Start time: 2021-07-14 01:21:26 
+Method name: create_pod_sync {'yaml': '/home/ebattat/PycharmProjects/benchmark-runner/benchmark_runner/benchmark_operator/current_run/stressng_pod.yaml', 'pod_name': 'stressng-workload'} , Start time: 2021-07-14 01:21:26 
+Method name: wait_for_pod_create {'pod_name': 'stressng-workload', 'namespace': 'my-ripsaw', 'timeout': 300} , Start time: 2021-07-14 01:21:27 
+Method name: wait_for_pod_create , End time: 2021-07-14 01:22:01 , Total time: 33.85 sec
+Method name: create_pod_sync , End time: 2021-07-14 01:22:01 , Total time: 34.5 sec
+Method name: wait_for_initialized {'label': 'app=stressng_workload'} , Start time: 2021-07-14 01:22:01 
+Method name: wait_for_initialized , End time: 2021-07-14 01:22:03 , Total time: 1.64 sec
+Method name: wait_for_ready {'label': 'app=stressng_workload'} , Start time: 2021-07-14 01:22:03 
+Method name: wait_for_ready , End time: 2021-07-14 01:22:04 , Total time: 1.84 sec
+Method name: wait_for_completed {'label': 'app=stressng_workload'} , Start time: 2021-07-14 01:22:04 
+Method name: wait_for_completed , End time: 2021-07-14 01:22:27 , Total time: 23.06 sec
+Method name: get_long_uuid {} , Start time: 2021-07-14 01:22:27 
+Method name: get_long_uuid , End time: 2021-07-14 01:22:28 , Total time: 0.7 sec
+Method name: get_long_uuid {} , Start time: 2021-07-14 01:22:28 
+Method name: get_long_uuid , End time: 2021-07-14 01:22:29 , Total time: 0.73 sec
+Method name: verify_es_data_uploaded {'index': 'ripsaw-stressng-results', 'uuid': 'e7d53cdf-61c5-5da5-87fb-ac8354fa9224'} , Start time: 2021-07-14 01:22:29 
+Data with index: ripsaw-stressng-results and uuid=e7d53cdf-61c5-5da5-87fb-ac8354fa9224 was uploaded to ElasticSearch successfully
+Method name: verify_es_data_uploaded , End time: 2021-07-14 01:22:30 , Total time: 0.81 sec
+Method name: delete_pod_sync {'yaml': '/home/ebattat/PycharmProjects/benchmark-runner/benchmark_runner/benchmark_operator/current_run/stressng_pod.yaml', 'pod_name': 'stressng-workload'} , Start time: 2021-07-14 01:22:30 
+Method name: wait_for_pod_terminate {'pod_name': 'stressng-workload', 'namespace': 'my-ripsaw', 'timeout': 300} , Start time: 2021-07-14 01:22:31 
+Method name: wait_for_pod_terminate , End time: 2021-07-14 01:22:32 , Total time: 0.72 sec
+Method name: delete_pod_sync , End time: 2021-07-14 01:22:32 , Total time: 2.56 sec
+Method name: stressng_pod , End time: 2021-07-14 01:22:32 , Total time: 65.84 sec
+Method name: run_workload_func , End time: 2021-07-14 01:22:32 , Total time: 65.84 sec
+Method name: helm_delete_benchmark_operator {} , Start time: 2021-07-14 01:22:32 
+Method name: wait_for_pod_terminate {'pod_name': 'benchmark-operator'} , Start time: 2021-07-14 01:22:38 
+Method name: wait_for_pod_terminate , End time: 2021-07-14 01:23:11 , Total time: 33.28 sec
+Method name: helm_delete_benchmark_operator , End time: 2021-07-14 01:23:11 , Total time: 38.6 sec
+Method name: run_workload , End time: 2021-07-14 01:23:11 , Total time: 115.81 sec
+Method name: main , End time: 2021-07-14 01:23:11 , Total time: 120.58 sec