Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Link to mlcommons@cm4mlops #1206

Merged
merged 5 commits into from
Apr 16, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/test-qaic-compute-sdk-build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ jobs:
- name: Install dependencies
run: |
python3 -m pip install cmind
cm pull repo mlcommons@ck
cm pull repo mlcommons@cm4mlops
cm run script --tags=get,sys-utils-cm --quiet

- name: Test QAIC Compute SDK for compilation
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-qaic-software-kit.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ jobs:
- name: Install dependencies
run: |
python3 -m pip install cmind
cm pull repo mlcommons@ck
cm pull repo mlcommons@cm4mlops
cm run script --tags=get,sys-utils-cm --quiet

- name: Test Software Kit for compilation on Ubuntu 20.04
Expand Down
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ using a few CM commands:

pip install cmind -U

cm pull repo mlcommons@ck
cm pull repo mlcommons@cm4mlops

cm rm cache -f

Expand Down Expand Up @@ -152,10 +152,10 @@ to generate CM commands that will prepare and run MLPerf benchmarks and AI appli
```bash
pip install cmind -U

cm pull repo mlcommons@ck
cm pull repo mlcommons@cm4mlops

cm checkout repo mlcommons@ck --branch=dev
cm checkout repo mlcommons@ck --branch=master
cm checkout repo mlcommons@cm4mlops --branch=dev
cm checkout repo mlcommons@cm4mlops --branch=master

cm rm cache -f

Expand Down Expand Up @@ -205,7 +205,7 @@ cmr "get generic-python-lib _package.torchvision" --version=0.16.2
cmr "python app image-classification torch" --input=computer_mouse.jpg


cm rm repo mlcommons@ck
cm rm repo mlcommons@cm4mlops
cm pull repo --url=https://zenodo.org/records/10787459/files/cm-mlops-repo-20240306.zip

cmr "install llvm prebuilt" --version=17.0.6
Expand Down
31 changes: 1 addition & 30 deletions cm-mlops/README.md
Original file line number Diff line number Diff line change
@@ -1,30 +1 @@
# CM repository with cross-platform scripts for MLOps and DevOps

[![License](https://img.shields.io/badge/License-Apache%202.0-green)](https://github.com/mlcommons/ck/tree/master/cm)
[![Supported by CM](https://img.shields.io/badge/Supported_by-MLCommons%20CM-blue)](https://github.com/mlcommons/ck).

This repository contains automation recipes to run native MLOps and DevOps scripts and tools via a simple, common and human-readable
[CM interface](https://github.com/mlcommons/ck) on any platform with any software stack.

All СM scripts have a simple Python API, extensible JSON/YAML meta description
and unifed input/output to make them reusable in different projects either individually
or by chaining them together into powerful, efficient and portable automation workflows,
applications and web services adaptable to continuously changing models, data sets, software and hardware
(see [CM workflow/pipeline for MLPerf inference](script/app-mlperf-inference/_cm.yaml) as example).

These automation recipes are being developed and maintained by the [MLCommons Task Force on Automation and Reproducibility](../docs/taskforce.md)
with [great contributions](../CONTRIBUTING.md) from the community and important feedback from Google, AMD, Neural Magic, OctoML, Nvidia, Qualcomm, Dell, HPE,
Red Hat, Intel, TTA, One Stop Systems, ACM and other organizations.

### Catalog

See the automatically generated catalog at [GitHub](https://access.cknowledge.org/playground/?action=scripts)
or via the [Collective Knowledge playground](https://access.cknowledge.org/playground/?action=components).

### License

[Apache 2.0](LICENSE.md)

### Copyright

2022-2024 [MLCommons](https://mlcommons.org)
**This repository is archived. Please use [mlcommons@cm4mlops](https://github.com/mlcommons/cm4mlops/tree/dev) instead!**
4 changes: 4 additions & 0 deletions cm-mlops/automation/script/module_misc.py
Original file line number Diff line number Diff line change
Expand Up @@ -261,6 +261,10 @@ def doc(i):
# '{{CM_README_TOC}}',
# '</details>',
# '',
'**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/{}).**'.format(meta['alias']),
'',
'',
'',
'Automatically generated README for this automation recipe: **{}**'.format(meta['alias']),
]

Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/activate-python-venv/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/activate-python-venv).**



Automatically generated README for this automation recipe: **activate-python-venv**

Category: **Python automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/add-custom-nvidia-system/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/add-custom-nvidia-system).**



Automatically generated README for this automation recipe: **add-custom-nvidia-system**

Category: **MLPerf benchmark support**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-image-classification-onnx-py/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-onnx-py).**



Automatically generated README for this automation recipe: **app-image-classification-onnx-py**

Category: **Modular AI/ML application pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-tf-onnx-cpp).**



Automatically generated README for this automation recipe: **app-image-classification-tf-onnx-cpp**

Category: **Modular AI/ML application pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-image-classification-torch-py/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-torch-py).**



Automatically generated README for this automation recipe: **app-image-classification-torch-py**

Category: **Modular AI/ML application pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-tvm-onnx-py).**



Automatically generated README for this automation recipe: **app-image-classification-tvm-onnx-py**

Category: **Modular AI/ML application pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-image-corner-detection/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-corner-detection).**



Automatically generated README for this automation recipe: **app-image-corner-detection**

Category: **Modular application pipeline**
Expand Down
6 changes: 5 additions & 1 deletion cm-mlops/script/app-loadgen-generic-python/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-loadgen-generic-python).**



Automatically generated README for this automation recipe: **app-loadgen-generic-python**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down Expand Up @@ -127,7 +131,7 @@ ___
- Workflow:
1. ***Read "deps" on other CM scripts***
* get,ml-model,cmc
- *Warning: no scripts found*
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/cm4abtf/tree/master/script/get-ml-model-abtf-ssd-pytorch)
* `_custom,huggingface`
- Workflow:
1. ***Read "deps" on other CM scripts***
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-ctuning-cpp-tflite).**



Automatically generated README for this automation recipe: **app-mlperf-inference-ctuning-cpp-tflite**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-dummy/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-dummy).**



Automatically generated README for this automation recipe: **app-mlperf-inference-dummy**

Category: **Modular MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-intel/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-intel).**



Automatically generated README for this automation recipe: **app-mlperf-inference-intel**

Category: **Modular MLPerf benchmarks**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-cpp).**



Automatically generated README for this automation recipe: **app-mlperf-inference-mlcommons-cpp**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-python).**



Automatically generated README for this automation recipe: **app-mlperf-inference-mlcommons-python**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-nvidia/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-nvidia).**



Automatically generated README for this automation recipe: **app-mlperf-inference-nvidia**

Category: **Reproduce MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-qualcomm/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-qualcomm).**



Automatically generated README for this automation recipe: **app-mlperf-inference-qualcomm**

Category: **Modular MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference).**



Automatically generated README for this automation recipe: **app-mlperf-inference**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-training-nvidia/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-training-nvidia).**



Automatically generated README for this automation recipe: **app-mlperf-training-nvidia**

Category: **Modular MLPerf training benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-training-reference/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-training-reference).**



Automatically generated README for this automation recipe: **app-mlperf-training-reference**

Category: **Modular MLPerf training benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-stable-diffusion-onnx-py/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-stable-diffusion-onnx-py).**



Automatically generated README for this automation recipe: **app-stable-diffusion-onnx-py**

Category: **Modular AI/ML application pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/benchmark-any-mlperf-inference-implementation).**



Automatically generated README for this automation recipe: **benchmark-any-mlperf-inference-implementation**

Category: **MLPerf benchmark support**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/benchmark-program-mlperf/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/benchmark-program-mlperf).**



Automatically generated README for this automation recipe: **benchmark-program-mlperf**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/benchmark-program/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/benchmark-program).**



Automatically generated README for this automation recipe: **benchmark-program**

Category: **DevOps automation**
Expand Down
5 changes: 5 additions & 0 deletions cm-mlops/script/build-docker-image/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/build-docker-image).**



Automatically generated README for this automation recipe: **build-docker-image**

Category: **Docker automation**
Expand Down Expand Up @@ -153,6 +157,7 @@ ___
#### New environment keys auto-detected from customize

* `CM_DOCKER_BUILD_ARGS`
* `CM_DOCKER_BUILD_CMD`
* `CM_DOCKER_CACHE_ARG`
* `CM_DOCKER_IMAGE_NAME`
* `CM_DOCKER_IMAGE_REPO`
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/build-dockerfile/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/build-dockerfile).**



Automatically generated README for this automation recipe: **build-dockerfile**

Category: **Docker automation**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/build-mlperf-inference-server-nvidia).**



Automatically generated README for this automation recipe: **build-mlperf-inference-server-nvidia**

Category: **MLPerf benchmark support**
Expand Down
6 changes: 5 additions & 1 deletion cm-mlops/script/calibrate-model-for.qaic/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/calibrate-model-for.qaic).**



Automatically generated README for this automation recipe: **calibrate-model-for.qaic**

Category: **AI/ML optimization**
Expand Down Expand Up @@ -251,8 +255,8 @@ ___
- CM script: [get-preprocessed-dataset-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-preprocessed-dataset-squad)
* get,ml-model
* CM names: `--adr.['model-src']...`
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/cm4abtf/tree/master/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-3d-unet-kits19](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-3d-unet-kits19)
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-bert-base-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-base-squad)
- CM script: [get-ml-model-bert-large-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-large-squad)
- CM script: [get-ml-model-dlrm-terabyte](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-dlrm-terabyte)
Expand Down
6 changes: 5 additions & 1 deletion cm-mlops/script/compile-model-for.qaic/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/compile-model-for.qaic).**



Automatically generated README for this automation recipe: **compile-model-for.qaic**

Category: **AI/ML optimization**
Expand Down Expand Up @@ -395,8 +399,8 @@ ___
- CM script: [calibrate-model-for.qaic](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/calibrate-model-for.qaic)
* get,ml-model
* CM names: `--adr.['model-src']...`
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/cm4abtf/tree/master/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-3d-unet-kits19](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-3d-unet-kits19)
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-bert-base-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-base-squad)
- CM script: [get-ml-model-bert-large-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-large-squad)
- CM script: [get-ml-model-dlrm-terabyte](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-dlrm-terabyte)
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/compile-program/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/compile-program).**



Automatically generated README for this automation recipe: **compile-program**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/convert-csv-to-md/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/convert-csv-to-md).**



Automatically generated README for this automation recipe: **convert-csv-to-md**

Category: **DevOps automation**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/convert-ml-model-huggingface-to-onnx).**



Automatically generated README for this automation recipe: **convert-ml-model-huggingface-to-onnx**

Category: **AI/ML models**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/copy-to-clipboard/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/copy-to-clipboard).**



Automatically generated README for this automation recipe: **copy-to-clipboard**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/create-conda-env/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/create-conda-env).**



Automatically generated README for this automation recipe: **create-conda-env**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/create-fpgaconvnet-app-tinyml/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/create-fpgaconvnet-app-tinyml).**



Automatically generated README for this automation recipe: **create-fpgaconvnet-app-tinyml**

Category: **TinyML automation**
Expand Down
Loading
Loading