Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

a few minor fixes #1265

Merged
merged 3 commits into from
Jun 25, 2024
Merged

a few minor fixes #1265

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
6e87b30
force numpy < 2.0.0 for onnx
gfursin Jun 25, 2024
ebe31f6
clean up
gfursin Jun 25, 2024
eedb2c6
added cm4mlops snapshot to Zenodo
gfursin Jun 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 10 additions & 5 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,12 +26,15 @@ CK consists of several ongoing sub-projects:
Furthermore, in comparison with cmake, these automation recipes can not only detect missing code
but also download artifacts (models, data sets), preprocess them, build missing
dependencies, install them and run the final code on diverse platforms in a unified and automated way.
You can read more about the CM concept in this [presentation](https://doi.org/10.5281/zenodo.8105339).
You can learn more about the CM concept from this [white paper](https://arxiv.org/abs/2406.16791)
and the [ACM REP'23 keynote](https://doi.org/10.5281/zenodo.8105339).


* [CM automation recipes for MLOps and DevOps](https://github.com/mlcommons/cm4mlops) (*~6MB*) - a small collection of portable, extensible and technology-agnostic automation recipes
* [CM4MLOPS: CM automation recipes for MLOps, MLPerf and DevOps](https://github.com/mlcommons/cm4mlops) (*~6MB*) -
a collection of portable, extensible and technology-agnostic automation recipes
with a human-friendly interface (aka CM scripts) to unify and automate all the manual steps required to compose, run, benchmark and optimize complex ML/AI applications
on diverse platforms with any software and hardware: see [online catalog](https://access.cknowledge.org/playground/?action=scripts)
on diverse platforms with any software and hardware: see [online cKnowledge catalog](https://access.cknowledge.org/playground/?action=scripts),
[online MLCommons catalog](https://docs.mlcommons.org/cm4mlops/scripts)
and [source code](https://github.com/mlcommons/cm4mlops/blob/master/script).

* [CM automation recipes to reproduce research projects](https://github.com/ctuning/cm4research) (*~1MB*) - a unified CM interface to help researchers
Expand All @@ -45,17 +48,19 @@ CK consists of several ongoing sub-projects:

* [Modular C++ harness for MLPerf loadgen](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-cpp)

* [Modular Python harness for MLPerf loadgen](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-python)
* [Modular Python harness for MLPerf loadgen](https://github.com/mlcommons/cm4mlops/tree/main/script/app-loadgen-generic-python)

* [Collective Knowledge Playground](https://access.cKnowledge.org) - an external platform being developed by [cKnowledge](https://cKnowledge.org)
to list CM scripts similar to PYPI, aggregate AI/ML Systems benchmarking results in a reproducible format with CM workflows,
and organize [public optimization challenges and reproducibility initiatives](https://access.cknowledge.org/playground/?action=challenges)
to find the most performance and cost-effective AI/ML Systems.

* [CK GUI to run modular benchmarks](https://access.cknowledge.org/playground/?action=howtorun) - such benchmarks
* [GUI to run modular benchmarks](https://access.cknowledge.org/playground/?action=howtorun) - such benchmarks
are composed from [CM scripts](https://access.cknowledge.org/playground/?action=scripts)
and can run via a unified CM interface.

* [MLCommons docs to run MLPerf inference benchmarks from command line via CM](https://docs.mlcommons.org/inference)

### License

[Apache 2.0](LICENSE.md)
Expand Down
1 change: 1 addition & 0 deletions cm-mlops/script/app-image-classification-onnx-py/_cm.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@ deps:

- tags: get,generic-python-lib,_package.Pillow
- tags: get,generic-python-lib,_package.numpy
version_max: "1.99.99"
- tags: get,generic-python-lib,_package.opencv-python


Expand Down
1 change: 1 addition & 0 deletions cm-mlops/script/app-loadgen-generic-python/_cm.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,7 @@ deps:
# Extra package
- tags: get,generic-python-lib,_psutil
- tags: get,generic-python-lib,_package.numpy
version_max: "1.99.99"

# Detect CUDA if required
- tags: get,cuda
Expand Down
2 changes: 1 addition & 1 deletion cm/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@ cmr "python app image-classification torch" --input=computer_mouse.jpg


cm rm repo mlcommons@cm4mlops
cm pull repo --url=https://zenodo.org/records/10787459/files/cm-mlops-repo-20240306.zip
cm pull repo --url=https://zenodo.org/records/12528908/files/cm4mlops-20240625.zip

cmr "install llvm prebuilt" --version=17.0.6
cmr "app image corner-detection"
Expand Down
2 changes: 1 addition & 1 deletion cmr.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ git: true

prefix: cm-mlops

version: 2.0.4
version: 2.3.2

deps:
- alias: mlcommons@cm4mlops
Expand Down
Loading