Release v0.9.0

[marquiz]

Release Process

• In the issue description, add a changelog section, describing changes since the last release.
• Local release preparations
  • Perform mandatory internal release checks and preparations.
  • Run make release-tests to run an extended set of tests prior to a release.
  • Run git tag -a -m "CRI Resource Manager release $VERSION" $VERSION.
  • Create source+dependencies tarball with make vendored-dist.
• Final verification of artefacts
  • Verify the installation of binary packages.
  • Verify runnability of container images.
• Publishing
  • Push the tag with git push $VERSION.
  • Create a new draft release corresponding to the tag.
    • Upload all artefacts to the release.
    • Write the change log to the release.
    • Mark the release as a non-production pre-release if necessary.
    • Save as draft.
  • Check that new container images are published for the tag.
    • https://hub.docker.com/r/intel/cri-resmgr-agent/tags
    • https://hub.docker.com/r/intel/cri-resmgr-webhook/tags
  • Get the change log OK'd by other maintainers.
  • Publish the draft as a release.
  • Add a link to the tagged release in this issue.
• Close this issue.

What's Changed

New dynamic-pools policy

A new policy that allows applications to be assigned to dynamically resized CPU pools. The pools are non-overlapping and are resized based on the resource requests of the containers and the actual CPU utilization of the application.

Enhancements to balloons policy

New PreferSpreadOnPhysicalCores configuration option in the balloons policy. Enabling this option for a balloon makes the CPU allocator to prefer CPUs from separate physical CPU cores.

There are also bugfixes to dynamic configuration updates.

Config status

Configuration status (was the configuration successfully applied or not) is now exposed via readiness probe of the cri-resmgr-agent. (#986)

CRI v1alpha2 dropped

Support for deprecated CRI version v1alpha2 was removed. This means that CRI-RM v0.9 requires Kubernetes v1.23 (or later) and containerd v1.6 (or later) or CRI-O v1.20 (or later).

Bugfixes

• CPU priority detection fixed (cpuallocator: fix cpu priority discovery #971)
• Collecting of hugetlb statistics from cgroup v1 fixed (metrics: fix collecting hugetlb statistics from cgroup v1 #968)
• Fixed sudden cri-resmgr process exit on page demotion (demoter: fix sudden cri-resmgr process exit on page demotion #1054)

List of PRs

• sysfs: add SysRoot() getter for SetSysRoot() by @askervin in sysfs: add SysRoot() getter for SetSysRoot() #970
• cpuallocator: fix cpu priority discovery by @marquiz in cpuallocator: fix cpu priority discovery #971
• Policy: create dynamic-pools policy for cri-rm by @Yugar-1 in Policy: create dynamic-pools policy for cri-rm #969
• rdt: stop trying to get container cgroup dir by @marquiz in rdt: stop trying to get container cgroup dir #975
• metrics: fix collecting hugetlb statistics from cgroup v1 by @askervin in metrics: fix collecting hugetlb statistics from cgroup v1 #968
• build(deps): bump golang.org/x/net from 0.2.0 to 0.7.0 by @dependabot in build(deps): bump golang.org/x/net from 0.2.0 to 0.7.0 #976
• Bump builds to use Golang v1.19.6 by @marquiz in Bump builds to use Golang v1.19.6 #981
• pkg/avx/collector: don't crash on no regexp match. by @klihub in pkg/avx/collector: don't crash on no regexp match. #985
• build(deps): bump golang.org/x/sys from 0.0.0-20200202164722-d101bd2416d5 to 0.1.0 in /pkg/topology by @dependabot in build(deps): bump golang.org/x/sys from 0.0.0-20200202164722-d101bd2416d5 to 0.1.0 in /pkg/topology #987
• agent: implement config status readiness probe. by @klihub in agent: implement config status readiness probe. #986
• Migrating from CRI-RM to NRI by @luukasmakila in Migrating from CRI-RM to NRI #988
• Add SNYK and CodeQL security scanning by @intel-k8s-bot in Add SNYK and CodeQL security scanning #991
• Bump builds to use Golang v1.20.2 by @marquiz in Bump builds to use Golang v1.20.2 #982
• build(deps): bump github.com/opencontainers/runc from 1.1.4 to 1.1.5 by @dependabot in build(deps): bump github.com/opencontainers/runc from 1.1.4 to 1.1.5 #992
• topology-aware: fix logging of cpuset changes. by @klihub in topology-aware: fix logging of cpuset changes. #995
• dockerfiles: (re)name suse Dockerfile as expected. by @klihub in dockerfiles: (re)name suse Dockerfile as expected. #999
• pkg/topology: perform colonoscopy on testdata. by @klihub in pkg/topology: perform colonoscopy on testdata. #1005
• Update deps by @marquiz in Update deps #1008
• build(deps): bump pygments from 2.13.0 to 2.15.0 in /docs by @dependabot in build(deps): bump pygments from 2.13.0 to 2.15.0 in /docs #1013
• go.mod: update dependencies by @marquiz in go.mod: update dependencies #1014
• chore: remove refs to deprecated io/ioutil by @testwill in chore: remove refs to deprecated io/ioutil #1012
• docs/deps: update pygments to v2.15.1 by @marquiz in docs/deps: update pygments to v2.15.1 #1021
• Bump golang to v1.20.7 by @marquiz in Bump golang to v1.20.7 #1018
• github: replace snyk with trivy by @marquiz in github: replace snyk with trivy #1020
• github: take golang version from go.mod by @marquiz in github: take golang version from go.mod #1022
• scripts: drop unused stuff from docker-build-image by @marquiz in scripts: drop unused stuff from docker-build-image #1024
• docs: use ADD in the dockerfile to fetch go tarball by @marquiz in docs: use ADD in the dockerfile to fetch go tarball #1025
• Makefile: prepare binary packages as release assets by @marquiz in Makefile: prepare binary packages as release assets #1026
• cross-build: get golang binaries instead of compiling from source by @marquiz in cross-build: get golang binaries instead of compiling from source #1027
• Use golang builtin multierror by @marquiz in Use golang builtin multierror #1023
• Makefile: isolate image-push from image target by @marquiz in Makefile: isolate image-push from image target #1028
• github: drop the turnstyle plugin by @marquiz in github: drop the turnstyle plugin #1030
• github: run security scanning on release branches by @marquiz in github: run security scanning on release branches #1029
• github: drop containerized build of docs from verify workflow by @marquiz in github: drop containerized build of docs from verify workflow #1031
• [backport from nri-plugins] all: stop importing kubernetes/kubelet internals. by @klihub in [backport from nri-plugins] all: stop importing kubernetes/kubelet internals. #1010
• github: refactor docs building by @marquiz in github: refactor docs building #1032
• fixes: fix a few innocent codeql alert. by @klihub in fixes: fix a few innocent codeql alert. #1034
• Makefile: remove -it arg from docker run by @marquiz in Makefile: remove -it arg from docker run #1035
• Makefile: fix creation of deb release assets by @marquiz in Makefile: fix creation of deb release assets #1036
• github: split security scanning into re-usable jobs by @marquiz in github: split security scanning into re-usable jobs #1033
• github: use pinpointed ubuntu version on the runners by @marquiz in github: use pinpointed ubuntu version on the runners #1040
• Makefile: drop unwanted update-workflows target by @marquiz in Makefile: drop unwanted update-workflows target #1038
• scripts: remove unused batch file for docs building by @marquiz in scripts: remove unused batch file for docs building #1041
• github: refactor verify workflow by @marquiz in github: refactor verify workflow #1039
• github: add workflows for image building by @marquiz in github: add workflows for image building #1037
• github: build and upload release assets in release workflow by @marquiz in github: build and upload release assets in release workflow #1042
• github: fix the usage of github environments by @marquiz in github: fix the usage of github environments #1044
• github: add trivy license scanning by @marquiz in github: add trivy license scanning #1046
• go.mod: update goresctrl to v0.5.0 by @marquiz in go.mod: update goresctrl to v0.5.0 #1043
• github: split code and docs CI into separate workflows by @marquiz in github: split code and docs CI into separate workflows #1045
• pkg/topology: sync go.mod with the main module by @marquiz in pkg/topology: sync go.mod with the main module #1047
• e2e: clean up vm as the last step in the static-pools test suite by @askervin in e2e: clean up vm as the last step in the static-pools test suite #1049
• e2e: fix topology-aware/n4c16/test09-container-exit test by @askervin in e2e: fix topology-aware/n4c16/test09-container-exit test #1050
• e2e: update default distro from Ubuntu 20.04 to 22.04 by @askervin in e2e: update default distro from Ubuntu 20.04 to 22.04 #1052
• e2e: fix distro=opensuse to support k8s 1.27+ by @askervin in e2e: fix distro=opensuse to support k8s 1.27+ #1051
• demoter: fix sudden cri-resmgr process exit on page demotion by @askervin in demoter: fix sudden cri-resmgr process exit on page demotion #1054
• e2e: relax dynamic demotion first detection round requirement by @askervin in e2e: relax dynamic demotion first detection round requirement #1053
• e2e: fix opensuse-15.4 image URL, support distro=opensuse-15.5 by @askervin in e2e: fix opensuse-15.4 image URL, support distro=opensuse-15.5 #1055
• e2e: use latest image for debian-10 tests by @marquiz in e2e: use latest image for debian-10 tests #1056
• e2e: use Fedora 38 for the fedora test target by @marquiz in e2e: use Fedora 38 for the fedora test target #1057
• e2e: use bridge cni plugin by default by @marquiz in e2e: use bridge cni plugin by default #1058
• e2e: ignore terminated processes on fetching allowed resources by @askervin in e2e: ignore terminated processes on fetching allowed resources #1065
• e2e: fix "ambiguous allowed resources" caused by race by @askervin in e2e: fix "ambiguous allowed resources" caused by race #1062
• e2e: add --wait to kubectl delete of pods and namespaces by @marquiz in e2e: add --wait to kubectl delete of pods and namespaces #1059
• e2e: check default serviceaccount in cluster readiness check by @marquiz in e2e: check default serviceaccount in cluster readiness check #1060
• Makefile: simplify packaging tests by @marquiz in Makefile: simplify packaging tests #1061
• e2e: drop vm-force-restart() by @marquiz in e2e: drop vm-force-restart() #1064
• e2e: support for verify --retry N by @askervin in e2e: support for verify --retry N #1069
• e2e: don't use pyexec in tests directly by @marquiz in e2e: don't use pyexec in tests directly #1066
• e2e: relax topology-aware coldstart test by @marquiz in e2e: relax topology-aware coldstart test #1068
• e2e: fix starting a custom containerd version by @askervin in e2e: fix starting a custom containerd version #1072
• build(deps): bump golang.org/x/net from 0.8.0 to 0.17.0 by @dependabot in build(deps): bump golang.org/x/net from 0.8.0 to 0.17.0 #1073
• balloons: PreferSpreadOnPhysicalCores & balloon-specific CPU allocator by @askervin in balloons: PreferSpreadOnPhysicalCores & balloon-specific CPU allocator #1071
• go.mod: update deps by @marquiz in go.mod: update deps #1074
• test/e2e: fix incorrect Allocat[ion|or]Priority config key. by @klihub in test/e2e: fix incorrect Allocat[ion|or]Priority config key. #1077
• balloons: fix applying new configuration by @askervin in balloons: fix applying new configuration #1076
• Bump golangci-lint to v1.55.2 by @marquiz in Bump golangci-lint to v1.55.2 #1082
• Bump Go to v1.21.5 by @marquiz in Bump Go to v1.21.5 #1080
• pkg/sysfs: drop discovery flags by @marquiz in pkg/sysfs: drop discovery flags #1083
• github: generate codeql report on release tags by @marquiz in github: generate codeql report on release tags #1084
• go.mod: update dependencies by @marquiz in go.mod: update dependencies #1079
• pkg/cri: remove support for the obsolete v1alpha2 CRI protocol. by @klihub in pkg/cri: remove support for the obsolete v1alpha2 CRI protocol. #1081
• pkg/cri: implement container event relaying. by @klihub in pkg/cri: implement container event relaying. #1085

New Contributors

• @Yugar-1 made their first contribution in Policy: create dynamic-pools policy for cri-rm #969
• @luukasmakila made their first contribution in Migrating from CRI-RM to NRI #988
• @testwill made their first contribution in chore: remove refs to deprecated io/ioutil #1012

Full Changelog: v0.8.0...v0.9.0

[marquiz]

Drafted a changelog. PTAL @klihub @kad @askervin

[askervin]

@marquiz , looks great to me! Thank you!

[kad]

LGTM. one small addition: for CRI v1alpha2 deprecation, minimal version of cri-o also should be mentioned.

[marquiz]

LGTM. one small addition: for CRI v1alpha2 deprecation, minimal version of cri-o also should be mentioned.

Added.

[marquiz]

Container event relaying was implemented. Let's tag? 🕺

[marquiz]

GitHub release page:
https://github.com/intel/cri-resource-manager/releases/tag/v0.9.0