2.6.0

What's Changed

New Tests

• Add edit/admin permissions tests for Kserve UI by @lugi0 in #1081
• RHOAIENG-1179 Verify user can create a workbench with an existing data connection by @jiridanek in #1094
• New Test ODS-2223 by @manosnoam in #1101
• Verify GPU AcceleratorProfile is created after restarting Dashboard by @manosnoam in #1103
• ODS-1975 - Verify user can cancel workbench start from event log [AUTOMATION] by @jiridanek in #1104
• Add e2e test for Caikit Nlp Client by @bdattoma in #1075
• Test Automation ODS-2173 Verify user can create a workbench using Intel AiKit image by @asanzgom in #1107
• [RHOAIENG-1574] - Add codeflare-sdk e2e tests by @ChughShilpa in #1112
• Add automated test for TGIS Standalone serving runtime (gRPC CLI) by @bdattoma in #1124
• Add test to verify Dashboard detects OpenShift Pipelines operator by @Raghul-M in #1141
• DIR SPD tests for Trusty AI by @nehachopra27 in #1088
• Add UI testing for TGIS Standalone by @bdattoma in #1151
• Add Kueue tests by @ChughShilpa in #1148

Enhancements

• [Fix] the Tests.Jupyterhub.Test-Jupyterlab-Git-Notebook by @jstourac in #1014
• [Fix] the test that checks the User/Group privileges permissions by @jstourac in #1064
• After installation, verify the monitoring stack only for managed by @jgarciao in #1077
• Improve Hive deployment to fail fast on fatal error, and fix deprovision logic by @manosnoam in #1078
• Pass Execution at the end of 'Provision Self-Managed Cluster' by @manosnoam in #1083
• Remove SMMR clean up from KServe test teardown by @bdattoma in #1082
• Workaround for old Hive with Openstack by @manosnoam in #1089
• Keywords for management of components by @jiripetrlik in #1085
• Add missing taint for gpu node by @tarukumar in #1091
• RHODS-13159: Use the new parameter 'base_domain' in ods-ci by @apodhrad in #1097
• Flip coin pipeline compiled by @diegolovison in #1109
• Fix ODS-493 (and other Explore tab tests) for ODH 2.6 by @jiridanek in #1111
• Fix test "Verify CSS Style Of Getting Started Descriptions" by @jgarciao in #1116
• Fix: 2.6 xpath fixes by @FedeAlonso in #1114
• Fix "Click Action From Actions Menu" and CustomServingRuntime test by @bdattoma in #1117
• Patternfly changes for gpu model serving by @tarukumar in #1123
• Fix ODS-2206, ODS-2226 for ODH 2.6 by @jiridanek in #1113
• Fix pf5 xpaths for Verify User Can Create And Start A Workbench Adding A New PV Storage by @jiridanek in #1126
• Move LLM CLI tests from Smoke to Sanity by @bdattoma in #1127
• Fix model serving tests in 2.6 by @bdattoma in #1125
• Fix projects page selector path by @bdattoma in #1130
• Remove ODS-1005(KFDEF) TC from the repo by @tarukumar in #1129
• Enhance "Verify That XXXXXX Image Is A CPaaS Built Image" tests by @jgarciao in #1131
• Add support for self-signed certificates by @apodhrad in #1135
• Fix for RHOAM check of the tile on the Explore page by @jstourac in #1147
• Fix xpath to env var remove button for notebook spawn by @jstourac in #1146
• Give a bit more time to load the UI elements for DS project page tests by @jstourac in #1145
• Add RHOSi Setup and RHOSi Teardown in all test suites of distributed workloads by @ChughShilpa in #1133
• Remove busybox workaround for ray by @diegolovison in #1152
• Fix: Dashboard automation errors for 2.6 pt1 by @FedeAlonso in #1132
• Adjust tests for Kuberay 1.0 by @jiripetrlik in #1150
• Fix timing issue when logging into OpenShift. Remove deprecated jupyter test by @jgarciao in #1154
• Fix library versions tests by @lugi0 in #1143
• Fix pipeline url by @diegolovison in #1156
• Trivial logging update attempt and increase of timeout by @jstourac in #1155
• Update CA_BUNDLE whenever we create DS pipeline server by @apodhrad in #1153
• Fix the broken dryrun tests with Trusty deployment by @nehachopra27 in #1159
• Revert "[Fix] attempt to stabilize the Logged Into OpenShift test (… by @jstourac in #1164
• Increase timeout for DSPO reconciliation retry by @diegolovison in #1163
• Fix broken sanity tests + Add skip wait option in test teardown in model serving by @bdattoma in #1157
• Fix CI ruff check for the take_nap.py file recently added by @jstourac in #1166
• Updating incorrect variable syntax metrics by @nehachopra27 in #1167
• Fix multiple Sanity failures in 2.6 by @lugi0 in #1158
• Use must-gather with sha256 digest by @apodhrad in #1169
• Enhancements for Trusty Tests by @nehachopra27 in #1172
• Fix test some LLM UI tests from Smoke by @bdattoma in #1170
• [Fix] Workbenches - fix xpaths for env variables section by @jstourac in #1173
• [Fix] for the window title to accomodate with RHOAI 2.5 by @jstourac in #1050

Enhancements in scripts and CI/CD

• Add __init__.py files in utils/ to mark directories as Python packages in PyCharm by @jiridanek in #1098
• Add ruff Python linter and suppress reported issues by @jiridanek in #1099
• Fix various Python lint warnings using ruff auto-fixes by @jiridanek in #1100
• Improve the code quality ruff action by @jiridanek in #1119
• Check for pre-created virtual environment to save time on repeated poetry installs by @jiridanek in #1128
• Declare and use currentpath and basepath constants in shell script by @jiridanek in #1137
• Removal of unused Polarion scripts by @jstourac in #1174
• Update defaults for test variables generation. by @jstourac in #1096

Misc

• Rename Force Tags to Test Tags due to deprecation by @jstourac in #1134
• Add take-nap example pipeline by @jgarciao in #1162

Other Changes

• Fix 'Operator Subscription Last Condition Should Be' by @manosnoam in #1079
• Add Check for dependent operator(Serverless and servicemesh) if it is Installed or not by @tarukumar in #1080
• Update of the CONTRIBUTING guide. by @jstourac in #1095
• Add support to validate gpu driver ,demonset etc validator pod verifcation after NFD resource are created by @tarukumar in #1090
• RHODS-12892: Parameterize the hive namespace by @apodhrad i...

2.5.0

What's Changed

New Tests

• [RHOAIENG-136] ODS CI tests which run Codeflare E2E by @jiripetrlik in #1054
• Add Kserve UI tests by @lugi0 in #1062
• Ray and Pipelines integration test by @diegolovison in #1057

Enhancements

• fix: Dashboards UI Tests 1775 and 1814 by @FedeAlonso in #1043
• Update dsc default name by @bdattoma in #1045
• Install Kserve Dependency before RHOAI installation starts by @tarukumar in #1052
• [Fix] for datascience project tests for RHOAI 2.5 by @jstourac in #1049
• Keep ReadWriteOnce as a default for storage class by @diegolovison in #1058
• Enable Ray and Codeflare for DW tests by @jiripetrlik in #1060
• Update Model Serving tests for 2.5 by @bdattoma in #1044
• Always describe clusters with ID by @apodhrad in #1056
• Adding keywords for kserve UI testing by @mwaykole in #1061
• [Fix] capital letters for the particular menu sections by @jstourac in #1063
• Update logic to check requests/limits in containers by @lugi0 in #1072
• [Fix] References to RHOAI in Explore page in our tests by @jstourac in #1073
• [Fix] to distinguish between PVC in pending and PVC in bound status by @jstourac in #1070
• [Fix] The test for the expected error message to be shown to the user by @jstourac in #1074

Enhancements in scripts and CI/CD

• Add dependency operators for deploying RHOAI addon by @aloganat in #1066

Other Changes

• Merge changes for RHOAI 2.5 from temporary branch to master by @jstourac in #1042
• install Dependent operator for kserve by @tarukumar in #1039
• Added suite variable for the Dependent operator to be installed from tasks by @tarukumar in #1051
• Skip pre-req install by default in the KServe test suite by @bdattoma in #1053
• Add bucket_name parameter in upload_download sample pipeline by @diegolovison in #1047
• Add additional logs to installation process by @jiripetrlik in #1048
• Remove verification of monitoring pod for modelmserving by @tarukumar in #1055
• [Fix] attempt to stabilize the Logged Into OpenShift test by @jstourac in #1065
• Add fix for must gather log by @tarukumar in #1069
• Remove extra brackets by @tarukumar in #1071

Full Changelog: 2.4.0...2.5.0

2.4.0

What's Changed

New Tests

• Test Pipeline YAML context menu and verify read only by @manosnoam in #995
• Verify DSPO Operator Reconciliation Retry by @diegolovison in #981

Enhancements

• FIx install issue for Beta channel for managed rhods by @tarukumar in #1004
• [Fix] indentation of the robotframework keyword by @jstourac in #1001
• Add support for odh nightly with new changes by @tarukumar in #1006
• Fix faulty kserve tests by @bdattoma in #1005
• Fix uninstall for odh by @tarukumar in #1007
• Wait pipeline server button be enabled by @diegolovison in #999
• fix button for model serving in 2.4 by @lugi0 in #1008
• Delete csv for odh-nightly by @tarukumar in #1012
• [Fix] Verify Elyra Pipelines In SDS-Based Images by @jstourac in #1016
• Fix monitoring tests in Smoke for RHODS 2.4.0 by @jgarciao in #1017
• [Fix] Tests.Jupyterhub.test-pipChanges-not-permanent by @jstourac in #1015
• fix capitalization of nvidia gpu accelerator by @lugi0 in #1018
• [Fix] of the xpath for the jupyterlab workbench image version check by @jstourac in #1019
• [Fix] test versions for the RHODS 2.4; add TrustyAI and HabanaAI by @jstourac in #1011
• Update tests to use new Caikit + TGIS images by @bdattoma in #1009
• [Fix] make dry-run happy again by @jstourac in #1020
• Update Monitoring tests for RHODS 2.4.0 RC2 by @jgarciao in #1021
• [Fix] we should click on elements that have some size by @jstourac in #1023
• Increase pipeline run timeout by @diegolovison in #1028
• Increase timeout to wait for No pipeline server by @diegolovison in #1029
• Update Model Serving test tags and skip if component is enabled by @bdattoma in #1010
• Add tag with Polarion test case to DW test by @jiripetrlik in #1024
• Check DS listed project by link instead of xpath by @manosnoam in #1036
• [Fix] custom image tests and one test removal by @jstourac in #1030
• Temporally disable verifications of CodeFlare alerting and recording rules for 2.4 by @jgarciao in #1041
• [Fix] test to check various user group access by @jstourac in #1034

Other Changes

• Add support to create DSC without any conditon for rhods24 by @tarukumar in #996
• Revert "Delete csv for odh-nightly" by @tarukumar in #1013
• RHODS-12410 - Create a Robot framework test for running DW tests by @jiripetrlik in #980
• Removal of "Verify Anaconda in Kfdef" Keyword by @asanzgom in #1025
• Change the DSC name based on new changes by @tarukumar in #1026
• Fix managed by @tarukumar in #1022
• Add check for odh nightly by @tarukumar in #1038

New Contributors

• @jiripetrlik made their first contribution in #980

Full Changelog: 1.34.0...2.4.0

1.34.0

What's Changed

New Tests

• Add option to install KServe stack from Script instead of simulating step-by-step by @bdattoma in #947
• Add support to deploy custom runtime for upgrade testing by @tarukumar in #967
• [RHODS-11955] Verify user can edit name and description in a workbenc… by @jstourac in #942
• Add Custom Serving Runtime UI test suite by @bdattoma in #964
• Automate embedded RHODS install by @lugi0 in #924
• Add watsonx basic deployment tests for additional models by @bdattoma in #974
• Add runtime image upgrade test by @bdattoma in #975
• Add WatsonX metrics test by @bdattoma in #985
• Fix custom image tests by @lugi0 in #988

Enhancements

• Revert "workaround for section header regression (#937)" by @bdattoma in #955
• Fix xpath selectors for workbenches and model serving dropdowns in 1.34 by @lugi0 in #960
• Fix for V2 operator install for rhods1.34 by @tarukumar in #961
• Fix starburst enteprise tests by @bdattoma in #958
• Add version check on Elyra libraries by @lugi0 in #962
• Change the ns to have same config as documented by @tarukumar in #973
• Update OpenShift Pipelines to latest version by @diegolovison in #979
• Make DS Project tests independent by @bdattoma in #978
• Compiled upload download yaml for testing purpose by @diegolovison in #982
• Restore two tensor flow tests into sanity by @bdattoma in #986
• Reduce the scope of the mlpipeline_minio_artifact_secret parameter value and dynamic bucket name for Tekton test by @diegolovison in #987
• Changed oc command to get RHODS version on Common.robot by @asanzgom in #989
• Make the ht password shorter by @apodhrad in #990
• [Stabilize] Let's wait for DOM ready before we start to edit workbenches by @jstourac in #993
• [Fix] name of the robotframework keyword Set NVidia GPU Accelerator by @jstourac in #998

Enhancements in scripts and CI/CD

• Fix check uninstall osd cluster by @kornys in #972

Other Changes

• Fix generating XML for polarion with not passed tests by @kornys in #963
• Increase timeout for end to end pipeline using Kfp_tekton by @diegolovison in #966
• Base image for tekton tests by @diegolovison in #984
• fix: Jupyuterhub, workbench and model serving related tests by @FedeAlonso in #971
• [Fix] Typo in the variable name by @jstourac in #994
• addding rosa as supported env by @mwaykole in #997

New Contributors

• @asanzgom made their first contribution in #989
• @apodhrad made their first contribution in #990

Full Changelog: 1.33.0...1.34.0

1.33.0

What's Changed

New Tests

• Add support for model serving in upgrade suite by @tarukumar in #945
• Add support to validate that image provide is based on digest not tags by @tarukumar in #949

Enhancements

• [Fix] Update the expected CUDA version to 12.2 by @jstourac in #917
• Reduce number of IDE errors and wrong imports by @kornys in #913
• [Fix] Update version of numpy to 1.24.4 by @jstourac in #918
• fix culler suite git issues by @lugi0 in #921
• Bump kfp-tekton to 1.5.8 by @diegolovison in #905
• Use 'Create File From Template' KW in 'Compile Inference Service YAML' by @manosnoam in #900
• Update global variables of Prometheus if required by @manosnoam in #903
• Bump kfp-tekton to 1.5.9 by @diegolovison in #932
• Data Science Pipeliens: fix Xpath for Get Workflow Name From Topology Page by @diegolovison in #935
• Update expected external links for Starburst Enterprise test by @bdattoma in #939
• increase scroll amount on env variables section by @lugi0 in #940
• update the locator path for Container size drop down by @tarukumar in #941
• Workaround for Import Pipeline button is ready by @diegolovison in #938
• Fix wrong import of operating system lib by @kornys in #933
• Adding support to look only operator pod in operator namespace by @tarukumar in #950
• Update to Robot Framework 6 by @lugi0 in #923
• util.execute_command() real-time output and ocm.py verbosity level option by @manosnoam in #926
• Fix Openshift Pipelines installation in OCP 4.14 & fix timing issue by @jgarciao in #946
• Small change in README + addition of a flag to open the test reports in a browser after test execution by @jstourac in #936
• Update Smoke Suite by @lugi0 in #948
• fix namespace for odh-nightly by @tarukumar in #954
• [Fix] run_robot_test.sh - OC login and return value by @jstourac in #943
• [Dockerfile] Add fix for using chromium with selenium 4.13 by @bdattoma in #957
• Add sanity tag to DS Project smoke tests by @bdattoma in #959

Enhancements in scripts and CI/CD

• Remove the double quotes from dashboard URL in managed workflow by @aloganat in #928

Other Changes

• Update nightlies install to V2 by @lugi0 in #912
• Add support to uninstall odh-nightly operator by @tarukumar in #914
• Add fix for odh-nightlies on managed cluster by @tarukumar in #915
• Add Test For Non Admin User for Watsonx stack by @tarukumar in #916
• Multiple fixes for GPU scripts by @manosnoam in #922
• Add support to get the RHODS/ODH dashboard URL during run time by @aloganat in #925
• Rename imageSetRef in hive_osp_cluster_template.yaml by @manosnoam in #899
• Use Addon CatalogSource from openshift-marketplace by @winklerm in #920
• Revert "Use Addon CatalogSource from openshift-marketplace" by @tarukumar in #929
• change placeholder text in model serving path field by @lugi0 in #931
• Workaround for section header regression by @lugi0 in #937
• Fix installation of OpenShift Pipelines by @jgarciao in #944
• Add support for CodeFlare operator in RHODS task by @winklerm in #927
• upgrade to Selenium 4.13 by @lugi0 in #952
• fix the machine pool exiting function by @tarukumar in #956

New Contributors

• @jstourac made their first contribution in #917
• @winklerm made their first contribution in #920

Full Changelog: 1.32.0...1.33.0

1.32.0

What's Changed

New Tests

• Add test for multiple models served with WatsonX stack in the same namespace by @bdattoma in #876
• Add support for canary roll out by @tarukumar in #883
• Add test for auto scale using Concurrency by @tarukumar in #889
• Add tests for deploying models with multiple replicas by @bdattoma in #885
• Add Test for scale to zero using kserve by @tarukumar in #896
• Add new tests for WatsonX serving stack by @bdattoma in #893

Enhancements

• Enhance the keyword and remove duplicate keyword call by @tarukumar in #884
• Clean unused Floating IPs in Openstack, before creating new ones by @manosnoam in #881
• Add initial support for running tests on Open Data Hub by @jgarciao in #873
• Update the keyword for odh nightlies by @tarukumar in #892
• Update pyyaml to work ods-ci on macos by @kornys in #891
• Modify DSC CR install for 1.32 RC4 by @lugi0 in #890
• fix uninstall for v2 operator by @lugi0 in #888
• Wait 30 seconds to check if pods are equals to 0 when deleting pipeline server by @diegolovison in #895
• Update keyword to work with V1 and V2 operator by @tarukumar in #901
• ODH support - Use namespace global variables & Rename jupyter notebook ids by @jgarciao in #898
• Check rhods-notebooks namespace only when needed after install by @lugi0 in #902

Documentation

• fix: Inconsisten path in Readme by @FedeAlonso in #894

Other Changes

• Support odh-nightlies channel and update operatorhub install logic by @lugi0 in #880
• Add buckets variables in test-variables.yml by @bdattoma in #882
• Upload Download Pipeline Example by @diegolovison in #875
• Bump kfp-tekton to 1.5.6 by @diegolovison in #886
• Update watsonX tests by @bdattoma in #904
• Remove typo in file path for operatorhub install by @lugi0 in #906
• odh nightlies moved to v2 operator by @tarukumar in #911

New Contributors

• @FedeAlonso made their first contribution in #894

Full Changelog: 1.31.0...1.32.0

1.31.0

What's Changed

New Tests

• First round of automation for new serving stack by @bdattoma in #867
• Add test and keyword to deploy and query models by @bdattoma in #868
• First keywords for operator rearch by @lugi0 in #859

Enhancements

• Add oauth login step by @lugi0 in #870
• Add fixes for Jupyter oauth caching and workbenches xpaths by @lugi0 in #871
• Use the 'Jump to section' links to scroll elements into view by @lugi0 in #872
• Improve the teardown not to fail for corner case scenario by @tarukumar in #878

Other Changes

• Fix rhods installation for build 1.31 by @tarukumar in #863
• Verify No Metadata Pods Were Deployed by @diegolovison in #869
• Install OpenShift Pipelines before running the test by @diegolovison in #874
• Change from Smoke to Sanity to reduce noise by @diegolovison in #879

Full Changelog: 1.30.0...1.31.0

1.30.0

What's Changed

Enhancements

• fix uninstall issue with operatorhub by @tarukumar in #854
• Add option to use custom user settings in ods-ci image by @bdattoma in #841
• Import ODHDataScienceProject/Pipelines.resource to fix dryrun by @diegolovison in #847
• Increase workbench timeout in first Elyra test by @lugi0 in #855
• Disable sharing memory usage for temp file by @kornys in #857
• Delete Pipeline Server by @diegolovison in #848
• Fix model framework heading path for RHODS 1.30 by @lugi0 in #862

Other Changes

• Add extra message by @tarukumar in #858
• Add support for rosa cluster creation by @mwaykole in #837
• Fix login to cluster step with right kubeconfig path by @kornys in #861
• Add support to change-components-stage in test-variable by @mwaykole in #866

New Contributors

• @kornys made their first contribution in #857

Full Changelog: 1.29.0...1.30.0

1.29.0

What's Changed

New Tests

• Add Deletion of pipeline runs by @diegolovison in #812
• Test data science pipeline deletion by @diegolovison in #843
• ODS-1932 - Verify user can edit a S3 data connection by @diegolovison in #846

Enhancements

• Validates OdhDashboardConfig in 'Is RHODS Installed' keyword by @manosnoam in #840
• update model label and pod verification for rhods installtion by @tarukumar in #838
• Enhance OpenShift Pipelines installation depending on environment + pipeline route bugfix by @jgarciao in #839
• Update model serving xpaths for RHODS 1.29 by @lugi0 in #842
• Add teardown for uninstall by @tarukumar in #849
• Fix test using DataSciencePipelinesAPI.Delete * by @diegolovison in #850
• Add out log console for clone repo keyword by @tarukumar in #852
• Wait until pipeline route is ready to avoid firing pipeline alert by @jgarciao in #851

Enhancements in scripts and CI/CD

• Restructure robot xml output file for performing polarion update by @aloganat in #845

Other Changes

• Retrieve Test tags from local branch changes by @diegolovison in #721

Full Changelog: 1.28.1...1.29.0

1.28.1

What's Changed

New Tests

• Automate tests for Elyra Pipelines in Workbenches by @lugi0 in #766

Enhancements

• ods_ci/build/Dockerfile: update to give HOME read/write access to the user by @kpouget in #813
• fix SSL validation for model serving tests in self-managed clusters by @lugi0 in #836

Full Changelog: 1.28.0...1.28.1