Releases: red-hat-data-services/ods-ci
Releases · red-hat-data-services/ods-ci
1.11.0
What's Changed
New Tests
- Add Grafana test to verify if it is shipped and enabled by @pablofelix in #347
- Verify that Blackbox exporter is shipped and enabled within RHODS by @pablofelix in #357
- Verify that Dashboard is shipped and enabled within RHODS by @pablofelix in #352
- Verify Traefik Proxy is deployed in HA by @pablofelix in #354
- Verify Alert Manager Is Shipped And Enabled Within ODS by @pablofelix in #359
- Added Tests to Verify MT-SRE Can Connect To Prometheus , Alert Manager Using OpenShift Port-Forwarding by @prudhvi-165 in #348
- Add jupyterhub test tag by @pablofelix in #356
- Add test cases for testing QuickStart worflows by @bdattoma in #364
- Add Tests to verify Grafana Connected to Prometheus using TLS(ODS-963) by @prudhvi-165 in #340
- Verify pushing project changes to a git repository [ODS-326] by @pranavsuryaw in #276
- verify rhods-dashboard cluster role by @pablofelix in #365
- Add test to verify JupyterHub leader monitoring using RHODS Prometheus(ODS-689) by @rkamble5 in #320
- Verify that Prometheus is shipped and enabled within RHODS by @pablofelix in #353
- Calculates avg time taken by server to start by @pranavsuryaw in #314
- Add performance test by @tarukumar in #379
- Checking for oauth container ODS-355 by @pranavsuryaw in #369
- Verify CPU And Memory Requests And Limits by @pablofelix in #360
- Add test to Verify Telemetry Data Is Accessible from jupyterhub/api page by @rkamble5 in #368
- Add test case to "Verify That MT-SRE Are Not Paged For Alerts In Clusters Used For Development Or Testing" (ODS-1058) by @rkamble5 in #370
Enhancements
- Anaconda image name change in v1.11 by @lugi0 in #362
- Changes in ods-1227(verify alert severity) by @rkamble5 in #361
- Added code to verify the default size by @tarukumar in #373
- Update tensorflow version check in minimal image by @lugi0 in #375
- fix RHOSAK test case after changes in UI by @bdattoma in #374
- added pattern to check failed entry by @tarukumar in #377
- update ods-ci container to install python3.8 and use RH ubi image by @bdattoma in #372
- Update ODS-CI container with new features by @bdattoma in #378
- Add ods-ci serviceaccount variables to test-variables yaml by @bdattoma in #382
- Sec update for ODS-CI by @bdattoma in #380
- Add keyword to check for npm library installed version in container by @lugi0 in #381
- Fix "Verify JupyterHub Deployment" for RHODS < 1.12 by @lugi0 in #384
- Fix "Usage Data Collection" test. Add keyword "Save Changes In Cluster Settings" by @jgarciao in #383
- Fix automation bug in "Verify RHODS operator information" (ODS-644) by @pablofelix in #385
- Fix configuration of autogeneration of release notes by @jgarciao in #351
- Fix "Test Metric "Notebook CPU Usage" (ODS-178) when cpu usage is null by @rkamble5 in #387
- fix ODS-293 by adding wait for rollout to start by @bdattoma in #388
- Miscellaneous fixes for ods-ci 1.11.0 by @jgarciao in #386
- Update tags for nvcc TC by @lugi0 in #393
Documentation
Other Changes
- Add test cases for metrics in OpenShift Monitoring: notebook cpu usage, rhods_total_users and rhods_aggregate_availability (RHODS-3288) by @rkamble5 in #312
Full Changelog: 1.10.0...1.11.0
1.10.0
What's Changed
New Tests
- Add tests to Verify A Default Image Is Provided And Server Starts Successfully(ODS-469) by @prudhvi-165 in #311
- Add Tests to Verify NVCC Version in Minimal Cuda Image(ODS-483) by @prudhvi-165 in #315
- OSD sandbox test case by @tarukumar in #304
- Add Tests to Verify Package Versions in Notebooks(ODS-468) by @prudhvi-165 in #290
- Add test to check access, Gid, Uid of /opt/app-root/lib and /opt/app-root/share (ODS-486) by @pranavsuryaw in #288
- Add testcases for Prometheus metrics "Notebook CPU Usage", "Rhods_Total_Users" and "Rhods_Aggregate_Availability" (ODS-178, ODS-628, ODS-636) by @rkamble5 in #281
- NB culler test cases by @lugi0 in #295
- Add test to check dynamic update of available GPUs by @lugi0 in #310
- Add test case to verify filters in RHODS Dashboard resources page (ODS-489) by @rkamble5 in #286
- Add Test to Verify that MT-SRE can connect to Grafana using port-forwarding by @mwaykole in #306
- Add testcase Alert notification emails can be updated but changes don't get updated in alertmanager configuration by @rkamble5 in #296
- Add Test to Verify Default Access Groups Settings And JupyterLab Notebook Access (ODS-1164) by @prudhvi-165 in #244
- Verify Tensorflow Can Be Installed In The Minimal Python Image Via Pip [RHODS-3350 ODS-555 ODS-908 ODS-535] by @pranavsuryaw in #262
- Add Tests to Verify "Notebook images are building" is not shown when no images are building(ODS-307) by @prudhvi-165 in #319
- add test cases to verify custom notebooks by @lugi0 in #317
Enhancements
- Add email report feature to ods-ci plus RF task compatibility by @bdattoma in #307
- By default, disable email report by @jgarciao in #324
- pvc save changes button by @tarukumar in #316
- change notbook size by @tarukumar in #330
- add jq to test container image by @jbpratt in #313
- add Tier tag to ODS-1226 by @bdattoma in #338
- Add logic to hide variables values from sensitive keyword by @bdattoma in #248
- Replacing load witrh safe_load for yaml lib by @mwaykole in #334
- Close all browsers before starting minimal CUDA test by @lugi0 in #342
- Modify update_notification_email_address keyword so that it doesn't stop test execution on errors by @tarukumar in #341
- Update culler wait strategy by @lugi0 in #344
- Fix some automation bugs in Tier2 by @bdattoma in #343
- remove explicit secret creation from RHOAM Interop test by @bdattoma in #329
- Fix CUDA suite setup failure by @lugi0 in #350
Enhancements in scripts and CI/CD
- Add script to upload results in report portal by @aloganat in #321
- Workaround fix for idp discovery issue by @aloganat in #326
- Add support to provide notification email during rhods installation by @aloganat in #349
Documentation
New Contributors
Full Changelog: 1.9.0...1.10.0
1.9.0
What's Changed
New Tests
- Add test case to verify jupyterlab and notebook version in Anaconda i… by @risusing in #284
- Add test to verify if users can use custom rhods groups to access JH by @bdattoma in #208
- Add test for RHODS/RHOAM install and unistall scenarios by @bdattoma in #239
- Added Tests to Verify JupyterHub Pod Logs Dont Have Errors About Distutil Library(ODS-586) by @prudhvi-165 in #252
- Added tests to Verify A Default Image Is Provided And Starts Successfully(ODS-469) by @prudhvi-165 in #250
- Add test to verify if Pachyderm can be installed using OpenShift console by @risusing in #275
Enhancements
- Fix bug in test to verify GPU learning resources in RHODS Resource Section by @risusing in #294
- precise timeout for JH Deploy by @tarukumar in #301
- Fix build alert tests adjusting the expected alert timeout by @jgarciao in #291
Enhancements in scripts and CI/CD
- Add email address to addon notification field by @tarukumar in #297
- Fix and update ods-ci to run in container by @bdattoma in #205
Misc
- Add keyword for setting addon notification email by @tarukumar in #299
Other Changes
- Revert "Added tests to Verify A Default Image Is Provided And Starts Successfully(ODS-469)" by @lugi0 in #308
- Add Smoke tag by @lugi0 in #309
Full Changelog: 1.8.0...1.9.0
1.8.0
What's Changed
New Tests
- Add new tests for alerts (DeadManSnitch and SLO) by @jgarciao in #226
- [Test/lib]capture and verify if kfdef event is streaming in openshift or not by @tarukumar in #213
- implement verification for jupyterlab server pods spawning in the rhods-notebooks namespace by @pranavsuryaw in #229
- Add test case for verifying if pachyderm is installed by @risusing in #228
- Add test for backend of custom notebook images by @lugi0 in #233
- Add test for verifiying alert severity by @lucferbux in #242
- Add Test Pager Duty Secret Verification by @milindw96 in #245
- Add test to check blackbox_exporter is protected with auth-proxy(ODS-1090) by @rkamble5 in #251
- Add test to check JupyterHub version >=1.5,<2.0 by @lugi0 in #257
- Verify documentation link from dashboard [ods-327 , ods-492] by @pranavsuryaw in #197
- Added test case to verify starburst beta text have been removed, chan… by @risusing in #261
- Add tests to verify access to the dashboard settings and Usage Data Collection by @jgarciao in #264
- Add test to verify RHODS Release version number(ODS-478) by @prudhvi-165 in #240
- Add Test to Verify git plugin by @pranavsuryaw in #256
- Add test to verify Login Page Appears While Reaching RHODS Page by @risusing in #273
- Add test to verify Oath-Proxy Image is fetched From CPaaS by @risusing in #270
- Add tests to verify logged in users is displayed in dashboard (ODS-354) by @prudhvi-165 in #199
- Verify GPU Items Appears In Resources Page by @risusing in #272
- Verify functionality for multiple GPUs in same cluster [RHODS-3190] by @lugi0 in #280
- Add test case for backend and ui of PVC change by @tarukumar in #282
Enhancements
- Use "Fix Spawner Status" in between server teardowns by @lugi0 in #237
- Fix keyword conflict for post-install by @lugi0 in #235
- Fix HCC Splash page on login and increased timeout to check card existence on Enabled page by @bdattoma in #253
- Change User Server Cleanup Keyword by @lugi0 in #255
- Change requirements to robotframework 4.* (and not 5.x) by @jgarciao in #277
- Skip alert severity test for RHODS < 1.9.0 by @jgarciao in #267
- Add machine pool if the machine pool not exists with given name by @aloganat in #283
- Add Execution-Time-Over-30m to build alert tests + small enhacenments by @jgarciao in #287
Enhancements in scripts and CI/CD
- Add ldap-admin users as dedicated-admins when creating test clusters by @pablofelix in #258
Other Changes
- Add support to install gpu addon and to create machine pool by @aloganat in #230
- Add test to verify users get notifications if storage capacity limits get exceeded (ODS-539) by @pranavsuryaw in #227
- Add JH tag by @lugi0 in #254
- Add tier1 tag in the TC by @milindw96 in #285
New Contributors
- @pranavsuryaw made their first contribution in #229
- @risusing made their first contribution in #228
- @prudhvi-165 made their first contribution in #232
Full Changelog: 1.7.0...1.8.0
1.7.0
What's Changed
New Tests
- Refactoring, GPU Keywords, minimal CUDA test by @lugi0 in #206
- Add new test case to check disabled cards in ODS Dashboard by @bdattoma in #209
- Add test case to verify OOM kill by creating multiple namespace in openshift by @tarukumar in #204
- Verify that Prometheus image is a CPaaS built image with oc(ODS-734) by @rkamble5 in #225
- Automated test for text formatting bug - RHODS-3149 by @bdattoma in #216
- Add new test case for traefik proxy pod container restart count by @tarukumar in #219
New Libraries
- Add keyword to Install import package and Test to verify Pip Changes by @milindw96 in #202
Enhancements
- Fix failures in library version check TC by @lugi0 in #215
- change tier tags for AiApps installation test cases by @bdattoma in #214
- add three additional test users to test-variables for automating ODS-293 by @bdattoma in #212
- Add support to remove disabled card for ovms and aikit by @tarukumar in #211
- Add some polarion IDs and KnownIssues tags to Dashboard/AiApps TCs by @bdattoma in #218
- Fix for spawner failures in 1.7 automated runs by @lugi0 in #217
- Remove Anaconda Teardown for Smoke TCs by @bdattoma in #220
- Fix compatibility issue with OCP4.10 discovered in Anaconda TCs by @bdattoma in #220
- Refactor prometheus alerts. Lint and check robocop rules by @jgarciao in #221
- Add Polarion ID for CUDA TC by @lugi0 in #223
Documentation
Misc
Other Changes
- request and limit size verification by @tarukumar in #193
New Contributors
Full Changelog: 1.6.0...1.7.0
1.6.0
What's Changed
- Add olm installation by @pablofelix in #152
- ignore teardown failure on Splash Page by @bdattoma in #178
- Basic keyword to work with Marketplace by @tarukumar in #163
- Added TC to check error in rhods operator logs by @tarukumar in #174
- update test-variables example file by @bdattoma in #192
- Hotfix patch for rhods operator by @tarukumar in #187
- created new PR to have both Tcs AIKIT/openvino by @tarukumar in #181
- Implementation of ODS-488 by @bdattoma in #183
- delete empty directory by @bdattoma in #194
- Add robocop & robotidy configuration and document usage by @jgarciao in #195
- Disable RenameKeywords transformer in robotidy.toml by @jgarciao in #200
- Unify version check TC by @lugi0 in #184
- integrate RHOSAK TC for new UI changes by @bdattoma in #190
- Integrate ACE and RHOSAK TCs with new feature to remove disabled cards from dashboard by @bdattoma in #189
Full Changelog: 1.5.0...1.6.0
1.5.0
What's Changed
- Added Keyword in Teardown to reset Setting for ACe using OpenShiftCLi by @tarukumar in #132
- Fix polarion update script to handle multiple instances of testcases by @aloganat in #153
- Refactoring ocm.py wrt usability by @aloganat in #150
- Fix uninstall addon check in ocm.py by @aloganat in #156
- Update JupyterLab version by @VaishnaviHire in #126
- Add support to pick versions from channel group by @aloganat in #157
- Fix PVC alert test teardown by @jgarciao in #158
- remove logout keyword from Jupyterlab Git Notebook test case by @bdattoma in #155
- fix select region html id for RHOSAK ODS-242 by @bdattoma in #154
- Added ODS-498 for text verification by @tarukumar in #124
- Add script to check plugin image changes by @tarukumar in #142
- add rhosak test configs in testvariables by @bdattoma in #161
- Add support to create vm instances in openstack by @aloganat in #160
- Upgrade pip to latest version by @aloganat in #164
- to handle the failure occurs for smoke by @tarukumar in #167
- [WIP] 1.3 new UI by @lugi0 in #125
- Added code to show missing plugins by @tarukumar in #168
- Adapt test ODS-175 to RHODS-1.5.0 by @jgarciao in #169
- Use branch "main" when cloning pylero by @jgarciao in #173
- Automation of RHOSAK UseCase by @bdattoma in #141
- remove ODS-242 from suite by @bdattoma in #176
- Catch ValueError exception in GTE keyword on invalid SemVer by @LaVLaS in #175
- Make pvc alert test teardown more robust by @jgarciao in #177
- Add precise wait for spawner being ready by @lugi0 in #170
- Enabled images check by @lugi0 in #171
- Update
Spawn Notebook With Arguments
and related TCs by @lugi0 in #172 - remove wait for JL splash page and kernel popup from RHOSAK test by @bdattoma in #179
- Fix failing spawn keyword by @lugi0 in #180
Full Changelog: 1.3.0...1.5.0
1.3.0
What's Changed
- Fixes for 1.3 sanity run (python ver, new doc keyword) by @lugi0 in #133
- Add support to get osd version by @aloganat in #131
- version compare keyword by @lugi0 in #137
- Update polarion tags and Python version check (tensorflow+pytorch) by @lugi0 in #127
- Add prefix to RequestLibrary.Get & Fix PVC alert error by @jgarciao in #140
- Drop .z check from python version by @lugi0 in #143
- HA components test by @lugi0 in #130
- Add tag selector option by @pablofelix in #146
- add keyword to open sidebar before clicking on root folder icon by @bdattoma in #121
- Automate RHOSAK Enablement and Launch - ODS-392 by @bdattoma in #128
- Automate test case to Enable and Delete a Kafka Stream (ods 242) by @bdattoma in #134
- Fix pvc alert teardown by @jgarciao in #144
- Update Polarion IDs due to document cleanup by @lugi0 in #148
- enhancement of some keywords to fix anaconda TC by @bdattoma in #145
- Remove PVC alerts from Smoke and Sanity by @jgarciao in #151
- Open RHODS apps using hyperlink instead of dropdown by @samuelvl in #149
New Contributors
Full Changelog: 1.2.0...1.3.0
1.2.0
What's Changed
- Add "Clean Up User Notebook" keyword by @jgarciao in #111
- Add support to install and uninstall rhods using addons by @aloganat in #106
- adding anaconda key in test-variables.yml by @bdattoma in #114
- Added status check for enable button in ACE by @tarukumar in #108
- ODS 516/517 - Added Prometheus Alert for PVC Usage by @lucferbux in #102
- Add metrics tests (ODS-509 and ODS-510) to smoke by @jgarciao in #118
- Add automated test for ODS-310 and ODS-367 by @bdattoma in #107
- Minimal tensorflow test by @lugi0 in #69
- Add must-gather image test to Sanity and Smoke (ODS-505) by @jgarciao in #119
- Add support to create ocm.json config based on testing platform by @aloganat in #122
- Add Automated test to cover ODS-272,344 and 501 by @bdattoma in #120
- Added support to execute Robot scipt from mac OS by @tarukumar in #115
- add account keywords for rhosak in test-variables by @bdattoma in #129
New Contributors
- @lucferbux made their first contribution in #102
Full Changelog: 1.1.1...1.2.0
1.1.1 - RHODS Field Trial!
What's Changed
- Add polarion test IDs to smoke tests by @aloganat in #53
- Check for new Python version in images by @lugi0 in #54
- Change the login auth from kubeadmin to test user by @aloganat in #57
- Refactor the folder structure for the tests by @jgarciao in #60
- Add minimal image test to Smoke by @lugi0 in #61
- S3+Git CC Fraud test suite by @lugi0 in #62
- Add utility scripts to generate testconfig file and to update polarion by @aloganat in #64
- Add first openshift billing metrics tests by @jgarciao in #63
- Long running test by @lugi0 in #65
- New Spawn Keyword with arguments, retries by @lugi0 in #66
- Special usernames test by @lugi0 in #70
- Add support to have prometheus token for cluster in config file by @aloganat in #74
- Fix some issues rhods 1.1.0 by @jgarciao in #72
- Fix screenshot name escaping by @lugi0 in #71
- Add support for creating OSD cluster using ocm cli by @aloganat in #76
- Fix typo in osd cluster create command by @aloganat in #77
- Verify services available in ODS Dashboard by @jgarciao in #73
- Add support to create ldap identity provider by @aloganat in #78
- Fix for not erroring out if idp or user already exists by @aloganat in #80
- Add LDAP special users to OSD workflow by @lugi0 in #81
- Fix/s3 test case by @lugi0 in #84
- remove
+
from special chars by @lugi0 in #82 - Modify xpath to find for polarion id tags by @aloganat in #86
- Fix dictionary handling when empty by @lugi0 in #87
- Add dependency for CLI library by @vasukulkarni in #89
- Fix flacky metrics test failing with "no datapoints found" by @jgarciao in #85
- Adding JH tests for permitted, admin, and non-authorized users by @crobby in #88
- Add tests for must-gather logs by @VaishnaviHire in #90
- Create a test for ODS-536 by @tmckayus in #92
- Move jupyterhub-user-access test to Sanity tests by @LaVLaS in #96
- Add prometheus url in test-variables config file by @aloganat in #97
- Add Metrics monitoring tests by @anishasthana in #95
- Add support to delete osd cluster by @aloganat in #100
- Fix Stop JupyterHub Notebook Server keyword by @jgarciao in #98
- Fix billing metrics tests (datapoints found error) and disable checking removed prometheus rule by @jgarciao in #99
- Test for external links in RHODS Resources section by @bdattoma in #83
- Add support to install specific osd version by @aloganat in #105
- Fix monitoring tests ODS-173 and ODS-175 after changes in OpenShift 4.9 by @jgarciao in #104
New Contributors
- @tmckayus made their first contribution in #92
- @anishasthana made their first contribution in #95
Full Changelog: 0.1.0...1.1.1