Skip to content

Releases: red-hat-data-services/ods-ci

1.11.0

06 Jun 15:36
1c758b9
Compare
Choose a tag to compare

What's Changed

New Tests

  • Add Grafana test to verify if it is shipped and enabled by @pablofelix in #347
  • Verify that Blackbox exporter is shipped and enabled within RHODS by @pablofelix in #357
  • Verify that Dashboard is shipped and enabled within RHODS by @pablofelix in #352
  • Verify Traefik Proxy is deployed in HA by @pablofelix in #354
  • Verify Alert Manager Is Shipped And Enabled Within ODS by @pablofelix in #359
  • Added Tests to Verify MT-SRE Can Connect To Prometheus , Alert Manager Using OpenShift Port-Forwarding by @prudhvi-165 in #348
  • Add jupyterhub test tag by @pablofelix in #356
  • Add test cases for testing QuickStart worflows by @bdattoma in #364
  • Add Tests to verify Grafana Connected to Prometheus using TLS(ODS-963) by @prudhvi-165 in #340
  • Verify pushing project changes to a git repository [ODS-326] by @pranavsuryaw in #276
  • verify rhods-dashboard cluster role by @pablofelix in #365
  • Add test to verify JupyterHub leader monitoring using RHODS Prometheus(ODS-689) by @rkamble5 in #320
  • Verify that Prometheus is shipped and enabled within RHODS by @pablofelix in #353
  • Calculates avg time taken by server to start by @pranavsuryaw in #314
  • Add performance test by @tarukumar in #379
  • Checking for oauth container ODS-355 by @pranavsuryaw in #369
  • Verify CPU And Memory Requests And Limits by @pablofelix in #360
  • Add test to Verify Telemetry Data Is Accessible from jupyterhub/api page by @rkamble5 in #368
  • Add test case to "Verify That MT-SRE Are Not Paged For Alerts In Clusters Used For Development Or Testing" (ODS-1058) by @rkamble5 in #370

Enhancements

  • Anaconda image name change in v1.11 by @lugi0 in #362
  • Changes in ods-1227(verify alert severity) by @rkamble5 in #361
  • Added code to verify the default size by @tarukumar in #373
  • Update tensorflow version check in minimal image by @lugi0 in #375
  • fix RHOSAK test case after changes in UI by @bdattoma in #374
  • added pattern to check failed entry by @tarukumar in #377
  • update ods-ci container to install python3.8 and use RH ubi image by @bdattoma in #372
  • Update ODS-CI container with new features by @bdattoma in #378
  • Add ods-ci serviceaccount variables to test-variables yaml by @bdattoma in #382
  • Sec update for ODS-CI by @bdattoma in #380
  • Add keyword to check for npm library installed version in container by @lugi0 in #381
  • Fix "Verify JupyterHub Deployment" for RHODS < 1.12 by @lugi0 in #384
  • Fix "Usage Data Collection" test. Add keyword "Save Changes In Cluster Settings" by @jgarciao in #383
  • Fix automation bug in "Verify RHODS operator information" (ODS-644) by @pablofelix in #385
  • Fix configuration of autogeneration of release notes by @jgarciao in #351
  • Fix "Test Metric "Notebook CPU Usage" (ODS-178) when cpu usage is null by @rkamble5 in #387
  • fix ODS-293 by adding wait for rollout to start by @bdattoma in #388
  • Miscellaneous fixes for ods-ci 1.11.0 by @jgarciao in #386
  • Update tags for nvcc TC by @lugi0 in #393

Documentation

  • email-report changed to False as run_robot_test.sh by @mwaykole in #366

Other Changes

  • Add test cases for metrics in OpenShift Monitoring: notebook cpu usage, rhods_total_users and rhods_aggregate_availability (RHODS-3288) by @rkamble5 in #312

Full Changelog: 1.10.0...1.11.0

1.10.0

10 May 15:42
ad2d068
Compare
Choose a tag to compare

What's Changed

New Tests

  • Add tests to Verify A Default Image Is Provided And Server Starts Successfully(ODS-469) by @prudhvi-165 in #311
  • Add Tests to Verify NVCC Version in Minimal Cuda Image(ODS-483) by @prudhvi-165 in #315
  • OSD sandbox test case by @tarukumar in #304
  • Add Tests to Verify Package Versions in Notebooks(ODS-468) by @prudhvi-165 in #290
  • Add test to check access, Gid, Uid of /opt/app-root/lib and /opt/app-root/share (ODS-486) by @pranavsuryaw in #288
  • Add testcases for Prometheus metrics "Notebook CPU Usage", "Rhods_Total_Users" and "Rhods_Aggregate_Availability" (ODS-178, ODS-628, ODS-636) by @rkamble5 in #281
  • NB culler test cases by @lugi0 in #295
  • Add test to check dynamic update of available GPUs by @lugi0 in #310
  • Add test case to verify filters in RHODS Dashboard resources page (ODS-489) by @rkamble5 in #286
  • Add Test to Verify that MT-SRE can connect to Grafana using port-forwarding by @mwaykole in #306
  • Add testcase Alert notification emails can be updated but changes don't get updated in alertmanager configuration by @rkamble5 in #296
  • Add Test to Verify Default Access Groups Settings And JupyterLab Notebook Access (ODS-1164) by @prudhvi-165 in #244
  • Verify Tensorflow Can Be Installed In The Minimal Python Image Via Pip [RHODS-3350 ODS-555 ODS-908 ODS-535] by @pranavsuryaw in #262
  • Add Tests to Verify "Notebook images are building" is not shown when no images are building(ODS-307) by @prudhvi-165 in #319
  • add test cases to verify custom notebooks by @lugi0 in #317

Enhancements

  • Add email report feature to ods-ci plus RF task compatibility by @bdattoma in #307
  • By default, disable email report by @jgarciao in #324
  • pvc save changes button by @tarukumar in #316
  • change notbook size by @tarukumar in #330
  • add jq to test container image by @jbpratt in #313
  • add Tier tag to ODS-1226 by @bdattoma in #338
  • Add logic to hide variables values from sensitive keyword by @bdattoma in #248
  • Replacing load witrh safe_load for yaml lib by @mwaykole in #334
  • Close all browsers before starting minimal CUDA test by @lugi0 in #342
  • Modify update_notification_email_address keyword so that it doesn't stop test execution on errors by @tarukumar in #341
  • Update culler wait strategy by @lugi0 in #344
  • Fix some automation bugs in Tier2 by @bdattoma in #343
  • remove explicit secret creation from RHOAM Interop test by @bdattoma in #329
  • Fix CUDA suite setup failure by @lugi0 in #350

Enhancements in scripts and CI/CD

  • Add script to upload results in report portal by @aloganat in #321
  • Workaround fix for idp discovery issue by @aloganat in #326
  • Add support to provide notification email during rhods installation by @aloganat in #349

Documentation

New Contributors

Full Changelog: 1.9.0...1.10.0

1.9.0

15 Apr 13:41
d5a4c2c
Compare
Choose a tag to compare

What's Changed

New Tests

  • Add test case to verify jupyterlab and notebook version in Anaconda i… by @risusing in #284
  • Add test to verify if users can use custom rhods groups to access JH by @bdattoma in #208
  • Add test for RHODS/RHOAM install and unistall scenarios by @bdattoma in #239
  • Added Tests to Verify JupyterHub Pod Logs Dont Have Errors About Distutil Library(ODS-586) by @prudhvi-165 in #252
  • Added tests to Verify A Default Image Is Provided And Starts Successfully(ODS-469) by @prudhvi-165 in #250
  • Add test to verify if Pachyderm can be installed using OpenShift console by @risusing in #275

Enhancements

  • Fix bug in test to verify GPU learning resources in RHODS Resource Section by @risusing in #294
  • precise timeout for JH Deploy by @tarukumar in #301
  • Fix build alert tests adjusting the expected alert timeout by @jgarciao in #291

Enhancements in scripts and CI/CD

Misc

  • Add keyword for setting addon notification email by @tarukumar in #299

Other Changes

  • Revert "Added tests to Verify A Default Image Is Provided And Starts Successfully(ODS-469)" by @lugi0 in #308
  • Add Smoke tag by @lugi0 in #309

Full Changelog: 1.8.0...1.9.0

1.8.0

28 Mar 14:47
59a3ec8
Compare
Choose a tag to compare

What's Changed

New Tests

  • Add new tests for alerts (DeadManSnitch and SLO) by @jgarciao in #226
  • [Test/lib]capture and verify if kfdef event is streaming in openshift or not by @tarukumar in #213
  • implement verification for jupyterlab server pods spawning in the rhods-notebooks namespace by @pranavsuryaw in #229
  • Add test case for verifying if pachyderm is installed by @risusing in #228
  • Add test for backend of custom notebook images by @lugi0 in #233
  • Add test for verifiying alert severity by @lucferbux in #242
  • Add Test Pager Duty Secret Verification by @milindw96 in #245
  • Add test to check blackbox_exporter is protected with auth-proxy(ODS-1090) by @rkamble5 in #251
  • Add test to check JupyterHub version >=1.5,<2.0 by @lugi0 in #257
  • Verify documentation link from dashboard [ods-327 , ods-492] by @pranavsuryaw in #197
  • Added test case to verify starburst beta text have been removed, chan… by @risusing in #261
  • Add tests to verify access to the dashboard settings and Usage Data Collection by @jgarciao in #264
  • Add test to verify RHODS Release version number(ODS-478) by @prudhvi-165 in #240
  • Add Test to Verify git plugin by @pranavsuryaw in #256
  • Add test to verify Login Page Appears While Reaching RHODS Page by @risusing in #273
  • Add test to verify Oath-Proxy Image is fetched From CPaaS by @risusing in #270
  • Add tests to verify logged in users is displayed in dashboard (ODS-354) by @prudhvi-165 in #199
  • Verify GPU Items Appears In Resources Page by @risusing in #272
  • Verify functionality for multiple GPUs in same cluster [RHODS-3190] by @lugi0 in #280
  • Add test case for backend and ui of PVC change by @tarukumar in #282

Enhancements

  • Use "Fix Spawner Status" in between server teardowns by @lugi0 in #237
  • Fix keyword conflict for post-install by @lugi0 in #235
  • Fix HCC Splash page on login and increased timeout to check card existence on Enabled page by @bdattoma in #253
  • Change User Server Cleanup Keyword by @lugi0 in #255
  • Change requirements to robotframework 4.* (and not 5.x) by @jgarciao in #277
  • Skip alert severity test for RHODS < 1.9.0 by @jgarciao in #267
  • Add machine pool if the machine pool not exists with given name by @aloganat in #283
  • Add Execution-Time-Over-30m to build alert tests + small enhacenments by @jgarciao in #287

Enhancements in scripts and CI/CD

  • Add ldap-admin users as dedicated-admins when creating test clusters by @pablofelix in #258

Other Changes

  • Add support to install gpu addon and to create machine pool by @aloganat in #230
  • Add test to verify users get notifications if storage capacity limits get exceeded (ODS-539) by @pranavsuryaw in #227
  • Add JH tag by @lugi0 in #254
  • Add tier1 tag in the TC by @milindw96 in #285

New Contributors

Full Changelog: 1.7.0...1.8.0

1.7.0

07 Mar 12:46
3d414cd
Compare
Choose a tag to compare

What's Changed

New Tests

  • Refactoring, GPU Keywords, minimal CUDA test by @lugi0 in #206
  • Add new test case to check disabled cards in ODS Dashboard by @bdattoma in #209
  • Add test case to verify OOM kill by creating multiple namespace in openshift by @tarukumar in #204
  • Verify that Prometheus image is a CPaaS built image with oc(ODS-734) by @rkamble5 in #225
  • Automated test for text formatting bug - RHODS-3149 by @bdattoma in #216
  • Add new test case for traefik proxy pod container restart count by @tarukumar in #219

New Libraries

  • Add keyword to Install import package and Test to verify Pip Changes by @milindw96 in #202

Enhancements

  • Fix failures in library version check TC by @lugi0 in #215
  • change tier tags for AiApps installation test cases by @bdattoma in #214
  • add three additional test users to test-variables for automating ODS-293 by @bdattoma in #212
  • Add support to remove disabled card for ovms and aikit by @tarukumar in #211
  • Add some polarion IDs and KnownIssues tags to Dashboard/AiApps TCs by @bdattoma in #218
  • Fix for spawner failures in 1.7 automated runs by @lugi0 in #217
  • Remove Anaconda Teardown for Smoke TCs by @bdattoma in #220
  • Fix compatibility issue with OCP4.10 discovered in Anaconda TCs by @bdattoma in #220
  • Refactor prometheus alerts. Lint and check robocop rules by @jgarciao in #221
  • Add Polarion ID for CUDA TC by @lugi0 in #223

Documentation

  • Fix rebase section in CONTRIBUTING.md and small tweak in check-code-style.md by @jgarciao in #207

Misc

  • Add GitHub release config to create release notes automatically by @jgarciao in #231

Other Changes

New Contributors

  • @milindw96 made their first contribution in #202
  • @rkamble5 made their first contribution in #225

Full Changelog: 1.6.0...1.7.0

1.6.0

07 Mar 12:45
eff4c7b
Compare
Choose a tag to compare

What's Changed

Full Changelog: 1.5.0...1.6.0

1.5.0

07 Mar 12:42
Compare
Choose a tag to compare

What's Changed

Full Changelog: 1.3.0...1.5.0

1.3.0

07 Mar 12:40
21a5844
Compare
Choose a tag to compare

What's Changed

  • Fixes for 1.3 sanity run (python ver, new doc keyword) by @lugi0 in #133
  • Add support to get osd version by @aloganat in #131
  • version compare keyword by @lugi0 in #137
  • Update polarion tags and Python version check (tensorflow+pytorch) by @lugi0 in #127
  • Add prefix to RequestLibrary.Get & Fix PVC alert error by @jgarciao in #140
  • Drop .z check from python version by @lugi0 in #143
  • HA components test by @lugi0 in #130
  • Add tag selector option by @pablofelix in #146
  • add keyword to open sidebar before clicking on root folder icon by @bdattoma in #121
  • Automate RHOSAK Enablement and Launch - ODS-392 by @bdattoma in #128
  • Automate test case to Enable and Delete a Kafka Stream (ods 242) by @bdattoma in #134
  • Fix pvc alert teardown by @jgarciao in #144
  • Update Polarion IDs due to document cleanup by @lugi0 in #148
  • enhancement of some keywords to fix anaconda TC by @bdattoma in #145
  • Remove PVC alerts from Smoke and Sanity by @jgarciao in #151
  • Open RHODS apps using hyperlink instead of dropdown by @samuelvl in #149

New Contributors

Full Changelog: 1.2.0...1.3.0

1.2.0

07 Mar 12:35
7c4dfd2
Compare
Choose a tag to compare

What's Changed

  • Add "Clean Up User Notebook" keyword by @jgarciao in #111
  • Add support to install and uninstall rhods using addons by @aloganat in #106
  • adding anaconda key in test-variables.yml by @bdattoma in #114
  • Added status check for enable button in ACE by @tarukumar in #108
  • ODS 516/517 - Added Prometheus Alert for PVC Usage by @lucferbux in #102
  • Add metrics tests (ODS-509 and ODS-510) to smoke by @jgarciao in #118
  • Add automated test for ODS-310 and ODS-367 by @bdattoma in #107
  • Minimal tensorflow test by @lugi0 in #69
  • Add must-gather image test to Sanity and Smoke (ODS-505) by @jgarciao in #119
  • Add support to create ocm.json config based on testing platform by @aloganat in #122
  • Add Automated test to cover ODS-272,344 and 501 by @bdattoma in #120
  • Added support to execute Robot scipt from mac OS by @tarukumar in #115
  • add account keywords for rhosak in test-variables by @bdattoma in #129

New Contributors

Full Changelog: 1.1.1...1.2.0

1.1.1 - RHODS Field Trial!

07 Mar 12:33
99158c0
Compare
Choose a tag to compare

What's Changed

  • Add polarion test IDs to smoke tests by @aloganat in #53
  • Check for new Python version in images by @lugi0 in #54
  • Change the login auth from kubeadmin to test user by @aloganat in #57
  • Refactor the folder structure for the tests by @jgarciao in #60
  • Add minimal image test to Smoke by @lugi0 in #61
  • S3+Git CC Fraud test suite by @lugi0 in #62
  • Add utility scripts to generate testconfig file and to update polarion by @aloganat in #64
  • Add first openshift billing metrics tests by @jgarciao in #63
  • Long running test by @lugi0 in #65
  • New Spawn Keyword with arguments, retries by @lugi0 in #66
  • Special usernames test by @lugi0 in #70
  • Add support to have prometheus token for cluster in config file by @aloganat in #74
  • Fix some issues rhods 1.1.0 by @jgarciao in #72
  • Fix screenshot name escaping by @lugi0 in #71
  • Add support for creating OSD cluster using ocm cli by @aloganat in #76
  • Fix typo in osd cluster create command by @aloganat in #77
  • Verify services available in ODS Dashboard by @jgarciao in #73
  • Add support to create ldap identity provider by @aloganat in #78
  • Fix for not erroring out if idp or user already exists by @aloganat in #80
  • Add LDAP special users to OSD workflow by @lugi0 in #81
  • Fix/s3 test case by @lugi0 in #84
  • remove + from special chars by @lugi0 in #82
  • Modify xpath to find for polarion id tags by @aloganat in #86
  • Fix dictionary handling when empty by @lugi0 in #87
  • Add dependency for CLI library by @vasukulkarni in #89
  • Fix flacky metrics test failing with "no datapoints found" by @jgarciao in #85
  • Adding JH tests for permitted, admin, and non-authorized users by @crobby in #88
  • Add tests for must-gather logs by @VaishnaviHire in #90
  • Create a test for ODS-536 by @tmckayus in #92
  • Move jupyterhub-user-access test to Sanity tests by @LaVLaS in #96
  • Add prometheus url in test-variables config file by @aloganat in #97
  • Add Metrics monitoring tests by @anishasthana in #95
  • Add support to delete osd cluster by @aloganat in #100
  • Fix Stop JupyterHub Notebook Server keyword by @jgarciao in #98
  • Fix billing metrics tests (datapoints found error) and disable checking removed prometheus rule by @jgarciao in #99
  • Test for external links in RHODS Resources section by @bdattoma in #83
  • Add support to install specific osd version by @aloganat in #105
  • Fix monitoring tests ODS-173 and ODS-175 after changes in OpenShift 4.9 by @jgarciao in #104

New Contributors

Full Changelog: 0.1.0...1.1.1