v2.11.0

Updated Tests

-docker/credhub_enabled.go

• Update to not prompt when executing purge-service-offering.

Helpers updates

• helpers/download...
  • Improve error message when API redirects multiple times. #358
    • "can copy package bits to another app and download the package" in v3/package.go fails with a confusing unzip error, when api redirects multiple times, because it tries to unzip the body of a redirect.
      This change stops on the second redirect with an error message emulating what the cf CLI would do.

v2.10.0

Updates:

-- This release reverts changes made in #354 which contained a regex bug causing CATs to fail.

v2.9.0

DO NOT USE - a regex bug was uncovered after this release was published.

We'll revert the change which caused the issue and publish a new release shortly.

Notice:

• This release includes a fix for a leaky credentials bug referenced in the previous release (v2.8.0). (badc83f)

New Tests

-v3/service_instances.go

• Promote test out of capi-experimental into v3 -- validate service instance sharing (which is now GA). (68f18a8)

Other Updates

• helpers/download
  • Improve error reporting when API redirects multiple times. Can copy package bits to another app and download the package fails with a confusing unzip error when the api redirects multiple times because it tries to unzip the body of a redirect. This change updates the error message so it emulates what the cf CLI would do.

v2.8.0

Notice:

• this release was marked as a pre-release after initial publish because a leaky credentials bug was exposed.
  A new release of CATs will be released once the bug is fixed.

New Tests

-v3/deployment.go

• Promote test out of capi-experimental into v3 -- validate zero downtime app deployments.

Updated Tests

-aps/lifecycle.go

• Provide better CATs failure message (the output of cf app) if test fails to match the metrics regex.

v2.7.0

Updated Tests

• v3/app_lifecycle.go
  • make docker image in customizable instead of being hardcoded to cloudfoundry/diego-docker-app:latest #352

Other Updates

• helpers/v3_helpers/v3.go
  • Exit early if package operation fails instead of repeatedly curling 6c52bab

v2.6.0

New Tests

• logging_isolation_segments/logging_isolation_segments.go
  • Tests that the logs from an app running on an isolated Diego cell can be retrieved from the isolated logging system. Your CF deployment must been deployed with a logging isolation segment and this test cannot be run together with the routing_isolation_segments test.

Other Updates

• windows/running_security_groups_win.go
  • Added windows stack -s windows for CATs.

v2.5.0

New Tests

• volume_services/volume_services.go
  • Tests that volume service provided by volume service broker can be bound to the app and the app can use the volumes provided by that service. 23a2316

Other Updates

• assets/catnip
  • updated to fix failing ASG/C2C test when running CATs against newer rootfs. 6c6eaaa

v2.4.0

Updates

• ssh/ssh.go
  • Add more verbose logging around SSH test
• apps/app_stack.go
  • Added support for multiple stacks to be passed in via integration-config.json
    • if no stacks value is included in the config, default stack is set to cflinuxfs2
    • stacks currently supported: cflinuxfs2 and cflinuxfs3

v2.3.0

Updates

• windows/running_security_groups_win.go #338
  • Updated to only do the internet access test when GetIncludeInternetDependent config value is set to true.

v2.2.0

New Features

• In Development--> example-cats-config.json52ef6a0
  • Although not yet finalized, this config will be maintained as the comprehensive listing of what can be enabled in CATs.
  • Used as-is, it will enable the tests we recommend running to provide minimum coverage for your foundation.
  • You may wish to transform it programmatically to run/disable tests within your pipeline(s) as appropriate. ref: #332

Updates

• apps/syslog_drain.go & assets/syslog-drain-listener/syslog_drain.go #335
  • Updated so syslog drain test can pass on NSX-T.
• security_groups/running_security_groups.go #345
  • Updated so security groups test can pass on NSX-T by accommodating both No route to host and Connection timed out errors.