Getting refstack-client / tempest to work for SCS certification

Getting a test list

The test list is based on https://opendev.org/openinfra/interop/src/branch/master/guidelines/2022.11.json. A flattened list is available under test-list.txt

Note: The flattened list in this repo is missing tempest.api.identity.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists (see below)

Exclude test_default_domain_exists

tempest.api.identity.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists needs to be excluded. This operation cannot be done as a regular user (member) if the user is not in a domain called default.

Patch test_rebuild_server()

The test_rebuild_server() check will rebuild the server and then complain that the SSH host key is not the same as before. This is to be expected with pretty much any cloud image, as they generate the keys on first boot. I think this is due to paramiko adding the key at the first time.

Apply the provided patch paramiko-hostkey.patch to always trust any SSH keys, even if they change.