CHANGES
=======

15.0.0
------

* Remove unused variable and unnecessary instance variable in network
* Remove deprecated compute config options for validation
* Remove unused variable in compute and volume
* Add DeleteErrorException
* Remove unused neutron_available
* Add skip if public_network_id is not specified
* Remove input-scenario config options
* Fix AttributeError in wait_for_volume_retype
* Try boot a vm with lower than min ram
* admin/test_flavors: some code cleanup and factorization
* Remove deprecated network config options
* Remove redundant parameters for server creation
* Remove deprecated compute microversion config options
* Add PreconditionFailed exception for HTTP 412 errors
* Check whether server is located on the requested host
* Use test_utils.call_until_true in tempest tests
* Update _create_test_user in identity base
* Finish switching to decorators.idempotent_id
* Remove redundant setup_client method
* Fix router port IP address references
* Introduce flake8-import-order
* Remove skip of test_stamp_pattern
* Add resources_prefix to rand_name when created
* Enable sphinx on servers_client
* Make wait_until default as 'ACTIVE' in manager.create_server
* Add create_flavor in compute.base
* Add v14.0.0 releasenote
* Use correct routers_client in _delete_router
* Swift list containers should test for reverse listing param
* Revert "Fix _check_network_external_connectivity in test_network_basic_ops"
* Fixed wrong link in microversion_testing.rst
* test_create_server_from_volume_snapshot: assert dict is not empty before accessing a key
* Fix AZ List Detail schema to allow hosts as None
* Get server fault if snapshot fails
* Add unit tests for BaseV2ComputeTest.create_image_from_server
* Remove wait_for_server from create_image_from_server
* Implied roles API tests
* Fix _check_network_external_connectivity in test_network_basic_ops
* Switch to decorators.idempotent_id on scenario
* Add test.attr for negative tests
* Switch to decorators.idempotent_id on volume
* Switch to decorators.idempotent_id on orchestration
* Switch to decorators.idempotent_id on object_storage
* Switch to decorators.idempotent_id on network
* Switch to decorators.idempotent_id on image
* Add test_create_is_domain_project
* Implied roles methods
* Remove unused client from "_create_network" method
* Log server state changes when waiting for delete
* Add related_bug for bug/1660878
* let addCleanup use the current client
* Fix map usage on py3 in v2 test_volumes_snapshots_list
* Fix tests which use 'display_name' for both V1 and V2
* ssh: Add proxy support
* Add related bug#1659811 for tenant_id filter compute tests
* Fix date-time format checking in response schema
* Add test for compute API microversion 2.42
* Create volume from private volume type
* Snapshot v2 pagination tests
* Switch to decorators.idempotent_id on identity
* Switch to decorators.idempotent_id on compute.*
* Switch to decorators.idempotent_id on compute.servers
* Switch to decorators.idempotent_id on compute.admin
* Remove default_params_with_timeout_values variable
* Refactor test_roles_client
* Use single underscore variable in loop iteration(in compute)
* Use single underscore variable in loop iteration(in identity)
* Remove a redundant 'body' variable
* Add extra elements check for 'show_volume_type' command
* Remove ListImagesTest from test_images
* Don't skip Cinder backup tests based on Swift's availability
* Fix update_host API response schema
* Using oslo_log instead of logging
* Use single underscore variable in loop iteration
* Remove a redundant cleanup_snapshot method
* [py35] Fixes to get more tempest tests working
* Add tempest tests for volume retype with migration
* Migrate volume while attached to an instance
* Fix test test_rescue_unrescue_instance
* Modify the indentation problem for the if loop
* Boot server from snapshot
* Add namespace tags client and tests
* Correct print pattern in rest_client
* Fix compute baremetal service client tests
* Replaces yaml.load() with yaml.safe_load()
* Add random name in base._create_keypair
* Modify comments in xxx_name_length_exceeds_256
* Add generate_random_security_group_id in BaseSecurityGroupsTest
* Use oslo.log library instead of system logging module
* Improve volume_backed logic in create_test_server
* Add a test case for metadata POST
* Fix logging messages not being formatted correctly
* Shared images test create with default visibility
* Use Token Clients from the client factory
* Use invalid id with rand string instead of special char
* Add short options to tempest
* Remove unnecessary name definitions
* Define 'delete_snapshot' method as a static method
* Feature flag: allow disabling 'manage snapshot' tests
* Use 'attach_volume' method
* Add tempest test to test NoVNC support
* Formally deprecate the allow_port_security_disabled feature flag
* Define 'delete_volume' method as a static method
* Allow not the same sequence in container_formats and disk_formats
* Fix a typo in 'attach_volume' docstring
* Unmanage and manage snapshots
* Fix variable name
* Set PYTHON env variable for python3
* Deprecate the volume_feature_enabled.volume_services feature flag
* Use base.delete_server in addCleanup
* Deprecate the identity-feature-enabled.reseller config option
* Remove an unused variable in the BaseTestCase class
* Remove the tempest/tests/negative/ directory
* Check error message returned by the system
* Removes unnecessary utf-8 encoding
* Replace six.iteritems with dict.items
* Remove 'id' from expected in SecurityGroupRulesTestJSON
* Remove _migrate_server_to's return value
* Add related_bug() to 1629110's test
* Remove skip for Heat-Neutron tests
* Add test namespace object functions in images
* Remove redundant assertIn('id', xxx)
* Do not use message=msg in InvalidConfiguration
* Add a test for reproducing bug/1651064
* Removes unnecessary utf-8 coding
* Correct boundary value of image id length
* Add check user access in test_remove_member
* Port object_storage tests to Py3
* Add accounts.yaml to .gitignore
* Making all identity service clients as tempest available

14.0.0
------

* Use call_and_ignore_notfound_exc method
* Fix container cleanup in test_account_bulk
* Rename reno files for releasing 14.0.0
* Fix service clients for kwargs as None or 0
* Use lower value to create flavor for creating server
* Define v3 domains_client as library
* Add releasenotes for baremtal tests removal
* Forcing dynamic credentials for identity admin
* Clients.py: add back the default_params_with_timeout_values class variable
* Hacking: enable H904
* Add connectivity check test for migration with revert
* Avoid volume limit usage for existing volumes
* Do not use self.volume_origin in volume.base.attach_volume
* Remove unused clients in setup_clients
* Use ephemeral=0 to create flavor without ephemeral disk
* Fix flavor_client create_flavor interface
* test_service_providers: require service-type ext
* Add volume backup description parameter
* Do not create volume in resource_setup for test_volume_reset_status
* Remove unused CONF and LOG
* Remove unused client in SecurityGroupRulesNegativeTestJSON
* Use base.delete_server in base.rebuild_server
* Few updates for baremtal dependent tests
* Removing baremetal tests from tempest tree
* Use base.delete_server in ServersTestJSON
* Improve volume pools tests code
* Fix a few Python 3.x issues
* PCI-DSS tests
* Separate capabilities service method from account_client
* Add test.related_bug() to know launchpad bug reports
* Make identity v3 domains_client use **kwargs
* Set auth in clients before they are used
* Add namespace property unittest
* Use base.create_volume in VolumesTestJSON
* Remove unused client in setup_clients
* Backup and restore bootable volume
* Docs: Add the remote tag to the badge image
* Network test: rework the service types/service providers tests
* Correct improper comment
* tempest/test.py: make set_validation_resources() more idiomatic
* Use wait_until in create_test_server to wait for server ACTIVE
* Wait for server to be active before deleting
* Improve help message for scheduler_available_filters
* Correct tempest reraising of exception
* Add status_code to RESTful exceptions
* Honour discoverability feature flag in swift tests
* Add extra unit tests for base_url
* Remove the Auto Tests Generators
* Tox.ini: removed an outdated code comment
* Tox: Hacking: enable extensions H106 and H203
* Remove unused admin_hosts_client
* Add server_group in default_quota_set
* Correct variable usage error in test_get_hypervisor_uptime
* Correct fake V3 token responses
* Delete volume first before deleting snapshot
* Replace str(uuid.uuid4) with uuidutils.generate_uuid()
* Modify incorrect import path
* Add get metadata schema test methods
* Remove unused client
* Change personality inject path to /
* Add sleep(2) when try to delete a container
* Use different file content to test max_number_personality_files
* Correct boundary value test in ImagesOneServerNegativeTestJSON
* Remove prepare_instance_network in ImagesOneServerNegativeTestJSON
* Rename test_delete_image_id_is_over_35_character_limit
* Write a couple of test cases together
* Add a test for attaching 2 volumes to a server
* Make common->compute->shelve_server param more clear
* Add resource clean for tests
* Add server group limits in test_absLimits_get
* Remove unnessary assertIsNotNone
* Fix unit-test test_user_messages file name
* Use TempestException from tempest.lib
* Added bindep.txt to the project
* Remove _is_true() from test_volumes_actions.py
* Specify snapshot size when creating volume
* Add possibility to pass prefix before cli command
* Remove setup_client method
* Add 'Negative' to negative test class names
* Rename "VolumesCloneTest" class name to "VolumesV2CloneTest"
* Add test create volume from bootable volume
* Add resize_server in compute.base
* Fix compute test_attach_volume
* Remove old v3 volume services library and use lib/service for v3
* Create two new clients under tempest.lib libary
* Fix typo in documentation
* Show team and repo badges on README
* Minor fix in role_assignments_client docstring
* Remove an obselete msg from then optimize a router test case
* Updated from global requirements
* Move role_assignments_client to tempest lib
* Use names containing "non-existing" as non-existing resource names
* Do not use instance variable in FloatingIPsNegativeTestJSON
* Replace directly import of logging with import oslo_log
* Remove CONF.volume_feature_enabled.bootable
* Rename testcase names with 'with_out' to 'without'
* Add namespace properties client and tests
* Add deprecated_reason for nova_cert
* Integration tests for device role tagging
* Check project connectivity on port admin state
* Add wait_for_server_termination in test_server_basic_ops
* Updated API ref link as single line which is more readable
* Add hypervisor_type option
* Make the parameter 'device' optional
* Remove skipException for volume creation failure
* Remove negative_rest_client
* Make get_partitions() work for partitioned disks
* Use names containing "invalid" or "nonexistent" as invalid name
* Make Identity v2 service clients as available  module
* Check volume and minimum disk sizes to create volume
* Cinder absolute-limits tests
* Improved Cinder snapshot tests
* Remove unused client in ServerMetadataTestJSON
* Remove meaningless assignment
* Use call_and_ignore_notfound_exc to cleanup floating-ip-bulk
* Move list_hosts to resource_setup in test_hosts_negative
* Add missing volume snapshot skip
* Do not remove server_groups from default_quota_set
* Use assertIs(Not)None to check for None
* Add api ref link in TenantUsagesClient
* Fix ref link in volume v1 service clients
* Fix volume_create to use shared function with a cleanup
* Delete duplicated dvr tests
* Bump hacking version in test-requirements.txt
* Use the correct path of InvalidConfiguration
* Typo fixing
* Move wait_for_interface_status to waiters
* Wait for FIP status to get to DOWN in test_router_rescheduling
* Improve error message on volume tests failure
* fix bulk service name
* _log_console_output missing space
* Updated from global requirements
* Fix glance create image
* Use more specific asserts in tests
* Get rid of useless tenant_id attribiute
* _log_console_output do not raise NotFound
* Move cred_client to tempest.lib
* Update volume client class description
* Updated from global requirements
* Add connectivity check test for migration
* Validate power_state enums in compute API response schema
* compute/images/test_images_oneserver: don't share resources
* Updated from global requirements
* Fix cinder message-client naming to volume_v3_messages_client
* Delete TimeoutException in tempest/exceptions.py
* Require l3-ha extension for test_centralized_router_update_to_dvr
* Add negative tests about update-volume API
* Fixing 'test_verify_created_server_ephemeral_disk' test
* Do not have heat to connect to external service
* Use InvalidCredentials exception from correct path
* Use random name in network common function
* Remove services/volume/{v1,v2} directories
* Remove a redundant dictionary
* Fix a docstring typo in manager.py
* Remove unnecessary function _create_multiple_servers
* Pop name from volume.base.create_server
* Boot a server from a non-bootable volume
* Use assertGreater(Equal) over assertTrue
* Make the non ha router usage explicit in a dvr test
* Fix race in test_networks.py: don't try to get a possibly-deleted network
* Correct a scheme example error from fake netutron versions client
* Use is_scheduler_filter_enabled for ServerGroupAffinityFilter
* Add random name in scenario.manager.create_server
* [TrivialFix] Replace 'assertTrue(a in b)' with 'assertIn(a, b)'
* Use random name in common function
* Use random name in volume.base.create_snapshot
* Use base.create_test_server_group to create server group
* Define image status enums for compute proxy API schema
* Pass username on v3 token issue
* Move some network tests from Neutron to Tempest
* Add missing tests for the image v2 API
* Use assertGreater(Equal) over assertTrue
* delete list_all_container_objects in the container_client
* Updated from global requirements
* Add _error_checker() call on versions_client
* Remove unused arguments from _error_checker()
* Use assertGreater(len(x), 0) over assertTrue(len(x) > 0)
* Revert "Skip unstable v6 scenario tests"
* Repalce to "tempest account-generator"
* Don't rely on testtools.tests
* Remove the Stress framework
* Use rand name in common function in scenario tests
* Use common function create_volume to create test volume
* Add test_volumes_list functions in test_volumes_list.py
* Use random name in network common function
* Correct image's random name
* Set random name in common function create_server
* Remove unnecessary name definition
* Remove unnecessary function _create_multiple_servers
* Fix a typo in test_security_groups.py
* Remove testscenarios denpendency
* Image cleanup is missing in test_create_delete_image
* Remove one-line function in test_volumes_actions
* Fix a typo in test_networks.py
* Move volume service clients under tempest.lib
* Skip test_volume_backed_live_migration unconditionally
* Revert an accidental error modification of config item help message
* Deprecate nova api extensions config option
* Fix wording for python3.4 section in the readme
* Stop using subprocess for testr init in tempest init
* Improve error reporting when workspace not registered
* Move InvalidConfiguration exception to tempest.lib
* Use lib version of data_utils in dynamic creds
* Move cred_provider abstract class to tempest lib
* Remove CONF usage from dynamic_creds module
* Remove the NegativeAutoTest Framework
* waiters.py: raise BackupException defined in tempest/lib
* Use Cinder v2 by default in scenario tests
* Remove NetworksIPV6TestAttrs duplicate tests
* Correct 'list index out of range' in FloatingIPDetailsTestJSON
* Add test list namespace function
* Correct 'list index out of range' error in dhcp agent test
* Isolate change_server_password to use its own server
* Remove unnecessary name definition
* Add unit tests for volume quotas_client
* Add port parameter to ssh Client
* Add unit tests for volume snapshots_client
* Use common func create_volume in test_volumes_actions
* Remove unused func _detach
* Correct improper assert judgement
* Remove redundant assert judgement
* Add a generic method for backup creation
* Remove unnecessary wait-for-volume-available
* Add list the primary tenant
* Add negative tests for deleting attached volume
* Updated from global requirements
* Use a common method for is a router interface
* Rename reno files of 13.0.0
* Fix the 13.0.0 newton release note
* Remove duplicate python-subunit from test-requirements.txt
* Add v13.0.0 release note page
* Enable release notes translation

13.0.0
------

* Add release notes for start of Newton support
* Add unit tests for encryption_types_client
* Remove meaningless volume negative test
* Only call register_service_clients if there are clients
* Test case with list-instance-actions for deleted server
* Remove Sahara tests from Tempest
* Updated from global requirements
* Clarify the guideline of negative tests
* Moving scenario docstring under the relevant test method
* Remove a redundant image_id variable
* Re-use common methods in ServerRescueNegativeTestJSON
* Re-use common methods in test_rebuild_server_with_volume_attached
* Re-use common methods in test_delete_server_while_in_attached_volume
* Re-use common volume create/attach methods in test_iscsi_volume
* Add compute API admin test for swap volume
* Switch unit test tox jobs to use ostestr
* Fix docstrings in Tempest REST client for Ironic
* Add link for Unset keys and update some links in qos_client
* Permission changes: Python file should be 0644 not 0775
* Migrate backups clients to tempest.lib
* Add a test for revert cold migration
* Adding a new option CONF.network.dvr_extra_resources
* Add 'code-block' and revise tab
* Reviewing guideline: ask for CRD when new test+feature flag
* Remove over-comment
* Add existing volumes when using pre-provisioned credentials
* Trivial: Delete a definition that is not needed
* Updated from global requirements
* Fix typo in the file
* Add inherited role assignments tests
* Fix tempest init inconsistency when it fails
* Update hotplug test description
* Docstrings should not start with a space
* Correct a misleading in docstring
* Allow for wait in _restore_password
* Fix a few grammatical errors in docs
* Correct several typos
* Trivial: Remove redundant variable
* Updated from global requirements
* Add a test for cold migration
* Remove redundant links to clients
* Wait for floating_ip to detach from server after deletion
* test_images_oneserver - use the addCleanup mechanism
* test_list_servers_by_admin(specified_tenant) for preexisting servers
* Add prefix "$" for command examples
* Remove misleading arguments
* Fix Release Notes index page title
* standardize release note page ordering
* Add more swift container negative tests
* Introduce a new tox target that checks requirements.txt
* Fix compute test_agents tests
* Remove a redundent variable
* Fix LOG.warn to LOG.warning
* Change into staticmethod
* Skip some tests if security-group extension is disabled
* Move wait_for_qos_operations method to common.waiters
* Move wait_for_backup_status function to common.waiters
* Add test to get images by owner
* Avoid local variable referenced before assignment
* Move test_snapshot_list_* tests to new file
* Remove invalid assertions for 304 resp
* neutron: added test case to check connectivity using MTU sized frames
* Updated from global requirements
* Fix assert for public networks with multiple subnets
* Remove residual package
* Define v2 encryption_types_client as library
* Remove duplicated judgement
* Migrate V1 and V2 qos service to tempest lib
* Fix missing serial option of tox full-serial target
* Rename renos of 12.1.0
* Rename renos of 10.0.0 and 11.0.0
* Trivial: group import statement in client.py
* Deprecate method get_ipv6_addr_by_EUI64
* Don't include openstack directory in exclude list for flake8
* Delete Savanna element in client list
* Container Services underscore in metadata key translate to dash
* Remove image v1 test_delete_image_with_invalid_image_id
* tempest-cleanup can only be invoked as tempest cleanup
* Fix subunit-trace output with tempest run
* Fix typo in data_utils.py
* remove unused statement
* Split base snapshots_client into v1 and v2
* Revert "Fix of verify_glance_api_versions"
* Define v1 encryption_types_client as library
* Rename renos of 12.2.0
* Fix with using oslo_serialization base64 module
* Use other item instead of security_group in network-quotas test
* Fill name param in create_test_server
* Switch tox to use tempest run and deprecate bash runners
* Scenario: server_basic_ops: use regular variable (not instance var)
* Define the volume types_client as library
* Scenario: object_storage_basic_ops: move and update test description
* Scenario: test_minimum_basic: remove useless function
* Scenarios: remove redundant call to `resource_setup()`
* Add some params docstring to create_server
* Add config option to create networks with port_security_enabled
* Always wait on server delete
* Remove _setup_network_and_servers() in TestNetworkAdvancedServerOps
* Fix credential client to return raw response
* Use ConfigParser instead of SafeConfigParser
* Update skip message in overlimit testcases
* Remove unnecessary resource_setup()
* Modify use of assertTrue(A in B)
* Rename test_list_servers_filter_by_server_status
* Ignore deb-* packaging repos in the plugin list
* Fix the docstring of _default_security_group
* Remove unnecessary __init__.py of identity v2
* Replace volume's "test" name with classname as prefix
* Update Available para link of image v1 client
* Remove tests/fake_auth_provider
* Use local variable for volume instead of instance one
* Add description to the help of enable_instance_password
* Update tempest init help message
* Remove auth_request as no used
* Reordering tests under the approprite directories
* py3: Miscellaneous fixes
* Define v3 credentials_client as library
* Define v3 trusts_client as library
* Move method to v2 volumes_client
* Update Available para link of keystone v3 client
* Use api_extensions to decide security_group type nova used
* Move v3 inherited_roles_client to library interface
* Move v3 roles_client to library interface
* Define separate inherited_roles_client for inherited roles
* Validate floating IP in server['addresses'] scenario
* Use an instance method instead of class method
* Define v3 identity_client as library
* Update Available para link of network client
* Move 3 volume methods to v2 volumes_client
* Remove base_types_client for the reability
* Separate encryption_types_client from types_client
* Don't create network resources for identity tests
* Define the v3 Users Client as a library
* Define v3 Groups Client as library
* Update Available params of image
* Delete duplicate if judgment
* Use testcase name as prefix of resource name
* Add skip logic for admin cred in test_auto_allocate_network
* Make identity v3 roles_client use **kwargs
* Define v2 identity_client as library
* Add deprecated code review guideline

12.2.0
------

* Remove unnecessary resource_cleanup/setup
* Narrow assertion in attach/delete volume test
* test_list_servers_by_admin for preexisting servers
* Move wait_for_qos_operations into base volume test
* Move `call_until_true` to tempest/lib
* Fix doc build if git is absent
* Count volumes vs partitions and remove hard-coded expected result
* Remove get_attachment_from_volume()
* Remove the default size in volumes_client
* Remove unused methods from volumes_client
* Define v3 projects_client as library
* Add omitted blank space to assert_msg
* Update user and tenant client's Available params link
* Use quota_set instead of default_quota_set
* Remove a word 'smoke' from some scenario tests
* Add volume clone flag to clone tests
* Add doc section on expectations of clean tenants
* Adding testcases for metadata def resource types
* Fix MismatchError in test_host_name_is_same_as_server_name
* Define v3 services_client as library
* Add a space between super's and setUpClass
* Use expect_empty_body flag
* Remove unused global variable from VolumesV1NegativeTest class
* Define v3 regions_client as library
* Remove the update_object() in object_client
* Move volume-type-access methods to volume v2
* Skip admin floating IP tests if router extension is disabled
* Remove expected_success check in images_client
* Add a release note link on README
* Fix docstrings to match with method arguments
* Adding update backups quota
* Remove unused config.CONF
* Revert "skip get-me-a-network tests"
* Deprecate meaningless TYPE
* Clean imports in code
* Exclude gateway_ip of subnet in get_unused_ip_addresses
* Delete unuesd function arguments in rest_client
* TrivialFix: Remove cfg import unused
* skip get-me-a-network tests
* TrivialFix: Remove logging import unused
* Fix mutliple attach/detach issue
* Add using dash options instead of underscore
* Remove thirdparty from tox.ini
* Lower the aes-xts-plain64 key_size to 256
* Create resources using wrapper utility
* Improve test_update_image_metadata testcase
* Update volume type details
* Fix OverLimit's message
* Add admin list_servers test with invalid_status
* Use 'OS-EXT-SRV-ATTR:host' directly
* Fix exec_command to hang indefinitely
* Call addCleanup(delete_server) immediately after resize server
* Fix parameter receive
* Added logic to validate storage policy info
* Remove unnecessary setUp()
* remove unnecessary call in test_delete_container
* Make args of types_client same
* Fix test_volume_services testcase
* Revert "Move dscv and ca_certs to config section service_clients"
* Remove an unused function in object_client
* Use classname as prefix of volume name
* Use cls in class method instead of self
* Scenario: remove the `addCleanup_with_wait` helper method
* Add compute API tests for 'get-me-a-network'
* test_schedule_to_all_nodes should choose available nodes
* Class Credentials not define __ne__() built-in function
* Update the links to api-ref of network
* Add existing volumes when using pre-provisioned credentials
* Delete no need definitions
* Use cls in classmethod instead of self
* Remove unnecessary str() from some clients
* Remove skip statement for bug 1450859 is fixed
* Fix test_shelve_volume_backed_instance
* Remove useless parenthesis
* Fixed net_id key evaluation for net['id']
* Remove a redundent resource_cleanup method
* Remove the test_upload_large_objects negative test
* Improving test_volumes_get testcase
* Add missing config file read to tempest init
* Adds to verify_cinder_api_versions api_v3 check
* Remove unnecessary str() from base_types_client
* Fixed manager.py to support multinode test on vnic_port
* Remove unnessary delete_volume in test_volumes_list
* Define volume quotas_client as library
* Remove base_quotas_client for the reability
* Fix of verify_glance_api_versions
* Fallback to creds provider for fixed IP network if no network_for_ssh
* Fix checks for content length in object storage tests
* Fix network_for_ssh config option help
* Fix reference to nonexistent ssh_connect_method in config help
* change nova_cert config to default False and deprecate it
* skip test_connectivity_between_vms_on_different_networks
* Fix manager->get_auth_provider interface
* Move dscv and ca_certs to config section service_clients
* Configure stable service clients via the registry
* Define volume services_client as library
* Define volume hosts_client as library
* Remove unnecessary str() which was for XML
* Don't load non json body
* Migrate service_clients to tempest.lib
* Fix tempest and available modules
* boot into a network that has "port_security_enabled=False"
* Updated from global requirements
* Remove a redundant wait_for_backup_deletion()
* Make identity v3 users_client use **kwargs
* Make identity v3 credentials_client use **kwargs
* Define volume availability_zones_client as library
* Define volume extensions_clients as library
* Fix notes which differnt from actual parameters
* Add a TODO to remove Ironic related workaround
* Optional setting service client on factory
* Make identity v3 services_client use **kwargs
* Make identity v3 groups_client use **kwargs
* Remove deprecated Javelin CLI utilities from Tempest
* Add : to docstring of service_clients
* Fix. Do not create port if vnic_type defined and port is passed
* Run attach/detach volume tests even without ssh
* assertEqual can be used instead of assertListEqual
* Set timeout value in urllib3.poolmanager.PoolManager
* Updated from global requirements
* Update the links to api-ref of network
* Remove the wapper method show_quota_usage()
* Remove unused TYPE from base_quotas_client
* Remove base_services_client for the reability
* Remove base_hosts_client for the reability
* Skip test_reassign_port_between_servers until fixed
* Delete unused parameters
* Do not use $ in regex
* Modified into a more appropriate function
* Modify a spelling mistake
* Delete no meaningful definition
* Remove base_availability_zone_client for the reability
* Remove base_extensions_client for the reability
* Minor change to comment
* Migrate image client group to client factory
* Migrate network client group to client factory
* Migrate compute client group to client factory
* Register Tempest clients via the new interface
* Service Clients registration interface for plugins
* Fix README
* Replace OpenStack LLC with OpenStack Foundation
* Add available params in compute clients' comment
* Add volume type description support
* Do not use $ in OS user password
* Use skip_checks in test_snapshot_pattern
* Deprecate run_tests.sh
* Fix typo about message of exception
* Add server_id in exception ServerUnreachable
* Skip unstable v6 scenario tests
* Fix release notes around
* Increase size of subnet allocation pool
* Define v3 policies_client as library
* Updated from global requirements
* Define v3 endpoints_client as library
* Fix subunit-describe-calls name of usage
* py3: Replace map/filter with a list comprehension
* Modify comment which does not conform to code
* Introduce the ClientsFactory
* Add available params in volume clients' comment
* Reverse order of get_unused_ip_addresses
* Remove unused LOG to keep code clean
* Add new live_migration case to support block_migration=auto
* Remove DataGenerator from the dentity base
* Remove DataGenerator from admin V3 identity tests
* Remove DataGenerator from admin V2 identity tests
* Add python 3.5 classifier and venv
* Fix typo in tempest/run help document
* cinder backup reset status
* Use skip_checks instead of skipUnless in TestShelveInstance
* Add a test for attach/detach port on multiple servers
* Add sync to avoid the loss of pub key data
* Fix typo in Test Removal Procedure doc
* Correct reraising of exception
* Requirements.txt: remove pyOpenSSL
* Removes explicit looping over dict .keys() method
* Add available params in metering labels client's comment
* Add available params in ports client's comment
* Add available params in neutron security group client's comment
* Updated from global requirements
* Don't enable DHCP on floating IP subnet tests
* Add missing validation to test_delete_saving_image
* Remove non-locking accounts from the config guide
* Add available params in network clients' comment
* Add available params in subnet pools client's comment
* Add available params in neutron security group rule client's comment
* Add available params in baremetal client's comment
* Add available params in identity v2 client's comment
* Remove unused LOG
* Add available params in neutron float ips client's comment
* Add documentation for glance api
* Factor up (most) CONF value in clients.Manager
* Check network_data info in config drive tests
* Update docstring for create_test_server
* Remove the unused tenant and user option in cleanup
* Moving backup test under non admin directory
* Remove white space between print and ()
* Cinder get-capabilities tests
* Add available params in networks client's comment
* Add available params in subnets client's comment
* Tempest: Fixed a typo
* Fix minor details in README
* Update quickstart for revised temepst init setup
* Making delete_on_termination configurable
* Extend server schema for extended volume attribute
* Fix test_project_create_with_parent
* Updated from global requirements
* Disable file injection by default
* Add purge flag in image_meta_to_headers
* Delete dynamic tenant correctly when _cleanup_default_secgroup fails
* Cleanup tempest quickstart
* Remove duplicated identity v2 clients
* Fix teardown of the identity api
* Use find_test_caller in test_utils instead of in misc
* Add basic tempest run instructions to the quickstart
* Add support for specifying a config file to tempest run
* Add request/response to subunit-describe-calls
* Adds clone/snapshot volume test for create volume
* Add documentation for glance api

12.1.0
------

* Add support for workspaces to tempest run
* Add whitelist and blacklist file options to tempest run
* Add plugin registry generation to sphinx build
* Fix subunit describe calls utility document warnings
* Tidy up document index page
* Define 4 identity v2 clients as libraries
* Updated from global requirements
* Prepare the Manager class for tempest.lib
* Fix resize tests
* Fix search disk name for the config_drive in scenario test
* Remove unused service tags and client
* Member role may already exist
* Remove placeholder file from releasenotes/notes dir
* Add parent_id to create_project
* Remove trove tests from tempest
* Add __pycache__ to .gitignore
* Define v1 images_client as library
* Move image_meta_to_headers from images_client
* Py3: don't access the `unicode` type directly
* Remove unnecessary __init__ and resource_setup/cleanup
* Fix AttributeError with run_validation=true
* Add available params in base_volumes_client's comment
* Fix assertItemsEqual usage for py3
* Add workspace subcommands help
* Fix Available params docs in service clients
* Add Available params in volume backup and snapshot clients
* Correct "Available params" link in create_flavor
* Move properties handling to the test side
* Add guidance on negative tests in HACKING.rst
* Api specs for update_volume_image_metadata
* Remove the _try_wrapper function from identity tests
* Cleanup projects in reverse order
* Restriction on sequence of allowed address pairs
* Fix the init command global conf dir path
* Py3: Don't use dict.keys()[0], dict.values()[0] or dict.items()[0]
* Remove testscenarios usage from test_server_basic_ops
* Fixed typo in in data_utils.py
* Remove unnecessary setUp and tearDown
* Add subunit-describe-calls
* Move oslo config generator config inside package
* Add section on release notes to reviewing doc
* Service client modules in various services  __init__
* Service client modules in object-storage __init__
* Service client modules in image __init__
* Service client modules in volume __init__
* Fix un-assignment local variable 'returncode' error
* Add test removal procedure doc
* Cinder volume type access tests
* Add available params in set metadata
* Test-requirements: Bump hacking to >=0.11
* Image metadata for volume
* Service client modules in identity __init__
* Volume pagination with specific tenant
* Update identity v2 users_client methods name
* Correct some misspelt words in print messages
* Service client modules in network __init__
* Service client modules in compute __init__
* Move helper methods for object_storage to base.py
* Generic "delete volume" method
* Remove unused LOG from images_client
* Define v1 image_members_client as library
* Make `tempest init` working dir an abspath
* Return ResponseBody object from delete_role
* Make identity v2 roles_client use **kwargs
* Make identity v2 tenants_client use **kwargs
* Make identity v2 user_client use **kwargs
* Make identity v2 service_client use **kwargs
* Add IPv6 rule creation to validation resources
* Add a response schema for "log" attribute
* Add tests for Cinder user messages v3 API
* Backup create using force flag
* Fixes port.id bug added with 777a307b3c9f4284facf081e6b951b5755333adf
* Change hostname_equals_servername to get_hostname
* Add operator role to heat stack owner
* Cleanup exceptions in tempest
* Consider pre-existing VMs when testing server list
* Add InvalidIdentityVersion in lib.exception
* Remove neutron OO wrappers
* Rename mathods of v1 image_members_client
* Quota usage after volume transfer
* Add available params in identity client's comment
* Clarify "data" arg in create/update_image()
* Move get_image_meta_from_headers from images_client
* Remove the test path of image service
* Add image API version to the reno
* Remove unnecessary setUp()
* Define v2 endpoints_client as libarry
* Make endpoints_client use **kwargs
* tempest: use host instead of hypervisor for aggregate test
* Make --concurrency not required in account_generator cmd
* Add available params in attach_volume's comment
* Define v2 images_client as library
* Add missing tests for the identity v3 API
* Fix dsvm typo to dscv
* Use is_valid_ipv4 from oslo.utils
* Fix rendering of account generator utility authentication table
* Fix docs warnings of auth
* Fix the reno format of image-clients-as-library
* Disable SmartyPants for docs
* Add tempest run command
* Count partitions starting with sd prefix
* Move reno of add-tempest-workspaces
* Stop passing TestResources to Managers
* Define _set_network_clients
* Define _set_image_clients
* Remove unused return value from take_action
* Define image_members_client of image v2 as library
* Use scope in v3 identity client
* Rename image members clients
* Define 3 image clients as libraries
* Add unit tests for glance v2 service clients
* Separate resource_types_client from images_client
* Allows specifying a name for a particular endpoint
* Add unit test coverage for account generator
* Cleanup some small issues in the microversion testing doc
* Fix cinder volume nameing for admin
* Remove use_default_creds from preprov creds
* Fix the v2 image client variable name
* Centralized Workspaces
* Make missing global config dir not fatal in tempest init
* Separate Image v1 members client
* Separate schemas_client from v2 images_client
* Cleanup wording and section for remote access config doc
* Let method _get_ssh_connection handle timeout error
* Separate namespaces_client from v2 images_client
* Separate Image v2 members client
* Fixed a Typo
* Adding/fixing docstring to _create_creds function
* Add vcs string to version option output
* Account generator for identity v3
* Tempest image clients use version in URL
* test_aggregates should choose available compute node
* Remove unused _get_file_size()
* Check which glance client version to use
* Define routers_client as library interface
* Move comptue base test to common dir
* Remove tempest/tests/services/compute path
* Remove unnecessary __init__()
* Updated from global requirements
* Return 'DOWN' ports when Ironic enabled
* Make username and project use same random ID
* Increase test coverage on preprov creds
* Fix volume backup import test
* Change "$>" to "$" as CLI prompt
* Not to create security group when security_group ext is disabled
* Fix Tempest testing way on the doc
* Remove integrated dashboard tests
* Add hacking rule to enfore no config in tempest.lib
* Remove delete_extra_routes()
* Remove update_extra_routes()
* Remove GET ops from update_router()
* Updated from global requirements
* Keep py3.X compatibility for urllib
* Revert "Modify --endpoint-type to --os-endpoint-type for nova"
* Correct test_get_usage_tenant's AttributeError
* Use @wraps decorator
* Introduce new helper: call_and_ignore_notfound_exc()
* Unit test: fix flaky test_networks_returned_with_creds
* Remove the `file_utils` module
* Modify --endpoint-type to --os-endpoint-type for nova
* Remove the Glance HTTP client. Use the common Rest Client instead
* Use api_extensions to decide security_group type nova used
* Moved Cinder QOS tests to admin directory
* Finish removing legacy credentials
* Add admin role on domain for v3
* Swift object client: use urllib3 builtin support for chunked transfer
* Fix docs errors and warnings
* Use common "waiters.wait_for_image_status" function everywhere
* Heat: wait condition: allow insecure HTTPS url
* Introduce scope in the auth API
* Rename get_image_meta method into check_image for Glance V1 client
* Hash credentials on user, project/tenant and pwd
* Modify --endpoint-type to --os-endpoint-type for nova
* Remove kilo config flags from Tempest
* Document tempest APIs which plugins may use
* Fix update_password tests
* Use mock instead of relying on command stderr
* Add simple test for Neutron GET /
* Remove deprecated legacy credentials provider
* Modify projects_client to receive more attributes
* Add missing test for the object storage v1 API
* Updated from global requirements
* Cinder storage pools tests
* Docs: Fix Hacking guide bulleting
* Improve logging of credentials
* Add assertion to test_create_security_group_rule_with_invalid_ports
* Update cfg option network_for_ssh's help msg
* Correct misspelt word in msg in test_images.py
* Add a test case for rebuild of instances with volumes
* Revert "Skip test_resize_volume_backed_server_confirm for now"
* Adding wait_for_resource_deletion function for volume cleanup
* Skip test_resize_volume_backed_server_confirm for now
* Addresses Expect: 100-continue client behavior
* Change scenario test 'test_resize_server_confirm'
* Add separate release notes page for 12.0.0
* Improve RestClient rate limiting

12.0.0
------

* Add release notes for kilo EOL release
* Add test case for CONF skip decorators with message
* Ensure tempest tests don't assume IP address allocation strategy
* Snapshot list using 'limit' parameter
* Add cleanup in identity/test_users_negative.py
* Adding documentation to dynamic_creds functions
* Editing descripition for _create_loginable_secgroup_rule
* Skip multinodes testing if no same/different scheduler filter enabled
* Correct mispell words in comments
* test_port_security_macspoofing_port: Don't assume DHCP port
* Fix the docstring of skip_unless_config()
* ssh before shelve to avoid ssh failures
* Pass server to RemoteClient in API tests
* Extend remote client to allow for better debugging
* Use a single venv for all tempest jobs
* trove: skip broken tests
* Added random Infiniband GUID address generator
* Update configuration docs wrt admin credentials
* Remove few refercences left to tempest-lib
* Remove negative test framework documentation
* Removed q-vpn from the list of dirty logs
* Migrate network resources into scenario path
* object_storage/object_client.py: kill some dead code
* Fix reference to tempest_lib
* Verify config support keystone on subpath
* Fix tempest init to update config options
* Fix conf file open mode when "tempest init"
* Volume: remove a useless `_delete_volume_type` alias
* Py3: `reduce` is not a built-in anymore, use six.moves instead
* Py3: fix an error when adding two `dict_items`
* Add option to tempest init to show global conf dir
* Fix error message about credential
* Search another path for etc/tempest
* Use the same logic for selecting config path
* Remove unnecessary space in help
* Make README.rst consistent
* Add generic CONF skip decorators
* Fix base unit test class location
* Fix account generator error message
* Remove Ceilometer tempest tests
* Fix usage of rest_client expected_success() in tests
* Add ostestr tox jobs
* Add tests of fixed_ips in the attach interfaces nova API
* Skip test_volume_list_with_detail_param_marker
* Updated from global requirements
* List only alive agents
* SSH: Do not rely on the .closed attribute
* Align multiple lines in tox
* Add pep8 check to use data_utils.rand_uuid()
* Fix rest_client's expected_success for non int status
* Add a test for reverting a resize with a deleted flavor
* Remove definitions of unused exception classes
* Remove iso8601 and anyjson from requirements.txt
* Remove old cinder multibackend configuration from tempest.conf
* "is_resource_deleted" fails to verify delete
* Microversion v2.20 tests: nova volume operations when shelved
* Move shelve server logic in compute utility
* Add compute 2.10 microversion tests info in doc
* Replace Mox with Mock
* Do not create network resources in verify-config
* Updated from global requirements
* Get rid of httplib2, use urllib3 instead
* Remove openstack-common.conf
* Updated Image Not Created Error Thrown
* Remove JSON from class name
* Fix version replacement when path
* Refactor extract code to function in auth.py
* Use tempest.tests.lib.base instead of tempest.tests.base
* Adding explanation comment for multi-node test
* Fix Review Checklist URL
* Enable T108 check for network api tests
* Update extra_headers param docstring
* Updated from global requirements
* Add separate release notes page for v11.0.0
* Move multi-tenant server negative tests into subclass
* Change alarm client name and tenant name
* Change assertTrue(isinstance()) by optimal assert
* Extend T110 check for lib's service clients
* Added test for router's port update with fixed IP

11.0.0
------

* Move keypair client to lib interfaces
* Skip test_compare_db_flavors_with_os
* deprecate use of tenant in configs
* Make ports_client use common waiter method
* Fix volume mountpoint - read from configuration file
* Remove AuthorizationTestJSON tests
* Ignore created_at/updated_at in test_show_port
* Fix `test_requires_ext_decorator_with_all_ext_enabled`
* Add pep8 check for tempest.lib import
* Prepare for dynamic generation of tempest plugin registry
* Remove the migrated service client
* Add T111 history to HACKING.rst
* Use common "waiters.wait_for_snapshot_status" function everywhere
* Removing wrapper method for "wait_for_volume_status" function
* Fix typo in variable name
* Add pypi download + version badges into README.rst
* Removing some redundant words
* Fix a few typos in microversion doc
* Add release notes for tempest release 11.0.0
* Add release notes page for v10.0.0
* glance_http: add IPv6 support
* More info when fail to get api version
* Fix comments in microversion doc
* Removed deprecation warning from 'tempest --help'
* Correct server basic ops test case name
* Add microversion testing doc in tempest
* Move wait_for_resource_status()
* Move list_dhcp_agents_on_hosting_network()
* Remove redundant list_router_interfaces()
* Fix tests when having multiple floating pools
* Update the docs on ssh validation
* Add tests for compute v2.10 microversion
* include domain_id when creating groups
* Remove unsed wrapper method
* Trivial: Fix some document comments in microversion
* Make routers_client use **kwargs
* Add support of microversion in all compute service clients
* Cinder verifies getting volume list with marker
* Fix API test for external subnet visibility
* Add note a section to lib doc about where to put plugins
* Fix cleanup CLI for router client
* Fix PendingDeprecationWarning for assert*
* Migrated microversion testing framework to tempest/lib
* Move microversion config options to 'compute' section
* Remove tempest duplicate copy of skip_unless_attr
* Fix V3 credential behavior, documentation
* TrivialFix: Remove pending deprecationwarning
* Optimize "open" method with context manager
* Adding a note to 'test_update_user_password' test for Keystone V2
* Update comments for keystone precision and fernet
* Unskip test_list_virtual_interfaces
* Use tempest.lib's base module for network clients
* Split out Neutron routers client
* Make 'device' optional in volume attach response schema
* Test base_url works with an unversioned endpoint
* Switch hdp to cdh in the default list of Sahara plugins
* common/compute.py: remove some useless code
* Added support to verify extra-routes deletion
* Fix typo in library doc title
* Allow get_tenant_network() for non-primary creds
* network: Fix subnet_allocation extension check
* Use urlunparse to reconstruct base_url
* Add OS-INHERIT of keystone v3 in api tempest
* Actually run `test_skip_attr_*` unit tests
* Making Keystone clients consistent
* Fixes LiveBlockMigrationTestJSON.test_iscsi_volume bad call
* Remove service_client module
* Use tempest.lib clients for bulk ops
* Allow heat volume tests to use configured volume size
* Updated from global requirements
* Make network clients use rest_client
* Make identity clients use rest_client
* Make image clients use rest_client
* Make volume clients use rest_client
* Make database/telemetry clients use rest_client
* Unit tests: mock some time.sleep and time.time
* Fix ambiguous method name
* Add more detail info to EndpointNotFound
* Make object/orchestration clients use rest_client
* Implement TIMEOUT_SCALING_FACTOR for tempest
* Scenario/manager.py: always wait when delete a cinder vol

10.0.0
------

* Security Groups multi-node scenario
* Add LOG.info to boot from volume tests
* Fix test_get_service_by_host_name
* Make compute keypairs_client use rest_client
* Make data_processing/baremetal use rest_client
* Add release notes for upcoming release
* Properly handle failures during resource cleanup
* Add documentation for the library interface
* Split roles_client for keystone v3 client
* Tokens need user domain be created correctly
* Make identity service client class name consistent
* Cleanup useless aliasing in test_container_acl
* Updated from global requirements
* Add Identity v3 account configuration information
* Allow user to be disabled
* Instance ID was corrected
* Use isinstance instead of type
* Added processing /compute URL for getting list of versions
* Allow image name to be empty for simple list test
* remove largeops test
* Skip test_volume_backed_live_migration()
* Add reno to tempest
* Use tempest.lib code in tempest
* Deprecate Tempest stress tests
* Migrate tempest-lib code into new lib dir
* Skip Heat neutron tests
* Use new oslo.config api to generate configuration-group help
* Split trusts_client from keystone V3 client
* Split domains_client from keystone V3 client
* Minor test style update
* Add microversion fixture to set microversion
* Remove virtualenv management scripts from oslo-incubator
* Remove zaqar tests from tempest
* Python 3 deprecated the logger.warn method in favor of warning
* Enable logging if log_config_append is None
* Fix cleanup command
* Fix cleanup cmd for assigning role to user
* Remove redundant interfaces from v3 identity client
* Remove some dead code
* Remove test test_create_delete_server_group_with_multiple_policies
* Get NIC name by "ip -o link"
* Use subnetpools_client from tempest-lib
* Use quotas/security_groups clients from tempest-lib
* Don't run testcase if interface_attach is False
* Remove MapR 4.0.1 tempest test
* Skip the test_get_service_by_host_name
* skip overlimit tests when default quota set is -1
* Split users_client from keystone V3 client
* Separate projects client from identity V3 client
* Fix cleanup for networking quota
* Updated from global requirements
* Revert "Remove setup_credentials from orchestration tests"
* Add cleanup for endpoint tests
* Remove old code for Juno compatibility
* Log more info when mke2fs fails on a guest
* Use 2 network clients from tempest-lib
* Update .mailmap
* Fix KeyError in exception message of manager
* Revert "Add new test "RebuildInstanceWithVolume""
* Add tests of port_id in the attach interfaces nova API
* Updated from global requirements
* Updated .gitignore to work with ide
* Update the home page
* Make v3 identity_client consistent
* Emit warning when instances have ports not ACTIVE
* Fixing typos in tempest/test.py
* Fixed bug with url building
* Add new test "RebuildInstanceWithVolume"
* Add note about ironic config options
* Make 2 functions in network_client use **kwargs
* Only run dual-NIC/dual-stack IPv6 tests in gate
* don't explicitly delete security group rules
* Remove setup_credentials from orchestration tests
* Remove Keystone client variables that are not used anywhere
* Add new exception InvalidAPIVersionRange for microversion
* skip test_list_server_filters_by_regex
* Remove the port list that is not used
* Separate microversion test case related unit tests
* Identity V3: missing api coverage for 'Get Endpoint' method
* Consolidate the ssh code
* Refactoring of 'DataGenerator' classes for identity V2 and V3
* Add the group and role checks API in tempest
* Fix stress tests job to use dynamic cred
* Split endpoints-client out of keystone v2 identity client
* Split out Neutron extensions client
* Updated from global requirements
* Scenarios: remove trivial wrapper methods
* Remove redundant import from scenario tests
* Replace legacy cred provider in heat api test
* Replace exit() by sys.exit()
* Revert "Cap Pip<8 due to pip bug"
* Split DataGenerator class for v2 and v3
* Updated from global requirements
* Separate base microversion client and compute client
* Updated from global requirements
* Fix logic in dump_accounts
* Cap Pip<8 due to pip bug
* Add omit files for coverage
* create_server: pass arguments as part of kwargs
* Split services client out of keystone v2 identity client
* Fixing test_create_port_in_allowed_allocation_pool when 3 (or more) controllers
* Use container/disk format settings in glance v1 test
* Wait for servers termination when cleaning up telemetry test
* Adds default domain name to dashboard login params
* add client_manager_class param to BaseTestCase
* Delete unnecessary internal method
* Mark amazon image file config options deprecated
* Split out Neutron security group rules client
* Raise tox min version to avoid maximum recursion issue
* Don't use non-existent method of Mock
* Migrate tempest-account-generator to new cliff cli framework
* Apply "POST/DELETE" rules to agents_client
* Add network wrapper method checks
* Add different_host test on multiple nodes
* Add tests for Nova microversion v2.2
* Fix to show cli subcommand help message
* Use 5 neutron clients from tempest-lib
* Fix create_test_server for multiple create request
* Make v1 list_images use **kwargs & doc string update
* Fix tempest_lib import order
* Mark Javelin as deprecated
* Split users_client from keystone client v2
* Updated from global requirements
* Migrate verify-tempest-config to new cliff cli framework
* Skip security group tests without secgroup ext
* API/compute: create all servers through the common wrappers
* Make volume snapshots_client to use **kwargs
* Updated from global requirements
* Add tempest-list-plugins
* Use floating_ips_client from tempest-lib
* Update global-requirement for tempest-lib
* Scenario: Skip TestServerMultinode when only 1 compute node
* Add external gateway to dvr before scheduling with dvr_snat agent
* Redundent if Statement
* Make v1 create_image & update_image use **kwargs
* Make volume volume_client to use **kwargs-part2
* Make volume volume_client to use **kwargs-part1
* Add support of schema versioning for microversion
* remove log_console_of_servers from get_remote_client
* Trival: Remove unused logging import in some files
* Rename compute images_client to compute_images_client
* Fix create/show/delete methods on subnetpools_client
* Fix the password input
* Rename references to compute security group rules client
* Scenario manager: don't access glance_client if Glance is not available
* Silences Javelin UT
* Typos and consistency in configuration.rst
* Fix grammatical mistake, Changed word from "an" to "a" in below file:
* Correct wrong message in configuration doc
* Wrong spelling of existing
* Add a note about using a full path for test accounts option
* Config: change cinder bootable flag to True
* Change LOG.warn to LOG.warning
* Misspelling in message
* Fixing the deprecated library function
* Misspelling in messages
* Change validate message for test_exceed_max_template_size_fails
* Fix leak from tempest.conf in fake_config fixture
* Add support override OS_TEST_TIMEOUT for all environments
* Wrong usage of "an"
* Wrong usage of "a"
* Fix server admin password usage
* Safe ram/disk/vcpus values for test-made flavor
* Refactoring of setting 'name' variable in tempest/common/compute.py
* Add set microversion in base compute service client
* Add logic to select the request microversion
* Make 2 base_snapshots_client function use **kwargs
* Split out Neutron subnetpools client
* Split out Neutron agents client
* Make v3 update_role use **kwargs & doc string
* Use six.StringIO/BytesIO instead of StringIO.StringIO
* Make v2 for identity_client functions use **kwargs
* Updated from global requirements
* Keep py3.X compatibility for urllib.urlencode
* [V3] Renaming region_client into regions_client
* Fixing two tests when nova-net is enabled and run_validation = True
* Stop testing rebuild for ironic
* [V3] Renaming policy_client into policies_client
* Split out Neutron security groups client
* Make 3 functions in network_client use **kwargs
* Add stdout logging for cleanup CLI
* Use servers_client from tempest-lib
* Use Tempest-lib's compute server_groups_client
* Use Tempest-lib's compute security_group_rules_client
* Use floating_ips_client from tempest-lib
* Update global-requirement for tempest-lib
* Fix password not strong enough for identity test_groups
* Make v2,v3 create_role use **kwargs & doc string

9
-

* Fix tempest cleanup command
* Add description for stress in tempest cli
* [V3 identity] Renaming service_client into services_client
* Add stdout logging for stress
* Enable test_list_security_groups_list_all_tenants_filter with neutron
* Remove the ec2 api tests from tempest
* Make volume_qos_client use **kwargs
* Drop lock_path section from config guide
* Set a tempest lock_path default to a tmpdir
* Fix password not strong enough for cmd
* Get rid of unused env variable
* Update configuration options ssh-auth-strategy
* Remove pre-check for test accounts file in credential factory
* Split out roles client from keystone identity client
* Make update_agent in network_client use **kwargs
* Fix telemetry tests to use v1 create image correctly
* Fix password not strong enough failures
* Make create_image use **kwargs
* Fix and improve server personality tests
* 'List volume type' comment has fixed
* Clean up comment about dual-stack case handling
* Fixed the comments of port security group test
* Split out Neutron quotas client
* Make server action methods[m-z] use **kwargs
* [sahara] adding new plugin versions to sahara tempest tests
* Make add_dhcp_agent_to_network  use **kwargs
* Make v3 update_user_password use **kwargs
* Replace assertEqual(None, *) with assertIsNone in tests
* Split out keystone tenant client
* Make server action methods[f-l] use **kwargs
* Make server action methods[a-c] use **kwargs
* Set force_tenant_isolation on neutron quotas tests
* Teach Tempest how to count vcpus
* Add compute client base class for microversion support
* Rename references to compute security groups client
* Make volume backups_client to use **kwargs
* Change docstring of compute client
* Make live_migrate_server() use common method
* Makes microversions config option clear about 'None'
* Make v3 create_trust  use **kwargs & doc string
* Make update_extra_routes use **kwargs & doc string
* Making names of Cinder client classes consistent
* Remove unused add_sample()
* Use Tempest-lib's compute volumes_client
* Fix T110 violation for database client
* Remove pre-request-validation from v2 image_client
* Make v2 create_user_ec2_credentials  use **kwargs
* Make add_router_to_l3_agent use **kwargs
* Make volume_types_client use **kwargs
* Add unit test for test_servers_client-allfunctions
* Add run_stress to cliff-based cli framework
* Make add_member use **kwargs and doc string update
* Updated from global requirements
* Fix some Type in docstrings
* Split out Neutron metering label rules client
* Make create_floating_ip use **kwargs
* Use the idempotent id and tooling from tempest-lib
* Switch run_tests.sh to use subunit-trace
* Renaming Cinder admin client files
* Remove unused agents's schema
* Add script to use tempest-lib files in tempest
* Use interfaces_client from tempest-lib
* Update global-requirement for tempest-lib
* Rename add_image_member to create_image_member
* Rename image_client to images_client
* Add docstring for update_image_member
* Make volume_quotas_client  use **kwargs
* Add network quota exceeding negative test
* Put py34 first in the env order of tox
* Updated from global requirements
* Migrate scenario tests ssh-auth-strategy
* Changing directory structure for Cinder clients
* Fix typo in tox.ini
* Add tests to update group with few fields
* Split out Neutron metering labels client
* Remove unused json_request()
* Rename private methods of glance_http
* test_port_security_macspoofing_port: Fix an inversed check
* [V3] Rename get_policy to show_policy
* Make argument params of list methods consistent
* Add keystone v3 user negative case test authentication with disabed user
* [V3] Rename get_region to show_region
* [V3] Rename get_credential to show_credential
* Fix some Typo in docstrings
* Add the base microversions test part
* Make argument params of list methods consistent
* Remove "s" from imange clients' method
* Make image_client use **kwargs
* Change checks for test_server test
* Fix race condition when changing passwords for admin tests
* Fix some inconsistency in docstrings
* Change multi-backend configuration to a list
* Use versions_client, versions from tempest-lib
* Use tenant_usages_client from tempest-lib
* Use tenant_networks_client from tempest-lib
* Use snapshots_client from tempest-lib
* Use Tempest-lib's compute services_client
* Use Tempest-lib's compute security_groups_client
* Drop fixed_network dependency from CONF
* Use V3 params when initializing Keystone V3 clients
* Use Tempest-lib's compute security_group_default_rule
* Use Tempest-lib's compute quotas_client
* Use Tempest-lib's compute quota_classes_client
* Fix T110 violations for image_client
* Switch run_tempest.sh to use subunit-trace
* Change tests to adapt alarm spliting
* Adds test for mac_spoofing
* Split out Neutron floating IPs client
* Scenarios: cleanup class scope variable usage
* Change comments and description for minimum_basic test

8
-

* Removing initialization of clients that are not used
* Use Tempest-lib's compute networks_client
* Use Tempest-lib's compute migrations_client
* Use Tempest-lib's compute limits_client
* Remove preprov provider dependencies from CONF
* Use Tempest-lib's compute instance_usage_audit_logs
* Use Tempest-lib's compute images_client
* Add T111 hacking rule for consistent DELETE method
* [V3] Rename get_group to show_group
* Refactor T110 rule
* Add keystone v3 user negative cases
* Skip test that rely on creds by role
* Updated from global requirements
* Set default value for tempest log file
* Fix T110 violations for servers_client
* [V3] Make groups_client use **kwargs
* [V3] Separating groups_client from identity_client
* Move identity wait until after password is updated
* Fix H404/405 violations for remaining
* Unbreak test_created_router_interface (heat)
* Fix H404/405 violations for thirdparty and stress
* Fix H404/405 violations for unit tests
* Fix H404/405 violations for common code
* Fix H404/405 violations for api tests(3/3)
* Fix H404/405 violations for api tests(2/3)
* Fix H404/405 violations for api tests(1/3)
* Move get_user_by_username to common part
* Move get_tenant_by_name to common part
* Add negative test to test_domains_negative
* Fix H404/405 violations for tools
* Fix H404/405 violations for service clients
* Fix skip_checks in live_migration
* Move get_server_or_ip method to common class
* Fix H404/405 violations for scenario tests
* Remove novaclient/neutronclient description
* Remove server_groups_client from ignore_list
* [V3] Make service_client use **kwargs
* Add installation procedure of cookiecutter to doc
* Updated from global requirements
* Fix AttributeError in multinode jobs
* Rename get_server_group to show_server_group
* Add hacking rule for "GET /resources"
* Modify baremetal_basic_ops test
* make schedule_to_every_node use real scheduler hint
* add 'create domain with name length > 64'
* [V3] Make region_client use **kwargs
* Factor up config dependent credential classes
* change some sentences to help understand
* add test to ensure cloud is using minimum number of nodes
* [V3] Make policy_client use **kwargs
* [V3] Make endpoints_client use **kwargs
* [V3] Make credentials_client use **kwargs
* Rename references to compute floating IPs client
* Remove unused config option image_alt_ssh_user
* Use skip_checks for live-migration feature in test
* Fix race condition when changing passwords
* Trivial fix of doc string
* Fix TypeError exception in test_server_actions setup
* Rename list_users_for_tenant to list_tenant_users
* Apply a naming rule of GET to v2 keystone clients
* Remove unused has_admin_extensions()
* Modify scenario tests
* Use choices kwarg when defining string options with defined choices
* Remove BaseComputeTest and _api_version
* Provide better message when no IPv4 addresses found
* Split a server test into two distinct tests
* Refactor volume_boot_pattern test
* Add negative test: create domain with empty name
* Add cleanup to cliff-based cli framework
* Allow empty directories for tempest init
* Add assertion after domain deletion
* Updated from global requirements
* Split out Neutron ports client
* Add documentation for service catalog format
* Prepare cred_client for migration
* Fix unit tests for migration
* Remove resource_setup() from test_live_migration
* Switch to using pbr version for cli version string

7
-

* test_snapshot_pattern: cleanup class scope variable usage
* Remove checks for ipv6 utilities before use
* Add plugin cookiecutter in documentation
* Drop admin_role CONF dependency from cred provider
* Remove dependency from credentials domain CONF
* Remove CredentialProvider deps to CONF
* Stop validating pre-provisioned credentials
* Removed shared instances for live-migration
* plugin.rst: Fix a typo in an example code fragment
* skip compute alt tenant tests if no project_id in url
* Fix DEFAULT_CONFIG_DIR
* Remove skip decorator for volume scenario test
* Make docstring of servers consistent
* test_network_advanced_server_ops: cleanup class scope variable usage
* test_minimum_basic: cleanup class scope variable usage
* Pass the status 'ACTIVE' for getting a target port
* test_shelve_instance: cleanup class scope variable usage
* test_stamp_pattern: cleanup class scope variable usage
* Use Tempest-lib's compute hypervisor_client
* Use Tempest-lib's compute hosts_client
* Use Tempest-lib's compute floating_ips_bulk_client
* Use Tempest-lib's compute floating_ip_pools_client
* Use Tempest-lib's compute flavors_client
* Fixing checking bytecode
* Use Tempest-lib's compute fixed_ips_client
* Remove migrated service clients from test_service_client
* Add compute personality feature config
* Use Tempest-lib's compute extensions_client
* Use Tempest-lib's compute certificates_client
* Use Tempest-lib's compute baremetal_nodes_client
* Use Tempest-lib's availability_zone_client
* Use Tempest-lib's aggregate client
* Split out Neutron subnets client
* Bump minimum tempest-lib version
* Moves an incorrectly marked negative test
* Set correct ACL for Swift staticweb tests
* Add failure ports to error message
* Make services_client use **kwargs
* Log output from ping command
* Fix value explanation in get_creds_by_roles
* Add unit test for create_server,list_addresses
* Handle exceptions from plugins gracefully
* Rename accounts to preprovisioned accounts
* Add unit test for init.py->generate_sample_config()
* Fix return value of reserve_fixed_ip client method
* Use tempest-lib's agents_client
* Fix fixed-ip schema for empty response body
* Updated from global requirements
* Rename isolated creds to dynamic creds
* Add json schema for disable service
* Fix tempest-account-generator command roles issue
* Add container and disk format parameters
* Added Test Cases for ImagesClient
* Added Test Case for InterfacesClient
* Add unit tests for show_server and list_servers
* Remove "extensions" from volumes_extensions_client
* Add unit tests for snapshots_client
* Pass mount_path through to ssh_client.mount in scenario manager
* Remove unused _ssh_to_server from test_stamp_pattern
* Remove "extensions" from snapshots_extensions_client
* Make create_server_group use **kwargs
* Split out Neutron networks client
* Refactor tempest scenarios tests
* Check cinder api version in compute tests
* Fix gate-tempest-dsvm orchestration.stacks.test_volumes failure
* Add test for config drive extension
* Replacing data_processing with data-processing
* Add volume backed live migration test
* Add unit test for flavors_client
* Fix spelling typo in warning message
* Follow up patch on missed IdentityV2 methods
* Subnet pools extension api added
* Updated from global requirements
* Fix init command
* Bring back Python 2.6 compat (don"t use dict comprehension)
* Negative test cases added in Telemetry
* Rename SwiftScenarioTest to ObjectStorageScenarioTest
* Full response for missed IdentityV2Client methods
* create_router cannot take enable_snat=False
* Metadata definition namespaces api added
* Add resource cleanup in volume snapshots tests
* Enhance unit test coverage: availability_zone_client
* Rename `index` test into list
* Add unit test for floating_ips_client
* Make create_server use **kwargs
* Rename references to compute networks client
* Create base class for Tempest Network clients
* Use tempest-lib's fake_auth_provider on services
* Fixing a typo in "TODO" message
* Move add/remove fixed ip action to servers_client
* Change tenant usage tests to wait until retrive valid response
* Test case updated with alarm history api
* Add tests for getting nova api version details
* Remove _stop_instances hack in test_volume_boot_pattern
* Add unit tests for volumes_extensions_client
* Add test for volume snapshot in compute api
* Fix missing value types for log message
* Add unit tests for security_group_rules_client
* Remove nova v2 API comments
* Added Identity API tests for user ec2 credentials
* Fix way to create login_url in dashboard test
* Return complete response from servers_client
* Add a simple test for port security vs security group
* Skip test_router_rescheduling if l3 scheduler extension is not enabled
* Fix the condition of nova cert tests
* Switch using token_client to the recommended
* Fix test_port_list_filter_by_ip with test_accounts
* Deprecate credential config options
* Enhance unit test coverage: agents_client
* Add unit tests for security group default rules
* Remove list_security_group_rules wrapper method
* Updated from global requirements
* Split the operator and reseller users in the account generator
* Add unit test for hypervisor_client
* Add possibility to skip test_subnet_details if DHCP client not available
* Use proper method for nova disable service unit test
* Fix typos in scenario tests, etc
* Add unit tests for floating_ips_bulk_client
* Return complete resp from volumes_extensions_client
* Give access to CredClient in tests
* Switch using token_client to the latest for gate
* Only add roles for enabled services
* Add unit test for server_groups_client
* Use Cinder API V2 if V1 is disabled
* Add docs section on config options to reviewers guide
* Fix wrong dict reference for show_network
* Unskip baremetal api tests
* Remove unused parameter 'tenant_id'
* Added Test Case for HostsClient
* Added Test Case for BaremetalNodesClient

6
-

* Add unit tests for migrations_client
* Add unit test for floating_ip_pools_client
* Split snapshot test in test_volume_quotas_negative
* Deduplicate cert, audit_log and tenant_net client
* Add unit tests for security_groups_client
* Remove code duplication in delete methods
* Added Test Cases for FixedIPsClient
* Ensure test_list_show_tenant_networks is isolated
* Deduplicate client unit tests
* Added test_user_update_own_password tests for Identity v2, v3
* Added test_list_tenants non-admin test for v2, v3 api/identity
* Cleanup API version schema
* De-duplicate test class names
* Make update_server use **kwargs
* Remove assertion checking rescoped issued_at
* Add test for Nova list-versions API
* Remove Nova v3 version API schema
* Add hacking check for testtools.skip
* Cleanup tempest docs a bit
* Fix checks for X-Trans-Id in DLO-related storage tests
* Migrate volume tests to the ssh-auth-strategy
* remove service-type from neutron extension list
* Fix the condition of some snapshot tests
* Do not pass wait_until to create_server()
* Add docstring for tenant_network
* Add unit tests for tenant_networks_client
* Switch remaining json import to oslo_serialization
* test_volume_boot_pattern: re-use create_floating_ip from base class
* Remove too_slow_to_test flag
* Add "server" to action methods - part 2
* Fix identity new endpoint_type options for old users
* Skip ebs scenario test due to bug 1489581
* Full response for VolumesClient methods
* Return complete response from remaining service client
* Encap netaddr-0.7.16
* Add mac info to test_list_virtual_interfaces
* Return correct domains in cleanup service
* Remove meaningless braces
* Skip router rescheduling test
* Fix typo in baremetal_group & AuthGroup of config.py
* Full response for database flavor client methods
* Fix response of database Limits & Versions client
* Add initial unit test for tempest plugins
* Update logic to detect DVR in rescheduling test
* add waiting for snapshot available status
* Fix the mix use of name and uuid in NetworksNegativeTestJSON
* Disable cinder backup import/export test
* Remove unused init file and directory
* Fix tests updating server by name rather than id
* Fix typo in the create_isolated_networks help in config.py
* Added CONF.validation entry security_method
* Add unit tests for instance_usage_audit_log_client
* Add unit tests for certificates_client
* Add unit test for  availability_zone_client
* Add unit tests for tenant_usages_client
* Add flag for volume clone tests
* Fix typo in tempest coding guide
* Return complete response from compute images_client
* Return complete response from limits,migration client
* Return complete response from compute quotas client
* Properly skip nova tests if nova isn't available
* remove test_update_host_with_extra_param
* Use the oslo.config sphinx module to generate sample
* Fixed few typos
* Add shelve/unshelve volume backed instance test
* Full response for missed Identity V3 Client
* Make volumes_extensions_client use **kwargs
* Add plugin docs section on configuration options
* Update the Tempest README for new run workflow
* Return complete response from compute networks_client
* Return complete resp from security_groups_client
* Return complete resp from sec grp default rule client
* Return complete response from tenant_usages_client
* Return complete response from tenant_networks_client
* Return complete response from services_client
* Return complete resp from server_groups_client
* Return complete resp from security_group_rules_client
* Return complete response from interfaces_client
* Return complete response from instance usage client
* Return complete response from flavors_client part-2
* Return complete response from flavors_client part-1
* Return complete response from compute/aggregates_client
* non-admin user only able to download Active image
* Update tox.ini for sphinx build instructions
* Fix misspelling in the "README.rst"
* Fix typo in tempest configuration guide
* Fix name "Quantum" to "Neutron" in comment
* Full response for Volume SnapshotsClient methods
* Router should be disabled to be upgraded to DVR
* Marking the login_url option as "deprecated_for_removal"
* add 'boot from ebs' scenario test
* Full response for Database Limits & Version Client
* Remove some dead code
* scenario/test_minimum_basic: relax a MatchesDictExceptForKeys check
* Add unit tests for services_client
* Fixed typo
* Full response for VolumeHostsClient methods
* Full response for Volume QosClient methods
* Full response for Volume BackupsClient methods
* Fix typo in tempest configuration page
* Full response for DataProcessingClient methods
* Full response for Orchestration client methods
* Return complete response from hypervisor_client
* Return complete response from floating_ips_client
* Return complete response from hosts_client
* Return complete response from floating_ips_bulk_client
* Return complete response from compute certificates_client
* Return complete response from compute extensions_client
* Add unit tests for network_client
* Add unit test for quotas_client
* Make live_migrate_server use **kwargs
* Full response from v2 ImageClient methods
* Migrate telemetry tests to the ssh-auth-strategy
* Return complete response from compute/keypairs_client
* Return complete response from compute/agent_client
* Adding timeout to verify_metadata method in test_server_basicops
* Set validatable False by default
* Fix typo in Tempest Coding Guide
* Updated from global requirements
* Full response for Volume ExtensionsClient methods
* Full response for v3 ServiceClient methods
* Full response for VolumeServicesClient methods
* Full response for Volume AvailabilityZoneClient methods
* Full response for VolumeTypesClient methods
* Full response for v3 PolicyClient methods
* Full response for v3 RegionClient methods
* Remove redundant response schema check
* Make attach_volume use **kwargs
* Move wait_for_server_termination from servers_client
* Add docstrings for parameter translation
* Add "server" to action methods
* allow non '/' root for dashboard
* Full response for v3 IdentityClient methods
* Full response for v3 EndpointsClient methods
* Enhance IPv6 scenario - dual network testing
* Removed unnecessary commented code
* Full response for v3 CredentialsClient methods
* Bake in oslo sample config generation to sphinx build
* Add extension alias for test_list_show_extensions
* Fixed single quoted docstring
* Fixed unformatted message string
* Move test_waiters to match directory structure
* Handle 'error_restoring' status in wait_for_volume_status
* Fix constants of config sections names in verify_*_api_versions
* Cleaned up class variable scope issue
* Fixed invalid error message
* Remove unused ignore_error
* Adds test for router rescheduling
* Full response for v2 IdentityClient methods
* Fixing tests when run_validation is set to true
* Fix a spelling typo in tempest/thirdparty/boto/test.py
* Add unit test for quota_classes_client
* Add unit test for keypairs_client
* Add unit tests for extensions_client
* Enhance IPv6 scenario - Ping default GW
* Return complete response from floating_ip_pools_client
* Full response for v1 ImageClient methods
* Fix scenario test fails when port_vnic_type is set
* increase failure information for ip_regex test
* Added endpoint types for intialization of different IdentityClients
* Fix the way to get tempest.conf in README.rst
* Fixed Typos
* Add plugin interface documentation
* Discover the correct default config dir
* Stop gating on sample generation check
* Include sample configuration in dev docs
* Updated from global requirements
* Revert "Fix scenario test fails when port_vnic_type is set"
* Logging migrations for particular server if migration failed
* Return complete response from compute fixed_ips_client
* Move common functionality to base class
* Return complete response from compute baremetal client
* Return complete response from availability_zone_client
* Make security_group_rules_client use **kwargs
* Fix Typos
* Add identity v2 endpoint operations
* Fix sample config yet again
* Add plugin interface for extending sample config generation
* Ensure server unlocking after test_lock_unlock_server
* Add unit test for aggregates_client
* Make security_groups_client use **kwargs
* Make security_group_default_rules_client use kwargs
* Make create_image use **kwargs
* Make create_flavor use **kwargs
* Make keypairs_client use **kwargs
* Make set_flavor_extra_spec use **kwargs
* Skip test_check_nova_notification_event_and_meter
* Avoid default quota limit of 10 subnets
* Remove openstack.common package
* Use relative path in data_files in setup.cfg
* Rename service client classes which include "Ip"
* Allow v3 identity to work without the admin domain name
* Add unit test for method show_limits
* Separate security_group_rules_client
* Updated from global requirements
* Add unit test for method list_keypairs
* Add unit tests for create/update/delete_agent
* Add documentation to HACKING.rst describing idempotent_id
* Fix two typos on tempest documentation
* Fix scenario test fails when port_vnic_type is set
* Update smaple config for new oslo.config release
* Add tempest init command to tempest cli
* Activate site-packages for tempest plugins
* Make quotas_client use **kwargs
* Make interfaces_client use **kwargs
* Fixing test_volume_boot_pattern when use_floatingip_for_ssh=false
* Add unit test for method list_aggregates
* Updated from global requirements
* Fix Neutron cleanup
* Add 'allow_duplicate_networks' to compute-feature-enabled options
* Make fixed_ips_client use **kwargs
* Use image minDisk as volume size when necessary
* Adds testcase for volume backup-export and import
* Avoid weird typecasting
* Remove extra space in docstring
* Reuse mocked body value between tests
* More cleanup/refactoring of neutron client
* Fix list_migration response schema for None values
* Ensure we close the file accounts file after reading
* Updated from global requirements
* Remove redundant attach/detach volume methods from test_minimum_basic
* Ensure a role is assigned to created users with v3 auth
* Migrate compute tests to the ssh-auth-strategy
* Stop test execution in case of an plugin error
* Fix error in loader.discover() call
* Make aggregates_client use **kwargs
* Add unit test for agents_client
* Switch all uses of json to oslo_serialization
* Rename test.plugins to test_plugins
* Fix non-admin compute quota issue
* Make argument params of list methods consistent
* Use self.client in test_server_actions
* Remove wait_for_server_status from servers_client
* Separate floating_ips_bluk_client
* Separate floating_ip_pools_client
* Updated from global requirements
* network_client should support multi routes
* Fix mock==1.1.0 break test_raw_request_chunked
* Sync venv scripts from oslo-incubator
* Make the arguments of resource id consistent
* Provide a full path top level to test discovery
* Remove wait_for_volume_status from compute client
* Remove unused is_enabled()
* Remove wait_for_image_status from compute client
* Move wait_for_interface_status from service client
* Create test for private image
* test_server_basic_ops: Test metadata service
* Separate server_groups_client from servers_client
* Add plugin interface for appending to tempest config
* Add basic external test plugin support to tempest
* Expanded assertion in test_create_token for keystone v2, v3
* Wait server to be terminated in VolumesV2NegativeTest
* Fixing test_port_list_filter_by_ip in case of several DHCP agents
* Adding negative test cases for ports
* Remove unnecesarry code in PortsAdminExtendedAttrsTest
* Use the prefix-embedded rand_name method
* Adding negative test cases for subnets
* Apply a naming rule of GET to show_server method
* Get rid of duplicated creation of security groups in test_volume_boot_pattern
* Remove "JSON" from sevice clients' names
* Add cliff based common cli entrypoint
* Fix useless usage of Linux utils
* Add ":" to docstring of CredentialProvider
* Remove str() calls from compute clients
* Apply a naming rule of GET to compute clients(v*)
* Apply a naming rule of GET to compute clients(t*)
* Apply a naming rule of GET to secgroup clients
* Use random password generator for IsolatedCreds
* Updated from global requirements
* update ceilometermiddleware sample target
* Removing unused functions parameters in test.py
* Removing unnecessary comments
* Unbreak the world!
* use services decorator to enable telemetry test
* add initial check for nova event in ceilometer
* Re-factor neutron client for 'list' methods
* Neutron service client should not trim API response
* Re-factor neutron client for 'delete' methods
* Re-factor neutron client for 'show' methods

5
-

* Re-factor neutron client for 'update' methods
* Re-factor neutron client for 'create' methods
* Add resource prefix string
* Modify RemoteClient to use ssh validation config parameters
* Add tests for Cinder volume list pagination
* Apply a naming rule of GET to compute clients([ik])
* Updated from global requirements
* Added comment how to get list of network extensions in tempest.conf
* Support for ipv6 in compute response JSON schema
* Fix the description in tempest.conf.sample
* Delete resources when dvr test skipped
* Updated from global requirements
* Apply a naming rule of GET to compute clients(q*)
* Add compute_feature_enabled.attach_encrypted_volume config option
* Set the correct API version for the V2 identity client
* Block additionalProperties on Nova API tests
* Provide a config option to customize remote shell command
* Add create_test_server function
* Fix failed to access pip server when run behind proxy
* Fix no attribute 'is_dvr_router' error in test_l3_agent_scheduler
* Add a rule for blocking "-" from rand_name call
* re-enable glance notification tests
* Made a several-seconds checking&waiting for object to be deleted
* Remove key 'absolute' from limits client
* More javelin unit tests
* Apply a naming rule of GET to compute clients(n*)
* Separate quota_classes client from quotas client
* Remove error handling of list_networks
* Apply a naming rule of GET to compute clients(l*)
* Apply a naming rule of GET to compute clients(h*)
* Remove advanced services tests
* Updated from global requirements
* Apply other "get" rule of GET to image v2 client
* Neutron: Remove get_namespace from API extensions
* Fix spell error in configuration.rst
* More Javelin Unit tests
* Add tenant network creation to account creation script
* Fix L3AgentSchedulerTestJSON failure for dvr routers
* Fix fail test_iscsi_volume
* Apply a naming rule of GET to compute clients(f*)
* Apply other "get" rule of GET to image v1 client
* Make the names of image_member methods consistent
* Provides a sample resourcefile for Javelin
* Unskip test skipped because of closed bugs
* Fix several bugs in verify_tempest_config
* Added documentation to tempest-account-generator
* Fixing some tests for DHCP IPv6
* Check for NotFound exception in setUp() function
* Fix condition of Swift SLO API tests run
* Add test_port_list_filter_by_ip test
* Add support for image deactivate and reactivate
* Check domain's enabled attribute strictly
* Deleting ports before deletion of routers in resource_cleanup
* Raise baremetal.unprovision_timeout default to 300 sec
* Do not consider subnets of shared public nets
* Add config option to disable network isolation
* Fix sample conf file based on new oslo.log release
* Log instance console when ssh fails in EC2 test
* Verify exact match for volume metadata update
* Check only for added/deleted metadata entries
* Remove extra return value from scenario call to show_router
* Verbose waiting for status in neutron FWaaS
* Remove skip for bug 1439371 on test_volume_boot_pattern
* Pass wait_until arg in create_test_server call
* Fix Nova API misimplementation for security groups
* Replace "hardcode" in scenario tests
* Apply a list_image_members rule of GET to image client
* Apply a show_image rule of GET to clients
* More Javelin Unit tests
* Fix typo in skip_checks function of BaseTestCase class
* Apply a list_images rule of GET to image client
* Add domains negative test
* Added test of default domain in Keystone
* Add test caller to scenario manager ssh connection failure for tracking
* Fixing broken Heat tests for Swift resources
* isolated creadentials are not cleaned up
* Remove heat-slow tox entry
* Fix typo in cleanup_service class name
* Fixing wrong cleanup order in test "test_rebuild_server"
* Ensure scenario utils creds are cleaned up
* Tool for generation user accounts from spec
* Make sure filtered_by_ip list servers test uses correct ip filter
* Add passenv option to tox.ini
* Only create a TokenClient if api_v2 is enabled
* Fix doc issue of lock test accounts
* Extend credentials to support roles
* Move identity_version to class level
* Don't create network resources for scenario utils
* Add py34 to readme, pkg metadata, and envlist
* Image properties in scenario tests
* To test bootable flag in a cinder volume
* Fix last unit tests on py34
* Fix raise syntax in test.py for python3 compat
* Use six.moves.builtins to mock open in unit tests
* Introduce creds_provider in test.py
* Extend get_client_manager to support roles
* Add new config option to globally trigger resource validation
* Add keystone v2.0 and v3 api discovery checks
* Adds unit test for Javelin
* Check IPv6 mupltiprefix feature
* Add cleanup after creating keypair
* Updated from global requirements
* Move remaining schema files into v2_1 directory
* Switch use of hashing strings to unicode in accounts
* Fix tenant isolation and unit tests with py3
* Switch all uses of iteritems to use six instead
* Fix comprehension syntax error with python3
* Switch all uses of urllib and HTMLParser to import from six
* Fix verify_tempest_config to not leak a tenant
* Remove common/ssh.py due to migration to tempest_lib
* Instance ID was corrected
* Remove CLI testing once and for all
* Fix server creation n test_large_ops
* Drop use of 'oslo' namespace package
* Define validation_resources function for ssh validation
* Drop v2 and v3 tokens clients
* Respect configured cred provider in scenario utils
* Delete server after resize test
* Remove unused wrapper methods
* Trim object storage smoke tests to a small set
* Remove unnecessary force_tenant_isolation
* Remove version string from the setup.cfg
* Test live migrate on a paused instance
* add image smoke tags
* trim compute smoke tag
* Fix typo in scenario manager
* Fix logging.conf sample
* Drop auth and corresponding unit tests
* remove qos tests from volume smoke tag
* trim network smoke tests
* remove smoke tag from admin tests
* remove smoke tag from negative tests
* not all scenario tests should be in smoke

4
-

* Use addCleanup in test_rebuild_server
* Rework get_network_from_name() function
* Remove unused methods
* Initial class creds creation in test base class
* remove gate tag (part 3)
* remove gate tag (part 2)
* remove gate tag (part 1)
* Apply a naming rule of GET to compute clients(a-e)
* Apply a naming rule of GET to telemetry client
* Cleanup some details about the accounts files
* Wait for complete deletion of volume snapshot before deleting volume
* Extend PATH and set -o pipefail in linux ssh
* Add OS_TOP_LEVEL to testr conf
* Switch all uses of httplib to import from six
* Switch all uses of ConfigParser to import from six
* Switch all uses of urlparse to import from six
* Switch all uses of StringIO to use it from six
* Fixing spelling errors in messages when tests are skipped
* remove swift cli tests
* Direct ssh bash output to /dev/null
* Fix non-locking test accounts doc section
* Add a paragraph on the use of tempest_roles option
* Add section to config guide for setting up services
* Add config guide section on service feature enabled sections
* Add logging of account allocation to accounts provider
* Add configuration guide sections for more required options
* Start a tempest config guide networking section
* Fix test accounts unit test race with networks
* Revert "Test creation of server attached to created port"
* Honour ssh_connect_method in test_baremetal_server_ops
* Cleanup fixed_name logic in test_list_server_filters
* Update linux client to support basic MTU testing
* Add version and min_version to version API schema
* Add network support to the accounts providers
* Improve logging in fixed_networks
* FIx Accounts with identity v3 and v2 data in yaml
* Add new multi ssh configuration options
* Refactor exception handling
* Rename an internal method to _helper_list()
* Apply a naming rule of GET to messaging client
* Enable tempest install to setup a config dir
* Adding port_admin_state_change option to config
* Fix external connectivity check for dualstack
* Test creation of server attached to created port
* Add router to resources section of yaml output
* Make this script work with keystone v2 and v3
* Rearrange hypervisors response schemas into one file
* Embed network resoruces and credentials in TestResources
* Make L3AgentSchedulerTestJSON DVR-aware
* Prevent failures when running as non-admin
* Use network from get_tenant_network in scenario
* Use the catalog to discover available services instead of get_service
* Adjust registration of ami image in boto tests
* Added cleanup for tenant quotas
* Remove EC2 test case that incompatible with Amazon
* Apply a naming rule of GET to orchestration client
* Apply a naming rule of GET to volume client
* Skip test_volume_boot_pattern until bug 1439371 is fixed
* Fix fixed_network bug 1439634
* Fix fixed_network bug 1439634 - ipsec issue
* Rename test_live_block_migration to test_live_migration
* L3 Agent Scheduler testcase cleanups
* Allow SSH instance with username and password in scenario cases
* Remove Sahara CLI tests (migrated)
* Limit tempest.config's use of cfg.CONF
* test_accounts_file can be None
* Print an error message and fail if network could not be found by name
* Allows Javelin to specify Swift role
* Only use accounts.yaml with locking provider
* Allow Javelin to create volumes without servers
* Remove hyphen from rand_name calls in scenario tests
* Allows selection of floating IP pool in Javelin
* Skip test_security_groups_basic_ops for vnic_type=direct of macvtap
* Use the configured version of identity in stress
* Add API tests for Neutron DVR extension
* Handle fixed_network edge cases gracefully
* Clarify how to resolve a uuid collision
* Update description of Enable block_migrate_cinder_iscsi
* Change default cirros ssh user
* Split resource_setup for network tests
* Remove hyphen from rand_name calls in identity tests
* Remove hyphen from rand_name calls in compute tests
* Remove hyphen from rand_name calls in thirdparty tests
* Start instances using fixed network when possible
* Remove hyphen from rand_name calls in baremetal tests
* Remove hyphen from rand_name calls in image tests
* Remove hyphen from rand_name calls in volume tests
* Non-admin token tests for Keystone API
* Pass identity_version into get_credentials
* Support identity_version in credential provider wrappers
* Refactor floatin_ips V2.1 API response schema
* Drop any dependency from config in test_credentials
* Refactor fixed_ips API response schema
* Rearrange aggregates response schema into one file
* 1373513 has been fixed, remove skip
* Adding sudo to command _renew_lease_dhclient in remote_client
* Remove invalid use of kwargs from image clients
* Remove remaining CONF references in service_client
* Use oslo concurrency api to get lock path
* Updated from global requirements
* Support v3 in credential providers and subclasses
* Remove ceilometerclient CLI tests
* Add test for the various config cases of is_admin_available()
* Arrange quotas response schema into one file
* Rearrange keypairs response schema into one file
* Fix interfaces response schema
* Rearrange certificates response schema into one file
* Rename compute response schema dir to v2_1
* Respect configured credential provider everywhere
* Remove unused dependency to config module
* Fixing spelling error in the message when test is skipped
* Remove redundant calls to clear_isolated_creds
* Make check_uuid executable
* Add 'instance_uuid' in show baremetal schema
* Add 'disabled_reason' in hypervisor schema
* Allow sress test runner to skip based on available services
* Fixes a typo and adds proper captilization
* javelin: don't destroy floating IP resource
* Remove last references to python-keystoneclient
* Add additional checks for attributes
* Adding common header attributes in image header schema
* Add 'fault' attributes in server schema
* Add 'images_links' attribute in image list schema
* Add 'servers_links' attribute in server list schema
* javelin: add missing network_name in destroy_servers loop
* javelin: fix destroy_servers
* Restore "Add scenario 'test_preserve_preexisting_port'"
* Fix NoSuchOptError when using use_floatingip_for_ssh
* Distinguish between luks and cryptsetup volume types
* javelin: implement floating-ip support
* Skip test_connectivity_between_vms_on_different_networks for baremetal
* Deprecates 'format' in Javelin image description
* Revert "Add scenario 'test_preserve_preexisting_port'"
* Remove python-ironicclient from requirements
* remove redundant negative flavor admin tests
* Remove neutron CLI tests
* Cleanup the tempest readme
* Skip boto tests when auth_version is v3
* Testcase to create domain without description
* Create test nodes for test_baremetal_nodes
* Create a new project for trusts tests
* Allow full v3 authentication
* Support SSL and trace params in get_credentials
* Add scenario 'test_preserve_preexisting_port'
* fix import grouping
* Add section to the config guide on lock_path
* Update all Oslo module use
* Decouple Sahara templates test from vanilla plugin
* Add support to the services decorator for trove
* Make is_admin_available not call for a token
* Stop using [orchestration] image_ref
* Revert "disable neutron network tests that fail too much"
* Replace hardcoded volume size by created volume size
* Remove last dependency from keystone client
* Fix image/server schema for 'OS-DCF:diskConfig'
* Add extended server attributes in list detail schema
* Fix hypervisor schema for hypervisor status extension
* Keep up with changes in oslo-config-generator
* Make scenario tests requiring admin skip if no admin creds
* Split resource_setup for compute tests
* Split resource_setup for scenario tests
* Add check on role availability before request creds by roles
* Remove migrated utils code
* Copy the default params dict to avoid race
* Fix: don't hardcode admin role name, use config option instead
* Update auth section of the configuration guide
* Use ssl conf settings for raw verify_tempest_config requests
* Remove identity CLI tests
* Remove orchestration scenarios
* fix target location for ceilometermiddleware data
* Fix unpack error in test_list_servers_detailed_filter_by_image
* Switch swift tests to use cred_provider with roles
* Add support for roles to credentials providers
* Remove tempest-lib exc Frobidden to Unauthorized translation
* Fix server schema for OS-EXT-IPS extension attributes
* Add server groups quota attributes in limit schema
* Add 'flavors_links' attribute in flavor list schema
* Fix FIP bulk schema for 'fixed_ip'
* Adding 'security_groups' attributes in server schema
* Update test to fail instead of skip if floating pool is already allocated
* Skip CLI tests is identity v2 is not available
* Skip test_subnet_details for baremetal
* Replaces hardcoded volume size by configured value
* Testcase to create domain with disable status
* Remove CONF values from images clients
* Remove CONF reference from servers client
* Move identity v2 tests to their own folders
* Check Floating ip status before load balancer check
* Fix check for FloatingIP status before check connection
* Fix isolated cred cleanup for cli tests
* Allow time for ipv6 auto addresses to get assigned
* Split resource_setup for thirdparty tests
* Fix ICMP code/type in security group rule test
* Editing comment in test "test_trust_expire"
* test_neutron_resources slow tag to gate
* Add a test for network connectivity between two tenant networks
* Log the names of the other isolated_creds on starvation
* Fix response schema for compute aggregate API
* Add UUIDs to all tempest tests and gate check
* Add UUIDs to tests with tools and checks
* Remove python-novaclient from requirements.txt
* Prepare token clients for migration to tempest-lib
* Fix and re-enable H105
* Move to hacking 0.10
* Updated from global requirements
* Revert "Change messaging clients to return one value and update tests"
* Fix missing variable in test accounts warning log
* Set the boto ca_certificates_file from tempest config
* Add tempest config guide doc
* Fix AttributeError on testtools missing MismatchError
* Make tempest's python 2.6 policy clear
* Fix schema of list hypervisors API
* Add response parameters for quota_server_group ext
* refactor save_state code
* add support for ceilometermiddleware data
* Simplify method deserialize_list of network_client
* Floating IP test enhancements
* Fix missing exception catch in is_admin_available()
* Remove unused NotFound raise
* Split resource_setup for compute volumes tests
* Split resource_setup for volume tests
* Adds IPV6 bulk ops tests for network/subnet/ports
* Fix baremetal node property keys
* Change network/interfaces clients to return one value and update tests
* Change messaging clients to return one value and update tests
* Change database clients to return one value and update tests
* Handle errors listing flavors and images in scenario utils
* Allow tenant isolation by default
* Split resource_setup for limit tests
* Split resource_setup for telemetry tests
* Split resource_setup for identity tests
* Remove CONF values from Token clients
* Remove CONF values from identity clients
* Split resource_setup for object_storage tests
* Omitting microseconds when creating a trust
* Fix compute baremetal_nodes API schema
* Change servers client to return one value and update tests
* Fix left-over client calls in stress test to receive one value
* Update compute base test to split up resource_setup
* clear dict post cleanup in clear_isolated_creds
* Finish cleanup CONF from auth
* Skip new instance port admin state test for ironic
* Add 'type' parameter to compute image schema
* Change two-value client methods to use ResponseBodyData
* Cinder: Wait for volume to be 'available' before attaching
* Split resource_setup for image tests
* Adds "retype" to "volume/admin/test_volume_types.py"
* Fix some typos in log and test
* Add the description of hacking rule T107
* Change tempest BadRequest exc to tempest-lib exc
* Remove unused password in test_live_block_migration
* Use cls instead of self in classmethod
* Remove CONF reference from volume client
* Add os-baremetal-nodes tests
* Remove CONF values from data_processing client
* Rename data_processing client
* Remove unused CONF from limits/identity_client
* Fix 'Number of new ports: 2' failure mode on test_hotplug_nic
* Updated from global requirements
* Drop the legacy and un-used _interface
* Change basic server client methods to return one value and update tests
* Split resource_setup for database tests
* Unskip and Add timeout method to dns check scenario
* Change project and domain parameters
* Change tempest Unauthorized exc to tempest-lib exc
* Change tempest NotFound exc to tempest-lib exc
* Change tempest Conflict exc to tempest-lib exc
* Change tempest OverLimit exc to tempest-lib exc
* Move default creds to cred_provider
* Adding the ability to use pre-created ports in Network scenarios
* Remove novaclient CLI tests
* DHCP should be disabled on external subnet
* Change fixed/floating ip clients to return one value and update tests
* Fix super calls in ResponseBody and ResponseBodyList
* Change some small compute clients to return one value and update tests
* Change compute volume client to return one value and update tests
* Remove HTTP_SUCCESS from tempest.test module
* Removes unused function from javelin
* Remove auth_version config from get_credentials
* Adding api tests for dvr routers
* Add compute feature enabled flag for the ec2 api
* Fix typos in boto decision_maker()
* Change flavors client to return one value and update tests
* Change telemetry client to return one value and update tests
* Change data_processing client to return one value and update tests
* Change limits/quota clients to return one value and update tests
* Volumes: strict type and value check of the 'bootable' flag
* Update test_live_migration for return-one-value
* Split resource_setup for orchestration tests
* Change security-group clients to return one value and update tests
* Split resource_setup for messaging tests
* Change keypair client to return one value and update tests
* Split resource_setup for baremetal tests
* Split resource_setup for data_processing tests
* Test for id_username instead of "Log In"
* Separate token client from identity client
* Switch to using the skip_because decorator from tempest-lib
* Fix stress test which was not changed to receive one client value
* Updated from global requirements
* Remove CONF values from volume clients
* Fix import in nova cli tests
* Add debug info to timeout exception in _hotplug_server
* Change tempest InvalidContentType exc to tempest-lib exc
* Change tempest UnprocessableEntity exc to tempest-lib exc
* Remove unused exceptions
* Adds "list-groups" testcase to v3/test_groups
* Remove UnexpectedResponseCode exception
* Remove CONF values from baremetal client
* Remove inheritance from baremetal client
* Move JSON de/serializers to base baremetal client
* Add sec-grp-rule for ipv6-icmp to enable ping6 between instances
* Order service clients setting first
* Remove CONF values from telemetry client
* Test case for database limits
* Update live migration test for return one value
* Remove data_utils import from a service client
* Remove CONF values from messaging client
* Remove CONF values from object_storage clients
* Do not parse Neutron error message to tolerate message changing
* Fix typos in security group scenario test
* boto: Remove skip for bug 1072318
* Add os-tenant-networks test
* Fixed a small spelling mistake
* Fix create server request in test_network_v6
* Add Forbidden translation
* Add _set_object_storage_clients() to client setting
* Add a tests for service clients
* Drop nova-manage CLI tests
* Turn off sitepackages
* Improves a couple of docstrings in Javelin
* Fix FIP negative tests for nova V2.1 API
* Always use an available plugin for CLI sahara test
* Updated from global requirements
* Add ironic port show by mac address
* Add a test for new-style container-sync
* Remove CONF values from database client
* Allow to specify the list of sahara enabled plugins
* Add SSL  parameters to negative tests
* Use server_client clearly for removing server_group
* Remove CONF values from network client
* Remove CONF values from compute clients
* Update glance_http for SSL
* Fix _create_loginable_secgroup_rule in scenario manager
* update test_volume_boot_pattern to assign one value
* Skip test_subnet_details
* Add ipsec-site-connections to resource map of a network client
* Use valid metadata keys for compute images
* Switch rest_client module to tempest-lib
* Remove RestClientException inheritance
* Change orchestration client to return one value and update tests
* Remove CONF values from OrchestrationClient
* test_update_instance_port_admin_state
* Test multiple security groups association for a vm
* Change some compute admin image client methods to return one value
* Add explicit cleanup to test_ports
* Add compute_quotas lock fixture to test_absolute_limits_negative
* Use create_test_server in test_max_image_meta_exceed_limit
* Add return one value to volume delete methods
* Adds scenario for DNS-nameserver configuration
* test_verify_multiple_nics_order failing in gate
* Remove JSON-specific code from client settings
* Change compute image client methods to return one value
* Make rest_client module py34-compatible
* Move tempest_roles options to auth group
* Add roles to all tempest created users
* Change volume client methods to return one value
* Move fake get_credentials methods to test_auth
* Remove CONF reference in test_rest_client
* Move ResponseBody/List classes to service_client
* Make TestSwiftBasicOps use object_client
*  Test port update with new security group
* Separate tests of negative_rest_client
* Remove imports of http module
* Add raw_request() to RestClient
* Remove all CONF values from RestClient
* Updated from global requirements
* Adds tests create/update port with multiple attributes
* Create port in allowed allocation pools
* Restore the persistent server option in the LB tests
* Add image client build timeout config option
* Change image client methods to return one value
* printout testr tests that fail
* Add a test for filtering list servers for a specific tenant
* Change v2 identity client methods to return one value
* Floating IP Negative Tests
* Handle HTTP 415 in rest_client
* Update sample config
* Separate NegativeRestClient from rest_client
* Move _get_region() to NegativeRestClient
* Remove ObjectClientCustomizedHeader class
* Remove AccountClientCustomizedHeader class
* Remove _get_endpoint_type() from RestClient
* Separate build_interval/timeout from RestClient
* Updated from global requirements
* Delete unused schema definition console_output
* Ensure subnet for port security group tests
* Avoid port_state error in test_create_list_show_delete_interfaces
* Drop ComputeAdmin configs, credentials and manager
* Remove python client related logging
* Preupgrade setuptools in tox tempestenv
* Change v3 identity client methods to return one value
* Ignore router_interface is not found while cleanup
* Test delete of SLAAC subnet without port delete
* Floatingip as port fixed ip
* Refactor custom matchers
* Fixing typo in config.py
* Add ComputeClient for cleanup
* Skip personality max limit tests in case no limit
* Fix log message on exception in setUpClass
* Remove interface json and set skip_test method
* EC2: do not assume order in dictionary
* Add ObjectStorageClient for cleanup
* Add VolumeClient for cleanup
* Improve error message on exception raised by get_default
* Improves documentation formatting of cleanup.py
* Add IdentityV3Client for cleanup
* Fix dhcpv6-stateful tempest test to validate only valid use-case
* Avoid overlapping subnets in class NetworksTestJSON
* Add test case for floating_ip response body
* Actually attach a volume to an instance before taking snapshot
* DHCP6 Tests fail to remove DVR ports
* Adds documentation for Javelin
* Fix slowest test output after test run
* Change neutron client methods to return one value and update tests
* Test wrong IP version of prefix in security rule
* Skip load balancer API test for ipv6 network
* Routers Negative API Test
* Correctly fetch the ips from server
* Add a word "Test" to metering test classes
* Remove Nova v3 API config
* Reorder setup and cleanup functions for readability
* Remove unnecessary setting from CredentialsTests
* Add Test to Create Port with no security groups
* Fix rebuild server tests for wrong input
* Add note about build_timeout
* Remove Nova v3 API schemas
* Remove Nova v3 API clients
* Remove Nova v3 API tests
* Use isolated creds for dashboard scenario
* Fix ipv6 network scenario in multi-network environment
* Skip IPv6 scenarios for baremetal
* Remove use of 'cls.enabled = False'
* Bump working version to 4
* Remove Nova v3 API code from RestClient
* Raise a new exception NotImplemented for HTTP501
* Remove XML related code from RestClient
* Updated from global requirements
* Change rest client exceptions' inheritances
* Move safe_body() into specific class
* Make InvalidServiceTag inherit from TempestException
* Framework for staged setup
* Use assertIn to check for subnet membership
* Do not test the metadata_items limit when there is no limit
* Remove unused TOKEN_CHARS_RE
* Remove network debug
* Check that the number of fixed_ips is at least one
* Skip test_update_router_admin_state for baremetal
* Temporarily disable service-type test
* Do not test the maxImageMeta limit when there is no limit
* Ensure extension aliases are used for nova based services
* Revert "Log the credentials used to clear networks"
* Add more verbose info for wait_for_..._status methods
* Remove Volume V1 specific test base classes
* Log the credentials used to clear networks
* Ironic: Remove few misguided negative tests on ports
* Test to create bulk port
* Handle pagination keys in lister response
* Add ca_certificates_file option to test against SSL servers
* Make policy client methods return one value, and fix tests
* Support creating users with a default_project_id
* Port  API Test Enhancement
* Basic networks Scenario Test Enhancements
* Remove unnecessary secgroup attrs from scenario tests
* add cinder v2 api tests for volume_services
* part-2 expect badRequest in server metadata test
* Use volume_id rather than volume_name in volume extensions timeout
* Fix print name of ResponseBody object
* Adds scenario for IPv6 addresses
* Expect badRequest in server metadata negative test
* Adapt negative testing documentation
* Use a compute service type from tempest.conf
* Respect auth.allow_tenant_isolation
* Remove unnecessary parameters on create_volume API
* Fixing casual failing of nc service in LBaaS

3
-

* use built in HTMLParser instead of lxml
* Firewall as a service API Test Enhancement
* Remove not used attribute _schema_file
* Remove unused xml config options
* Enable cinder v2 api tests in volume quotas
* Add code to enable single-value response for http clients
* Scenario manager: catch Exception in get_remote_client
* Fix doc for usage of python clients in scenario tests
* Expand service validation to work for Nova cells
* remove xml_utils and all things that depend on it
* purge xml clients from tempest.clients
* part 2 of delete xml
* delete all compute xml tests
* Skip test_volume_boot_pattern until bug 1373513 is fixed
* Dashboard login page assert string fix
* rm pyc files before test runs
* Cleanup class resources for large-ops scenario
* Take InstanceType for launchconfig res creation
* Unified interface for ScenarioTest and NetworkScenarioTest
* DHCPv6 network tests
* Update documentation for clarity
* Updated from global requirements
* Fix error message when isolated tenant subnet creation fails
* Add check for too_slow_to_test flag on swift notification test
* Use standard assertVolumeStatusWait for volume detachment
* Added neutron cli test case for fwaas
* Security Groups  API Tests Enhancements
* enable cinder v2 api for test_volumes_backup
* Add internal methods for setting identity clients
* Sync latest log module from oslo-incubator
* Add Conflict exception in test_floating_ips_actions case
* Add internal methods for setting volume clients
* Moved init_conf call and preserve tempest network objects
* Add config options for XML support in Keystone
* Ignore NotFound during network cleanup on API
* Enable cinder v2 api for volume type extra specs tests
* Enable v2 api for volume and snapshot tests
* Fix inheritance for BaseTestCase
* Move common compute clients to the setting method
* Enable cinder v2 api for volume hosts
* Adds test for deleting external network with floatingIPs
* Updated from global requirements
* Adds doc for public_router_id in tempest.conf
* Update README.rst for generating sample conf file
* Add internal methods for setting compute clients
* Attempt to test live_migration by default
* skip test_server_cfn_init as the failure rate is too high
* Delete console negative tests
* Add a shelve/unshelve scenario
* Make every swift clients use expected_success
* enable cinder v2 api for volumetype test
* Fix invalid URL in AccountClientCustomizedHeader
* Add scenario test for swift-proxy ceilometer middleware
* Support for IPv6 tests for API
* Stop resource leakage for negative tests
* Use addCleanup when running swift scenario tests
* Make delete_container use expected_success
* Fix empty string as id in create flavor request
* Fixes grammatical errors in HACKING.rst
* Creating individual resources for vpnaas test case
* Remove a redundant KeyPairsV3ClientJSON
* javelin2: destroy functions above network resources
* javelin: add network and secgroup resources
* quota testcases use tenant_name should use tenant_id
* Fix tox stress invocation to not quote arguments
* Update docs for regenerating sample conf file
* Decouple resources and preconditions in secgroup scenario
* Fixes volume client in volume tests
* Revert "Skip test_list_server_addresses if neutron"
* Adds "list external networks" test to regular user
* Remove ephemeral size assertion in baremetal scenario
* Add wait for async secgroup add to minimum basic scenario
* Skip some tests when cinder is not enabled
* Remove "Disabled Reason" from test_cinder_service_list
* Increase default maximum safe_body function
* Don't setup identity v3 client if v3 is disabled
* Fixed a comment on dirty logs list
* Fix service validation schema
* Increase the 'all' timeout because slow tests are included
* Change CLI tests to use auth providers
* Prevent external router IPs from being sent back
* Correct docstring indentation
* Fix the flavor ram string value
* Allow some lag for floating IP to reach a status
* Fix unit tests to detect import failures
* Adds method to verify multiple tenants are available
* Include 207 in http success status code RFC-4918
* Add list-networks test for os-networks API
* Fix missing usage of the xml neutron clients
* Use "ip" instead of "ifconfig" to get MAC address
* Remove checking of non empty resp body for 204
* Add config option for XML support in Networking
* Switch to using subunit-trace from tempest-lib
* Migrate cli test framework to tempest-lib
* Fix AttributeError when test_function_help fails
* Create subnet without gateway and explicit IP ver
* Adds test for list/get volume attachments V2 APIs
* Fix resource leakage in messaging.test_queues
* Remove AltManager class from client
* Bump version string to coincide with kilo release
* Security Group ICMP validation for icmp-code
* Test to update port with CIDR value
* Added neutron cli test case for vpnaas
* Fix and re-enable test_disassociate_not_associated_floating_ip

2
-

* Make duration in serial test approximate total run time
* Add cleanup to test_verify_multiple_nics_order
* Remove PYTHONHASHSEED=0 from tox pep8 job
* Log identifiers of resources being cleaned up
* Move tempest to oslo-config-generator
* Add list servers to large ops test
* Fix execute status of cleanup script files
* Don't double log API request
* enable cinder v2 api for test_multi_backend
* Fix resource_setup order in scenarios
* Add missing space to build_timeout description
* Verify network interfaces are in requested order
* Fix cleanup for EC2 test_compute_with_volumes
* Adds TestSecurityGroupsBasicOps created VM's security_groups check
* Move status check to client for "messaging" tests
* Make rest_client.wait_for_resource_deletion timeout error more specific
* Add exceptions.BadRequest to the test case of reserve_fixed_ip
* Run telemetry in javelin if resources.yaml says so
* Add a server console-log test with unlimited length
* Don't use a specific arg list for stress in tox.ini
* Remove @author tags from copyright statements
* Port  API Tests Enhancements
* Add Credentials Provider factory
* Fix duplicate ref of volume_types_client in vol tests
* Orchestration use stack timeout waiting for ping response
* Allow javelin to run with incomplete resources.yaml
* Add expected response checks of secgroup rules
* Fix verify_tempest_config with disabled services
* Fix use of kwargs instead of **kwargs
* Drop unused safe_setup decorator
* Hacking rule to forbid resource unsafe fixtures
* Log AttributeError as 'info' instead of 'exception'
* Remove OfficialClient dependency from HACKING.rst
* Adds status check for FloatingIP in network scenarios
* Remove setUpClass added after cleanup
* remove heat test_updates tests
* Migrate cli tests to resource_* fixtures
* Migrate thirdparty tests to resource_* fixtures
* Migrate scenario tests to resource_* fixtures
* Migrate volume API tests to resource_* fixtures
* Improve IPV6 parity in Security Group testcases
* Revert "Skip telemetry_notification_api test due to bug 1336755"
* Fix Docstrings for test_server_basic_ops.py
* Separate security group rule test for each args
* Remove Resp status code checks in stress tests
* Fix create_user parameters for v3
* Don't parse config file if it doesn't exist
* Use shared values for test_security_group_rules
* skip cfn_init test, it is failing too much
* Revert "Add "reboot_instance" EC2 API test"
* Remove "nova-manage flavor list" CLI test
* Removes deprecated net_common module
* Drop client_type for auth module
* Drop OfficialClientManager and references to it
* Drop OfficialClientManager from tenant isolation
* Add the start message for debugging net info
* javelin: fix user destruction
* disable neutron network tests that fail too much
* Fix finding router for scenario tests
* Fix schema definition admin_flavor_create
* Reduce complexity during import phase
* Add an internal test method for rebooting a server
* Fixes image create utf-8 multibyte test
* Add a test for deleting a suspended server
* javelin: Detach the volume before destruction
* Updated from global requirements
* Fix MismatchError for LB scenario test
* Clean up tox.ini and make tempest and unit test distinct
* Migrate scenario utils to tempest client
* Skip large_ops_scenario if large_ops_number < 1
* Migrate telemetry API tests to resource_* fixtures
* Migrate queuing API tests to resource_* fixtures
* Migrate orchestration API tests to resource_* fixtures
* Javelin: enable volume resources
* Fix resource cleanup in server rescue tests
* Rename NeutronScenarioTest to NetworkScenarioTest
* Drop OfficialClientTest and NetworkTest
* Cleanup leftover dependencies to official clients
* Add test caller to test_server_cfn_init timeout error message
* reenable full request/response logging at DEBUG
* Fix use of code name in services decorator
* Add "reboot_instance" EC2 API test
* Stop using intersphinx
* enable volumes v2 snapshot tests by sharing codes
* Easier to read console output
* Add bash to tox whitelist_externals
* Remove duplicate _ping_ip_address() methods
* Log deletion errors in  clean servers
* Migrate test_load_balancer_basic to tempest client
* Properly preserve trace on error during wait
* Lock test_resize_server_using_overlimit_* tests on 'compute_quotas'
* Replace wait with communicate to avoid potential deadlock
* Add a test documentation section to the docs
* Drop autoscaling scenario test
* Updates Tempest to match Zaqar's API name change
* Restoring dashboard tests
* Delete baremetal resources in correct order
* Add tempest post-run cleanup script
* Migrate baremetal_basic_ops to tempest clients
* Add missing baremetal API tests
* Typo fixes "tryies", "snaphot", "Retruns"
* Migrate object_storage API tests to resource_* fixtures
* Migrate image API tests to resource_* fixtures
* Make cli test namespace include test files
* Migrate data_processing API tests to resource_* fixtures
* Migrate database API tests to resource_* fixtures
* Migrate baremetal API tests to resource_* fixtures
* Migrate network API tests to resource_* fixtures
* Migrate identity API tests to resource_* fixtures
* Migrate computev3 API tests to resource_* fixtures
* Migrate computev2 API tests to resource_* fixtures
* Framework for resource safe class level fixtures
* Migrate TestStampPattern to tempest client
* Removes bogus negative create image compute
* Select AuthProvider type from credentials type
* Fix scenarios not passing down specific network
* Add subnet tests for extra attributes
* Add response schema for V2 sec grp default rule
* Migrate test_server_cfn_init to tempest clients
* Fail tempest if 0 tests are run
* Remove PYTHONHASHSEED=0 from tox.ini
* Update Heat CLI test to pass with random hash
* Unskip test_update_port_with_second_ip()
* Unskip test_rescope_token()
* Unskip test_stack_update_add_remove()
* Unskip test_create_and_get_delete_bucket()
* Add test list_servers_filtered_by_name_regex
* Properly print STDOUT and STDERR in test_wrappers
* Backward compatibility to credentials in conf
* Migrate test_large_ops to tempest client
* large ops test should be derived from OfficialClientTest
* Skipping dashboard test to unblock gate
* Support lack of ephemeral volumes for baremetal
* Change LOG.exception to LOG.info for skipped tests
* VolumeMultiBackendTest: delete error volumes
* Add a test for deleting multiple objects by POST method
* Replace confusing member name
* Remove redundant waiter in create_volume cleanup
* Better timeout exception in wait_for_resource_deletion
* javelin: fix object destruction
* Allow new quota types
* Make SwiftScenarioTest methods public
* Have the EC2 instance test to wait for termination
* Migrate advanced server network to tempest clients
* Migrate test_encrypted_cinder_volumes to tempest client
* Migrate security_groups_basic to tempest clients
* Fwaas API Test Enhancement
* Fix unstable assertion in test_cinder_endpoints
* Add baremetal API tests about console
* Move javelin2 over to use oslo logging
* Move cli tests into service subdirectories
* Move success response checking to the token client
* Move response code checking to client for v3 identity tests
* Check port's status also in show port tests
* Remove force_tenant_isolation=True from test that doesn't need it
* Verify network connectivity before state check
* Only log console log if nova supports consoles
* Avoid to iterate over empty list in DictMismatch
* Add a NotLockingAccounts credentials provider
* Fix use of nonexistent class variable in accounts
* Properly detect grenade in check_logs script
* Fix TypeError in TestVolumeBootPattern
* Make output from check_logs less verbose
* Fix V2 hypervisor server schema attribute
* Some scenario tests do not delete network resources
* Work toward Python 3.4 support and testing
* Make unit tests not depend on random hash seed
* Adds the clients and tests for CINDER QoS V1 & V2 APIs
* Fix load balancer scenario if no tenant network
* Fix network/secgroup scenario tests for ironic
* Allow out of quota failure status code to be 413 or 403
* Migrate test_network_basic_ops to tempest clients
* Fix IPv6 default masks for SLAAC
* Adds v2 keystone service test to service v3
* Fix response body format of orchestration_client to dict
* Fix "mutable" object as default value
* Cleanup neutron default security groups on tenant deletion
* Use safe_setup instead try block in setUpClass
* Add a check_telemetry method to javelin
* javelin: implement resource destruction
* Heat SwiftResources : only count containers created by Tempest
* Migrate test_volume_boot_pattern to tempest client
* Migrate test_server_advanced_ops to tempest client
* Migrate test_server_basic_ops to tempest client
* Refactor ways of creating anonymous test user
* Improve the selectability of Swift tests
* Fix tox coverage job
* Adds Ironic set/get boot device API test
* Extract SwiftScenarioTest class to manager
* Client response checking for orchestration service
* Move API response success check to Neutron client
* Ensure proper ordering of XML arguments
* Add a test for inline parameter of TempURL
* Adds support for custom image formats in scenarios
* Fixes Hyper-V basic scenario volume partition name
* Add cases for Swift scenario test
* Allow FWaaS API test to accept more than one end state
* Revert change to get_remote_client()
* Add _interface attribut in BaseNetworkTest
* Add sec-group rules for ping6 and ssh -6
* Catch BadRequest exception from correct module
* Add REVIEWING.rst
* Ensure PYTHONHASHSEED=0 for the 'all' tox env
* Remove functionality to load json files
* Updated database clients for bp client-checks-success
* Updated the baremetal client for bp client-checks-success
* missing network configuration in telemetry tests
* Add glance tag to test_server_actions
* Migrate test_snapshot_pattern to tempest client
* Migrate test_minimun_basic to tempest client
* Fix "NotFound" error in _clear_stacks()
* test_hotplug_nic wait for the guest
* Change default size for strings to 1
* Add functools.wraps on all function decorators
* Update volume client check success
* Add service tags to tempest/api/orchestration/stacks
* Add network's status check after creation of network
* Supports DEFAULT group opts in TempestPrivateConfig
* Do not run fwaas API tests in smoke
* Don't run lbaas scenario test as smoke test
* Add MatchesDictExceptForKeys custom matcher
* Deacrease the required image store size by 4 GiB
* Rename Marconi to Zaqar
* Remove test_db_archive_deleted_rows
* Add os-networks JSON client for tempest
* Migrate test_aggregates_basic_ops to Tempest clients
* Migrate swift scenario test to tempest client
* Remove test start output in pretty tracer
* Use python abc in DeletableResource class
* Use python abc in StressAction class
* Add new snapshot compute feature flag
* Disable hacking rule H305
* Remove not used server creation from test_server_rescue
* Add ironic instance rebuild test
* Convert request schema (servers)
* Convert request schema (flavors_admin)
* Convert request schema (flavors)
* Allow dict's as schema definitions
* Revert "Added neutron cli test case"
* Adds an orchestration API test for resource types
* Enable E128 ignore E129
* Use list comprehension in create_bulk_networks
* Enable H407,H305,H307,E122 ignore E123
* Relax check for router interface in _verify_network_details
* Remove cleanup code according to TODO comment
* Fix errors on import with service tags
* Added neutron cli test case
* Add console_output compute feature flag
* Add a config option to select compute xml api
* Fix arguments for method expected_success
* Remove skipping test_list_servers_by_admin_with_all_tenants test
* Remove skipping flavor_access_add/remove related tests
* Fix typo in comment
* Router API Tests Enhancements
* Move response validation schema's in sub folder
* Allow new quota types
* Removes test_force_delete_server_invalid_state negative test
* Implement javelin2 destroy images
* Do not isolate networks for baremetal
* Add interface_attach compute feature flag
* Skip ceilometer test test_check_glance_v*_notifications
* Avoid unneeded use of set, and use list instead
* Stop leaking identity resources in teardown_all()
* Add image-list to glance cli help test
* Set python hash seed to 0 in tox.ini
* Allow out of quota failure status code to be 413 or 403
* Change 'ceilometer' tag to 'telemetry' and add tags to cli tests
* Add a new credential provider to use a list of creds
* More comments to doc strings
* Add min_client_version decorator for CLI tests
* Skip test_rescope_token
* Add compute tags to tempest/api/database/flavors test
* Enable some volumes v2 tests by sharing codes part2
* If no volume, don't delete volume in teardown
* Allow out of quota failure status code to be 413 or 403
* Use random binary data for test images
* Tag test_nova_keypair_resources as gate, not slow
* Fix skip_path logic if path part is empty
* Add network tags to test_quotas_negative
* Separate create server schema for admin password
* Sahara: add API tests for jobs
* Sahara: preparations for job tests
* Move CommandFailed exception to tempest.exceptions
* Add unit test section to the field guide index
* Add links to the field guide index
* Fix javelin2's skip logic in checks
* Run javelin2 check at the end of create
* Make javelin2's ping for longer
* Make javelin2 create_server wait for server to boot
* Avoid errors in log when neutron tests are skipped
* Add glance notifications tests for ceilometer
* Check rescue_server action attributes of Nova APIs
* Add destroy_server to javelin2
* Add logs to javelin2
* orchestration api test_stacks wait for deletion
* orchestration: tolerate NotFound in wait_for_stack_status
* Skip telemetry_notification_api test due to bug 1336755
* test_neutron_resources to read template's values
* Adds "user-password-update" to v3/test_users
* Fix exception when api_extensions is set to empty
* Use python abc in auth class
* Revert "Add tests for wait_for_server_status"
* Add new shelve compute feature flag
* Check rebuild server action API attributes
* Delete unused class Service
* Add client response checking for data processing service
* Add config file flag to javelin
* Log when javelin2 finishes running successfully
* Make javelin resources optional
* Update compute attach tests to use "volume_device_name"
* Updated from global requirements
* Move baremetal API tests to an /admin subdir
* Skip migrate server invalid state if resize is off
* Make sure cli CommandFailed prints out stdout and stderr
* Fixes incorrect assertion check
* Migrate test_dashboard_basic_ops to tempest clients
* Base class for scenario test using Tempest clients
* remove default=None for config options
* Fix a few bugs when running with -u
* Add base class for all credential providers
* Refactor random url generation into its own method
* Adjust stress test documentation
* Verify get_instance_action attributes of Nova API
* Call clear_isolated_creds in scenario tests
* Removed deprecated command from glance cli
* Make javelin check logging a bit better
* Added Heat Software Config-Deploy API tests
* Skip hypervisor uptime test for baremetal
* Create test images via Glance instead of Nova
* Correct misspelled words
* Add tests for wait_for_server_status
* Adds new v3 projects tests to Keystone
* Adds list users tests in v3
* Correct volume type api schema validation
* Add "capabilities:" to multiple_backends extra-spec key
* Re-enable 'check_trust_roles'
* Add three new CLI tests of sahara
* fix javelin to let you specify imgdir
* olso log sync
* Don't use swift roles when no swift
* Avoid conflicts with other tests instances
* Skip baremetal tests if driver not supported
* Always pass str to shlex.split for py26 compat
* First part of moving success response checking to identity client
* Enable some volumes v2 tests by sharing codes
* Read template's expected value orchest test Part-2
* Read template's expected value orchest test Part-1
* Add a skip for bug #1334368
* Change of copyright to HP for keystone regions
* Make os-quota-class-sets test not break quotas
* Running without keystone v3 doesn't require uri_v3
* Adds test for Sec group default rule Nova V2 API
* Remove docutils pin
* Exclude volume tags while listing instance tags
* Validate server detail list attribute of Nova APIs
* Add Ironic show driver API test
* Make test_drivers.py use driver name from conf
* Fix disk_available_least in JSON schemas
* Add python-ceilometerclient in requirements
* Convert scenario test tearDown to addCleanup
* Improve cinder CLI existing tests
* unskip list server actions tests
* update iptables rules for more useful debugging
* Remove unnecessary log message
* Sahara: minor changes for API tests
* Add skip decorators in test_servers_negative
* Fix "create a flavor" tests for strong validation
* VPNaaS API Tests Enhancements
* Add querying for lists in ceilometer client
* Fix race condition in flavor tests
* Remove the skip for test_get_instance_action()
* Add network service tag to compute tests
* Verify "get a server" API response attributes
* Add parametric tests of Swift object API, part 4
* add py27 to default tox
* Make unable to ping log messages appropriate level
* Add caller to v1 image_client wait_for_image_status timeout exception
* Correct nc command in test_load_balancer_basic
* Improve neutron CLI existing tests
* Require stevedore for check_uptodate.sh
* Add 'id' to the server group cleanup list, not body
* Fixes Scoping bugs
* Replace the console output on Error with fault a message
* Skip quota-out tests temporary to change error codes
* Fix availability zone client in compute admin test
* Missing node driver interface validation API
* Sharing codes for volumes list tests
* Allowed Address Pair API Tests Enhancements
* Avoid snapshotting from compute authorization test
* Verify create agent attributes of V2/V3 APIs
* Drop unused admin client in server metadata tests
* provide enough time to do expires in obj tests
* Add Tests for Message & Claim APIs
* Add 'Member' role to all created users
* Add client response checking for image service
* HEAD doesn't return a body
* Added service "data_processing" to service list
* Remove assertTrue from ssh unit tests
* Updated from global requirements
* Verify list-Floating-IP-Bulk Nova API attributes
* Add new rescue compute feature flag
* Avoid empty string for length in os-getConsoleOutput
* Use the http image location conf option for api tests
* Make test_snapshot_pattern ssh error path work
* Improve test isolation in test_networks:BulkNetworkOpsTest*
* Use config generator rc instead of wrapper script
* Update config generator from oslo-incubator
* Sahara: add API tests for job binaries
* Fix T104 for scenario test subdirs
* Add Ceilometer client for scenarios tests
* Skip case for fixing incorrect exception assertion
* Verify delete-Floating-IP-Bulk Nova API attributes
* Force connection auth as part of RemoteClient in scenario
* Don't try to trace non-printable characters in debug output
* Add tox job to build docs
* Adds scenario tests for volume encryption
* Added swift CLI test cases
* Verify V2 list server_group API attributes
* Check create-Floating-IP-Bulk Nova API attributes
* Fix calls to mock.assert_not_called()
* Enable E251,E265 rules ignore H402
* Sharing codes for cinder v1 and v2 tests
* Enable E113,E111,H302,F812,E713 rules
* Don't include boto tests as part of smoke tests
* Bump hacking to 0.9.x series
* Unbreak baremetal API tests that were not updated
* Add test for compute API os-quota-class-sets
* Set default to false for nova v3_api config option
* javelin: create and attach volumes
* Code clean-up of CLI test "cinder list-extensions"
* Verify list_instance_action attributes of Nova API
* Use known flavor ID as marker
* Tempest API tests: Add ipv6 attribute tests
* Disable isolated_creds.net_resources on network scenarios
* Sahara: preparations for job binary tests
* Handle backup not found in test_create_backup
* Remove the validate_driver_info test
* Sync versionutils from oslo-incubator
* add block_device_mapping to create_server params for nova clients
* Add total runtime to summary output
* Heat Overlapping ip issue
* fix usage of allow_tenant_isolation
* Cleanup for local variable in test_attach_volume
* make 'server' as 'required' in server update schema
* Adds test for Floating Ips bulk Nova V2 API
* Correcting 'id' type in compute schema
* Add unittests for remote client
* cleanup on remote_client
* Fix update_server JSON Schema for Nova V2
* make logformat more similar to oslo
* Bump baremetal power/assoc/unprovision timeouts
* Add a hacking check to block scenario manager in api tests
* Convert get_console_output length=None to -1 for Nova V3 API calls
* Change how tempest debug logs are displayed
* Use correct base test class for test_stress unit tests
* VPNaas IPSec policies tests
* Mising CLI test for Keystone
* Adds keystone roles v2 tests in v3
* Consolidate _check_tenant_network_connectivity in NetworkScenarioTest
* Consolidate _check_public_network_connectivity into NetworkScenarioTest
* Add bug skip for test_container_synchronization()
* Make run_stress.py script an entry point
* Add README section about API stability
* Revert "don't reuse servers in test_server_actions"
* provide ability to tweak oslo log defaults
* Place baremetal common methods in base class
* Add parametric tests of Swift object API, part 1
* Optimization and response status code update
* Check create/get/delete V2 server_group attributes
* Revert "Fail fast during advanced networking test"
* don't reuse servers in test_server_actions
* Add branchless tempest section to README.rst
* dump console if we time out on a server op
* Fix warnings from build_sphinx
* Remove the list_servers_since_test
* adds the missing _interface variable
* Clarify API extension description of Nova API
* Nodestate API test for power state set
* Add cinder CLI tests "qos-list" and "encryption-type-list"
* Add CLI test of "nova server-group-list"
* Add missing compute service tags to volume API tests
* Reworked scenario tests to use their own non-default security groups
* Wait for server activations for the updated servers
* Add compute notifications tests for ceilometer
* Enhanced Trove (database) flavor API tests
* Verify 'update-server-metadata' APIs attributes
* botoclient does not honor disable_ssl_certificate_validation
* Fixed argument parsing in run script
* Upload public image requires admin role by default
* Relax security group rules cleanup
* Sahara: add API tests for cluster templates
* Add veritification to name property in cinder volume
* Don't store duplicate policies for server_group
* test_aggregates_basic_ops picks a non compute node
* javelin 2
* allow for arbitrary kwargs in image client
* Updated from global requirements
* cleaning up index.rst file
* Sahara: minor changes for API tests
* allow 'main' as valid name for find_test_caller
* log request start when tracing classes
* Verify delete security group response of V2 API
* Remove default from image_ref options
* Remove dependency on keyring
* Fix sudo_cmd_call in tempest.common.commands
* set all build_intervals to 1s
* Deduplicate status call checks
* remove skip attributes for fixed bug
* Test script for CRUD operations on regions
* Use old dict generator syntax in baremetal/test_ports
* validate server action 'console_output' attributes
* Remove nova v2 client in ListSnapshotImagesTest
* Update version string to follow new convention
* Add quota delete test to cinder
* Make test_server_cfn_init a scenario test
* Add Marconi Smoke Tests
* tests the Keystone extensions V2 API
* Verify server list_addresses V2/V3 APIs attributes
* Cleanup docstring in test_l3_agent_scheduler
* Verify Server Actions attributes of Nova APIs
* Revert "Adds certificate tests for keystone v3"
* Sahara: add API tests for job binary internals
* Sahara: preparations for job binary internal tests
* Make sure image exists in test
* Start using oslotest for tempest unit tests
* Sahara: add API tests for data sources
* Add "create a server" test with server group
* Switch back to nc in test_load_balancer_basic
* Fail fast during advanced networking test
* Remove time.time mock from test_ssh
* lbaas basic - open firewall for http on vip port
* Fix security_group_create_get_delete testcase
* Fix alt tenant id's issue in BaseV2MemberImageTest
* Enable H302 rule everywhere
* Use a more sensible network topology for some router tests
* Fix test_create_show_delete_security_group_rule
* Add hacking import exception for service clients
* tolerate HTTPNotFound in scenario manager teardown
* add test for command bash-completion
* Add API test for resizing a stopped server
* Verify more information in floating ip tests(part2)
* Fix hardcoded gateway in IPV6 subnet api tests
* Fix subnet api test case for non-default cidr
* Sahara: editing licenses
* Fix test case in security groups
* Verify more information in floating ip tests
* Adds certificate tests for keystone v3
* Get credential IDs from Credentials class
* Split large-ops into three tests so each has its own timeout
* Remove tempest_auto_config script
* Enable GET port_detail API to set parameters
* Fix issues introduced /w migration to Credentials
* adds tests for CINDER encryption volume-type APIs
* Updated from global requirements
* Verify the response attributes of 'aggregate-add-remove-host' API
* Add a common admin class for Nova v2/v3 API tests
* create test and worker summary report
* Add tests for server-group Nova V2 APIs
* Verify "list interfaces" Nova v2/v3 API response attributes
* refactor out code duplication
* orchestration: add test for untyped provider resources
* orchestration: Add test for resource_registry environment
* orchestration add basic support for environment API test
* Use find_test_caller to put test name in timeout exception details
* Check list servers attributes of Nova APIs
* Share Certificates API's tests between V2 & V3
* Inherit V2 API's flavors tests from V3 tests
* Inherit V2 keypair API's tests from V3 tests
* Verify list_addresses_by_network APIs attributes
* Verify the response attributes of 'create-aggregate' API
* Verify update host Nova V2/V3 APIs attributes
* Add unit tests for tempest hacking checks
* Check non json type on glance client json_request method
* Add in a concurrency aware subunit filter
* Access credential fields as attributes
* Enforces the use of Credentials (part2)
* tests the user-password-update for Keystone V2 API
* Removing unnecessary pass instructions
* Refactor _find_caller into a public test finder utility
* Add tests for availability-zone-list CINDER V1 API
* modifies the test to sort based on UUID
* Add compute service tags to ListSnapshotImagesTest
* Verify "update a server" API response attributes
* Skip creation of network resources for disabled IPv6 tests
* Added Trove (database) version API tests
* Extending quota support for neutron LBaaS entities
* Add noqa support to no_setupclass_for_unit_tests
* Neutron Allowed Address Pair API test
* Revert "add server personality files test"
* Updated from global requirements
* Add a common class for Nova v2/v3 API tests
* Add test for subnet gateway IPv4 and IPv6
* Separate common 'start_up' definition from v2 schema
* Add unit tests for verifying extensions list
* Add unit tests for api_version detection
* Add unit tests for _get_unversioned_endpoint
* Add cmd entry point for verify_tempest_config
* Add support for updating the config file
* Enforces the use of Credentials (part1)
* Use auth data to fill credentials
* Define V3 Credentials
* Skip lbaas test test_load_balancer_basic
* Fix stress runner not stopping on first fail
* Stress runner/driver prints stats after SIGINT
* Remove {begin,roll}_detaching volume API tests
* Add a lacking message format letter 's'
* Verify Set/Get/Delete server meta item attributes
* Use fixed ips for lbaas pool members
* Add V3 Test to get Spice & RDP console of server
* Sahara: preparations for data source tests
* ssh_floating verify reboot
* Updated from global requirements
* Add tests for CINDER services v1 APIs
* Verify create/get flavor attributes of Nova APIs

1
-

* Add a response header validation
* Verify more information for member in lbaas api tests
* fix test_compute_with_volumes
* Remove unused arguments
* Adds more testcases to test_telemetry_alarming_api
* Account failure to the tearDown instead of setUp
* Check for 'Generated' in SSH key comment
* Verify 'list-server-metadata' APIs attributes
* Verify the attributes of 'set-server-metadata' API
* Defines a Credentials class
* Verify addrs only against ports with fixed IPs
* Verify os-migration API response attributes
* Verify attributes through Nova os-quota-sets API
* orchestration api add test for volume retain deletion policy
* orchestration api add basic volume resource test
* orchestration api refactor access to stack outputs
* Verify tenant usages API response attributes
* Verify certificate API response attributes
* Verify delete aggregate attributes of Nova APIs
* Remove Nova v3 XML test skip
* Delete OrchestrationManager, and its unusual credentials
* skip the quota enforcement test for swift
* Add parametric tests of Swift object API, part 2
* Verify flavor extra specs attributes of Nova APIs
* Fix stress runner signal related issues
* ssh instance validation add options for Neutron
* Verify list agents attributes of V2/V3 APIs
* Added cleanup in some tests
* Check detail list Images attributes of Nova V2 API
* Check attributes of attach/detach volume Nova APIs
* Make large-ops test boot a group of instances 3 times
* Verify delete server attributes of Nova API
* Missing baremetal NodeState API test
* fix dict reference error
* Verify delete agent response of V2/V3 APIs
* VPNaaS API tests cleanup
* skip test_stack_update_add_remove because of race
* orchestration convert API test Timeouts to respect build_timeout
* Avoid passing empty string as AZ name
* List multiple fields tests for networks/ports
* move out ironic exception from common import
* add quotas tests
* Skip more pause tests if pause is not available
* Up the default timeout for stack builds
* Remove test_create_port_with_no_ip
* Validate list_instance_usage_audit_log Nova V2 API
* Fix test_verify_created_server_ephemeral_disk
* Move exceptions back into one place
* Remove the unused _get_unused_flavor_id()
* Consider state in firewall create/delete test
* Add Sahara client for scenarios tests
* fix import for default clients in clients.py
* Swift formpost cleanup
* Implementing XML client for VPNaaS
* Fix import group ordering in test_utils.py
* Add load_test mechanism for InputScenarioUtils
* Move the test_utils module to scenario test dir
* Add cinder api version detection to verify_tempest_config
* Fix service list in verify_tempest_config
* Fix url parsing for api version check
* Inspect listed ports for created port with binding
* Verify the response attributes of 'update-aggregate' API
* Check  get_vnc_console attributes of Nova APIs
* Remove test_create_server_response
* Updated from global requirements
* Verify delete interface response of V2/V3 APIs
* remove n-sch from the watch list
* Unit Tests for glance_http
* Add keystone api version detection to verify_tempest_config
* Add check that service tag isn't in path name
* Add unit tests for commands
*  Improve test_load_balancer_basic
* Add unit tests for all generators
* safe_setup preserve original trace
* Rename instance_actions v3 plugin tests to server_actions
* Don't output auth tokens with trace output
* Verify attributes through Nova os-security-groups API
* orchestration API add coverage for stack update API
* orchestration API refactor test_list_resources
* Verify delete quota response of V2/V3 APIs
* Verify "get az list" API response attributes
* Add opportunity to directly update headers
* Verify the response attributes of 'shutdown/reboot_host' API
* Change to use absolute path in load_template()
* Stop swift resource leaking even if an error occurs
* Verify list_virtual_interfaces attributes of API
* Add V2 Nova API os-agents tests
* Improve the extra routes test on router
* Remove created routers as part of test cleanup
* Make heat-slow job run in parallel
* Unskip load balancer basic scenario test
*  Verify the response attributes of 'aggregate-set-metadata' API
* Waiting for ACTIVE state in rescue tests
* Enable security_groups_basic_ops blocking tests
* Network fwaas API test
* Volume size could be specified to create volume
* orchestration API base class rename clear* functions
* Multiple fixes to test_server_basic_ops
* Trailing '/' throws error
* Add network API test to create/update a port with 2 IP addresses
* Adds unit test for negative class decorator
* Sahara: preparations for new tests
* Missing baremetal driver API test
* Server create - JSON schema validation: adminPass is optional
* Check attributes of get server password Nova APIs
* Check attributes of create/delete sec groups rule
* unskip test_list_servers_filtered_by_ip
* add trace_requests option to debug section
* Remove python25 workaround from glance_http
* Move run_ssh class variable into skip decorators
* Honor suspend/pause config switches in scenario tests
* Verify the response attributes of 'startup_host' API
* Remove singleton pattern in base_generator
* Enable one flavor tests
* Verify detail_list flavor attributes of V2/V3 APIs
* Adds Ironic test_baremetal_basic_ops scenario test
* Add and use a StackResourceBuildErrorException
* Use OS::Nova::Server for NeutronResourcesTestJSON
* Move resize_available class variable into skip decorators
* Move pause_available class variable into skip decorators
* Move suspend_available class variable into skip decorators
* Disable other suspend/resume tests if not supported
* Stress action for volume attach verify
* Expand baremetal port coverage
* Verify more information for pools in lbaas tests
* Split certificate API test
* Check add/remove flavor access APIs attributes
* Remove variable part of agent dict to fix AgentManagementTest
* orchestration add resource limit API test
* orchestration remove unused invalid_template_url
* orchestration api tests remove duplicate client assignment
* orchestration api tests, docstring cleanups
* Verify list extensions attributes of V2/V3 APIs
* Verify "get version" API response attributes
* Verify the create/delete volume APIs attributes
* Add os-migration tests for Nova v3 API
* Add os-migration tests for Nova v2 API
* Remove unused create_image of Nova v2 API
* Check attributes of image meta item Nova APIs
* Validate image metadata attributes of Nova APIs
* Verify the response status of create delete Image
* Enable private flavors tests
* Verify hypervisor uptime attributes of Nova API
* Check list & search hypervisor attributes of Nova
* Validate hypervisors_servers Nova V2/V3 API
* Introduce .coveragerc
* Verify the response attributes of 'get_aggregate'
* Updated from global requirements
* Check show_hypervisor attributes of Nova V2/V3 API
* fix sahara base class
* Verify list_hypervisors_detail Nova V2/V3 API
* Stop neutron resource leaking even if an error occurs
* Validate get_instance_usage_audit_log Nova V2 API
* ceilometer-collector now has errors
* Move xml common code into the common dir
* Verify "get quotas detail" API response attributes
* Deduplicate negative test calls
* Check hypervisor statistics attributes of Nova API
* Removing unnecessary pieces of code from network client
* factor out templates to yaml files
* Add list roles api to identity v3
* Update documentation for negative testing
* Validate for list flavor attributes of V2/V3 APIs
* Stop leaking in images tests
* Cinder client does not honor disable_ssl_certificate_validation
* Typo in config.py
* simplify heat test_limits
* Add config fixture support to unit tests
* Skip volume snapshot tests if feature is not enabled
* Verify attributes through Nova "list security groups" API
* Adds more verification in list alarms
* Add unit tests for cli.output_parser
* Add a new exception for invalid structure
* Add unit tests for NegativeRestClient class
* Check reserve/unreserve fixed-ips APIs attributes
* Fail a test if stack delete failed
* Add sahara edp cli commands tests
* Cleanup sahara cli tests
* Some keystone V3 API tests throw incorrect errors
* Verify the response attributes of 'list_aggregates'
* Add sahara to list of clients for T102
* Renew token before expiry time
* Check create/delete keypair attribute of Nova APIs
* Add Keystone role and service test cases
* Verify the list volume attributes of Nova APIs
* Stop volume leaking
* Test current tenant not added to private flavor
* Check attach-detach FIP & get FIP pool attributes
* Validate list_keypair attribute of Nova V2/V3 APIs
* Validate get keypair attributes of Nova V2/V3 API
* Add "delete the volume-attached server" tests
* Verify list Image attributes through Nova V2 API
* Verify Nova create & get Floating IP attributes
* Define 'links' as a common parameter type
* Move to the python-saharaclient
* Remove resize-revert workaround for bug 924371
* don't log cli output on success
* add request timing
* add _find_caller to the request log
* Adds "add_dhcp_agent" to test_dhcp_agent_scheduler
* add back empty whitelist
* Add Cinder quota negatives
* API test for 'create server with scheduler hints'
* simplify rest_client logging
* Translate xml server tenantId /userId
* Skip loadbalancer basic scenario test
* Verify quotas attributes through Nova os-quota-sets API
* unskip test_integration_1
* Add error handling if testscenarios aren't supported
* Add parametric tests of Swift object API, part 3
* Verify "create a server" API response attributes
* Make add_remove_fixed_ip tests executable in Nova gate
* Fix cinder quota cleanup
* Remove usage of internal library function in basic generator
* Add server to clean up even in case of errors
* fix cinder quota equality
* Verify attributes through Nova list flavor-access API
* Stop keystone resource leaking even if an error occurs
* Stop heat resource leaking even if an error occurs
* Make the checks of identity status code strict
* Add tests for external network extension
* Add validation test in identity v3 test_role
* Use HTTP_SUCCESS for checking success status code
* Verify "enable a service" API response attributes
* Verify Image attributes through Nova V2 GET API
* change dirty logs to work off a whitelist
* Verify the response attributes of 'show_host_detail'
* Verify the response attributes of 'list_hosts'
* Validate of Nova list Floating IPs attributes
* Validate get limits attributes of Nova V2 API
* Networks,Ports: delete with subnet, port with no IP
* Add unit tests for configurable network resources
* Add slow tag for test_ceilometer_resource_list
* Update Oslo config sample generator
* Volume boot test uses new block device syntax
* Introduce load_tests mechanism for negative tests
* Stop test server leaking even if an error happens
* Refactor create_ and update_ methods for floating ips
* add volume list tests for cinder v2
* Cleanup common.debug
* Add unit tests for debug
* add server personality files test
* add compute quotas test
* Validate get fixed-ips attributes of Nova V2 API
* Ignore .coverage* files
* Add utils.misc unit tests
* Enhance test to rescope token using v2
* Enhance rescope token test using v3
* Add test to rescope token using v3
* Add missing client names to T102 hacking check
* Add unit tests for wait_for_resource_deletion
* Add test to rescope token using v2
* Add unit tests for the tempest.common.utils.file_utils
* Add network credential unit testing
* Add unit basic unit tests for tenant_isolation
* Support endpoint type in CLI tests
* Remove test_can_log_into_created_server
* Add V2 Nova API os-quota-sets tests
* Add cinder tempest cases for encryption-type
* Modified test case for nova security group
* Add api tests for load balancer's VIPs and health monitors
* change teardown check to LOG.error
* Add return value of classmethod in network base.py
* Move verification of response attributes into service client
* Stop volume leaking even if an error is occurred
* Add list user groups api to identity v3
* Fix error trace induced by dhcp test actions
* Rename Savanna to Sahara
* Do not assert router l3 agent association
* Wait properly for server deletion in test_volumes_actions
* Add tests for binding extended attributes for ports
* Object storage tests to use default auth_provider
* Volume xml client translate json attribute names
* Fix issue with pep8 gate job
* Validate Volume attributes of Nova POST & GET API
* Fix V3 image tests according to new image_client
* Make imports proper order
* Convert fake_config class to use config fixture
* Add agents tests for Nova v3 API
* Add basic Delete Queue Marconi test
* Make test_volume_quotas force tenant isolation
* Stop leaking test_update_images
* Move network test_quotas to admin directory
* Skip Nova API attribute tests if an XML response
* Move negative tests for test_images
* Verify service attributes through Nova "get services" API
* Updated from global requirements
* Unset the imageRef when booting from volume
* Verify more information in API tests for LBaaS
* Add quota_set delete test for Nova v3 API
* API test for Get Image Member(s) Schema
* V2 API Test to get the VNC console of a Server
* Improve readability of test_networks
* Adds basic Marconi test
* Support disabling suspend/resume for compute api
* Support disabling server pausing for compute API
* Updated from global requirements
* Prepare for enabling H302 rule(services/telemetry, object_storage, etc)
* Add unit test for data_utils
* fix flake8 errors
* Removed teardown method from image test
* add token get tests
* Remove unused build_url function in data_utils
* Add negative tests for endpoints
* Increase testing of network connectivity
* Fix problem of deleting dhcp port
* Allow failing logs with errors on a per-log-file basis
* Enable H302 check (tempest/services/volume)
* Add shelve_offload test for Nova API
* Fixed _error_checker in rest client
* Make tempest accounts independent from devstack
* cleanup resources in setUpClass if exception raised
* Volume backup details API test
* Raise orchestration build_timeout to 600 seconds
* Add ignore files related to coverage to .gitignore
* ServerCfnInitTestJSON wait for stack complete before ssh
* Skip nova cli tests with volumes if Cinder unavailable
* Fix RemoteClient usage in scenario tests
* Enable H302 check (api/compute/{c*,f*,i*,s*,t*})
* Add support for negative tests with admin client
* Add multiple negative test generator support
* Add Trove (database) Flavor API Tests
* Fix test by waiting to lbaas entity delete
* Stop volume leaking test_server_rescue_negative
* Do not setUpClass or tearDownClass V3 tests if API is disabled
* Prepare for enabling H302 rule(services/identity)
* Cleanup _interface class variables in compute
* Prepare for enabling H302 rule(api/image)
* Prepare for enabling H302 rule(services/compute/v3/json)
* Separate negative tests for test_images
* Prepare for enabling H302 rule(services/compute/json)
* Add status code checks for Nova attach_interfaces API
* Nova V3 API test for resetNetwork/injectNetworkInfo
* Assign floating ip to a server in load balancer scenario
* Prepare for enabling H302 rule (api/volume,tempest/*)
* Prepare for enabling H302 rule (api/compute/admin)
* image(s) schema image metadata API test
* Removes gate test annotation in security_groups
* Fix invalid syntax in HOT templates
* Move ipv6 config option into network-feature-enabled
* Cleanup subnet creation in network api tests
* Stop running CONF getattr during import
* Seperate negative tests for V3 test_server_rescue
* Updated from global requirements
* Add Cinder tests for quota sets
* Add parametric tests of Swift account API
* Add "delete the resized server" tests
* Remove unused definition in network base.py
* Add "Nova V3 API test for add-fixed-IP/remove-fixed-IP"
* replace basetring/xrange
* Add V3 API Test to get the VNC console of server
* Add service/endpoint discover to verify_tempest_config
* Add swift discoverable_api support to verify_tempest_config
* Make reseller admin role configurable
* Split out config option registration
* Add unit tests for image waiter
* Configure the ec2 zone explicitly
* Adds VM connectivity check after advanced VM operations
* Add Nova V2 API test for resetNetwork/injectNetworkInfo
* Remove unused _parse_array functions
* XML endpoint client use correct string for enabled
* Cleanup _interface class variables in compute/v3
* unskip test_security_group_rules_negative tests
* Use pretty tox with the ``all`` env
* Revert "always use sitepackages"
* Fix setup_test_v3_user method in identity base.py
* Add "V2 API- add-fixed-IP and remove-fixed-IP server action" tests
* Separate negative tests for test_server_addresses
* Skip test_get_instance_action test for nova v3
* Prepare for enabling H302 rule (thirdparty)
* Extend network debug infos on network failures
* Add endpoint_type option to Savanna,Ironic and Ceilometer groups
* stress/actions/ssh_floating.py n-net compatibility
* Test to update neutron security group
* Improve tempest auth tests
* Fix api_version filter for KeystoneV3AuthProvider
* Adds L3 agent test case to test_l3_agent_scheduler.py
* Add namespaces to xml in Network client
* Adds scenario for hotplug nic in network_basic_ops
* NeutronResourcesTestJSON Use the correct resource name for console log
* Check server terminations on "delete server" tests
* Removal of methods from json/xml network_client files
* Move admin "delete a server" tests to test_servers
* Separate negative tests for test_instance_actions
* Improved tests in tempest.api.image.v2.*
* Fix the usage error for config
* Clean network scenarios
* Test creating router setting tenant_id
* Scenario : Start instances using fixed network when possible
* Prepare for enabling H302 rule (scenario)
* Prepare for enabling H302 rule (common,services,stress)
* Prepare for enabling H302 rule (api/compute)
* Stress runner friendly logging.conf.sample
* Add unit tests to tempest auth file
* Add security group deletion to the cleanup util
* Implement pluggability for tempest (exceptions)
* Separate negative tests for V3 test_quotas
* Fix author information
* Log ip Information on ssh failures in the minimum scenario
* Fix stress runner exit issues
* Refactor Managers to a common base class
* Preventing overlapping subnets in network scenarios
* Fix a typo of debug log in scenario/manager.py
* Removed RestClientXML class
* Avoid masking an assert failure with a KeyError Exception
* Use Python 2.6.x compatible syntax for dict comprehension
* add cli.has_manage option
* Fix InvalidInstanceID.NotFound handling
* Clarify admin_delete_server_of_others test case
* EC2 client token is not reuseable for new instance creation
* Add tests for Swift in orchestration
* Add qcow2 image support
* Clean up scenario functions
* Add "delete a shelved server" tests
* Separate the deleting server tests
* fix duplicate api_extensions
* Improve ServerCfnInitTestJSON asserts and debugging
* Skip EC2VolumesTest if Cinder is not available
* Allow IPv6 tests to be disabled
* add TRACE level to the items that are being flagged
* Separate negative tests for test_projects
* Makes some Swift API tests optional
* Separate negative tests for test_multiple_create
* Separate non-admin AZ tests from admin test files
* Remove unsed client variables
* Adds cinder backup functional tests
* Fix misspellings in tempest
* Splits network_basic_ops to fully isolated test cases
* Refactor cross_tenant to security_groups_basic_ops
* Minor changes to scenario manager
* Prepare for enabling H302 (identity,volume,etc.)
* Introduce T106 rule for vi modelines
* Seperate negative tests for test_server_rescue
* Mildly wound the interlopers
* Couple of fixes to tempest/auth
* Add python-savannaclient to requirements
* remove some unused code in nova image tests
* fix quotas client in admin/test_quotas.py
* Fix test classes name of test_tokens.py
* Migrate negative test to a different file
* Skip test_list_server_addresses if neutron until bug 1210483 is fixed
* Restore heat tests running with admin user, demo tenant
* Fix get_versions string parsing
* Fix get versions call in verify_nova_api_versions()
* Fix containers with expired objects deletion problem
* Add quota_set detail test for Nova v3 API
* Remove using of deprecated self.headers (part2)
* Make endpoint type configurable
* unskip test_list_non_public_flavor
* Removes vim headers 5th round
* Add basic Savanna CLI tests
* Refactor create_ and update_ methods for VIPs and health_monitors
* Remove using of deprecated self.headers (part1)
* Add extra list servers by host test
* Prepare for enabling H302 rule (api/object_storage)
* port nova v2 images related tests into nova v3 part2
* Neutron Extra DHCP Options API test
* Neutron LBaaS Agent Scheduler API test
* Add api tests for neutron router
* Replace assertEqual(None, *) with assertIsNone in tests
* Switch over to oslosphinx
* Fix request id log messages
* Add a note about python2.6 support to the README
* Ensure that bug number is actually a number for skip_because
* Test tempest decorators used on integration tests
* unskip neutron_meter_label cli tests
* cleanUp() removing all test resources as an admin
* Rename Openstack to OpenStack
* Add CRUD tests for telemetry alarming
* clean up security groups tests
* port flavors and server_password tests into nova v3 part2
* Define py27 assertFoo methods for py26
* Add test case for snapshot-create with in-use volume
* Test updating port's admin_state_up
* Separate negative tests for test_list_image_filters
* Fix coverage option for run_tests.sh
* Adapt documentation for negative testing
* Remove tests for Nova V3 API os-simple-tenant-usage
* Adds list pool stat test case
* Refactor rest-client and identity v2-client
* Add some cases about volume-create and volume-rename
* Remove tests for Nova V3 API os-instance-usage-audit-log
* Fix test_create_list_delete_volume_transfer without tenant isolation
* Fix usage of NotImplementedError exceptions in auth classes
* Rename images variable in TempestConfigPrivate
* Add a serial full tox job to tox.ini
* auth.py is too verbose
* port flavors and server_password tests into nova v3 part1
* Remove tox locale overrides
* Use testtools.matchers.GreaterThan in test_volumes_transfer
* Use service catalog_type when getting the heat/glance clients
* Fix syntax in test_load_balancer_basics._check_load_balancing
* Let the soft reboot really happen in the minimum scenario
* enable volume list tests for cinder v2 - part2
* enable volume list tests for cinder v2 - part1
* fix base_url in auth.py
* Network API: default to ipv4, add ipv6 tests
* Fix volume transfer tests with tenant isolation disabled
* Fix images tests with tenant isolation disabled
* Add support for special char in volume metadata
* Fix client usage in multibackend volume test
* Add nova migration-list CLI test
* InputScenarioUtils load images if glance available
* Skip failing test load balancing test
* Test to list ports filtered by router ID
* Support building wheels (PEP-427)
* network: add metering api operations
* Fixed misspellings in Tempest
* Add more information to BuildErrorException
* Make v2 and v3 identity apis configurable
* The rescue tests requires neutron resources
* Negative tests: Add result check for resources
* Savanna: add API client and tests for plugins
* Fix admin tenant credential
* Multiversion authentication part2
* Add check_uptodate.sh to run_tests.sh -p
* Use isolation credentials for neutron api tests
* Add the keyword "Test" to some test class names
* Clean/leave OpenStack after a stress test
* Add unit tests for negative test framework
* Multiversion authentication part1
* Removes leftover self.conf from isolated creds
* Add logging config values
* make testing neutron api extensions optional
* Remove unnecessary volume creation in test_server_rescue
* Correctly call client inits from test_multi_backend
* Change import of exceptions for keystoneclient
* Add log info for tempest SSH connection issues
* Negative test autogeneration framework
* Add scenario test for load balancer
* Fix attach_interfaces tests of Nova v3
* Remove suffix "JSON" from Nova v3 API test classes
* Remove suffix "JSON" from Nova v3 API last test class
* Add parametric tests of Swift container API
* Add skips to the services decorators
* Fix services decorator to use object_storage
* Fix stress test README.rst
* Don't run extensions list if service isn't available
* Updated from global requirements
* Add test for OS::Neutron::Router Heat resource
* Add missing isolated_cred cleanup to savanna tests
* Remove last uses of config without global CONF object
* Add key -n for sudo utility
* Convert all service clients to global CONF object
* Convert cli tests to use global CONF object
* Convert scenario tests to use global CONF object
* stop leaking tempdirs
* Enable tenant isolation for the boto tests
* Convert thirdparty and stress tests to use global CONF object
* Convert volume api tests to use global CONF object
* Convert ironic, swift, and heat api tests to use global CONF object
* Matches one flavor and one image by default
* Remove network resources created in scenario tests
* Forbid availability_zone None in aggregate Nova API
* Removes vim headers 4th round
* Add alias as prefix for flavor_rxtx v3
* remove unused variable
* Add bool and integer support to XML parser
* Convert network api tests to use global CONF object
* Convert image and identity api tests to use global CONF object
* Convert compute api tests to global CONF object
* test_rescued_vm_add_remove_security_group missing addCleanup
* Return body output after given status reached
* Skip negative tests of v3 server metadata
* Move negative tests for v3 test_server_metadata
* Revert "skip test_volume_boot_pattern"
* Removed unnecessary lock from a aggregate test
* Move common _delete_volume cleanup method in base compute test class
* Add tempest test for heat resource OS::Nova::KeyPair
* Remove super call in overloaded close()
* Separate negative tests for test_templates
* tighten up isolated creds create
* Fixed up an error message
* Remove Nova v3 XML tests completely
* Use BaseComputeTest.create_test_server
* Run SNAT specific test cases only with ext-gw-mode extension
* Specify 'active' status for deleting situations
* Fix glance_http HTTPS response issues
* Remove unused method basic_auth from rest client
* Removes vim headers 3rd round
* Use unittest2.TestSuite with py26
* Cleanup exceptions
* Increase failure details for network_basic_ops
* Update 'Member' with option 'operator_role' in tempest.conf
* add tests for force delete snapshot:
* Add volume cleanup to test_volume_transfer test
* Exclude heartbeat timestamp from agent list checks
* Add more descriptive assertion message for test_create_backup
* Separate negative tests for Swift
* Do not assume volume metadata is identical to POST request
* Remove baremetal xml support
* Increase ping timeout from 60 to 120 seconds
* Skip test_list_servers_by_admin_with_all_tenants test
* Create telemetry client
* Change status available to active
* remove the nova v3 xml tests from the code
* remove Nova v3 XML testing
* stop validating user IDs on role assignment operations
* Avoid using assertGreater
* Separate negative tests for test_quotas
* Call super class after extension check in vpnaas api test
* Remove vim headers 2nd round
* Add test for volume list with all-tenants
* Fix class inheritance for volume_types tests
* Fix attach_interfaces tests
* Check if service is available for cli tests
* Add simple node group tmpl API test for Savanna
* Use automated create and update methods for core network resources
* Fix logic for config file env variables
* Make --debug flag on run_tests and run_tempest use testtools.run
* Fix parameter in auth error message
* Sync Patch and PatchObject fixtures from oslo-incubator
* Python 2.6 do not has unittest.loader, we import unittest2 instead
* skip test_volume_boot_pattern
* Remove X-Storage-Stoken from object_storage
* Add tests for testing swift bulk middleware
* Rewrite RemoteClient.get_boot_time()
* text-html type is absent in TXT_ENC
* Remove vim headers
* Avoid expiration before updating metadata
* Fix log_console_output call in test_network_basicops
* Add a couple log errors to whitelist.yaml
* Move console output log place in test_cross_tenant_connectivity
* Only create necessary resources for compute v3 tests
* Add unit tests for SSH client functionality
* Create only necessary resources for compute v2 and network tests
* Make network resource creation in isolation configurable
* Fix typo in imagev2 class name : Memeber should be Member
* Make BaseV2MemeberImageTest inherits from BaseV2ImageTest
* AttachInterfacesTest: use build_timeout on iterface deletion
* Fixing typo in test_volumes_get.py
* Fix parameter type spelling tempest HOT template
* Remove user creation in object service and healthcheck test
* Fixing typo "existant". Must be "existent"
* Create only necessary networks resources for scenario tests
* Create only necessary resources for image, object_storage, volume
* Forbid admin_password None in rescue Nova API
* Add to whitelist two errors that slipped through
* Add more console output log for scenario tests
* Remove test_network_quotas_scenario
* Fix host_update test case for losing essential parameter
* Create security group rule with additional args
* Fix parameter of nova v3 flavors API
* Add missing whitespace in config description
* Add a check for compute api versions to verify_tempest_config
* Add neutron extension support to verify_tempest_config
* Rework extension verification in verify_tempest_config
* Moves negative tests from test_server_metadata
* Fix an error when executing run_tests.sh
* Use install_venv from oslo to fix no post_process issue
* Test server create with ephemeral disk
* Remove copyright from empty files
* Improve testing of list_extensions for compute
* Update README.rst with details about unit tests
* Add aggregates scenario test
* Tests object_storage extension listing
* Fix volume metadata validation of identical to request
* Add delete specific status server test
* cinder v2 api tests - fix volume client
* Input scenario capability for tempest
* Add coverage option to run_tests.sh
* Fix v3 test_list_servers_negative
* Fixes handling of arrays in XML to JSON conversion
* trusts API test, avoid creating duplicate user
* Neutron Agent Management List Agents Non Admin
* Remove Swift container-sync test skipping
* Adds test_list_XX_fields cases to list some fields
* log console_output when test_network_basic_ops failed
* Add a config option for trusts
* Fix typo in ssh_floating.json for stress tests
* Add a discoverable_apis option for swift
* Adds test_show_XX_fields cases to show some fields
* Refactor usage of custom_match tests
* Fix bug in validating Swift transaction ID
* List Nova and Cinder extensions in debug log
* Delete a BuildError server
* Add list server filter with extra limits
* Add a version API test for Nova v3 API
* API tests for Ironic
* Fix typo in ceilometer and neutron tests
* Remove skip_because in swift object expiry test
* Moves negative tests from test_instance_actions
* port test_server_metadata and test_server_personality into v3 part2
* add keystone group tests
* Add heat stack action test case
* Add a unit test coverage tox job
* Add base class for Telemetry tests
* Add python-swift client to the requirements
* Add extra list server by status test
* fix a minor bug when detecting server image flavor
* Wait for the server before validate the rotation result
* Add a run_tempest.sh script
* Make run_tests.sh for running unit tests
* Add basic read-only tests for heat cli
* Fix reference config before initialization in cli tests
* Skip simple_tenant_usage related tests
* Skip flavor_access_add/remove related tests
* Add tests for snapshot_metadata
* remove eventlet from requirements
* always use sitepackages
* keystone trusts API test, move delete into tearDown handler
* port nova v2 images related tests into nova v3 part1
* sync oslo to current
* Catch ssh exception and detach in min scenario
* Remove test_auth_token.py
* Increase exception log details
* add tests for security_group updating
* Kill finally, use addCleanUp
* Add test for HEAD queries on Swift tempurl MW
* Dump all log errors to console
* Moves negative tests from test_absolute_limits
* port admin/test_servers* into Nova V3 tests part2
* port admin/test_servers* into Nova V3 tests part1
* port instance_usage_audit_log tests into nova v3 part2
* port test_live_block_migration into nova v3 part2
* port test_live_block_migration into nova v3 part1
* port test_quotas into v3 part2
* Add tests for volume_metadata
* Add config for Telemetry
* port some servers tests into nova v3 part2
* Moves negative tests from test_server_addresses
* port test_aggregates and test_hosts into nova v3 part2
* port test_aggregates and test_hosts into nova v3 part1
* Remove unused wait_for function
* Use wrapper create_volume() in volume tests
* Refactor network client: add create_ and update_ methods
* Moves negative tests from test_multiple_create
* Separate negative tests for test_image_metadata
* port servers negative tests into v3 Part2
* port some flavor tests into nova v3 part2
* Separate negative tests for test_simple_tenant_usage
* Make testing neutron agents optional
* Fix the example of testr testing
* Fix OS_TEST_PATH in .testr.conf
* allow hypervisors to be down but still pass
* keystone OS-TRUST extension, test with expiry
* keystone OS-TRUST extension, test list operations
* Add negative tests for routers
* Add 2 tests to the Floating IP test case
* Add create_floating_ip function
* Use create_router_interface and create_port
* Serialize plurals correctly in neutron xml client
* Add version test for Ceilometer cli
* remove last errant file parse warning
* remove unneeded __init__ file
* rename old config object to TempestConfigPrivate
* Remove FloatingIPChecker from network_basic_ops
* Fix AutoScalingTest test suite error
* moving to global lazy loaded config
* cinder v2 api tests - part1
* port test_keypairs into nova v3 part2
* Refactor cross_tenant_connectivity for tenant isolation
* Remove unnecessary spaces from messages
* Add unit tests for rest_client
* Fix AttributeError on BadRequest in scenario tests
* scenario/network_basic_ops: reassociate floating-ip
* Enable HostsAdminTestXML
* Add swift scenario tests
* Increase support for isolated tenants in scenario
* Add testcases for images
* move negative tests out of test_services in nova v3
* Skip extraroute tests if extension is not enabled
* Add test_discover module to provide a load_tests hook
* scenario cross_tenant_connectivity
* attach_interfaces as smoke
* SSH connection related cleanups
* Separate negative tests for test_fixed_ips
* Add negative tests for network
* Fix cinder test cases when cinder extensions are in use
* Use rand_uuid and remove unused client for clean-up
* Fix the help message for run_ssh
* Fix three accidentally formatted paragraphs
* clean up invalid_multibyte test
* provide a valid utf8 multibyte test for nova images
* Refactor network client
* port certificates tests into nova v3 part2
* port certificates tests into nova v3 part1
* port instance_usage_audit tests into nova v3 part1
* port related volumes tests into nova v3 part2
* port related volumes tests into nova v3 part1
* add some tests for aggregates
* add some negative tests for flavor
* Add volume extensions tests
* Add Savanna client for node group templates
* Add Savanna-related configs for testing
* Adds ping method to remote client
* Separate negative tests for test_availability_zone
* Test for the agent management extension API
* scenario/network_basic_ops: detach floating-ip
* Make negative snapshot tests faster
* Move common wait_for_image_status from compute images_client to waiters
* Set pipefail for wrapper scripts
* actually turn on neutron cli tests
* Add whitelist entry for s-proxy 'Timeout talking to memcached'
* don't fail on dirty logs with grenade
* Run test_service_type_management test only if extension is available
* Fix failures when l3_agent_scheduler ext is not available
* Add a control point for floating IP assignment
* Add new env variable to specify test path
* Remove duplicate negative test of flavor_id
* port test_keypairs into nova v3 part1
* avoid resource leaks in keypairs tests
* remove a spurious wait that could get us into trouble
* Only initialize the glance_http if service is enabled
* add both v2 and v3 tests for get specified extension
* Wait for backup images to be ACTIVE in test_create_backup
* Make the wait_for_server_status timeout message a bit more clear
* Tighten ERROR regexp in log checker
* Don't have tox install pre-release software
* Fix the scope to share a server between tests
* Add testcases for security groups
* Change unstable test which gets console output
* Heat: check response fields
* Make Heat's non_empty_stack usable without a server
* Fix Neutron VPNaaS Test
* Remove generic_setup_package() function
* Updated from global requirements
* Add tests for keystone OS-TRUST v3 API
* Separate negative tests for list_floating_ips
* Fix the upper values of test_network_quotas
* Add the external gateway interface to vpn router
* Race condition in ListImageFilters tests
* Separate negative tests in flavors/test_flavors
* Add config options for enabled extensions
* Handle rest client 500 response if non-json body
* Fix display_name of volume for test_volumes_list
* Test for the update extra route
* Modify the name of a negative test class
* add admin server tests
* Add testcases for volume
* Moves negative tests from api/compute/servers/test_virtual_interfaces
* Separate negative tests for test_services in Tempest
* remove  test_service_enable_disable in nova V3 tests
* port test_server_rescue into v3 part2
* Add mock to test-requirements.txt
* Update tempest hacking regarding unit tests
* Remove redundant whitelist for DHCP agent
* VPNaas IKE policies tests
* Check HTTP response headers of Swift middleware API in detail
* Skip autoscaling test until more reliable
* Move import to import block again
* Fix a minor error in method _get_alternative_flavor
* Add tests for testing swift slo middleware
* port test_simple_tenant_usage into nova v3 part2
* port some flavor tests into nova v3 part1
* remove the test: test_service_enable_disable
* Remove unused allow_tenant_reuse flag
* update to hacking 0.8
* Adds paramiko logs to console output
* Rip out the coverage extension client from tempest
* port test_server_metadata and test_server_personality into v3 part1
* port test_quotas into v3 part1
* Negative tests separate file for floating_ips_actions
* port some server tests into nova v3 part1
* Add internal testing for the stress test framework
* port test_server_rescue into v3 part1
* add some test for force delete:
* Fix rebuild_server() function
* Adds "list hosts" test case - Cinder
* Adds improvements to the Swift TempURL test
* Use correct types for thresholds
* Revert "Add test_cases for cinder cli in v2 version"
* Start failing logs with errors except neutron
* Fix file print logic bug and update whitelist
* port test_hypervisor into nova v3 part2
* Moves negative tests from api/compute/keypairs/test_keypairs
* Some tests for dhcp agent scheduler
* Support Neutron security groups in scenario testing
* More stuff in the whitelist
* Dump all error messages for neutron
* Add missing "interface" argument to AltManager
* Use channel_timeout for SSH connection timeout
* Add two more tests for Swift staticweb middleware
* Add some tests for os_update_readonly_flag
* Add test_cases for cinder cli in v2 version
* Ensure no dangling resources are left if tests are skipped
* port test_simple_tenant_usage into nova v3 part1
* port attach_interfaces and server_address tests into v3 part2
* Add hopefully last batch to the whitelist
* Enable a uuid flavor
* Improve the UX around sample config generation
* Add hard reboot for outputting console log
* Adds delete api test to glance
* Check HTTP response headers of Swift API in detail
* port servers_negative tests into v3 part1
* Add migrate negative tests
* Enable the Nova V3 API Tests
* Add sample config check to tox pep8 job
* Move admin client initialization into stress-openstack
* Cleanup using about the data_utils module and functions again
* port test_availability_zone into nova v3 part2
* Cleanup using about the data_utils module and functions
* Make sure ssh retries on paramiko.SSHException
* Add test for Swift formpost middleware
* Add test for update/reset_snapshot_status API
* Avoid deleting ports assigned to router interfaces
* Rename object storage features section
* Enhance tests for flavor_extra_spec API
* Skip test_create_backup
* Disable V3 tests
* Forced isolation for the tests in test_list_servers_negative.py
* port instance_actions and server_list tests into nova v3 part2
* port instance_actions and server_list tests into nova v3 part1
* Don't use duplicate IP addresses
* add some negative tests for security group:
* Moves negative tests to test_images_oneserver_negative
* add tests for server_password
* Update openstack/common/lockutils
* port test_hypervisor into nova v3 part1
* Add test cases for volume-transfer
* Add some tests for security_group_rules api
* Remove unused code in user test
* Test for service type management
* add role negative tests
* Make smoke tests parallel
* Add special serial smoke option
* Adds negative tests to glance api's
* port test_extensions into nova v3 part2
* Reuse a server instance in test_disk_config
* Remove unused code in tempest files
* Enable all nova v3 tests
* Adds tests to cover Swift's crossdomain middleware
* Fixing ImageKilledException raising
* Add negative resize server action test
* Added images support and existing config support
* add tests for InstanceUsageAuditLog
* port attach_interfaces and server_address tests into v3 part1
* Add shelve/unshelve test of nova APIs
* add negative volumes tests
* Remove unused code in api/compute/admin/test_quotas.py
* Remove skips for bug 1182384
* removes a duplicate volume type test
* add tests for certificates
* Test image member is enforced
* Added some tests for reserve and unreserve volume
* Skip all nova v3 tests temporarily
* Remove unused run_ssh variable
* Add additional documentation for stress tests
* port test_availability_zone into nova v3 part1
* port test_services into nova v3 part2
* port test_services into nova v3 part1
* port test_extensions into v3 part1
* Rename to create_test_server in API tests
* removing dead docs
* remove old README files that are now redundant
* move nova v3 delete image tests into glance testing
* Adapt scenario readme with real-life aspect
* port test_images and test_server_actions into v3 part2
* Configure scenario clients with region
* port test_images and test_server_actions into v3 part1
* remove redundant code in fixed_ips_client for xml
* glance v2 image sharing tests
* Test for l3 agent scheduler API
* Add design principles to docs
* Change all non-slow scenario tests to smoke
* add positive tests for volume
* Switch base unit test class to oslo mox fixture
* Fix NameError exception
* Make test_show_host_detail work with multi host installation
* Add tempest unit test to verify the test list
* remove skip bug 1233026
* Add missing CLI Neutron tests
* add test for create_backup
* add debugging for when changes-sinces fails
* add tests for show and update of Flavor Extra Spec API extension
* Add test case to api/compute/test_quotas
* Adds api test to test_images
* Sync config file generator from oslo
* Fix default values so they work in a devstack run
* Fix incorrect config option types
* Add api version detection to verify_tempest_config
* Add config feature verification script
* Stop auto-detecting glance API versions
* Reorganize project feature config options
* Adds test to cover Swift healthcheck middleware
* Stop testing deprecated command nova-manage instance_type
* Test for flavor-access-list with private/public flavor
* edit inheritence tree api/network/security_groups
* Move decision_maker() call into setUpClass
* Add base test class for unit tests
* Update mailmap for Joe Gordon
* Fix bad classname
* add some negative tests for force_delete/restore
* Replace assertLessEqual - is not in py26 testtools
* assertTrue to assertIn
* Raise specific exceptions on tearDownClass failure
* Preserve the configured log level
* Add some test_cases for glance_cli
* Fix bad classname
* Sync latest module versions from oslo-incubator
* Sync fixtures from oslo and use LockFixture
* Updated from global requirements
* Update to latest pbr
* Set max_template_size to heat's default value
* Added some test for image tags
* Early die if on image gets killed
* Revert "Use isolation credentials for neutron api tests"
* Add more stuff to the whitelist
* RunTimeError on tearDownClass explained
* add extend volume tests:
* add tests for set_metadata in aggregate
* fix DeletableSubnet in api/network/common
* Refactor duplicate isolated creds code
* api/network/security_groups_negative add testcases
* Adds initial ceilometerclient testing code
* add negative test cases for create snapshots:
* Fix issue with ImagesOneServerJSON test
* Use isolation credentials for neutron api tests
* Simplify xml/json client selection
* Add filenames to skip_tracker.py output
* API tests for neutron router gateway
* Use lower case true/false in the sample config file
* use "" instead of "None" in xml file
* Inject "-tempest-" string to rand_name
* Forced isolation for the nova quota test
* add BaseV2ComputeTest as the base class of nova v2 api tests
* Changed the exception name
* server status remained in unexpected state
* Set tempest version for icehouse
* Add a skip for meter-label cli tests
* VPNaas vpnservice test cases
* Separate negative tests  api/network/security_groups
* Skip negative compute quota tests that don't work with Neutron
* uses skip_because where appropriate instead of regular skip
* Fixing ImagesOneServerTestXml issue
* add test for updating server's disk_config test
* Skip get_server_diagnostics test until bug 1240043 is fixed
* add some tests for host and seperate negative ones
* Fix to use proper random values
* add some tests for hypervisor operation
* add volume tests
* Reduce vm creations in negative tests
* Change six to match global requirements
* remove tearDownClass in test_quotas.py
* add more test cases to api/network/security_groups
* Add a flavor test for getting a specified key value API
* Restores passing additional parameters to nosetest
* Move negative action tests to right place
* Script to filter logs for ERRORs based on whitelist
* Rename cli tests from compute to nova
* Add section for negative tests to HACKING.rst
* Add some test-cases for cinder cli
* add token test for token-api
* add some negative tests for tenant
* Test for server create with IPv6 address only
* Accept gzip files in find_stack_traces.py
* Add a create_router utility function
* Update lockutils from oslo-incubator
* Add security group to large_ops test
* Use built in cleanup for servers in test_large_ops
* Split out unit tests as separate tox jobs
* Update to latest tox
* glance image v1 member test cleaup
* delete the duplicated variable definition
* Increase heat's default max_template_size
* add some tests for user api
* Add CLI tests for Neutron's metering agent
* Add some test_cases for compute-cli
* skip test_lock_unlock_server
* add some negative tests for volume updating:
* remove code duplication in tempest/config.py
* add volume list tests
* Add addtional logging and catch exceptions
* Placeholder log check script to be called by devstack-gate
* Cleanup existing instances in setup for test_list_servers_negative.py
* Fix skip_because decorator
* Test for the nova diagnostics API
* Use predictable instance/volume names in test_volumes_actions
* Cleanup test_list_server_filters setup/teardown
* add two negative tests for flavor-access
* Remove unused CONF variable and import statement
* add a negative test for flavor_extra_specs
* introduces skip_because decorator
* pass stop_on_error to _has_error_in_logs
* Clean up existing instances when not using tenant isolation
* Orchestration autoscaling improve status polling
* Allow _status_timeout to be used for non-nova polling
* TEMPEST_PY26_NOSE_COMPAT in py26 jobs
* Handle test_list_servers_by_changes_since without tenant isolation
* Add xml support to the floating ip and router
* add server delete/unpause tests
* add server suspend/resume negative tests
* Revert "unskipping bug related to test_stamp_pattern.py"
* Update style guide link in HACKING.rst
* meta should be metadata in rebuild server
* Unskip test_tokens and update expected status to 404 from 401
* Do not check for id in the keystone output
* Initial basic setup of openstack and tempest config file
* Make smoketests working again with Python 2.6/nose
* Add test for admin deleting servers of others
* add server reset_state tests
* Heat: use first_address instead of first_private_address
* Explicity specify network for heat slow tests
* _error_in_logs function of driver.py shall check all nodes
* Bump oslo.config version
* _get_tenant_by_name doesn't return correctly
* tempest/config.py parse some sections incorrectly
* _create_creds function shouldn't call rand_name twice
* Add tempest tests for os-aggregate update
* Adds more test to cover Swift tempURL middleware
* Added Negative tests for image member
* driver.py should log errors when ssh operations fail
* fix typo in config.py
* add __str__ function to RestClient class
* Fix problem with never stopping stress tests
* Print the lekaed 'boto' tags on Failure
* The debug configuration group is not registered
* Update docs config
* Add positive tests for os-floating-ip-pools
* Handling network resources in tenant isolation
* Don't log 'Not Found' ERROR during image cleanup
* makes passing the client optional to utilities in scenario/manager.py
* Add test for nova API of VM lock/unlock
* Fix json version of bootable check
* Add locking to test_list_hosts_with_zone
* Move LockFixture to tempest.common
* Fix typos in tempest/HACKING.rst Edit
* README.rst of tempest stress is misleading
* add server resizing tests
* add negative volume tests
* Added test to check list/show extensions-neutron
* Adds test_update_all_metadata_field_not_included negative test
* Replace OpenStack LLC with OpenStack Foundation
* Test that Heat max_template_size is applied
* Sync install_venv_common.py from oslo-incubator
* Consider lc string for bootable True/False
* unskipping bug related to test_stamp_pattern.py
* Raise OS_TEST_TIMEOUT for heat slow test
* Add tempest tests for os-host/{host-name} api
* Test cases for V3 Project Actions
* Skip test tokens
* Remove claim that scenario tests need 2 services
* Adding health monitoring test case
* Adding LB member operation test cases
* LBaaS client functions and pool testcases
* Add update-volume test
* Use built-in print() instead of print statement
* Add 'Field' to the title of the Field Guides
* Update README.rst to use testr instead of nose
* fix pep8 errors: E231, E128
* Adds tests covering Swift's container quotas middleware
* Add a function for creating a server on a given network
* Move _check_tenant_network_connectivity to the end
* Add update-snapshot test
* Add keystone user-update test
* Fix misused assertTrue in unit tests
* Fix a test case of 35chars+
* assertEquals is deprecated, use assertEqual
* Add "region" config for each service
* Add parallel test execution section to HACKING.rst
* Sync latest versions of oslo incubator
* Fix overlapping subnet creation
* test_fixed_ips unsafe xml/json resource sharing
* Enable the quota test cases
* Adding xml support for load balancer
* Network load balancer testing
* Fixes some typos in tempest
* add required python modules(six,iso8601,fixtures) to requirements.txt
* Fixes typos in tempest/api
* Add missing import of 'subunit' in test-requirements.txt
* Remove wait_for_image_resp_code
* Use common create_server method for advanced_ops
* VolumesListTest may hide configuration issues
* Add tearDownClass to base swift test class
* Adding negative test for port
* Bulk Subnets and Ports creation
* Make the admin role configurable within tempest
* Remove Whitebox tests
* Remove bin/tempest script
* Add service tag section to HACKING.rst
* Add hacking check for service tags in scenario
* Add services tags to scenario tests
* added an api test for security_groups
* Adds disk_format parameter to upload_volume method in volumes client
* task_state must be consider before many action
* Dump basic network info  in the test_network_basic_ops
* Adds verfication for Bootable Volume
* Translate server extension attributes to json
* Add service tags to api.volume
* Add @services decorator
* Remove order dependence from network_basic_ops
* Fix import grouping in scenario tests
* Fix tempest config usage in test_attach_volume
* Fix race condition for test_flavors_extra_specs
* Eliminate the impact of "wait_until='BUILD'"
* fix race condition between addCleanup and lockutils
* Credentials Keystone V3 API Tests
* Add a create_server test for flavor authorization
* Add device name, ssh password to Tempest config
* Fix colon in create volume logging output
* Append some operations to boot from volume pattern
* Added test case to check floating IP API operations
* Switch heat template to use native nova resource
* Add tests for Swift's StaticWeb middelware
* fix test_flavors_extra_specs failure
* Restrict Volume type deletion with volumes assoc
* add flavor creation tests
* Added missing xml tests of volume
* raise assertion error if output is falsy
* Add handling for inherited stress attributes
* Remove unused LOG variable in scenario tests
* Add more detailed message about the volumes missing
* Increase default test timeout for timeout fixture
* Log request ids from glance and nova
* moves addCleanup few lines upper to avoid potential leftovers
* Fix logging problem for stress test wrappers
* KeyError when tearDownClass called from setUpClass
* Add common "create_server_snapshot" method
* Fix test_admin_catalog_list
* Always log stdout and stderr of CLI commands
* Create discovery option for stress tests
* emit warning while running flake8 without virtual env
* Switch run_tests.sh to run in parallel by default
* Add unittest framework + tests for wrapper scripts
* Move the network api tests to smoke
* Add logging to the python-clients
* removes self.fail as suggested by HACKING.rst
* Rename heat logical_resource_id to resource_name
* Add large-ops option to tox
* Updating HACKING.rst
* Stress ssh_floating test
* Adds tests for Heat
* Update requirements from global requirements
* uniforms skip messages
* Use common create_keypair method for autoscaling
* Skip orchestration scenario tests if heat service not available
* Switch gating tox jobs to testr parallel
* Provide tox entry for running slow heat tests
* close http connections
* Fixed up a missing space in an error message
* refactor - _is_timed_out using instance timeout
* Fix ssh timeout issue
* Heat autoscaling scenario test
* cli: add messages to assertTrue
* Cleanup: Add common "ssh-login server" method
* Cleanup: Add common "create volume" method
* use assertIsNotNone instead of assertNotEqual(*, None)
* Skip os-fixed-ips test since neutron has not implemented it
* Cleanup: Add common "create security rule" method
* Add tenant isolation to the swift tests
* Adding network api xml support
* Set missing attribute self.server in _create_and_attach utility
* Mismatch dictionary key in the process of parsing XML
* Remove skip of neutron connectivity check
* Fix skip tracker regex for multi-line skips
* Add more tests for Swift Account Quota
* Fixing format_flavor to handle flavor extra_specs
* Cleanup: Add common "create keypair" method
* Fixing the rest of the comment spacing issues
* per test_method logging
* Remove identity race condition
* Protected matcher import
* Cleanup: Add common "create_server" method
* Fixed test for non-public flavor
* Add nose to run_tests and tox for python 2.6
* skip test_list_servers_filtered_by_ip_regex on neutron gate
* Fix typos in tempest/api/README.rst
* Unit tests as stress tests
* Cleanup try/except/finally blocks in several tests
* setUpClass/tearDownClass full chain
* Testcase to create bulk networks in one API call
* Added 3 Routers related testcases for Neutron API
* Adding extra_specs to flavor format
* Add tenant isolation for scenario tests
* Switch use of select() to poll()
* Remove positive tag
* Fix return code for pretty_tox_serial.sh
* Fix posargs usage for tox jobs
* Add tests for swift container listing filters
* Switch to testr serial instead of nose
* Rework class inheritance for scenario tests
* Change logging in stress test
* Added negative tests for server
* scenario test involving glance, cinder and nova functionalities
* Flag InstanceCfnInitTestJSON as the first slow heat test
* Add test for swift ACLs
* Adds tests covering Swift's Account Quota middleware
* Remove duplicate image tests for tenant authZ
* Skip more security group tests until bug 1182384 is fixed
* Skip secgroup invalid name/desc tests until bug 1161411 is fixed
* Make CLI timeout tests configurable
* Added a test for stop and start a server
* Add locks for all aggregates tests with hosts
* Test cases for Roles V3 Actions
* Add network api test cases
* Whitebox server expects deleted > 0
* Negative tests added for network
* Negative attribute added in server negative test
* Skip secgroup rules invalid id tests until bug 1182384 is fixed
* Make testr full runs skip tests with 'slow' tag
* renames the stress test class to include the Volume keyword
* Generate temepst API doc from source
* White space after # in tempest/api files
* White space after # in the tempest/services
* White space after # in thirdparty
* Disable logging to the stderr
* add image tests v2
* Add argument to stop stress test on first error
* Add testing of Neutron per tenant quotas API
* Switching to oslo importutils in the stress tests
* Make test_neutron_dhcp_agent_list_hosting_net use net name from conf
* Sync up the default value for the network_for_ssh option
* Sorting services list before asserting in test_get_service_list test
* Negative test added for rescuing a paused vm
* Add tox job for serial testr
* Add eventlet to requirements.txt
* Fix fail logic for server of another tenant test
* Add locking to test_aggregates
* Switch to using Oslo logging
* Fix neutron cli tests skip for testr
* Use state transition checker wait function in the ec2 image tests
* Add wait_for_volume_status in upload_to_image test
* Handle a possible volume attachment visibility wait/race issue
* Use assertIn and assertNotIn instead of assertTrue/assertFalse
* Add stress test to attach volumes to vm's
* Negative attribute added in volume negative test
* Revert "Add jsonschema to requirements.txt"
* Allow to run swift and keystone api tests standalone
* skip stamp test until race in nova can be debugged
* Sync lockutils and log from oslo
* Add environmental variables to test.conf
* fix race condition in service list compares
* Add posargs to testr-full tox job
* Add Neutron CLI tests to tempest
* Unskip test_register_get_deregister_ari_image
* Add jsonschema to requirements.txt
* Simplify whitebox/manager
* Added a server-pause test
* Negative test for rescuing a non-existent server
* Increase ping timeout on scenario testing
* Basic starter scenario for testing the dashboard
* Fixing man page generation
* Use nose skip exception conditionally
* add service tests
* Add tenant isolation for glance api tests
* Move isolated credential code to BaseTestCase
* Add isolated tenants for admin compute tests
* Add exit codes if run_stress.py detects an error
* Move heat_available option to service_available
* Add nova config option to service_available group
* Add swift config option to service_available group
* Add glance to service_available config group
* Move neutron_available option to service_available
* Ignore the default quota values
* Updating HACKING with some test writing recommendations
* update hacking to 0.6
* Add global statistic for stress tests
* Add scenario test of instance/volume snapshot
* add image tests
* Add cinder_available config option
* Adds tests for tags in boto (EC2 API)
* add missing apache2 license headers
* fix use of locals() in strings
* Skip test that is not relevant to Neutron
* Add boto tests for idempotent RunInstances calls
* Remove unneeded class filter from .testr.conf
* Document E125 as a won't fix
* Add unittest like output for testr-full in tox
* Use subunit colorizer from nova for run_tests.sh
* run_stress.py -h doesn't work without a connection
* Remove duplicate flaky test
* Remove skip code for test_servers_whitebox as bug had been fixed
* Fix stress-tox-job.json action file
* Switch to using testr as the test runner for everything non-gating
* Rework stress to be more UnitTest like
* Add an option to run_stress.py to run tests serially
* Fix tox job for stress tests
* Change path for "Run one test" example in README.rst
* Make tenant_network_mask_bits default setting consistent
* Remove version caps from python-fooclient
* Cleanup and make HACKING.rst DRYer
* Test Tokens - V3
* Fix SSH host to floating IP from fixed IP
* Configure a heat security group for testing ssh
* Add large_ops scenario test
* improve minDisk checking
* Add new test for the volume upload in Glance functionality
* Add cinder CLI tests to tempest
* Fixed test - segmented upload of file
* Domain Actions Test Case-V3
* update Quantum to Neutron
* Using relative path for personality file in rebuild server test
* Sync install_venv_common from oslo
* Add tests for server actions
* Add exception handling doc
* Postgresql is an Optional dependency
* Use the same logger class in all test cases
* add tests - list hosts tests using admin user
* Proposing a change to remove user validation tests
* Fixes a test case name
* Add a tox job to run stress tests
* Orchestration tests to use admin user, demo tenant
* Use build_timeout & build_interval from heat config
* Create stack in class setup, rather than instance
* Implement update_stack client method
* Always include credentials for heat stack create
* Use print_function
* Fix index link in footer bar
* add tests - list servers using admin user
* Clear keypairs on teardown
* Heat test ssh to the server
* Skip fixed_ip_details test with Quantum
* Skip list_vifs test with Quantum
* Revert "Update a test to work with Quantum SecGroup"
* Use os.path.join to form the cli command
* Skip test that is not relevant to Quantum
* CLI doc missing colon for code block
* Configurable volume storage_protocol + vendor_name
* Add scenario test of instance snapshot and boot
* Remove dependency on MySQL-python
* Use Python 3.x compatible syntax constructs
* Oslo Merge
* Remove automated skip decsion from compute
* Avoid potential race condition in list_stacks assert
* Fix create_security_group_rule to work with python 2.6
* Fix test_volumes_get volumes cleanup
* Add a volume create/delete stress test
* Ensures testtools 0.9.32
* Actually raise BadRequest if create_subnet fails
* Fix XML security group rule client
* Loosen constraints on Swift status codes
* Add posargs to tox coverage job
* skip test_ec2_instance_run.InstanceRunTest.test_integration_1
* Object client adds content-length if PUT is empty
* Fix a doc indentation bug
* add create_image_from_server to base class for auto cleanup
* Implement a new test case for volume cloning functionality
* Remove TODO note
* actually enable our no tempest/tests check
* Raise BadRequest if unable to create subnet
* Remove basic_auth strategy
* Add negative tests label
* Increase to 255 the length of the user name
* Remove quota whitebox tests
* Tempest Coding Guide
* Quantum client should not be conditional
* Fix: WhiteBox server leak
* Tests for os-hypervisors API extension of Nova
* Fixed Typos
* Add logic to tox.ini to run all tempest tests
* Enhance the validation of the quotas update
* Fixes list_snapshots and _with_details methods in snap XML client
* ensure no code merges to tempest/tests
* Fixed last merge file from "tests" folder to new "api" folder
* TestServerAdvancedOps server leaking
* Multi-server handling in base.py
* Fix a race condition in test_create_delete_image()
* Remove duplicate appends to image list
* Add keystone client optional arg tests
* List servers by changes since with dynamic date
* Default to m1.micro for heat test flavor
* Add python-cinderclient to requirements.txt
* Removed invalid skipped tests
* Fixes the multi-backend skip bug and the cleanup steps
* Remove executable bit on some files
* Makes run_tests.sh exit code match the nosetests exit value
* Unskipped object storage test
* Added test - conditional object download
* identity v3 token
* List Domains Test Case-V3
* Rename requires files to standard names
* Remove skip mark to test_create_image_when_server_is_rebooting
* Removes 'positive' tag from tests
* Adding test_server_sequence_suspend_resume
* Implement minimum basic scenario
* Add ssh check to quantum smoke test
* Heat test to launch a heat-cfntools based instance
* Merged 2 tests dependent on each other
* Fixes bugs in test_s3_ec2_images
* Test cases for Policy V3 API-New
* Add Flake8 extension for python client import checks
* update docs for consistency
* Moved swift container cleanup to a class method
* Configure logging format flexibly
* Update skip_tracker test directory
* Update README file
* Modify hacking flake8 extension
* Limit tests should pass correct image and flavor
* Update a test to work with Quantum SecGroup
* Set smoke/gate attributes for tests in "compute"
* initial seed for tempest doc directory
* Add some basic snapshots listing test
* Initial heat orchestration tests
* Add tests list tenant usage
* Remove unnecessary tags/attributes from our tests
* rename tests -> api
* Smoke attribute implies gate attribute
* Moved part of test cases to another class
* break out whitebox tests
* move boto tests to thirdparty directory - part 1
* add scenario directory
* Create Flake8 extension for tempest checks
* Code cleanup of object storage tests
* Removing redundant, possibly flaky test
* Add a sleep with back-off to retries
* Add tests list the services to compute
* Set smoke/gate attributes for tests in "image"
* Set smoke/gate attributes for tests in "identity"
* Set smoke/gate attributes for tests in "volume"
* A Heat client which does basic stack operations
* make test non executable, otherwise nose skips it
* Permits a list of values for the "type=" tests attribute
* Adding new test for iSCSI live block migration
* Clean up tenants created in test_users.py
* Adding negative test to check limits of Security Groups and rules
* collapse tox.ini test commands for readability
* move cli directory into new tree structure
* make status_timeout a method
* Enhance the validation of the quotas update
* only install things in the venv for pep8
* proposal for tempest directory restructure
* Do super()'s tearDowns last (bug 1178337)
* Put the logic from devstack gate into tox
* Remove old stress tests
* Simplified stress tests
* Enabling assertions disabled for bug #1074901
* Declare the config attribute in a simpler way
* Configurable fixed network name
* Add Aggregate XML client and tests
* Make sure isolated tenants are not left behind
* Add setup failure logging in tearDown method
* change test_register_http_image to use explicit url
* Ignore .testrepository/
* Adds Cinder Multi-Backend Test
* Update service test case - V3
* Add a test for creation of volumes' snapshots
* Remove reference to dead script configure_tempest.sh
* Migrate to pbr from openstack.common.setup
* Finish up flake8 conversion
* Fixes volumes cleanup in base class
* Removed duplicate usage of TempestConfig()
* Fix status_timeout incorrectly referencing self
* Added 2 user related testcases for Keystone V3API
* Fix to enable negative test image_invalid_metadata
* Missing image-del func in test_create_delete_image
* Clean up servers created in test_multiple_create.py
* Add tests list actions on a specified instance
* Remove skips in test server rescue
* Added tests to list instances by regexp
* Adding test_max_image_meta_exceed_limit
* Add tests list the availability zone
* Make CLI tests python2.6 compatible
* Exclude etc/logging.conf from versioning
* fix E122 and E126 flake8 issues
* attempt to get to flake8/hacking plugins
* Add fixed ip client and tests
* Fix to create an image with given  min_ram value
* Add logging configuration
* Add aggregate json client and tests
* Configure quantum basic ops tests as smoke
* Fix to use an API to get the default quota set
* raise the first exception in flavors and security_group test
* Fix HACKING compliance of test_network_basic_ops
* Remove smoke.py and clean up base test classes
* make stack traces tool find individual traces
* Re-enable detach volume from unrescued VM
* Fix docs for admin user config in conf sample
* Create tests for multiple server creation
* Fix AttachInterfacesTest error
* Adds create volume from image test
* xenapi:live-block-migration - fix XML client test
* Add tests for adding/removing flavor access
* Test cases for Endpoints V3 API
* RestClient:keystone_auth hides requests and errors
* Removes redundant tearDownClass methods
* Fix IBM copyright strings
* Set version to 2013.2
* Remove skips in quota tests
* Fix typo for run_tests.sh -S option
* Replace try/except/else with self.assertRaises
* Add basic quota tests
* Update test_networks.py to v2 of Quantum API
* refine _get_isolated_creds
* delete servers in setUpClass if ecxeption raised
* Reduce chance of name collision for resources
* cleanup resource in setUpClass if ecxeption raised
* Add missing exceptions import
* Remove unused variables
* Add glance register image from http service test case
* Use the same style checking everywhere
* Xml Support for Image Test scripts
* Addition of XML support to test_list_servers_negative
* In CLI tests set merge_stderr to False by default
* Fix SimpleReadOnlyNovaManageTest.test_flavor_list CLI test
* Move tempest runtime dependencies to the pip-requires
* Remove unused imports
* Create and delete flavor as regular user
* Make volume attach and detach rescue tests negative
* Add basic read only glance cli tests
* Add properties to CreateRegisterImagesTest case
* enable xml tests test_disk_config
* Update hacking.py for @testtools.skip() formatting
* Normalize skip bug format
* Refactor of test_network_basic_ops -prep new tests
* correct the reduplicate tests for list_severs_with_detail({'limit':1})
* Remove skips in volume types tests
* Adds XML support to test_live_block_migration.py
* Remove skips from bugs marked as fixed
* add test for creating a floating IP specifying an non-existent pool
* Updating the try/except blocks to assertRaises
* Add bug number for skips in CLI tests
* Add basic Keystone CLI tests
* Add service cleanup handler for test_list_services
* clean up trys in test_servers
* Replace try/except/else with self.assertRaises
* Extend compute-manage cli tests
* Make skip_tracker bug keyword detection more robust
* Expand CLI test
* Tweak quotas in tempest to include new fixed ip quota
* Change server create to use tracked create_server
* Convert try/expect/else as per new Tempest style
* fix the confused issue in server_client about list_server
* Fix exception name in test_server_actions
* Fix skip formats to trigger skip_tracker
* Remove unnecessary asserts from test_images.py
* Add api version detection support to glance tests
* xml_to_json should not convert xmlns into attribute
* Add base classes for image tests
* Convert try/expect/else as per new Tempest style
* Add a test to list the security group rules
* Disable test_rescued_vm_attach_volume
* Replace try/except/else with self.assertRaises
* add find_stack_traces tool
* Remove skip decorator from keypairs tests
* Switch to final 1.1.0 oslo.config release
* Add duplicate bug detection to skip_tracker.py
* fix sever not deleted issue in test_attach_detach_volume
* Replace try/except/else with self.assertRaises
* Fix rate limit handling and logging
* Tests to verify Nova VM Rescue operations
* Fix test_flavor_extra_specs
* Remove skips for fixed bugs
* Add image members tests
* Use oslo.config-1.1.0b1
* Have paramico to register the event pipe in time
* Remove skip from test_invalid_host_for_migration()
* Add glance api v2 testing
* RestClient remove wait parameter from the get method
* Small fixes around variable usage
* Enable XML testing for test_server_addresses
* Correct getchildren() usage in list_addresses()
* Adding test_security_group_rules_create_with_invalid_port_range
* Adding test_delete_the_default_security_group negative test
* Move glance image client and tests into v1 dirs
* skip ec2 test until it can be debugged
* Add tests for nova's os-attach-interfaces extension
* Add quantum_available config option
* Update live migration test to use new syntax for create_server
* enable test_servers_negative
* Fix endpoint usage for glance_http in image client
* Sync latest setup.py from oslo
* Add negative test in test_quotas.py
* Update defaults for s3 materials paths/names
* Catching new exception while disassociating a disassociated floating ip
* More assertions for test_integration_1
* Add basic image filtering tests
* add the version requirement for testtools
* Standardises expected exception layout
* convert to resource tracked create_server
* create_server cleanup
* test_server_metadata.py - BP add-xml-support
* add database drivers for whitebox testing
* Sync latest install_venv_common.py
* Update stress tests to properly use tempest.config
* Prepare base test class for CLI tests
* Implements test_update_all_metadata_field_error
* Catching new exception while disassociating a disassociated floating ip
* Add tests for server metadata
* Move the console tests to the other server actions tests
* Simplify xml-json inheritance in identity
* test_live_block_migration cleanup
* Implement assertRaises assertions on all tests
* Small server action code compression
* Handle XML body of server's virtual interfaces correctly
* tempest.tests.boto merge to tempest.testboto
* Cleanup of identity/admin/test_users.py
* Handle error in test_create_get_delete_service
* Expand read only cli compute test
* Add negative test for get server in test_servers_negative.py
* Add negative test for  set server metadata
* Clean up logging from glance_http.py
* Have all test case to use a single base class
* Simplify xml-json inheritance in compute
* update identity to handle new table attributes
* Fix update option for run_tests.sh
* Compare ipv6 only with canonized form
* Adding list_virtual_interfaces method to the servers_client
* Stress improts
* T4xx fixes
* Add object based wait capability to boto tests
* Fix compute tests init
* Add an update option to run_tests.sh
* Modify roles tests to deal with a default role
* Imports in alphabetic order
* Remove skipped test for bug 1061738
* By default the features are not skipped
* Configurable Tempest config file location
* First commit for python client test suite
* Fix init of test_volume_type_extra_specs_list
* Sync in latest version of oslo
* Remove duplicate calls to clear_servers
* Simplify volume test classes inheritance
* Add missing import to the image_client
* Remove unnecessary client alias in console tests
* Correction in quota_client's condition logic
* Fix 'if' in the clear_isolated_creds
* json name usage
* Update HACKING file
* Fixes test_resize_server_(confirm|revert) methods
* Add an images client
* Break out RestClient error checking
* Fixes around variable usage
* Remove unused imports
* Add negative test for create server
* Change quota tests to use assertEqual
* Remove duplicated wait
* Convert to use tempest attr implementation 2/2
* Convert to use tempest attr implementation 1/2
* Fix MismatchError error when checking flavor value
* Implements test_(create|update)_metadata_key_error
* Implements test_flavors.test_invalid_min(Ram|Disk)_filter
* Enable test_absolute_limits.test_absLimits_get
* Add generic nose/testtools attr decorator
* Add support for testrepository
* Implements test_flavors.test_invalid_is_public_string
* Change test_get_default_quotas to use assertEqual
* Sync latest install_venv_common from oslo
* Implements test_flavors.test_is_public_string_variations
* Removes use of nose.tools.raises
* Small Bug fixes
* Verbose logging on error
* Remove variable assignment that appears twice
* Add a volume from snapshot test case
* Make isolated volume tests have unique tenant
* clean the unittest2
* Fixes "not in" usage
* Fixes duplicate "-s" option in run_tests.sh
* Use real capabilites for all volume type instead of fake ones
* Move out http response checking from the request
* Adds unitest2 and keyring to pip-requires
* Fix boto initialization
* Fix volume XML tests
* Proposed EC2 OpenStack extension
* Remove use of detailed-errors nose plugin
* Removes assertGreaterEqual for Python 2.6 backward compat
* Enable boto keyapir test
* Testcase for keystone - List services
* bug 1110343 Fix missing config.network.username
* Derivate most of the RestClient's exception from the failureException
* Update TEMPEST_README.txt
* Move the singleton to a common location
* Addition of XML support to test_quotas.py
* Use install_venv_common.py from oslo
* Fix Py2.6 dict comprehension SyntaxError
* Handling rate-limit for JSON request- rest_client
* Use testtools as the base testcase class
* Add whitebox section
* Add NotImplementedError to the abstract method
* Remove not used configuration variables
* Fixes whitebox testing for deleted type change
* Credentials Configuration changes
* update whitebox testing for deleted type change
* Remove few unnecessary backslashes in ObjectTest
* Ensure package-wide test init is done with testr
* Flavor min memory tests
* Test to check container synchronization
* Fixes test name typo
* TestCase to check set/get/unset flavor extraspecs
* Add back missing return in ObjectClient
* bug 1101184 add new test: verify new n/w visible
* Fix flavors tests so they can be run in parallel
* Test to upload object in segments and download it
* Fix PEP8 compliance problems
* Refactor identity
* change ipv6 format to pass on postgresql
* Revert "Split up XML and JSON testing."
* Split up XML and JSON testing
* Test to check temp url support
* Fix install_venv-get_distro failure on Fedora
* Only create 1 server for server actions tests
* Allows identity endpoint to be specified as URI
* Add skips for tests when dependency not present
* Adds setting to disable SSL cert validation
* Removes paramiko dependency from test-requires
* Object write/read ACL and few security testcases
* Fix test_authentication_with_invalid_tenant
* Fix test_authentication_when_tenant_is_disabled
* Add CentOS-specific OpenSSL package installation
* Remove skips that are no longer necessary
* boto: instance teardown wait until instance is gone
* Don't ignore exceptions
* ensure setup_test_user has been called before using test_user
* Convert these tests of ServerBasicOps into one test
* make skip_tracker directly executable
* Refactor compute image tests
* Use '-m' for tempest_coverage.py in tox.ini
* Remove skip from Server Filters Tests
* Fix list images xml deserialization
* Add missing methods to xml admin_client
* ensure we wait for server deletes
* Disable test_run_terminate_instance
* Use real capabilites for volume type instead of fake ones
* Add wait for resource deletion on volume teardown
* Update gitignore because of oslo setup.py
* Modified Server Actions Create Image test
* Fix tenant leaking in test_tenants.py
* Adds 3 additional tests to test_flavor.py script
* Add tools/tempest_coverage.py script
* Fix parsing of addresses. lp#1074039
* Fix T401 and T402 errors
* tempest error codes should start with T
* Fix boto lib config
* ensure isolated test cases run with an isolated tenant
* add hacking.py rule to prevent docstrings
* fix file injection test to not assume /etc is present
* convert docstrings to comments
* convert docstrings to comments
* convert docstrings to comments
* convert docstrings to comments
* Fixes PEP8 error E121
* Fix venv for ./run_tests.sh -p
* Use oslo cfg module for tempest config.py
* Initial Oslo sync for Tempest
* Add python-quantumclient to pip-requires
* add run_tests.sh option to not capture stdout
* Addition of XML support to test_console_output.py
* Logic in rest_client incorrect "resp.status=413"
* Tests to check few object actions anonymously
* Remove unused imports
* Add error handling to smoke test cleanup
* Do not limit the max versions in the requirements
* Negative Cinder tests for Volume Types,extra specs
* Fix sample conf for compatability with devstack
* Specify region by name
* Fix use of venv in Tempest
* Test Case to check "swift object expiry"
* RestClient: Don't hard code volume service name
* Add smoke tests for quantum
* Add admin credential config for network client
* Fix smoke tests to delete resources synchronously
* Test to GET public-readable container's object
* ensure servers are deleted between tests
* add create_server_with_extras
* Check images by ids, not by count. lp#1088515
* Add num_retries configuration option
* Tempest should ignore SSL certificate validation
* Adds paramiko to pip-requires
* Ensure we check for the right body
* Add ability to skip disk_config tests regardless of extension status
* Improve pep8 checks to be similar to those in nova
* Fix pep8 failures in tests for Volume Types and extra specs
* fix formatting errors to help debugging
* Fix typo that causes NameError: global name 'exception' exception
* Enable EC2 Create volume from snapshot
* Enabling the tests of floating ip script test_floating_ips_actions.py that were skipped due to bug #957706
* Fix pep8 violations in stress tests
* Assign TODO to committer
* Fix use of except in tempest
* Fix import order to comply with import ordering rules
* Reenable security group related test case
* Remove tempest.conf.tpl
* Adds Cinder tests for Volume Types and extra specs
* early failures would prevent cleanup
* Make parameter list generation consistent using urlencode()
* Check for the canonical form as well, either is valid
* Skip tests broken by nova b u g 1086980
* Start making setup.py similar to other OpenStack Projects
* Empty Body testing according to the RFC2616
* Remove unused configuration variables
* Test Case to check "copy object across container"
* Started consolidation of disk config tests
* Fix and simplify arbitrary_string. lp#1085048
* Add swift object versioning test case
* Simplify parse_image_id
* Fixed potential unbound varialble errors on test failures
* Don't try to cleanup volume that doesn't exist
* Fix issue with 404 logs on wait for delete
* Fix pep8 failures in test_ec2_security_groups.py
* Don't log stack trace on S3/EC2 client errors
* test_absolute_limits.py to check limits response
* Adds a Quotas client for Nova
* Spelling: executng=>executing
* fix some typo
* Add start of the EC2/S3 API testing to tempest
* Adds JSON client for servers admin API
* fix for Bug1078481
* use deleted=False instead of deleted=0 in queries
* be specific about metadata too long error
* make it possible to run only one test in tempest
* exclude venv directories from local pep8
* Make assertion failures more informative
* Added Swift tests:       * account: delete account metadata       * container: retrieve/delete container metadata       * object: retrieve/copy(2 ways) object Syntax bug fix in container_client.py:       return resp. body => return resp, body Fixed passing headers parameter in head method in rest_client.py:       return self.request('HEAD', url, headers) Removed unused imports
* Remove unnecessary test. Fixes bug 1072841
* Fix SyntaxError: invalid syntax - comma
* Remove kong. Fixes bug 1052511
* General cleanup/organization of compute tests
* flavors with disk sizes of 10 10 20 30 would fail unexpectedly before since flavor[1]['disk'] == flavor[0]['disk]
* Initial add of Swift tests
* Fix 'message' is not defined errors
* Handle ImportError's when quantumclient is missing
* Added missing import for SkipTest in test_authorization
* Tempest tests to cover live-block-migration
* Refactor list servers negative test and fix remaining gate bugs
* Put skip at top level
* Add XML support for test_security_groups.py and test_security_group_rules.py
* Clean up pep8 E125 violations
* Clean up pep8 E123 and E124 violations
* Clean up pep8 E127 violations
* Clean up pep8 E128 violations
* Clean up pep8 E711 violations
* Passing endpoint makes authenticate lazy so getting catalog fails
* Add XML support for test cases under identity admin
* Clean up pep8 E502 violations
* Add XML support to the cinder client
* make the rand_name value shorter
* Update test_associate_already_associated_floating_ip
* Add support to XML in images_client and its tests
* Add XML support for test_list_floating_ips.py
* Adds client API and tests for volume attachments
* Fix test_rebuild_nonexistent_server
* Refactor status_timeout() methods in tempest.test
* Add XML support to the volumes tests
* Add XML support to the volumes client
* Add lxml to pip-requires
* Add .tox to .gitignore
* Replace glance.client with python-glanceclient
* Fix ssh.Client retval and deadlock danger LP#1038561
* Fix test_create_server_with_unauthorized_image
* Re-enable 3 flavor tests
* Fix bug 1005397
* Fix undefined name 'nose'
* Added missing imports in tempest.tests.compute.base
* Fix forgotten import of `exceptions`
* Provide more default clients for smoke tests
* Comment out flakey failing tests
* Adds Cinder client
* Ensure token refresh. Fixes bug 1044316
* Add *.egg-info to .gitignore
* Add XML support for extensions_client
* Add XML support for flavors_client
* Add XML support for test_attach_volume
* Add XML support for test_security_groups.py
* Prevent stale isolated tenants from blocking test runs
* Add xml support to keypairs_client and its tests
* Resolves lp#1042541
* Add XML support to the server personality test
* Add XML support to the limits client
* Fix XML formatting for create server personality
* Add XML support for test_create_server.py
* Add XML support for test_server_actions.py
* Add XML support for test_list_server_filters.py
* Add XML support for test_servers.py
* Add XML support for test_images.py
* Add an xml/servers_client.py implementation
* Attempt to clean up any servers we left behind after a test
* Add a RestClient variant that sends and expects XML
* Skip tests that are causing tempest gate to fail
* Fixes LP Bug# 930482 - Test for security -tenanid by pass
* Skip whitebox tests until they are fixed
* Resolves lp#1033757
* Match name of test class to filename. Fixes bug 1006193
* Addresses lp#1004971
* Addition of base Smoke and Whitebox tests
* Fixes bug 902402- Integration Testcases for Keystone - users, Roles, and tenants
* Fixes Bug 1031639: admin_client.py- 'Assign and Remove role to user' points to a different URI
* Tolerate set_admin_password not implemented
* Fix for bug 1025552- Modifies test_servers_negative.py script
* Fix Bug1029936 :SKIP TEST removal and change of Bug ID
* Fix Bug1029334 :Skip Test removed from test_volumes_negative
* Fix for Bug 1029792. Added Documentation Strings to test cases in test_console_output.py
* fix for Bug 1029015.Added single quotes to remove unnecessary space in msg
* Disable ConfigParser interpolation (lp#1025993)
* Fix checks in server listing only lok for an ID
* Remove skip for bug #984762
* Remove skips for resolved bugs and fixed some coding errors in tests
* Fix logic on alt user tenant/password check
* Fix an unbound variable in setup_package
* Fix NameError in list image filters test
* Adds a script for tracking bug skips in tempest
* Optimized and reduced the scope of smoke tests
* Add skip for disabled user test until associated bug is fixed
* Fixes bug #1016042 - New tests for security groups
* Add tests for volume attach and detach
* Remove duplicate line cls.floating_ips_client = os.floating_ips_client from tempest/tests/compute/base.py
* Refactor Tempest to be parallel-test friendly
* Add BaseComputeTest.wait_for and use it to fix bug 1017932
* Skip slow/buggy soft reboot test until bug 1014647 is dealt with
* Comment out broken test involving soft reboot
* Step 1 of refactoring compute tests
* Wait for resource deletion after 202 response. Fixes bug 1007447
* Fix LP #1006198 - Network tests should be skipped if no Quantum
* Fixes lp:1003476. Adds negative tests for images
* Setup Nose multiprocessor config for:
* Fixes bug 1006405-Additional test cases to be added to test_volumes_negative.py
* Wait for server to be deleted before reboot/rebuild. Fixes bug 1006586
* Fixes bug 992088- Testcases for Console Output and one test case to test_authorization.py
* Deleted flavors can be viewed ... but not listed
* Adds admin tests for roles and roleRef API
* First cut of Network client and positive tests
* Fixes bug 992721- Metadata testcases for authorization testcases
* Fixes bug 972130- Testcases to CREATE, GET, DELETE, FILTER volumes
* Added an AddImageException to exceptions.py and modified images_client to use this exception rather than BuildErrorException
* Fix floating ip tests by adding missing an import
* Fixes Bug 1004138 - Fix for Bug 992275 Breaks on Python < 2.7
* Added tests for servers API as per bug/992299
* Fixes Bug 992167-Some new tests to be added to test_security_groups.py and test_authorization.py
* Fixes Bug 992215-Some new tests to be added to test_images.py and test_authorization.py
* Fixes lp:1002135. Minor re-factor to rest client
* Fixes bug/999647. Adds negative tests for LIST and GET servers API
* Adds instance_utils library and initial SSH tests
* Fixes bug 992275-Some new tests to test_floating_ips_actions.py
* Fixes bug 972673-Incorrect named parameters in BuildErrorException in test_volumes_list
* Fixes bug 992149-Some new tests to test_keypairs.py and test_authorization.py
* Fix LP #992228 - Test rebuild/reboot of deleted server
* Adds negative tests for Identity Tenants API
* Fixes bug/902405. Adds users tests and methods to admin client
* Add resources for floating_ip, keypair, volume. Add floating_ip test
* Skip blank role name test until resolved upsteam
* Minor fixes and docstrings updates
* Test cases for keystone tenant operations
* Fixes LP #992640 - Volumes sometimes not cleaned
* Moved parse_image_id() to data_utils
* Fixed the LP bug 993754. Ensure that the server created in the test is destroyed in finally: block of the test
* Fixed the LP bug 993739
* Adds key_name parameter in create_server
* fix for bug 992877
* Ensures that floating IP created in test is destroyed in a finally: block
* Fixed LP bug 991806. Ensures that floating IP created in test is destroyed in a finally: block
*     Adds an identity admin client and API tests for keystone roles
* Fixes LP #992096 - Add configure_via_auth=False
* Addresses lp#948243 - Tempest handles misconfig better
* Remind user about log_level
*   fixed the bug 983856. Pep8 complient made
* Added keypairs negative tests, removed unused client objects
* bug 985867: remove conf_from_devstack in favor of             devstack.git/tools/configure_tempest.sh
* Clients subclass the RestClient to allow attributes to be overrided by each client and allow better code reuse
* Do not assume network names
* Don't pass None for any values in post body
* Allow skip of disk_config tests that require resize
* Don't pass disk config as None. Fix for bug 980119
* Add License to Tempest
* Use `username' in ImagesConfig
* Fixes LP 973338 - Add custom alt and admin manager
* Adds config file template (for use in gate script)
* Convert to UNIX line endings
* Remove obsolete config file
* Enabling flavor marker tests
* Fixes lp##971527
* Properly handle skipping if no alt user
* Fix and simplify reboot stress test. Add new env stuff
* Refactor configuration setup and document config
* Adds basic tests for disk config extension
* Fixes bug 960864- Testcases for the action list Volumes and list Volumes with Detail
* Avoid new bug 963248
* Fix unbound local variable 'password error
* Generalize configuration for controller access
* Fixes lp#960647
* Fixes bug 902374-Negative tests for Volumes
* Addresses lp#940832
* Remove glance dependency. Fixes bug 944410
* Fixes bug 938953 parsing of image id
* Fixes LP Bug# 955349 - No init file in compute tests
* Fixes LP Bug#953450 - Remove vestigial ssh_timeout
* Initial checkin of Stress Test for nova
* Lowercase boolean configs before comparison
* Addresses lp#942382 - refactor configuration for clarity
* Intermediate improvement of Tempest quickstart
* Narrow race in wait_for_server_status()
* Redrive rate limited API calls
* test_rebuild_server tolerant of imageRef as URI
* Fixes lp#945419 - use_ssl value is ignored
* Fixes lp#945803
* Remove trailing whitespaces in regular file
* Pass credentials to glance client
* Fixes bug 902352 – New tests for security groups
* Addresses lp#902371
* Fixed Bug#943092
* Fixes lp#940532
* Resolves lp#941705
* Addresses lp#933845 * Changed config to use catalog type instead of catalog name
* Removed expected failure from negative access IP tests
* Fix hardcoding of status bug
* Skip test that is failing due to nova bug 940500
* Fix for bug 931712. Make keypair test work
* Fixes lp#932320 * Made catalog name configurable
* Make floating ip test work. Fixes bug 929765
* Fix for critical part of bug 929765
* Fixes LP#921409 * Adds /servers filter tests * Re-ordered resource building in fixtures to improve   execution time
* Fixes LP Bug#903977 - Boundary tests for list servers
* Fixes LP#922784 * Removed duplicate test * Re-ordered resource allocation
* Addresses LP#917976 * Adds basic logging when exceptions occur
* Fixes LP#902358 - Test case for Floating IPs
* Fixes LP#903978 - Write testcases for test_server_actions (boundary)
* Added flavor filter tests: lp899979, lp899980, lp899982 * Modified flavor service to return results in line with other services * Added bug flag to tests that are failing due to known issues
* Fixes LP #920782 - Malformed request URL
* Fixes LP#920812 - KeyError: 'overLimit' on 413 return
* KeyPairsClient: Configure client to query nova service from Keystone catalog
* Added Keypair extension (os-keypairs) client and tests LP#900139
* Adds Images API tests
* Don't set multiple images if image_ref_alt is the same as image_ref. Fix typo in skip_unless_addr
* Fixes LP Bug#903969 - Image metadata boundary tests
* Rework exceptions in Tempest
* import error on security groups clientfix 917867
* incorporated Jay's suggestion bug915695 security groups client - to list
* Fix for bug917490 * Adds a wait for the image to become active before deleting it
* Removed an invalid test Added nonexistant tests for list images operations
* Minor style related change in strings Changed indentation to 4 space width Added nonexistant tests for server metadata operations
* LP Bug#914770 - NameError in test_images
* Patch4 corrected typo - for server. not changing try except block Patch3 removed wait time Patch 2. Incorporated Jay's review comments fix for bug903970 create image from deleted server. Verified Pep8 formats. Verified that the test run fine . No image created
* Fixes LP Bug #912596 - image_ref_alt not found
* Added test_create_server_metadata_key_too_long
* Create a Tempest conf from a Devstack env
* RestClient to target specific services in Keystone catalog
* Added filter tests to list images tests, addresses lp bug 900088
* Fixed issue with white space after pep8 review Code review changes for Fixes for lp:903989 Change-Id: Ic345f0b30f24764a6f933684577323042fdeb8aa
* Negative test for Flavor - testcase bug 903967. Test run successfully fixed Pep8 issues. Ran Pep8, and it is fine now. Change-Id: I23f04adcbffef4ec67a996e406aec544fa2deb5b
* Code review changes for Bugfix for lp904407, /extensions tests
* Fixing revert/confirm resize tests
* Fixes lp:903466
* General test cleanup
* Fixes Bug lp:900910
* Fixed bug 902058 (review comments fixed)
* PEP8 fixes
* Removed storm references from README.rst
* Daryl's latest renaming commit needed some fixes
* Changes the namespace from storm to tempest, as well as adding addition tests and improvements * Changed namespace from storm to tempest * Added absolute limits service and server personality file tests * Optimized run time for image metadata tests * Added additional assertions for create server and rebuild server tests * Removed any SSH verification until further decisions are made
* Fixes LP Bug#899383 - Cleanup config file search
* * Added build_url() utility that returns an endpoint URL based on config parameters * Updated storm.conf * Added more properties to Nova config object * Fixed pep8 and the 'set' typo that came from a vi editor 'set list' fumble
* Removed unnecessary 'self' reference
* Update .gitreview with new project name
* Added image metadata tests, fixed minor bug in servers service with metadata
* Fix numeric header values for kernel_id and ramdisk_id
* Added server metadata and image tests. Also added a README for storm.conf
* Added negative tests for servers
* Assert we receive a scoped token & the correct user
* Removed unused imports; whitespace normalization
* Documented availability of 'auth' tag
* Added server details tests. Also re-added several files that somehow missed the initial commit
* Fix rabbitmq login
* Initial import of tests from the Zodiac project. On suggestion from Westmaas, imported tests under the nova directory (final naming TBD) to more quickly get them imported. To run these tests, execute 'nosetests nova/tests'. I've also only submitted the most stable of the tests. More to come
* Tests were not passing for test_servers in Kong tests. Kong was expecting too much information back from the POST
* Cleaning up kong.tests.test_server_actions
* Adding missing kong.common.utils module
* Removing link doctoring in test_images
* Adding identity api v2.0 tests
* Updating images tests
* Further optimize kong.tests.test_servers
* Removing unnecessary printing of config file
* Removed non-testing suggestions
* Stop kong/run_tests.sh from building venv each run
* Relaxing FlavorsTest entity checking
* Adding paramiko and unittest2 to pip-requires
* Updating sample config with required values
* The servers test deal with the new uuid params
* Add .gitreview config file for gerrit
* test supporting API v1.1
* Making run_test.sh python version and directory agnostic
* Adding generic run_tests.sh
* Add rfc.sh to help with gerrit workflow
* Consolidate configuration some more
* Make ServersTest.setUpClass just setUp to make sure we have read the config
* Annotate old stacktester tests so that they get run by run_tests.sh --whatever
* Output request to create server call for easier debugging
* Output response from create server call for easier debugging
* Make the use of a ramdisk optional for tests
* Pull in changes from stacktester
* Skip Rabbit tests if pika is not available
* Initialise openstack.Manager() with config from self.nova
* Make all tests inherit from the same base class
* Import all the stacktester stuff as-is (s/stacktester/kong/, though)
* Add __init__.py
* Move everything under the kong/ namespace
* PEP-8 compliance
* Remove a bunch of unused imports
* No need for xmlrpclib.Server
* This is not exactly Kong
* Add sample instructions for fetching images. Make sample config match these instructions
* cleanup of self.asserts
* cleanup self.asserts
* moved sample_vm directory under include dir. Added image/kernel/initrd declaration to config file. Updated glance tests to reference config variables for image/kernel/initrd
* Successfully deleting a server returns a 202 now instead of a 204
* Modified the logic to determine which ip to ping during build_check routine
* Initial Release
* Add README
