openstack/puppet-openstack-integration
Code Issues Proposed changes

Remove --regex from tempest command when running with RDO

Browse Source 
https://review.openstack.org/#/c/504345/ has changed the behavior of tempest
when running with --regex and --whitelist-file [1]

In order to promote we need to remove this regex option and implement [2] when ready
after promotion.

This patch is removing totally the --regex when not running in UCA. Note these tests
were disabled in [3] and hopefully they are more stable now and we can run
without skipping them until we can implement --blacklist-file.

[1] https://bugs.launchpad.net/tempest/+bug/1751115
[2] https://review.openstack.org/#/c/547278
[3] https://review.openstack.org/#/c/461969/

Change-Id: I0dd846a383ed2e1cb4c699a42e618156a9e628b2
This commit is contained in:
Alfredo Moralejo 2018-02-23 09:56:18 +01:00
parent 816c6f097b
commit 9325150ded
1 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
run_tests.sh
View File

@ -308,7 +308,13 @@ if uses_debs; then
# TODO (amoralej) tempest tests for object_storage are not working in master with current version of tempest in uca (16.1.0).
EXCLUDES="--regex=^(?!mistral_tempest_tests.tests.api.v2.test_executions.ExecutionTestsV2.test_get_list_executions.*$)(?!ceilometer.tests.tempest.api.test_telemetry_notification_api.TelemetryNotificationAPITest.test_check_glance_v2_notifications.*$)(?!tempest.api.object_storage.*$).*"
else
EXCLUDES="--regex=^(?!tempest.scenario.gnocchi.test.live_assert_vcpus_metric_is_really_expurged.test_request.*$)(?!tempest.scenario.gnocchi.test.live_assert_no_delete_metrics_have_the_gabbilive_policy.test_request.*$).*"
# https://review.openstack.org/#/c/504345/ has changed the behavior of tempest when running with --regex and --whitelist-file
# and now operator between them is OR when filtering tests (which is how it was documented, btw). In order to promote
# we need to remove this regex option and implement https://review.openstack.org/#/c/547278 when ready.
# Note these tests were disabled in https://review.openstack.org/#/c/461969/ and hopefully it's more stable now and allows
# us to run it until we can implement --blacklist-file in a stable way.
#EXCLUDES="--regex=^(?!tempest.scenario.gnocchi.test.live_assert_vcpus_metric_is_really_expurged.test_request.*$)(?!tempest.scenario.gnocchi.test.live_assert_no_delete_metrics_have_the_gabbilive_policy.test_request.*$).*"
EXCLUDES=""
fi
print_header 'Running Tempest'
cd /tmp/openstack/tempest