Option --scenario now accepts list of scenarios. They are executed
one-by-one, results are aggregated and stored in a single json
file or report. New option --artifacts-dir allows to store individual
results as well.
Change-Id: If9b8f0650635a8e2534f757de158a24461f045ba
Now Shaker can be run in Docker container! The container
does the whole work: it creates image, runs the scenario
and cleans everything up.
Change-Id: I9cbcb7e79d08f9526cf1ee8f3ccafab34d3935c2
Currently the nameserver for the subnets is set by default to
Google Public DNS by the heat templates. This patch makes the
dns nameserver configurable keeping the defaults standard. All
the heat templates are fixed to reflect the same.
+ Implementing Ilya's suggestions
Change-Id: I029e39407fccf528e164181539021978bd32c44b
Closes-Bug: #1591365
The flavor can be configured by image builder:
--flavor-ram - image RAM in MB
--flavor-vcpus - number of cores
--flavor-disk - disk size in GB
Change-Id: I243583ab8725d0a862ba66dae7828c23b9b20de0
* Replace all home-brewn code to work with OpenStack clients
with os-client-config lib. No need to monitor token expiration
for heat client anymore!
* Add 'os-project-name' parameter as it becomes standard
* Sync requirements to the latest
Closes-Bug: 1573504
Change-Id: I7520b9aed075074b4b47551eb22d18e568da83dd
Rename location of all OpenStack scenarios from "networking"
to "openstack". The old name is deprecated, but is automatically
translated into the new one.
Change-Id: I59ab4b7659199216bfdddcf2c57c254ddb1a19c8
Existing north-south scenarios actually do double path from tenant network
to external and then back. New scenarios allow to test against target host
located outside of the cloud. There are 2 options: instances with floating
IPs and without.
Change-Id: I91308465e9bbf261b0c919405b012d3d9b9f07da
With new option --book Shaker is able to generate report
as book in ReST format. The report contains necessary data only.
Change-Id: I3bc575214da5cabb7ec9eee7f497a8d5cbb67097
A new CLI parameter --matrix is introduced. The parameter allows to override
values specified in test cases.
Change-Id: I384b5f8c8963d8704ef9d31ce6f209be3ec8e184
Added new entry-point shaker-spot, which allows to execute scenarios
from the local node. Example of such scenario is spot/tcp which uses
iperf3 to measure bandwidth against one of public hosts.
Change-Id: I9303785501c3af7212ca590b8de63218ca877cd6
Now host name is not only taken from slave agent, but can
be specified directly in the test case. As example of usage
a new static agent networking scenario is added. The scenario
uses iperf3 to test connectivity to one of public iperf3 servers.
Change-Id: I660c91e1607a538217b81213abaaf9d57f4978a3
When using SSL in connections to the registry server, do not require
validation via a certifying authority. This is the registry's
equivalent of specifying --insecure on the command line using
Openstack clients for the API.
Change-Id: Id8164ccc5c8eee6e2da179c7552a667e10e61215
Use case: as a user, I would like to run networking tests when
master nodes are in one AZ and slave nodes in the other.
This patch removes hardcoded AZ name from config files, allows
to specify list of active AZs and enable cross AZ testing (for
case of 2 AZs). A new example of scenario is added into
networking/cross_az/full_l2.
Change-Id: I416f0f790d859f046525084ddc307952cbcc41d8
Added heat template for implementing centos target vms referenced by their alias.
Co-Authored-By: Joe Talerico <jtaleric@redhat.com>
Related-Bug: #1460726
Change-Id: I99c698506da36bd731951a58554f99701b49b4c9
UDP tests produce significant load on controllers, they should
be configured accordingly to scale of the cloud. This patch reduces
amount of UDP traffic in stock scenarios, tests with old values are
extracted to udp_* files.
Partial bug 1470892
Change-Id: I410bb3be0f7e267cd4aba4e95a3759e9ad6bc5c0
TLS/SSL support is enabled by adding os-cacert option to point
to a CA cert file. All Openstack client commands now pass
the cacert location as a parameter.
Change-Id: I72d9582d82381fd990e8d35b6320d0bea7cc203e
Cleans the heat stack in case of any error during scenario execution.
Configurable, with default action to clean the stack on any error
Closes-Bug: 1464315
Change-Id: I4a097ed92127b7eed6fdab1e80f3821002312bb3
Report template can be specified by full path or via alias.
List of available aliases can be found in the docs and CLI tools
help.
Change-Id: I22eb933d57a52b4eec24bba53b783e224a0a651b
Now Shaker package can contain several templates for image builder. Users may
refer to these templates by short name (alias), no full path knowledge is required.
All available aliases are shown in help message and in the docs.
Added Debian-based template as an example.
Closes bug 1460726
Change-Id: I6109be99acfa802abc185f92b15f0540007935be
SLA is specified in 'sla' section of test definition. The rules are
applied to all statistics (per-iteration and per-agent). The produced
result is available in report context.
Report supports --subunit option which allows to store sla checks in
subunit stream.
Change-Id: I6ae7a18ce9aff45af574d1f0ab656de251df5ea4
