Add report examples into the documentation

Change-Id: I88a115e472f2b2a0a1925c147504b666775a43a6
This commit is contained in:
Ilya Shakhat 2016-01-12 19:34:15 +03:00
parent 92bd753278
commit eaa469db09
39 changed files with 2449 additions and 77 deletions

View File

@ -1,67 +0,0 @@
===================
OpenStack Scenarios
===================
L2 Same Domain
--------------
This scenario tests the bandwidth between pairs of instances in the same virtual network (L2 domain).
Each instance is deployed on own compute node. The test increases the load from 1 pair until all
available instances are used.
.. image:: images/topology_l2.png
How To Run
^^^^^^^^^^
.. code::
shaker --server-endpoint <host:port> --scenario networking/full_l2 --report <full_l2.html>
Scenario
^^^^^^^^
.. literalinclude:: ../../shaker/scenarios/networking/full_l2.yaml
L3 East-West
------------
This scenario tests the bandwidth between pairs of instances deployed in different virtual networks
plugged into the same router. Each instance is deployed on its own compute node. The test increases the load
from 1 pair pair until all available instances are used.
.. image:: images/topology_l3_east_west.png
How To Run
^^^^^^^^^^
.. code::
shaker --server-endpoint <host:port> --scenario networking/full_l3_east_west --report <full_l3_east_west.html>
Scenario
^^^^^^^^
.. literalinclude:: ../../shaker/scenarios/networking/full_l3_east_west.yaml
L3 North-South
--------------
This scenario tests the bandwidth between pairs of instances deployed in different virtual networks. Instances
with master agents are located in one network, instances with slave agents are reached via their floating IPs.
Each instance is deployed on its own compute node. The test increases the load from 1 pair pair until
all available instances are used.
.. image:: images/topology_l3_north_south.png
How To Run
^^^^^^^^^^
.. code::
shaker --server-endpoint <host:port> --scenario networkingfull_l3_north_south --report <full_l3_north_south.html>
Scenario
^^^^^^^^
.. literalinclude:: ../../shaker/scenarios/networking/full_l3_north_south.yaml

View File

@ -0,0 +1,24 @@
L2 Same Domain
--------------
This scenario tests the bandwidth between pairs of instances in the same virtual network (L2 domain).
Each instance is deployed on own compute node. The test increases the load from 1 pair until all
available instances are used.
.. image:: ../images/topology_l2.png
How To Run
^^^^^^^^^^
.. code::
shaker --server-endpoint <host:port> --scenario networking/full_l2 --report <full_l2.html>
Scenario
^^^^^^^^
.. literalinclude:: ../../../shaker/scenarios/networking/full_l2.yaml
Report
^^^^^^
Example report collected at 20-nodes OpenStack cluster: :ref:`openstack_l2`.

View File

@ -0,0 +1,24 @@
L3 East-West
------------
This scenario tests the bandwidth between pairs of instances deployed in different virtual networks
plugged into the same router. Each instance is deployed on its own compute node. The test increases the load
from 1 pair pair until all available instances are used.
.. image:: ../images/topology_l3_east_west.png
How To Run
^^^^^^^^^^
.. code::
shaker --server-endpoint <host:port> --scenario networking/full_l3_east_west --report <full_l3_east_west.html>
Scenario
^^^^^^^^
.. literalinclude:: ../../../shaker/scenarios/networking/full_l3_east_west.yaml
Report
^^^^^^
Example report collected at 20-nodes OpenStack cluster: :ref:`openstack_l3_east_west`.

View File

@ -0,0 +1,25 @@
L3 North-South
--------------
This scenario tests the bandwidth between pairs of instances deployed in different virtual networks. Instances
with master agents are located in one network, instances with slave agents are reached via their floating IPs.
Each instance is deployed on its own compute node. The test increases the load from 1 pair pair until
all available instances are used.
.. image:: ../images/topology_l3_north_south.png
How To Run
^^^^^^^^^^
.. code::
shaker --server-endpoint <host:port> --scenario networkingfull_l3_north_south --report <full_l3_north_south.html>
Scenario
^^^^^^^^
.. literalinclude:: ../../../shaker/scenarios/networking/full_l3_north_south.yaml
Report
^^^^^^
Example report collected at 20-nodes OpenStack cluster: :ref:`openstack_l3_north_south`.

View File

@ -0,0 +1,9 @@
OpenStack Scenarios
===================
.. toctree::
:maxdepth: 2
full_l2
full_l3_east_west
full_l3_north_south

View File

@ -16,15 +16,8 @@ to execute. Additionally tests may be tuned dynamically in command-line.
installation
usage
tools
examples
examples_spot
architecture
examples/index
examples_spot
reports/index
contributing
.. Indices and tables
.. ==================
.. * :ref:`genindex`
.. * :ref:`modindex`
.. * :ref:`search`

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 20 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 20 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 24 KiB

View File

@ -0,0 +1,470 @@
.. _openstack_l2_dense:
OpenStack L2 Dense
******************
This scenario launches several pairs of VMs on the same compute node. VM are
plugged into the same private network. Useful for testing performance
degradation when the number of VMs grows.
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- double_room
- density: 8
- compute_nodes: 1
template: l2.hot
description: This scenario launches several pairs of VMs on the same compute node.
VM are plugged into the same private network. Useful for testing performance degradation
when the number of VMs grows.
execution:
progression: linear
tests:
- class: flent
method: tcp_download
title: Download
- class: flent
method: tcp_upload
title: Upload
- class: flent
method: tcp_bidirectional
title: Bi-directional
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/dense_l2.yaml
title: OpenStack L2 Dense
Bi-directional
==============
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_bidirectional
title: Bi-directional
.. image:: ba3c8569-7318-4dc6-ba70-1a45cee0e3e6.*
**Stats**:
=========== ============= ===================== ===================
concurrency ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
=========== ============= ===================== ===================
1 1.20 9621.43 9704.36
2 1.87 6330.36 6262.75
3 2.55 4598.51 4529.14
4 3.52 3279.71 3291.72
5 4.55 2516.36 2516.94
6 5.71 2002.73 2003.24
7 6.97 1638.64 1652.10
8 7.81 1408.17 1419.22
=========== ============= ===================== ===================
Concurrency 1
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 1.20 9621.43 9704.36
================= ============= ===================== ===================
Concurrency 2
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 1.86 6294.84 6204.99
node-6.domain.tld 1.88 6365.88 6320.52
================= ============= ===================== ===================
Concurrency 3
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 2.39 4557.23 4428.49
node-6.domain.tld 2.64 4670.00 4664.19
node-6.domain.tld 2.63 4568.32 4494.73
================= ============= ===================== ===================
Concurrency 4
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 3.68 3259.31 3287.13
node-6.domain.tld 3.26 3298.23 3314.15
node-6.domain.tld 3.83 3257.17 3226.80
node-6.domain.tld 3.33 3304.13 3338.81
================= ============= ===================== ===================
Concurrency 5
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 5.04 2550.88 2583.93
node-6.domain.tld 4.14 2486.48 2480.28
node-6.domain.tld 3.97 2520.54 2515.50
node-6.domain.tld 4.82 2483.47 2484.11
node-6.domain.tld 4.81 2540.44 2520.88
================= ============= ===================== ===================
Concurrency 6
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 5.90 1961.10 1984.38
node-6.domain.tld 4.99 2052.38 2051.06
node-6.domain.tld 6.02 1990.23 1965.51
node-6.domain.tld 5.19 1986.60 1964.58
node-6.domain.tld 6.02 1982.95 2006.11
node-6.domain.tld 6.15 2043.14 2047.81
================= ============= ===================== ===================
Concurrency 7
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 7.39 1683.33 1700.30
node-6.domain.tld 5.99 1614.44 1628.19
node-6.domain.tld 6.22 1631.46 1648.62
node-6.domain.tld 7.12 1615.92 1620.92
node-6.domain.tld 7.22 1624.42 1648.09
node-6.domain.tld 7.10 1609.21 1646.56
node-6.domain.tld 7.72 1691.71 1672.05
================= ============= ===================== ===================
Concurrency 8
-------------
**Stats**:
================= ============= ===================== ===================
node ping_icmp, ms tcp_download, Mbits/s tcp_upload, Mbits/s
================= ============= ===================== ===================
node-6.domain.tld 7.86 1381.55 1380.70
node-6.domain.tld 8.10 1360.85 1354.82
node-6.domain.tld 8.00 1629.02 1659.45
node-6.domain.tld 7.36 1403.67 1401.41
node-6.domain.tld 8.19 1362.26 1367.91
node-6.domain.tld 7.74 1395.07 1399.40
node-6.domain.tld 7.06 1377.46 1421.64
node-6.domain.tld 8.13 1355.44 1368.43
================= ============= ===================== ===================
Download
========
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_download
title: Download
.. image:: 73b640de-a11f-4876-9494-11a2641193b5.*
**Stats**:
=========== ============= =====================
concurrency ping_icmp, ms tcp_download, Mbits/s
=========== ============= =====================
1 0.64 15237.50
2 0.95 11753.03
3 1.08 10193.87
4 1.83 7311.93
5 2.70 5592.60
6 2.90 4488.04
7 3.64 3696.83
8 4.42 3166.11
=========== ============= =====================
Concurrency 1
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 0.64 15237.50
================= ============= =====================
Concurrency 2
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 0.96 11632.38
node-6.domain.tld 0.94 11873.68
================= ============= =====================
Concurrency 3
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 1.07 10284.54
node-6.domain.tld 1.18 10014.04
node-6.domain.tld 0.99 10283.04
================= ============= =====================
Concurrency 4
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 1.90 7257.45
node-6.domain.tld 1.84 7282.47
node-6.domain.tld 1.72 7416.10
node-6.domain.tld 1.88 7291.69
================= ============= =====================
Concurrency 5
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 2.60 5518.59
node-6.domain.tld 2.61 5753.13
node-6.domain.tld 2.38 5560.52
node-6.domain.tld 3.24 5583.56
node-6.domain.tld 2.67 5547.21
================= ============= =====================
Concurrency 6
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 2.68 4458.91
node-6.domain.tld 2.94 4565.03
node-6.domain.tld 2.83 4493.59
node-6.domain.tld 2.82 4502.03
node-6.domain.tld 3.30 4430.72
node-6.domain.tld 2.85 4477.96
================= ============= =====================
Concurrency 7
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 3.06 3685.12
node-6.domain.tld 4.15 3789.90
node-6.domain.tld 3.56 3668.97
node-6.domain.tld 3.19 3606.68
node-6.domain.tld 3.25 3753.06
node-6.domain.tld 4.08 3707.98
node-6.domain.tld 4.15 3666.12
================= ============= =====================
Concurrency 8
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-6.domain.tld 4.45 3188.59
node-6.domain.tld 3.68 3129.72
node-6.domain.tld 4.80 3081.13
node-6.domain.tld 4.02 3093.75
node-6.domain.tld 4.72 3209.73
node-6.domain.tld 4.52 3068.88
node-6.domain.tld 4.28 3107.04
node-6.domain.tld 4.89 3450.02
================= ============= =====================
Upload
======
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_upload
title: Upload
.. image:: 69d3be4d-88d9-49de-8d02-74c90b636410.*
**Stats**:
=========== ============= ===================
concurrency ping_icmp, ms tcp_upload, Mbits/s
=========== ============= ===================
1 0.76 16164.29
2 1.11 11832.46
3 1.49 9988.86
4 2.58 7146.27
5 2.90 5548.76
6 3.53 4465.03
7 3.85 3701.96
8 4.47 3145.42
=========== ============= ===================
Concurrency 1
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 0.76 16164.29
================= ============= ===================
Concurrency 2
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 1.11 11898.27
node-6.domain.tld 1.11 11766.64
================= ============= ===================
Concurrency 3
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 1.69 10005.98
node-6.domain.tld 1.54 9859.36
node-6.domain.tld 1.26 10101.24
================= ============= ===================
Concurrency 4
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 2.66 7042.02
node-6.domain.tld 2.77 7181.58
node-6.domain.tld 2.44 7203.51
node-6.domain.tld 2.47 7157.96
================= ============= ===================
Concurrency 5
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 2.87 5610.24
node-6.domain.tld 2.60 5423.45
node-6.domain.tld 2.71 5540.39
node-6.domain.tld 3.38 5503.63
node-6.domain.tld 2.97 5666.08
================= ============= ===================
Concurrency 6
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 3.33 4583.27
node-6.domain.tld 3.79 4437.25
node-6.domain.tld 3.01 4497.67
node-6.domain.tld 3.47 4516.93
node-6.domain.tld 3.71 4490.94
node-6.domain.tld 3.89 4264.11
================= ============= ===================
Concurrency 7
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 4.72 3699.14
node-6.domain.tld 3.39 3684.00
node-6.domain.tld 3.57 3694.32
node-6.domain.tld 3.58 3778.59
node-6.domain.tld 3.62 3667.92
node-6.domain.tld 3.80 3658.24
node-6.domain.tld 4.28 3731.53
================= ============= ===================
Concurrency 8
-------------
**Stats**:
================= ============= ===================
node ping_icmp, ms tcp_upload, Mbits/s
================= ============= ===================
node-6.domain.tld 4.42 3313.16
node-6.domain.tld 4.45 3090.43
node-6.domain.tld 4.58 3049.20
node-6.domain.tld 3.67 3099.69
node-6.domain.tld 4.30 3217.62
node-6.domain.tld 4.92 3086.23
node-6.domain.tld 4.62 3131.54
node-6.domain.tld 4.80 3175.52
================= ============= ===================

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 21 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 25 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 21 KiB

View File

@ -0,0 +1,468 @@
.. _openstack_l3_east_west_dense:
OpenStack L3 East-West Dense
****************************
This scenario launches pairs of VMs in different networks connected to one
router (L3 east-west)
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- double_room
- density: 8
- compute_nodes: 1
template: l3_east_west.hot
description: This scenario launches pairs of VMs in different networks connected to
one router (L3 east-west)
execution:
progression: linear
tests:
- class: flent
method: tcp_download
title: Download
- class: flent
method: tcp_upload
title: Upload
- class: flent
method: tcp_bidirectional
title: Bi-directional
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/dense_l3_east_west.yaml
title: OpenStack L3 East-West Dense
Bi-directional
==============
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_bidirectional
title: Bi-directional
.. image:: dbe5eb6f-351b-4297-88a8-5130f67064c5.*
**Stats**:
=========== =================== ============= =====================
concurrency tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
=========== =================== ============= =====================
1 2814.04 3.65 2862.18
2 2007.10 5.09 2118.44
3 1482.64 8.04 1305.91
4 1170.08 8.35 1141.41
5 909.19 10.51 918.53
6 799.28 12.35 759.03
7 673.86 14.81 666.51
8 596.48 16.11 581.02
=========== =================== ============= =====================
Concurrency 1
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 2814.04 3.65 2862.18
================= =================== ============= =====================
Concurrency 2
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 2080.99 4.29 2483.08
node-5.domain.tld 1933.21 5.89 1753.80
================= =================== ============= =====================
Concurrency 3
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 1238.39 10.64 1045.61
node-5.domain.tld 2016.54 5.48 1768.01
node-5.domain.tld 1192.99 8.02 1104.12
================= =================== ============= =====================
Concurrency 4
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 1177.99 7.54 1289.99
node-5.domain.tld 1135.60 8.45 1112.07
node-5.domain.tld 1204.90 9.21 1025.01
node-5.domain.tld 1161.82 8.19 1138.58
================= =================== ============= =====================
Concurrency 5
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 937.75 10.72 859.38
node-5.domain.tld 984.40 9.69 999.06
node-5.domain.tld 884.40 12.42 892.02
node-5.domain.tld 878.76 10.17 986.22
node-5.domain.tld 860.63 9.55 855.98
================= =================== ============= =====================
Concurrency 6
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 800.83 14.16 800.62
node-5.domain.tld 907.79 12.76 774.30
node-5.domain.tld 789.24 12.71 751.34
node-5.domain.tld 778.34 11.16 790.35
node-5.domain.tld 778.92 10.96 769.99
node-5.domain.tld 740.54 12.37 667.58
================= =================== ============= =====================
Concurrency 7
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 719.54 16.54 660.84
node-5.domain.tld 722.22 14.58 625.52
node-5.domain.tld 626.60 14.66 726.26
node-5.domain.tld 684.59 13.92 682.97
node-5.domain.tld 682.67 13.97 728.80
node-5.domain.tld 649.98 15.72 552.49
node-5.domain.tld 631.41 14.30 688.73
================= =================== ============= =====================
Concurrency 8
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-5.domain.tld 572.87 14.97 607.17
node-5.domain.tld 558.98 15.34 631.26
node-5.domain.tld 589.19 17.86 583.32
node-5.domain.tld 595.93 15.09 537.40
node-5.domain.tld 619.96 16.15 549.46
node-5.domain.tld 566.98 17.50 585.90
node-5.domain.tld 628.83 15.26 582.33
node-5.domain.tld 639.13 16.70 571.30
================= =================== ============= =====================
Download
========
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_download
title: Download
.. image:: b301136d-c6d5-4eb3-8942-be2041bde8e2.*
**Stats**:
=========== ============= =====================
concurrency ping_icmp, ms tcp_download, Mbits/s
=========== ============= =====================
1 2.61 3232.05
2 3.46 3265.07
3 4.14 2678.01
4 4.34 2192.83
5 5.77 1805.04
6 6.83 1520.49
7 6.68 1296.37
8 8.04 1169.80
=========== ============= =====================
Concurrency 1
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 2.61 3232.05
================= ============= =====================
Concurrency 2
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 3.50 3145.52
node-5.domain.tld 3.41 3384.62
================= ============= =====================
Concurrency 3
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 4.10 2752.96
node-5.domain.tld 3.57 2717.00
node-5.domain.tld 4.75 2564.08
================= ============= =====================
Concurrency 4
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 4.79 2105.32
node-5.domain.tld 4.27 2252.28
node-5.domain.tld 4.76 2144.97
node-5.domain.tld 3.55 2268.76
================= ============= =====================
Concurrency 5
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 6.57 1742.67
node-5.domain.tld 5.39 1868.02
node-5.domain.tld 5.24 1697.80
node-5.domain.tld 6.39 1952.90
node-5.domain.tld 5.24 1763.82
================= ============= =====================
Concurrency 6
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 6.80 1347.71
node-5.domain.tld 7.98 1406.02
node-5.domain.tld 6.81 1546.89
node-5.domain.tld 5.43 1662.43
node-5.domain.tld 7.36 1513.16
node-5.domain.tld 6.58 1646.74
================= ============= =====================
Concurrency 7
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 5.44 1524.59
node-5.domain.tld 6.32 985.88
node-5.domain.tld 6.65 1551.91
node-5.domain.tld 7.44 1444.54
node-5.domain.tld 6.60 1492.27
node-5.domain.tld 7.01 965.67
node-5.domain.tld 7.26 1109.73
================= ============= =====================
Concurrency 8
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-5.domain.tld 6.66 1361.59
node-5.domain.tld 7.88 1041.82
node-5.domain.tld 8.44 1263.24
node-5.domain.tld 8.40 1052.99
node-5.domain.tld 9.14 1218.77
node-5.domain.tld 7.72 1166.68
node-5.domain.tld 6.83 1189.83
node-5.domain.tld 9.23 1063.47
================= ============= =====================
Upload
======
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_upload
title: Upload
.. image:: fa959708-db0c-40be-9b11-391064e6a003.*
**Stats**:
=========== =================== =============
concurrency tcp_upload, Mbits/s ping_icmp, ms
=========== =================== =============
1 3844.43 2.81
2 3396.30 3.11
3 2321.55 3.30
4 2140.43 4.10
5 1730.21 5.14
6 1246.42 4.35
7 1329.00 6.97
8 1134.45 7.98
=========== =================== =============
Concurrency 1
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 3844.43 2.81
================= =================== =============
Concurrency 2
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 3482.66 2.78
node-5.domain.tld 3309.94 3.44
================= =================== =============
Concurrency 3
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 2942.33 2.80
node-5.domain.tld 2025.66 3.07
node-5.domain.tld 1996.67 4.05
================= =================== =============
Concurrency 4
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 1833.08 3.68
node-5.domain.tld 2506.52 4.41
node-5.domain.tld 2223.73 3.82
node-5.domain.tld 1998.38 4.49
================= =================== =============
Concurrency 5
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 1527.11 4.09
node-5.domain.tld 1877.01 3.86
node-5.domain.tld 1851.41 4.48
node-5.domain.tld 1944.21 6.07
node-5.domain.tld 1451.29 7.21
================= =================== =============
Concurrency 6
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 755.12 14.41
node-5.domain.tld 2021.84 2.26
node-5.domain.tld 928.22 1.26
node-5.domain.tld 2076.70 3.16
node-5.domain.tld 848.13 1.59
node-5.domain.tld 848.49 3.42
================= =================== =============
Concurrency 7
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 1330.81 8.47
node-5.domain.tld 1497.74 5.40
node-5.domain.tld 1297.62 6.61
node-5.domain.tld 1207.32 7.11
node-5.domain.tld 1388.78 8.44
node-5.domain.tld 1210.06 6.73
node-5.domain.tld 1370.67 6.01
================= =================== =============
Concurrency 8
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-5.domain.tld 1131.88 8.76
node-5.domain.tld 1058.38 7.68
node-5.domain.tld 1067.14 7.80
node-5.domain.tld 1350.97 7.68
node-5.domain.tld 985.73 6.97
node-5.domain.tld 1060.46 7.20
node-5.domain.tld 1117.55 9.80
node-5.domain.tld 1303.53 7.92
================= =================== =============

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 19 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 18 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 21 KiB

View File

@ -0,0 +1,280 @@
.. _openstack_l2:
OpenStack L2
************
This scenario launches pairs of VMs in the same private network. Every VM is
hosted on a separate compute node.
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- single_room
template: l2.hot
description: This scenario launches pairs of VMs in the same private network. Every
VM is hosted on a separate compute node.
execution:
progression: quadratic
tests:
- class: flent
method: tcp_download
title: Download
- class: flent
method: tcp_upload
title: Upload
- class: flent
method: tcp_bidirectional
title: Bi-directional
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/full_l2.yaml
title: OpenStack L2
Bi-directional
==============
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_bidirectional
title: Bi-directional
.. image:: 722a69c0-c3e5-458c-99df-486484b1d481.*
**Stats**:
=========== =================== ============= =====================
concurrency tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
=========== =================== ============= =====================
1 3578.59 3.19 3547.75
2 3912.17 2.95 3942.74
5 3807.46 3.05 3791.78
10 3752.25 2.89 3962.02
=========== =================== ============= =====================
Concurrency 1
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-8.domain.tld 3578.59 3.19 3547.75
================= =================== ============= =====================
Concurrency 2
-------------
**Stats**:
================= =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================= =================== ============= =====================
node-7.domain.tld 3680.14 3.21 3711.57
node-8.domain.tld 4144.20 2.68 4173.90
================= =================== ============= =====================
Concurrency 5
-------------
**Stats**:
================== =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================== =================== ============= =====================
node-11.domain.tld 3551.67 3.33 3544.93
node-18.domain.tld 3795.47 3.04 3811.38
node-4.domain.tld 3898.52 3.00 3882.67
node-7.domain.tld 3970.07 2.82 4005.72
node-8.domain.tld 3821.60 3.04 3714.18
================== =================== ============= =====================
Concurrency 10
--------------
**Stats**:
================== =================== ============= =====================
node tcp_upload, Mbits/s ping_icmp, ms tcp_download, Mbits/s
================== =================== ============= =====================
node-11.domain.tld 4014.04 2.85 3878.48
node-13.domain.tld 3767.26 3.24 3651.51
node-15.domain.tld 3316.62 2.96 3861.89
node-17.domain.tld 3330.25 2.88 4175.01
node-18.domain.tld 4208.58 2.74 3639.62
node-20.domain.tld 3988.34 2.74 4112.45
node-4.domain.tld 3939.45 3.08 4057.85
node-5.domain.tld 3846.78 3.01 3784.39
node-7.domain.tld 3390.47 2.38 4657.64
node-8.domain.tld 3720.68 2.98 3801.36
================== =================== ============= =====================
Download
========
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_download
title: Download
.. image:: 193493d3-7de6-4f3e-976e-3bffc9f5776b.*
**Stats**:
=========== ============= =====================
concurrency ping_icmp, ms tcp_download, Mbits/s
=========== ============= =====================
1 1.62 6758.58
2 1.49 6747.02
5 1.63 6755.12
10 1.68 6615.10
=========== ============= =====================
Concurrency 1
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-8.domain.tld 1.62 6758.58
================= ============= =====================
Concurrency 2
-------------
**Stats**:
================= ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================= ============= =====================
node-7.domain.tld 1.50 6771.23
node-8.domain.tld 1.47 6722.80
================= ============= =====================
Concurrency 5
-------------
**Stats**:
================== ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================== ============= =====================
node-11.domain.tld 1.52 6650.81
node-18.domain.tld 1.70 6870.23
node-4.domain.tld 1.74 6688.20
node-7.domain.tld 1.57 6741.27
node-8.domain.tld 1.63 6825.11
================== ============= =====================
Concurrency 10
--------------
**Stats**:
================== ============= =====================
node ping_icmp, ms tcp_download, Mbits/s
================== ============= =====================
node-11.domain.tld 1.43 6634.04
node-13.domain.tld 1.67 6769.58
node-15.domain.tld 1.60 6695.55
node-17.domain.tld 2.17 6145.54
node-18.domain.tld 1.64 6824.41
node-20.domain.tld 1.69 6786.08
node-4.domain.tld 1.70 6754.63
node-5.domain.tld 1.68 6572.60
node-7.domain.tld 1.80 6228.16
node-8.domain.tld 1.41 6740.39
================== ============= =====================
Upload
======
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_upload
title: Upload
.. image:: 7220f722-0c40-4edb-a323-ab9d2df71e1b.*
**Stats**:
=========== =================== =============
concurrency tcp_upload, Mbits/s ping_icmp, ms
=========== =================== =============
1 6804.07 1.43
2 6784.08 1.62
5 6671.28 1.69
10 6692.88 1.64
=========== =================== =============
Concurrency 1
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-8.domain.tld 6804.07 1.43
================= =================== =============
Concurrency 2
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-7.domain.tld 6708.61 1.63
node-8.domain.tld 6859.54 1.61
================= =================== =============
Concurrency 5
-------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-11.domain.tld 6442.30 1.78
node-18.domain.tld 6514.95 1.47
node-4.domain.tld 7005.11 1.79
node-7.domain.tld 6682.03 1.58
node-8.domain.tld 6711.99 1.83
================== =================== =============
Concurrency 10
--------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-11.domain.tld 6701.87 1.75
node-13.domain.tld 6777.32 1.64
node-15.domain.tld 6620.17 1.68
node-17.domain.tld 6469.74 1.52
node-18.domain.tld 6709.92 1.65
node-20.domain.tld 6686.77 1.62
node-4.domain.tld 6687.55 1.55
node-5.domain.tld 6896.79 1.62
node-7.domain.tld 6686.20 1.58
node-8.domain.tld 6692.50 1.75
================== =================== =============

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 18 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 21 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 19 KiB

View File

@ -0,0 +1,280 @@
.. _openstack_l3_east_west:
OpenStack L3 East-West
**********************
This scenario launches pairs of VMs in different networks connected to one
router (L3 east-west)
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- single_room
template: l3_east_west.hot
description: This scenario launches pairs of VMs in different networks connected to
one router (L3 east-west)
execution:
progression: quadratic
tests:
- class: flent
method: tcp_download
title: Download
- class: flent
method: tcp_upload
title: Upload
- class: flent
method: tcp_bidirectional
title: Bi-directional
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/full_l3_east_west.yaml
title: OpenStack L3 East-West
Bi-directional
==============
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_bidirectional
title: Bi-directional
.. image:: 971e06b7-59f2-4154-976c-1db0e7f7645f.*
**Stats**:
=========== ===================== =================== =============
concurrency tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
=========== ===================== =================== =============
1 3816.62 3474.93 2.92
2 2264.43 2632.60 4.88
5 1016.47 991.04 7.11
10 491.52 514.84 9.54
=========== ===================== =================== =============
Concurrency 1
-------------
**Stats**:
================== ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================== ===================== =================== =============
node-13.domain.tld 3816.62 3474.93 2.92
================== ===================== =================== =============
Concurrency 2
-------------
**Stats**:
================== ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================== ===================== =================== =============
node-13.domain.tld 2423.30 2639.19 6.56
node-15.domain.tld 2105.57 2626.00 3.20
================== ===================== =================== =============
Concurrency 5
-------------
**Stats**:
================== ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================== ===================== =================== =============
node-13.domain.tld 971.69 839.75 10.07
node-15.domain.tld 1490.89 948.82 6.33
node-20.domain.tld 758.93 889.14 5.69
node-4.domain.tld 786.01 1125.13 7.69
node-5.domain.tld 1074.82 1152.35 5.75
================== ===================== =================== =============
Concurrency 10
--------------
**Stats**:
================== ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================== ===================== =================== =============
node-11.domain.tld 752.08 763.63 9.52
node-13.domain.tld 320.14 935.47 13.50
node-15.domain.tld 354.13 506.37 5.85
node-17.domain.tld 902.35 346.84 13.27
node-18.domain.tld 790.13 358.23 13.42
node-20.domain.tld 378.52 360.62 5.99
node-4.domain.tld 346.47 437.56 9.38
node-5.domain.tld 367.27 706.91 5.70
node-7.domain.tld 347.72 392.19 9.47
node-8.domain.tld 356.42 340.56 9.33
================== ===================== =================== =============
Download
========
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_download
title: Download
.. image:: 7db77fbd-ac1b-4f48-9200-992578593598.*
**Stats**:
=========== ===================== =============
concurrency tcp_download, Mbits/s ping_icmp, ms
=========== ===================== =============
1 4049.22 0.96
2 4792.05 2.09
5 1858.96 3.94
10 999.79 7.62
=========== ===================== =============
Concurrency 1
-------------
**Stats**:
================== ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================== ===================== =============
node-13.domain.tld 4049.22 0.96
================== ===================== =============
Concurrency 2
-------------
**Stats**:
================== ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================== ===================== =============
node-13.domain.tld 5126.86 2.81
node-15.domain.tld 4457.24 1.38
================== ===================== =============
Concurrency 5
-------------
**Stats**:
================== ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================== ===================== =============
node-13.domain.tld 1475.56 4.33
node-15.domain.tld 1486.69 7.91
node-20.domain.tld 2385.87 2.15
node-4.domain.tld 2470.58 3.87
node-5.domain.tld 1476.10 1.42
================== ===================== =============
Concurrency 10
--------------
**Stats**:
================== ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================== ===================== =============
node-11.domain.tld 842.15 7.68
node-13.domain.tld 1180.86 8.50
node-15.domain.tld 1496.95 6.76
node-17.domain.tld 1018.10 8.80
node-18.domain.tld 979.22 8.77
node-20.domain.tld 893.75 6.47
node-4.domain.tld 846.17 7.52
node-5.domain.tld 822.03 6.59
node-7.domain.tld 866.79 7.42
node-8.domain.tld 1051.91 7.65
================== ===================== =============
Upload
======
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_upload
title: Upload
.. image:: a5cec469-249a-4d9a-ad2d-51b5ce38de7e.*
**Stats**:
=========== =================== =============
concurrency tcp_upload, Mbits/s ping_icmp, ms
=========== =================== =============
1 4209.99 0.79
2 3849.74 2.98
5 1996.74 5.47
10 1009.21 8.05
=========== =================== =============
Concurrency 1
-------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-13.domain.tld 4209.99 0.79
================== =================== =============
Concurrency 2
-------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-13.domain.tld 4086.94 2.07
node-15.domain.tld 3612.54 3.89
================== =================== =============
Concurrency 5
-------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-13.domain.tld 2053.60 9.05
node-15.domain.tld 1525.48 3.71
node-20.domain.tld 1463.32 3.94
node-4.domain.tld 3485.97 6.73
node-5.domain.tld 1455.31 3.96
================== =================== =============
Concurrency 10
--------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-11.domain.tld 830.32 8.19
node-13.domain.tld 720.02 11.14
node-15.domain.tld 807.43 4.96
node-17.domain.tld 956.33 11.02
node-18.domain.tld 926.50 11.21
node-20.domain.tld 1272.34 5.04
node-4.domain.tld 1371.94 8.07
node-5.domain.tld 1306.22 4.91
node-7.domain.tld 906.63 7.85
node-8.domain.tld 994.41 8.08
================== =================== =============

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 18 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 18 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 20 KiB

View File

@ -0,0 +1,282 @@
.. _openstack_l3_north_south:
OpenStack L3 North-South
************************
This scenario launches pairs of VMs on different compute nodes. VMs are in the
different networks connected via different routers, master accesses slave by
floating ip
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- single_room
template: l3_north_south.hot
description: This scenario launches pairs of VMs on different compute nodes. VMs are
in the different networks connected via different routers, master accesses slave
by floating ip
execution:
progression: quadratic
tests:
- class: flent
method: tcp_download
title: Download
- class: flent
method: tcp_upload
title: Upload
- class: flent
method: tcp_bidirectional
title: Bi-directional
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/full_l3_north_south.yaml
title: OpenStack L3 North-South
Bi-directional
==============
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_bidirectional
title: Bi-directional
.. image:: de257d81-c808-4b8e-bfdb-84c0ae1925e6.*
**Stats**:
=========== ===================== =================== =============
concurrency tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
=========== ===================== =================== =============
1 677.49 730.02 2.83
2 458.31 464.96 1.10
5 186.56 188.01 19.69
10 93.53 95.16 52.70
=========== ===================== =================== =============
Concurrency 1
-------------
**Stats**:
================= ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================= ===================== =================== =============
node-7.domain.tld 677.49 730.02 2.83
================= ===================== =================== =============
Concurrency 2
-------------
**Stats**:
================= ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================= ===================== =================== =============
node-7.domain.tld 463.71 358.63 1.17
node-8.domain.tld 452.91 571.29 1.04
================= ===================== =================== =============
Concurrency 5
-------------
**Stats**:
================== ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================== ===================== =================== =============
node-17.domain.tld 131.38 126.00 1.17
node-18.domain.tld 174.60 248.76 23.30
node-4.domain.tld 218.45 174.13 48.85
node-7.domain.tld 252.50 247.47 1.25
node-8.domain.tld 155.87 143.68 23.88
================== ===================== =================== =============
Concurrency 10
--------------
**Stats**:
================== ===================== =================== =============
node tcp_download, Mbits/s tcp_upload, Mbits/s ping_icmp, ms
================== ===================== =================== =============
node-11.domain.tld 70.72 105.89 32.10
node-13.domain.tld 41.09 87.66 58.91
node-15.domain.tld 50.97 66.22 49.67
node-17.domain.tld 134.96 107.46 49.53
node-18.domain.tld 195.38 73.91 57.20
node-20.domain.tld 47.33 109.20 64.02
node-4.domain.tld 93.19 130.02 69.01
node-5.domain.tld 160.04 84.94 36.94
node-7.domain.tld 80.14 53.36 50.13
node-8.domain.tld 61.44 132.92 59.52
================== ===================== =================== =============
Download
========
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_download
title: Download
.. image:: 43db46b3-0536-4c92-b809-4957afe3a794.*
**Stats**:
=========== ===================== =============
concurrency tcp_download, Mbits/s ping_icmp, ms
=========== ===================== =============
1 922.30 1.38
2 475.85 1.01
5 191.92 33.93
10 97.23 47.53
=========== ===================== =============
Concurrency 1
-------------
**Stats**:
================= ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================= ===================== =============
node-7.domain.tld 922.30 1.38
================= ===================== =============
Concurrency 2
-------------
**Stats**:
================= ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================= ===================== =============
node-7.domain.tld 472.46 1.12
node-8.domain.tld 479.23 0.91
================= ===================== =============
Concurrency 5
-------------
**Stats**:
================== ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================== ===================== =============
node-17.domain.tld 192.51 39.78
node-18.domain.tld 189.76 41.85
node-4.domain.tld 189.54 45.34
node-7.domain.tld 189.81 41.66
node-8.domain.tld 198.01 1.04
================== ===================== =============
Concurrency 10
--------------
**Stats**:
================== ===================== =============
node tcp_download, Mbits/s ping_icmp, ms
================== ===================== =============
node-11.domain.tld 161.82 50.27
node-13.domain.tld 66.99 51.33
node-15.domain.tld 83.39 54.02
node-17.domain.tld 62.38 54.22
node-18.domain.tld 77.17 54.20
node-20.domain.tld 51.60 54.22
node-4.domain.tld 97.86 50.46
node-5.domain.tld 53.75 0.98
node-7.domain.tld 158.17 54.30
node-8.domain.tld 159.16 51.26
================== ===================== =============
Upload
======
**Test Specification**:
.. code-block:: yaml
class: flent
method: tcp_upload
title: Upload
.. image:: 73b55d80-654d-438a-8ddd-3d89ce821f38.*
**Stats**:
=========== =================== =============
concurrency tcp_upload, Mbits/s ping_icmp, ms
=========== =================== =============
1 890.06 0.86
2 481.63 8.44
5 190.86 31.44
10 97.73 61.75
=========== =================== =============
Concurrency 1
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-7.domain.tld 890.06 0.86
================= =================== =============
Concurrency 2
-------------
**Stats**:
================= =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================= =================== =============
node-7.domain.tld 476.55 0.75
node-8.domain.tld 486.72 16.13
================= =================== =============
Concurrency 5
-------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-17.domain.tld 192.28 41.43
node-18.domain.tld 190.41 0.87
node-4.domain.tld 189.01 38.76
node-7.domain.tld 190.01 36.40
node-8.domain.tld 192.59 39.75
================== =================== =============
Concurrency 10
--------------
**Stats**:
================== =================== =============
node tcp_upload, Mbits/s ping_icmp, ms
================== =================== =============
node-11.domain.tld 138.34 62.15
node-13.domain.tld 138.37 64.57
node-15.domain.tld 63.27 63.77
node-17.domain.tld 72.49 63.56
node-18.domain.tld 137.22 58.73
node-20.domain.tld 56.73 64.66
node-4.domain.tld 76.95 60.73
node-5.domain.tld 68.55 59.09
node-7.domain.tld 87.67 59.11
node-8.domain.tld 137.68 61.18
================== =================== =============

View File

@ -0,0 +1,27 @@
Reports
=======
All reports under this folder are collected in the following environment:
* 20 bare-metal nodes running KVM
* 10Gb tenant network
* 1Gb floating network
* Neutron ML2 plugin with VXLAN
* Neutron HA routers
To generate the report based on raw data:
.. code::
shaker-report --input <raw data> --book <folder to store book into>
.. toctree::
:maxdepth: 2
full_l2/index
full_l3_east_west/index
full_l3_north_south/index
perf_l2/index
perf_l3_east_west/index
perf_l3_north_south/index
dense_l2/index
dense_l3_east_west/index

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 15 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 46 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 30 KiB

View File

@ -0,0 +1,153 @@
.. _openstack_l2_performance:
OpenStack L2 Performance
************************
This scenario launches 1 pair of VMs in the same private network on different
compute nodes.
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- single_room
- compute_nodes: 2
template: l2.hot
description: This scenario launches 1 pair of VMs in the same private network on different
compute nodes.
execution:
tests:
- class: flent
method: ping
sla:
- '[type == ''agent''] >> (stats.ping_icmp.mean < 0.5)'
time: 10
title: Ping
- class: iperf3
sla:
- '[type == ''agent''] >> (stats.bandwidth.mean > 5000)'
- '[type == ''agent''] >> (stats.retransmits.max < 10)'
title: TCP
- bandwidth: 0
class: iperf3
datagram_size: 32
sla:
- '[type == ''agent''] >> (stats.packets.mean > 100000)'
title: UDP
udp: true
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/perf_l2.yaml
title: OpenStack L2 Performance
Ping
====
**Test Specification**:
.. code-block:: yaml
class: flent
method: ping
sla:
- '[type == ''agent''] >> (stats.ping_icmp.mean < 0.5)'
time: 10
title: Ping
.. image:: 1586aa2e-863f-4469-a613-278bcfac8cb2.*
**Stats**:
.. code-block:: yaml
ping_icmp:
max: 4.236238930666339
mean: 1.0783260741090341
min: 0.4065897760580819
unit: ms
**SLA**:
========================== =========== ================= ======
Expression Concurrency Node Result
========================== =========== ================= ======
stats.ping_icmp.mean < 0.5 1 node-9.domain.tld FAIL
========================== =========== ================= ======
TCP
===
**Test Specification**:
.. code-block:: yaml
class: iperf3
interval: 1
sla:
- '[type == ''agent''] >> (stats.bandwidth.mean > 5000)'
- '[type == ''agent''] >> (stats.retransmits.max < 10)'
title: TCP
.. image:: 780d525c-da2d-44d4-aa93-3a73a57714cf.*
**Stats**:
.. code-block:: yaml
bandwidth:
max: 7492.275238037109
mean: 7015.98030573527
min: 5919.618606567383
unit: Mbit/s
retransmits:
max: 1
mean: 1.0
min: 1
unit: ''
**SLA**:
=========================== =========== ================= ======
Expression Concurrency Node Result
=========================== =========== ================= ======
stats.bandwidth.mean > 5000 1 node-9.domain.tld OK
stats.retransmits.max < 10 1 node-9.domain.tld OK
=========================== =========== ================= ======
UDP
===
**Test Specification**:
.. code-block:: yaml
bandwidth: 0
class: iperf3
datagram_size: 32
interval: 1
sla:
- '[type == ''agent''] >> (stats.packets.mean > 100000)'
title: UDP
udp: true
.. image:: b8de3714-e7f0-4109-8a3c-bfb3071c4f2d.*
**Stats**:
.. code-block:: yaml
packets:
max: 138160
mean: 133338.5
min: 124560
unit: pps
**SLA**:
=========================== =========== ================= ======
Expression Concurrency Node Result
=========================== =========== ================= ======
stats.packets.mean > 100000 1 node-9.domain.tld OK
=========================== =========== ================= ======

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 16 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 46 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 30 KiB

View File

@ -0,0 +1,153 @@
.. _openstack_l3_east_west_performance:
OpenStack L3 East-West Performance
**********************************
This scenario launches 1 pair of VMs in different networks connected to one
router (L3 east-west). VMs are hosted on different compute nodes
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- single_room
- compute_nodes: 2
template: l3_east_west.hot
description: This scenario launches 1 pair of VMs in different networks connected
to one router (L3 east-west). VMs are hosted on different compute nodes
execution:
tests:
- class: flent
method: ping
sla:
- '[type == ''agent''] >> (stats.ping_icmp.mean < 2.0)'
time: 10
title: Ping
- class: iperf3
sla:
- '[type == ''agent''] >> (stats.bandwidth.mean > 5000)'
- '[type == ''agent''] >> (stats.retransmits.max < 10)'
title: TCP
- bandwidth: 0
class: iperf3
datagram_size: 32
sla:
- '[type == ''agent''] >> (stats.packets.mean > 100000)'
title: UDP
udp: true
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/perf_l3_east_west.yaml
title: OpenStack L3 East-West Performance
Ping
====
**Test Specification**:
.. code-block:: yaml
class: flent
method: ping
sla:
- '[type == ''agent''] >> (stats.ping_icmp.mean < 2.0)'
time: 10
title: Ping
.. image:: 0549ebdf-5903-4592-ab06-5c12b10fc625.*
**Stats**:
.. code-block:: yaml
ping_icmp:
max: 3.880741082830054
mean: 1.23610103398376
min: 0.7130612739715825
unit: ms
**SLA**:
========================== =========== ================== ======
Expression Concurrency Node Result
========================== =========== ================== ======
stats.ping_icmp.mean < 2.0 1 node-19.domain.tld OK
========================== =========== ================== ======
TCP
===
**Test Specification**:
.. code-block:: yaml
class: iperf3
interval: 1
sla:
- '[type == ''agent''] >> (stats.bandwidth.mean > 5000)'
- '[type == ''agent''] >> (stats.retransmits.max < 10)'
title: TCP
.. image:: 489cd75f-c740-477f-9e03-9e0adf043ccf.*
**Stats**:
.. code-block:: yaml
bandwidth:
max: 5531.473159790039
mean: 4966.737230682373
min: 3640.0222778320312
unit: Mbit/s
retransmits:
max: 4
mean: 4.0
min: 4
unit: ''
**SLA**:
=========================== =========== ================== ======
Expression Concurrency Node Result
=========================== =========== ================== ======
stats.bandwidth.mean > 5000 1 node-19.domain.tld FAIL
stats.retransmits.max < 10 1 node-19.domain.tld OK
=========================== =========== ================== ======
UDP
===
**Test Specification**:
.. code-block:: yaml
bandwidth: 0
class: iperf3
datagram_size: 32
interval: 1
sla:
- '[type == ''agent''] >> (stats.packets.mean > 100000)'
title: UDP
udp: true
.. image:: c27bc4a9-b379-4f18-bcff-ff24e1f35ead.*
**Stats**:
.. code-block:: yaml
packets:
max: 141310
mean: 137370.33333333334
min: 135180
unit: pps
**SLA**:
=========================== =========== ================== ======
Expression Concurrency Node Result
=========================== =========== ================== ======
stats.packets.mean > 100000 1 node-19.domain.tld OK
=========================== =========== ================== ======

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 16 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 47 KiB

File diff suppressed because one or more lines are too long

After

Width:  |  Height:  |  Size: 30 KiB

View File

@ -0,0 +1,155 @@
.. _openstack_l3_north_south_performance:
OpenStack L3 North-South Performance
************************************
This scenario launches 1 pair of VMs on different compute nodes. VMs are in the
different networks connected via different routers, master accesses slave by
floating ip
**Scenario**:
.. code-block:: yaml
deployment:
accommodation:
- pair
- single_room
- compute_nodes: 2
template: l3_north_south.hot
description: This scenario launches 1 pair of VMs on different compute nodes. VMs
are in the different networks connected via different routers, master accesses slave
by floating ip
execution:
tests:
- class: flent
method: ping
sla:
- '[type == ''agent''] >> (stats.ping_icmp.mean < 2.0)'
time: 10
title: Ping
- class: iperf3
sla:
- '[type == ''agent''] >> (stats.bandwidth.mean > 5000)'
- '[type == ''agent''] >> (stats.retransmits.max < 10)'
title: TCP
- bandwidth: 0
class: iperf3
datagram_size: 32
sla:
- '[type == ''agent''] >> (stats.packets.mean > 100000)'
title: UDP
udp: true
file_name: /home/ishakhat/Work/shaker/shaker/scenarios/networking/perf_l3_north_south.yaml
title: OpenStack L3 North-South Performance
Ping
====
**Test Specification**:
.. code-block:: yaml
class: flent
method: ping
sla:
- '[type == ''agent''] >> (stats.ping_icmp.mean < 2.0)'
time: 10
title: Ping
.. image:: 42af5820-53ae-4dcb-a268-b59c046698a5.*
**Stats**:
.. code-block:: yaml
ping_icmp:
max: 3.4270406725254006
mean: 1.6479111172469332
min: 0.9622029103967339
unit: ms
**SLA**:
========================== =========== ================== ======
Expression Concurrency Node Result
========================== =========== ================== ======
stats.ping_icmp.mean < 2.0 1 node-11.domain.tld OK
========================== =========== ================== ======
TCP
===
**Test Specification**:
.. code-block:: yaml
class: iperf3
interval: 1
sla:
- '[type == ''agent''] >> (stats.bandwidth.mean > 5000)'
- '[type == ''agent''] >> (stats.retransmits.max < 10)'
title: TCP
.. image:: 44aea6a5-541d-43a0-a331-42fdcada8ac6.*
**Stats**:
.. code-block:: yaml
bandwidth:
max: 904.4981002807617
mean: 868.6801114400228
min: 508.1815719604492
unit: Mbit/s
retransmits:
max: 470
mean: 135.0
min: 1
unit: ''
**SLA**:
=========================== =========== ================== ======
Expression Concurrency Node Result
=========================== =========== ================== ======
stats.bandwidth.mean > 5000 1 node-11.domain.tld FAIL
stats.retransmits.max < 10 1 node-11.domain.tld FAIL
=========================== =========== ================== ======
UDP
===
**Test Specification**:
.. code-block:: yaml
bandwidth: 0
class: iperf3
datagram_size: 32
interval: 1
sla:
- '[type == ''agent''] >> (stats.packets.mean > 100000)'
title: UDP
udp: true
.. image:: 4effd839-3d1a-49ab-a9e0-9ad4f2a1434e.*
**Stats**:
.. code-block:: yaml
packets:
max: 140930
mean: 137099.0
min: 135620
unit: pps
**SLA**:
=========================== =========== ================== ======
Expression Concurrency Node Result
=========================== =========== ================== ======
stats.packets.mean > 100000 1 node-11.domain.tld OK
=========================== =========== ================== ======