52 Commits

Author SHA1 Message Date
Luan Nunes Utimura
e5c284bb0d Add missing qemu-utils package to Debian ISO
After splitting the virtualization packages (Libvirt and QEMU) from
`starlingx/integ` and moving them to `starlingx/virt`, it has been
observed that the `qemu-img` command is no longer present in the
platform.

By taking a look at the packages migrated from `starlingx/integ` [1] to
`starling/virt` [2], one can see that the `qemu-utils` package was left
behind in the middle of this process.

Therefore, this change adds the package to the Debian ISO.

[1] 2d3951f713
[2] 886d1cc759

Story: 2010317
Task: 47779

Test Plan:
PASS - Build qemu package
PASS - Build image
PASS - Bootstrap system with built image
PASS - Verify that qemu-utils was correctly added by running:
       $ qemu-img -V

Change-Id: Iccb7d5e127173339a18f549d306af01bd06e4f62
Signed-off-by: Luan Nunes Utimura <LuanNunes.Utimura@windriver.com>
vf/antelope
2023-04-20 15:52:42 -03:00
Luan Nunes Utimura
13a2cfc148 Remove unnecessary targets from QEMU build
This change updates the `0001-Customize-Debian-build-files-for-STX`
deb_patch for QEMU build to better filter the list of targets even for
the configure step.

It also reduces the build time by avoiding the generation and linking of
objects related to targets that won't be used by the package installed
on StarlingX.

Test Plan:
PASS - Build qemu package
PASS - Build/install image on AIO-SX
PASS - Verify that the package is installed in the system
PASS - Verify that stx-openstack sanity passes without new bugs

Story: 2010317
Task: 47666

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Signed-off-by: Luan Nunes Utimura <LuanNunes.Utimura@windriver.com>
Change-Id: I5ae5427271952d75f7d17b3a995d5bfdccbd803a
2023-04-19 13:53:33 -03:00
Scott Little
49d796e61f Update debian_stable_docker_images.inc to reflect libvirt relocation
A recent update relocated package libvirt from the 'integ' git repo
to the 'virt' git repo, but failed to update the docker image
packaging.

Testing:
    build-stx-images.sh: pass

Closes-bug: 2016907
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I7d650ee1257c703a3514b6f4c348e4020d138ed1
2023-04-18 12:51:36 -04:00
Scott Little
d00a058fab Several fixes to get thing compiling correctly.
Removed an erronious reference to integ from libvirt's meta_data.yaml.

Fix revcounts for relocated qemu and libvirt.

Added ${OS}_build_layer.cfg file so that the build system won't
ignore this repo.

Add a zuul setup.

Add minimal doc and release notes setup.

Testing:
build-pkgs -c -a: pass
build-pkgs -p libvirt,qemu: pass
build-iso: pass

Story: 2010317
Task: 47779
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: Id31df64f0182a6ae48ac4034100183e11218e988
2023-04-12 16:40:19 -04:00
Scott Little
1726c068b4 remove .zuul.yaml to permit importation to opendev
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I4a8b6dfd1373d87e1836a7edc4cd4bfbf912e92e
2023-03-31 14:13:28 -04:00
Scott Little
22e4a13542 Initial zuul, tox, gitreview settup
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I36bdbbd9cd9ae85e9c71163939c53cd6f9028943
2023-03-31 11:28:30 -04:00
Scott Little
886d1cc759 Config file changes to add 'qemu libvirt ' after relocation from 'cgcs-root/stx/integ'
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: Iec43ee082ad576832045e8a76008e5a503a76b37
Depends-On: Ifd002b037a537fbe2876ec72bc1c8982bc9ef61e
2023-03-31 10:56:45 -04:00
Zuul
d0f9716e80 Merge "Port stx-libvirt base image to stx-debian"
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: Ifd002b037a537fbe2876ec72bc1c8982bc9ef61e
2023-03-30 16:10:07 -04:00
Thales Elero Cervi
dfc90aee9d Port stx-libvirt base image to stx-debian
This change enables building the stx-libvirt Docker image within the
Debian build framework. It is now based on stx-debian and
following the new convention for StarlingX images.

Test Plan:
PASS - Build libvirt debian package
PASS - Build stx-libvirt image
PASS - Manually upload built image to a system, use helm-override to
       change the libvirt container image and apply stx-openstack
PASS - Ensure the libvirt Pod successfully starts and is running
PASS - Ensure libvirt Pod Liveness and Readiness probes are healthy

Story: 2010072
Task: 46974

Closes-Bug: 1998630

Depends-On: https://review.opendev.org/c/starlingx/tools/+/866411

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: I10112a0f1ab3a1f880ebc8b162c42b7b131d6aad
2022-12-14 11:05:01 -03:00
Thales Elero Cervi
365de7ff2a Debian: Add build structure for virt/libvirt
This change adds the necessary files for the libvirt package to be built
for Debian.
This change is the new approach for porting this package and will be
replacing an old change that will no longer be valid [1].

All the libvirt related packages (rpm) delivered on CentOS builds of
starlingx were verified to exist or have an equivalent package for the
Debian Bullseye (deb) distro [2], which is based on libvirt 7.0.0.

The upstream Debian packaging, patches and configuration will be used as
is, although the deb_patches directory will contain a patch to add few
starlingx specific files that are required, based on how stx-libvirt [3]
was previously built and delivered to CentOS.
This change will deprecate the starlingx-staging/stx-libvirt repository
and any future starlingx change to libvirt will now be placed here,
on top of debian/7.0.0-3 (bullseye) version.

Earlier (on CentOS) the base point was the libvirt 4.7.0 release and 17
starlingx specific commits were added to deliver new features or fix
bugs. Now, the base point will be the libvirt 7.0.0 release package
already prepared for Debian [4] and those 17 commits port will be
evaluated and done, in case they are still needed.

The patches dir will contain source code patches required for
stx-libvirt, that is, the code that was earlier added on top of 4.7.0
libvirt release to add StarlingX required functionalities.
The work done on this change is simply porting the code changes,
copying it and doing the minimum required updates when it is needed.
If more than one commit (from that list) can be placed on a single
patch, the patch description will contain all the necessary references.

The list of commits follow, where the "-" character indicates that the
commit was dropped now that we are based on 7.0.0:
-8c46e4 conf: Introduce VIR_DEFINE_AUTOPTR_FUNC for virStorageVolDef
-e8c2ae storage: add support for new rbd_list2 method
-dee98c storage: split off code for calling rbd_list
-956103 Revert "qemu: hotplug: Prepare disk source in..."
-97d02f STX: po make: limit thread creation ability of libgomp
-6e8f91 STX: Revert "vsh: Fix broken build on mingw"
 0d92d8 STX: pci-sriov perform limited retry on netlink failures
 c49366 STX: Increase timeout for connecting to monitor
 dedd07 STX: Stop processing memory stats if balloon info hard fails
-e0f897 STX: Allow vcpu pinning with TCG
 d8b544 STX: Adding systemd dependencies against pmon.service
-7bf5a9 STX: Set initial cpu affinity of qemu threads
 28b73b STX: Fixed default libvirtd systemd service
 e4c5a6 STX: DPDK parms handling
 fdf5e7 STX: Drop migration poll times to 10mS
 fbc79d STX: System Logging: set group read permission on log files
 2721c7 STX: CPU pinning not working over live-migration

[1] https://review.opendev.org/c/starlingx/integ/+/824928
[2] https://packages.debian.org/source/bullseye/libvirt
[3] https://github.com/starlingx-staging/stx-libvirt
[4] https://salsa.debian.org/libvirt-team/libvirt/-/tree/debian/7.0.0-3/debian

Test Plan:
PASS: Build the libvirt packages
PASS: Build Debian ISO with libvirt packages
PASS: Bootstrap Debian ISO on AIO-SX
PASS: Ensure libvirt packages are installed (apt list --installed)
PASS: Lock/Unlock AIO-SX *
* Future tests regarding the libvirt/qemu runtime features will be done
once all the pieces are in place in the ISO.

Depends-On: https://review.opendev.org/c/starlingx/root/+/865021

Story: 2010317
Task: 46391

Signed-off-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: Ib3da0e663336021fa2cfd6b400d1081fc0113348
2022-11-18 18:10:54 -03:00
Rafael Falcao
6c31d19c89 Debian: Add build structure for virt/qemu
This change adds the necessary files for the qemu package to
be built for Debian. This review follows the same approach
used on the virt/libvirt [1].

The base version selected comes from the Debian archive [2] since the
salsa-debian [3] version was not fully compatible with stx build tools.
The full upstream build was quite long (time) and big (size) so we
patched the Debian files with debian_patches to drop unnecessary
packages, that is, packages that starlingx does not need.

The patches dir will contain source code patches required for
stx-qemu, that is, the code that was earlier added on top of 3.0.0
qemu release to add StarlingX required functionalities.
The work done on this change is simply porting the code changes,
copying it and doing the minimum required updates when it is needed.

The list of commits follow, where the "-" character indicates that the
commit was dropped now that we are based on 5.2:

 d3400d STX: virtio-serial: don't touch virtqueue if vm is stopped
 71dc08 STX: Modify live migration auto-converge threshold
 9be81b STX: Suspend/Resume for VMs with PCIPT+Virtio
 876a3c STX: realtime uses mlock instead of mlockall
 007444 STX: qemu dpdk custom config
 3f6344 STX: add libdl
 dbda73 STX: qemu: add compile define for CONFIG_DPDK
 626bfd STX: qemu: add -enable-dpdk runtime flag
 79ea26 STX: qemu dpdk changes for openvswitch dpdk
 9c83db STX: migration thread affinity and priority qmp
 e7fbe5 STX: Add support statement to -help output
-48de9c STX: Changes for running on CentOS
-32b6f0 Upstream: Workaround: make sure vdev->vq[i].inuse never goes
        below 0
-246b26 virtio: Return true from virtio_queue_empty if broken

[1] https://review.opendev.org/c/starlingx/integ/+/863561
[2] https://snapshot.debian.org/archive/debian/20221109T211529Z/pool/main/q/qemu/
[3] https://salsa.debian.org/qemu-team/qemu/-/tree/debian-bullseye

Test Plan:
PASS: Build the qemu packages
PASS: Build iso with qemu packages
PASS: Bootstrap Debian ISO on AIO-SX
PASS: Ensure qemu packages are installed (apt list --installed)
PASS: Lock/Unlock AIO-SX *
* Future tests regarding the libvirt/qemu runtime features will be done
once all the pieces are in place in the ISO.

Depends-On: https://review.opendev.org/c/starlingx/root/+/864942

Story: 2010317
Task: 46390

Signed-off-by: Rafael Falcao <rafael.vieirafalcao@windriver.com>
Co-Authored-by: Thales Elero Cervi <thaleselero.cervi@windriver.com>
Change-Id: I424debf7eb24c024ba82a490cda746dbd5af0019
2022-11-18 18:10:18 -03:00
Scott Little
ec75ee133f Fix qemu and kubernetes build resource requirements
Qemu and kubernetes build failed to build under a 3 GB ramdisk.
The 6 GB ramdisk was ok.

Increase the minimum resources for these packages to 6 GB.

Closes-bug: 1964980
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I6027a4c02c15ef87a405ad300e967499c103b452
2022-03-15 11:39:08 -04:00
Leonardo Fagundes Luz Serrano
41a341369a Add debian package for virt/libvirt-python
Add debian packaging infrastructure for virt/libvirt-python
to build a debian package.

Verification:
- Built pkg
- Built image

Story: 2009101
Task: 44082

Signed-off-by: Leonardo Fagundes Luz Serrano <Leonardo.FagundesLuzSerrano@windriver.com>
Change-Id: I98e92b0dc095013ba452ec6bcf525f0e977c721a
2022-01-11 23:23:00 +00:00
Zuul
797b0127d6 Merge "remove /data which is not being used" 2021-08-19 02:28:02 +00:00
Bin Qian
41434787d9 remove /data which is not being used
Remove /data dir.

Closes-Bug: https://bugs.launchpad.net/starlingx/+bug/1940088

Change-Id: Ief68967da15ef142b5a24b0fb3b6ca04ad5d939d
Signed-off-by: Bin Qian <bin.qian@windriver.com>
2021-08-16 09:50:38 -04:00
Zuul
e0cf70581c Merge "Add auto-versioning to starlingx/integ packages" 2020-06-30 03:01:38 +00:00
Dongqi Chen
33b66a59b9 Add auto-versioning to starlingx/integ packages
This update makes use of the PKG_GITREVCOUNT variable
to auto-version the packages in this repo.

Story: 2007750
Task: 39951
Change-Id: I854419c922b9db4edbbf6f1e987a982ec2ec7b59
Signed-off-by: Dongqi Chen <chen.dq@neusoft.com>
2020-06-24 09:48:28 +08:00
Zuul
83ee48847e Merge "change tis patch version to 101 for below PR" 2019-07-26 15:26:04 +00:00
Sun Austin
f7790d5210 change tis patch version to 101 for below PR
https://github.com/starlingx-staging/stx-libvirt/pull/6

Revert "qemu: hotplug: Prepare disk source in
qemuDomainAttachDeviceDiskLive"
This reverts commit 192fdaa614e3800255048a8a70c1292ccf18397a.
According to https://bugzilla.redhat.com/show_bug.cgi?id=1672620
reverting this commit  will fix
https://bugs.launchpad.net/starlingx/+bug/1834194 and
reverting is official merged in libvirt-4.9.0 too.

Partial-Bug: #1834194

Change-Id: I0ea21e0b39ef016ecff113bb107b0667a2105424
Signed-off-by: Sun Austin <austin.sun@intel.com>
2019-07-05 18:46:51 +08:00
Zuul
891e25f4e4 Merge "libvirt and qemu patch reduction" 2019-04-29 14:40:28 +00:00
Jim Somerville
ae74dac5d5 libvirt and qemu patch reduction
Changes to support removing the RHEL patches include:
- drop systemtap from the spec file for qemu
- leave the man page name as qemu vs. qemu-kvm, man pages are not
  installed into containers anyway

Change-Id: I230f7213f9de50fc94b4ddbbb0ebd6581ee1f5a1
Story: 2005212
Task: 29990
Depends-On: https://review.opendev.org/#/c/655235/
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2019-04-23 15:37:42 -04:00
Don Penney
7012d1bfeb Remove pike/master files
This update removes pike and master wheel and/or image files,
as these have been replaced with stable/dev.

Change-Id: I02dfdd799c62f0b4028606b04ad6f125865769d9
Story: 2005248
Task: 30321
Signed-off-by: Don Penney <don.penney@windriver.com>
2019-04-03 22:30:59 -04:00
Zuul
46f45af5a2 Merge "Create the stable/dev wheel and image build files" 2019-03-22 18:19:23 +00:00
Don Penney
fbe2fd4121 Create the stable/dev wheel and image build files
This update supports the migration to stable/dev build streams by
setting up the stable/dev wheels.inc and image build files.

Change-Id: I2330be8a910245d434a9e0a116fa4db65f7212e8
Story: 2005248
Task: 30100
Depends-On: Ib5dc9a7c1d8c37368d073e28d83eeb883766ee3f
Signed-off-by: Don Penney <don.penney@windriver.com>
2019-03-20 14:09:34 -04:00
Chris Friesen
ae2b01c489 Formatting cleanups in libvirt hook bash script
Just doing some whitespace and variable expansion cleanups in the
bash script that were highlighted while doing a previous review.

Change-Id: I6a5a1e80057fbf6cb292fc0ed5415a26fb780958
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
2019-03-13 09:50:35 -06:00
Chris Friesen
ebbe3ae422 clean up unused libvirt hooks for emulated vTPM
The final upstream implementation for emulated TPM support in libvirt
has merged, and as such we no longer need to maintain our own hooks.

Let's clean up this code as it's no longer relevant.

Change-Id: I1c1ee1fa9f53c6c4cdaecc102bb05fe548ba9fb7
Story: 2005213
Task: 29991
Signed-off-by: Chris Friesen <chris.friesen@windriver.com>
2019-03-13 09:47:47 -06:00
Zuul
53d81fc8f8 Merge "Merge branch 'f/centos76'" 2019-03-12 01:18:36 +00:00
Dean Troyer
f49b153eb6 Merge branch 'f/centos76'
Change-Id: Ic27e6f02856eea90ffe12cf1b5204cb75f8d8157
2019-03-11 09:54:28 -05:00
Saul Wold
ff3ece59b8 Merge remote-tracking branch 'gerrit/master' into f/centos76
Change-Id: I73d792bb9b4bd10d3e1c0a81e73a2e853dd7fad4
Signed-off-by: Saul Wold <sgw@linux.intel.com>
2019-03-04 17:42:17 -08:00
Saul Wold
2a170ad956 Merge remote-tracking branch 'gerrit/master' into f/centos76
Change-Id: I1c7d7adf054471ef8a00bdc9ce9193dba83025a6
Signed-off-by: Saul Wold <sgw@linux.intel.com>
2019-02-12 08:02:41 -08:00
Scott Little
78a0beb992 Merge remote-tracking branch 'starlingx/master' into HEAD
Change-Id: I0fc135031ad40558f4227fb36905ae7b4a8cdc95
Signed-off-by: Scott Little <scott.little@windriver.com>
2019-02-04 12:03:27 -05:00
Zuul
a6dd633aaa Merge "Add low latency per-cpu power management" 2019-02-04 13:56:07 +00:00
Daniel Chavolla
8a5cd4383f Add low latency per-cpu power management
Refactor low latency compute per-cpu power management
out of stx-nova into libvirt qemu hook

Story: 2004610
Task: 28508

Change-Id: I80432b36c4e71d957db51f1742ef87fb519acce2
Signed-off-by: Daniel Chavolla <daniel.chavolla@windriver.com>
2019-02-01 14:27:10 -05:00
Dean Troyer
f52d1602f3 Merge remote-tracking branch 'origin/master' into f/centos76-merge
Change-Id: Ia834ef99c13cc8b842e6588233d10b9efe927b0c
2018-12-13 11:28:08 -06:00
Zuul
9b41946efa Merge "Upgrade qemu to version 3.0.0" 2018-12-10 22:04:10 +00:00
Jim Somerville
48045caaf1 Upgrade qemu to version 3.0.0
Note that it now uses keycodemapdb source which was upgraded
earlier.

Story: 2003395
Task: 24521

Change-Id: I551d654c4b5d7c923911d8c33f0b5fca022d1dda
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2018-12-04 15:24:11 -05:00
Zuul
684d802c9b Merge "Rebase openstack-helm and openstack-helm-infra" 2018-11-16 20:34:56 +00:00
Robert Church
5eefee9869 Rebase openstack-helm and openstack-helm-infra
The latest upstream libvirt helm chart now requires the cgexec binary
which is part of the libcgroup-tools package.

Change-Id: I6f5398a2788174f800612bc42226e8fdd26ab83f
Story: 2003909
Task: 27632
Signed-off-by: Robert Church <robert.church@windriver.com>
2018-11-15 23:55:58 -05:00
Don Penney
5cc80156fa Create stx-integ docker image directives file
This update adds the docker image build directives file for
stx-libvirt and creates the centos_pike_docker_images.inc.

Change-Id: I72409f0f321b6c315a62e540e79e5d716eb023ed
Story: 2003907
Task: 26788
Signed-off-by: Don Penney <don.penney@windriver.com>
2018-11-14 15:16:18 -06:00
Al Bailey
2f4a046b79 libvirt-python spec was failing to build
The py2_build_wheel macro was evaluating to a command
that failed to build libvirt-python.

libvirt-python has its own set of CFLAGS so those are
being used.

This also fixes the scenario where a non centos build env
would have been missing the BuildRequires for the wheel command.

Closes-Bug: 1799735
Change-Id: Ib9cf8a120069fa15f1832c925c2ba56c6ee8e971
Signed-off-by: Al Bailey <Al.Bailey@windriver.com>
2018-10-24 15:05:34 -05:00
Zuul
f4a6e1d78a Merge "Add hooks for python wheel generation" 2018-10-23 21:59:43 +00:00
Don Penney
93097992d6 Add hooks for python wheel generation
This update adds hooks to the spec files for the following packages
to generate wheels for the python modules:
- ceph-manager
- libvirt-python
- logmgmt
- platform-util
- python-3parclient
- python-cephclient
- python-lefthandclient
- python-ryu
- vm-topology

Change-Id: Ia63291e686818d19d0df52ff26b5f0bb3812b8ce
Story: 2003907
Task: 26787
Signed-off-by: Don Penney <don.penney@windriver.com>
2018-10-23 10:35:32 -04:00
Zuul
a6ab9eabde Merge "Upgrade libvirt to version 4.7.0" 2018-09-26 18:39:06 +00:00
Jim Somerville
96b7169893 Upgrade libvirt to version 4.7.0
Includes the libvirt-python package upgrade as well.  Note
that the generated package is now called python2-libvirt.

Story: 2003339
Task: 24377
Story: 2003396
Task: 24522

Depends-On: https://review.openstack.org/#/c/605230/

Change-Id: Iad2c521c2f2fc871589f793c5902555d3c3c41f4
Signed-off-by: Jim Somerville <Jim.Somerville@windriver.com>
2018-09-25 17:41:05 -04:00
Zuul
ac68a3d62a Merge "Merge remote-tracking branch 'origin/f/centos75'" 2018-09-20 04:44:47 +00:00
Dean Troyer
34c25b0944 Merge remote-tracking branch 'origin/f/centos75'
Change-Id: I93512a81ac4cc3e883c680bbb8366bf6d6e78437
Signed-off-by: Dean Troyer <dtroyer@gmail.com>
2018-09-19 14:36:01 -05:00
Dean Troyer
fb0980b7c3 Merge remote-tracking branch 'origin/master' into f/centos75
Change-Id: I166b99c4ce2ed458ac79ce686064ab05ad3ca198
Signed-off-by: Dean Troyer <dtroyer@gmail.com>
2018-09-15 01:18:37 -05:00
Dean Troyer
c8f0080bef Merge remote-tracking branch 'origin/master' into f/centos75-merge
Change-Id: Idf04b651ea1301745ad429a423b09d93543012e3
2018-09-02 15:42:07 -05:00
Sun Austin
fe8c8552c4 Fix linters issue E002 and E003 and linters check (none-voting)
E002 Tab indents
E003 Indent not multiple of 4

Story: 2003366
Task: 24424

Change-Id: Ie063ccfe346489f08c4752adaa344f5919db0378
Signed-off-by: Sun Austin <austin.sun@intel.com>
2018-08-31 04:08:52 +00:00
Zuul
7a5195c6d3 Merge "[upstream] Remove stx-integ/virt/libvirt/libvirt-2.0.0 Removing this directory because it is no longer used, as we are currently on libvirt-3.5.0" 2018-08-29 02:05:59 +00:00