73 Commits

Author SHA1 Message Date
Dinesh Garg
028fc00390 Allow GCP SDK and AZURE SDK image customization
Modify airship-images-publish playbook and makefiles to add
GCP_SDK and AZ_SDK variable to run the post job on internal
zuul setup

Change-Id: I516e71999330754dce6915c1da954492cb5a8f12
2020-12-09 10:26:12 +00:00
Anderson, Craig (ca846m)
f3ff01ae94 image-builder update for cloud-init integration
* Make kernel config available to kubernetes validation
* Install k8s via apt instead of curl
* Update sysctl defaults

Change-Id: I3f04973393e0a131afb30dc30869c859372ff812
2020-12-08 08:25:47 -08:00
Drew Walters
bc9931f1a2 Re-trigger publish jobs
This commit will be used to re-publish the image-builder job, which did
not successfully push to Quay because of a permission error.

Change-Id: I9d8634fb74e7e20438a517446571efad6901b54d
2020-12-04 23:17:32 +00:00
Anderson, Craig (ca846m)
e985e2ec86 Fix image-builder push args in makefile
Fix image-builder makefile arguments to match what the Zuul publishing
job expects.

Change-Id: Ib438399ac326a2b6ce73ab28e8b5b8d9dedd39c8
2020-12-04 12:45:20 -08:00
Zuul
0310c23b29 Merge "image-builder for ubuntu based airship hosts" 2020-12-04 19:38:04 +00:00
Craig Anderson
caa1cffc0a image-builder for ubuntu based airship hosts
Builds ephemeral ISO and target host images.

Also replaces isogen (iso-builder) with a single ansible-driven build
tool for both types of airship images used: ephemeral ISO as well as
target QCOW2 images deployed to base nodes.

Change-Id: I6d0368de771869e4e645a03d8a20f470b34602ab
2020-12-03 23:16:14 -08:00
Sreejith Punnapuzha
c234d23d0c Fix docker registry value for zuul job
* correct docker_registry value for zuul so that docker push works

Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
Change-Id: Ic9f225ed25d77732913472c14cb0ba2d82d5692b
2020-12-02 17:12:34 -06:00
Sreejith Punnapuzha
38fb8b8bc6 Fix image publish issue
* correct docker_registry value for zuul so that docker push works

Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
Change-Id: I76323da82a6adc9bf15ea21088b6884bed18ff2f
2020-12-02 15:09:01 -06:00
Battina, Sai (sb464f)
2abedb9a03 Update ironic-python-agent image
Change-Id: Ia75bbae75dabba528f6aaf398258593fb214dbcf
2020-12-01 17:42:00 -06:00
Dinesh Garg
91fc0d5017 Allow proxy and container repository customization
Modify airship-images-publish playbook and makefiles to add
proxy variables to run the post job on internal zuul setup

Change-Id: I3a5e55c9a64a0d7bef5f0f252f00b28a072c2fa1
2020-11-18 15:34:41 +00:00
Ratnopam Chakrabarti
3b351b1aa1 Bootstrap container for openstack provider (capo)
This patchset provides the Go code and scripts for the
Bootstrap container for Openstack.

The Bootstrap container for Openstack provider accepts
three commands: create, delete and help.
- create - creates an Ephemeral K8S cluster in Openstack
- delete - deletes the Ephemeral K8S cluster in Openstack
- help - Stdout the help text for usage of the bootstrap container.

Documentation is available at bootstrap_capo/README.md

Change-Id: Idd444834070b84170f18561626c487e23a3ca951
2020-11-10 13:16:47 +00:00
Sreejith Punnapuzha
32374c3293 Enhance ironic image
* Add sushy tools to ironic image build

Change-Id: I1936007a18fa6c5d322831b4a2fb669b61063f2a
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-11-05 16:44:14 -06:00
Zuul
b46220c4a2 Merge "Bootstrap container for Azure" 2020-11-03 02:25:06 +00:00
Sidney Shiba
58f39ffa95 Bootstrap container for Azure
This commit provides the Go code and scripts for the Bootstrap container
for Azure.

The Bootstrap container (bootstrap_capz) for Azure is designed to accept
three commands: create, delete and help.
- create - will create an Ephemeral AKS cluster in Azure Cloud
- delete - will delete the Ephemeral AKS cluster from the Azure Cloud
- help - Stdout the help text for using this container.

Please, refer to the bootstrap_capz/README.md for further details.

Change-Id: Id1947f7b831a5d6cf59296cf39ff2b436080483d
2020-11-02 14:54:04 -06:00
Sreejith Punnapuzha
c589852327 increase timeout for image publish job
This commit increases timeout from 1800 to 7200 for image publish job
since image publishing is getting timed out.

Change-Id: I7bcc0568b60be0d2ca6c3dbf2c7bf49092721581
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-30 14:04:16 -05:00
Sreejith Punnapuzha
1f251827ea Add image name to Makefile
This commit adds image name argument to Makefile so that image name can
be parameterised

Change-Id: Ie91f24f8d53705435b2e7bcb09007340533f3fc1
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-30 11:22:58 -05:00
Sreejith Punnapuzha
e381e255eb Fix Makefile for ironic image build
This commit fixes image tag and image name for docker push in make file
for ironic image

Change-Id: Ie2f9dceecc4742eba55479914109c12615826c88
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-30 08:36:23 -05:00
Sreejith Punnapuzha
0e77470ca9 Parameterize from url in apache dockerfile
Change-Id: I282f5c1f9b9ba38b1a1856fca4a755480d808cca
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-29 13:22:15 -05:00
Sreejith Punnapuzha
d34c3283ff Change user creation from adduser to useradd
This commit changes user creation from adduser to useradd so that docker
build will not wait for user information

Change-Id: Ia0d24be8139a97cb51e15456176c172974a56c3a
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-28 16:51:37 -05:00
Sreejith Punnapuzha
f16bd23f21 Fix Makefile for bootstrap_capg image
This commit fixed the image name in docker push for bootstrap_capg image

Change-Id: Ibf36d831315a3f107a016f24cc482fe87ad7004f
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-28 13:01:17 -05:00
Sreejith Punnapuzha
b7bcc0924d Ironic and dependency images
* Add script and dockerfile to build ironic image using loci image
    build
  * Add dockerfile for apache and dnsmasq
  * Add make files and readme for all images

Change-Id: Ia37b4608116b5705512faec1d966b45e413a1760
Signed-off-by: Sreejith Punnapuzha <sreejith.punnapuzha@outlook.com>
2020-10-27 10:35:40 -05:00
Sidney Shiba
aa624ce27c Bootstrap container code for GCP
This commit provides the Go code and scripts for the Bootstrap container
for GCP.

The Bootstrap container (bootstrap_capg) for Google Cloud is designed to
accept three commands: create, delete and help.
- create - will create an Ephemeral GKE cluster in Google Cloud
- delete - will delete the Ephemeral GKE cluster from the Google Cloud
- help - Stdout the help text for using this container.

Please, refer to the bootstrap_capg/README.md for further details.

Change-Id: Ifad7c7a7fede0230029716c9e093449f5886e859
2020-10-15 16:10:08 -05:00
Alexander Noskov
f45d429c3c Adding functional test for ISO image
This change provides functional testing for both UEFI and legacy boot mode.
This test builds an ISO image, run VM with a predefined IP address,
and checks SSH connectivity.

Change-Id: I498b78b4264a2f373837e3267a58b4309c8588fe
2020-09-02 10:12:24 -05:00
Alexander Noskov
afb1093f1a Rename isogen directory and fix iso name in docs
Since we moved from Debian to Ubuntu we need to
align it with docs and directory structure.

Change-Id: Ib13eedb1a33d6913c72d15405458bf71feb16891
2020-08-17 16:14:12 -05:00
Alexander Noskov
5e55597fbc Add UEFI support for Ubuntu live image
Change-Id: I6f5e8f86c246407d407c0ec74b8cb790a97fa7ec
2020-08-11 19:57:22 +00:00
Zuul
0de6f688d5 Merge "Add readme for ipa-downloader-image" 2020-07-24 22:03:26 +00:00
Zuul
4f1aa11b0e Merge "Remove the depth argument while git cloning" 2020-07-24 22:03:25 +00:00
Zuul
024aacec2e Merge "Minor documentation fixes" 2020-07-24 22:03:25 +00:00
Zuul
e30f9eebe9 Merge "Shorten version strings" 2020-07-24 21:59:03 +00:00
Zuul
de9737aab2 Merge "Add Ubuntu based isogen" 2020-07-09 14:34:09 +00:00
Ian Howell
f90d7cd20d Shorten version strings
This fixes the following issue in which the unique version created for a
git repo chart results in a name that is too long for kubernetes.

  Invalid value:
  "provisioner-3.0.0_source.ffc0607e10d59e4240e838af27fb821bce8f3653d340c7353df63653603b54f5":
  must be no more than 63 characters

Change-Id: I81032ffdd16a0de8faa51cfc3e218d066e9cc711
2020-07-08 13:18:34 -05:00
Nikolay Fedorov
3ca141f151 Add Ubuntu based isogen
CR made over debian-isogen for minimizing size and diff
Late, it should move to "ubuntu-isogen" folder

Change-Id: I44e9e55a1fa51e5ebba9ea80f189d793584ec646
2020-07-08 19:50:45 +04:00
Ian Howell
188512c9ba Remove the depth argument while git cloning
The depth argument is incompatible with cloning a specific commit. This
change removes the argument.

Change-Id: If8a855407ca383d046615ae2a4b8992d2e4b34fd
2020-07-06 13:13:25 -05:00
Ian Howell
9f2d5bfb20 Minor documentation fixes
Change-Id: If3c1abb34dcde12d8e704dbc60b64f5d19efd13a
2020-07-06 12:54:14 -05:00
Ian Howell
116eb2cc93 Add a Helm chart collator
This adds a Dockerfile for an image which works as a Helm chart
repository. Charts can be pulled from either pre-existing
Helm repos or from git repos.

Change-Id: I860394eea3c322f2b142ea00dd7cc0a6916c34d5
2020-07-02 14:27:46 -05:00
Ian Howell
6a98b4cc7e Fix image build checks missing setuptools
Use apt to install python3-pip, and use pip3 in event system has
both pip2 and pip3 installed. Use apt to install setuptools for
Ansible's consumption.

Change-Id: I3e0656acc41d0b0457bf77b89231fbc2763d698e
2020-06-17 10:42:51 -05:00
Alexander Noskov
eec2dc44e0 "debian-isogen: Remove unstable repository"
This reverts commit 3a38b534d193b7ff768a19ff840adf219aad5778.

Change-Id: Ifbcd5734760e1f6ae9552c68860ade69325f7a2b
2020-05-21 16:04:24 +00:00
Zuul
31f1555ba8 Merge "Update Airship vulnerability link" 2020-05-19 14:57:06 +00:00
Drew Walters
3a414f3654 Update Airship vulnerability link
The Airship vulnerability documentation has moved [0]. This change
updates SECURITY.md to point to the correct location.

[0] https://docs.airshipit.org/learn/vulnerabilities.html

Change-Id: Iea843a3399bc7836f5645c3ca81603e2e9ca7356
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-05-18 21:26:04 +00:00
Kostyantyn Kalynovskyi
3a38b534d1 Revert "debian-isogen: Remove unstable repository"
This reverts commit bca69c18937428afcf3e30a658665d810d7657b9.

Appears that unstable repository has been fixed. We should revert this
and find a solution from where to install or build  new version of
cloud-init instead of the one that comes from unstable repository.
Version of cloud-init that comes from stable repository, is old,
and doesn't support openstack network data properly

This is temporary fix, new issue will be created and address in
airshipctl repository

Change-Id: I02e95f8a4a84ba0c8238634abd3d9460caa62819
2020-05-15 15:30:55 -05:00
Drew Walters
bca69c1893 debian-isogen: Remove unstable repository
This change removes the unstable Debian repository that was added to
install cloud-init. Cloud-init is available in the stable repository at
the time of this commit.

Change-Id: Id51a1c7b60595630ace664038db31a71a07e4c6a
Signed-off-by: Drew Walters <andrew.walters@att.com>
2020-05-14 21:51:35 +00:00
Alexander Hughes
6c5cf09641 Revert "Specify user for Docker containers"
This reverts commit 552abb2a4668184de6652292443b9cfca0ed97ea.

Change-Id: Ia7b4951e589365a5ecf3b57836a355763b981368
2020-05-01 16:43:40 +00:00
Alexander Hughes
552abb2a46 Specify user for Docker containers
Change-Id: I7aab03bb17a2e0d3e3951922b357c6bfbf1c7f20
Signed-off-by: Alexander Hughes <Alexander.Hughes@pm.me>
2020-04-29 11:02:02 +00:00
Zuul
374ad76870 Merge "Use ensure-* roles" 2020-04-28 14:52:13 +00:00
sai battina
78f9b4dd58 Add readme for ipa-downloader-image
Change-Id: I367e81d893b2e38615041a699e5bb9c206584815
2020-04-23 14:22:08 +00:00
Roman Gorshunov
8c0b13b738 Fix docker-credential-helpers error in gate
Without pass package installed, docker-docker-credential-helpers drops
the following error message on running docker build:

the free(): invalid pointer
SIGABRT: abort
...

GitHub issue #103 in docker/docker-credential-helpers.
Ubuntu Launchpad Bug #1813003.

Change-Id: I9d3ff4773736a784cef16611453d4f4d47a34187
2020-04-23 14:08:18 +00:00
vass
eefa38ed9f Use ensure-* roles
The install-* roles in zuul-jobs have been renamed to ensure-*, follow
the rename.

Change-Id: Idede90919aaebf5a1416577f0511057527285d46
2020-04-21 21:16:01 +02:00
Vamsi Savaram
8cbd40cbc5 Gather container logs in check pipeline
This PS introduces two new roles:

 - airship-images-configure-docker:
     Configures docker logging driver to journald

 - airship-gather-runtime-logs
     Collects all journald logs for docker and containerd

Also changes have been made to debian-isogen Makefile
to completely output docker build logs instead of just
image ID.

Relates-To: #89

Change-Id: I435106b2ad15921367174446707179f157df7946
Signed-off-by: Vamsi Savaram <vamsi.savaram@gmail.com>
2020-04-14 16:20:54 +00:00
Kostiantyn Kalynovskyi
ebefeeadef Fix console logs for libvirt hosts
This commit adds parameters to start command line that would allow
console logs to be written into files on host OS when running resulting
images on top of libvirt.

Change-Id: Icc83e45c27876a2a36729b92f69ccbd59dbf24e4
Relates-To: #167
2020-04-10 12:19:12 -05:00
saibattina
250e01b208 Add ipa-downloader-image
Change-Id: I5302a362509fac88f6b86921161dc8e0bdb72b19
Signed-off-by: Pete Birley <pete@port.direct>
2020-03-31 15:24:16 -05:00