zuul/zuul-jobs
Code Issues Proposed changes
zuul-jobs/roles
History
Felix Edel 7761396303 mirror-workspace-git-repos: Retry on failure in git update task 
We occasionally see the this task fail for the first element in the
zuul.projects list with a MODULE FAILURE and a return code of -13
(SIGPIPE) [1]. So far we couldn't identify the root cause, so try to
mitigate this issue by retrying on failure. This solution is similar to
the one used for the "Synchronize repos" task[2].

There is a bug report in Ansible that fits

Since it's only the first element in the loop that is failing while
subsequent elements are successful, we currently have two assumptions:

  1. As the task before is using a `delegate_to: localhost' [3],
     there might be a problem with Ansible when switching the connection
     from localhost to the remote host (node).
  2. Since the task before is using the same SSH connection [4] that is
     used by Ansible to push the git repository, there might be some
     "leftovers" on the connection that make the next task fail.
  3. There is also a bug report in Ansible [5] which might be causing
     that error.

[1]:
    {
        "ansible_loop_var": "zj_project",
        "changed": false,
        "failed": true,
        "module_stderr": "",
        "module_stdout": "",
        "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error",
        "rc": -13,
        "zj_project": {...}
    }

[2]: 3b3495e255/roles/mirror-workspace-git-repos/tasks/main.yaml (L32)
[3]: 3b3495e255/roles/mirror-workspace-git-repos/tasks/main.yaml (L25)
[4]: 3b3495e255/roles/mirror-workspace-git-repos/tasks/main.yaml (L16)
[5]: https://github.com/ansible/ansible/issues/81777

Change-Id: I0c4cb87bb076b9b40c9c446dbe5db437daff5897
2023-12-08 06:37:55 -08:00
..
add-authorized-keys
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
add-build-sshkey
Document algorithm var for remove-build-sshkey
2021-04-01 15:29:01 +00:00
add-build-winrm-cert
Add per-build WinRM cert generation
2022-04-13 15:04:51 -07:00
add-fileserver
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
add-gpgkey
add-gpgkey: trust incoming key
2022-05-05 14:40:00 +10:00
add-launchpad-credentials
Use Python 3.x with launchpadlib
2020-11-24 01:29:36 +00:00
add-sshkey
Add-sshkey: ensure that ssh home directory exists
2020-09-01 14:43:15 +02:00
ansible-galaxy-import
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
ara-report
linters: add names to blocks
2022-07-27 17:13:39 +10:00
bazel-build
Add Bazel build and ensure roles
2020-04-30 18:05:41 +01:00
bindep
Add names to include tasks
2022-11-07 10:37:53 +11:00
build-container-image
Gracefully handle use of intermediate registry in container upload role
2023-05-09 16:18:42 -07:00
build-docker-image
Merge "Add promote-container-image role"
2023-03-22 00:32:42 +00:00
build-puppet-module
Rename install-pdk-dependencies to ensure-pdk-dependencies for consistency
2020-04-04 15:41:29 -04:00
build-python-release
build-python-release: Add flag for whether to build a wheel or not
2021-06-08 14:24:44 -07:00
build-releasenotes
Run sphinx-build in parallel for releasenotes
2020-05-15 00:35:29 +00:00
buildset-artifacts-location
Fix RST formatting
2018-10-13 10:36:36 +02:00
cabal-test
cabal-test: add install_args and build_args role var
2021-03-04 07:51:13 +00:00
chart-testing
Move chart-testing to a role and disable version check
2020-01-09 11:46:41 -08:00
clear-firewall
Add note to clear-firewall docs
2019-07-25 14:29:52 -07:00
collect-container-logs
collect-container-logs: don't copy on failure
2021-04-20 12:10:02 +10:00
collect-kubernetes-logs
More E208 (22)
2020-11-09 14:40:00 +00:00
configure-mirrors
configure-mirrors: fix typo in 9-stream enablement list
2022-09-19 16:16:34 +10:00
copy-build-sshkey
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
create-afs-token
Be consistent about spaces before and after vars
2019-08-07 20:17:41 +01:00
deploy-openshift
More E208 (22)
2020-11-09 14:40:00 +00:00
destroy-afs-token
Add create / destory roles for AFS tokens
2017-08-28 13:53:10 -04:00
download-artifact
download-artifact: fix missed part of revert
2020-06-05 15:23:58 +10:00
dstat-graph
ensure-dstat-graph: pull updated branch
2021-10-22 18:31:10 +11:00
emit-job-header
linters: add names to blocks
2022-07-27 17:13:39 +10:00
enable-fips
Changes to make fips work on ubuntu
2023-02-23 11:50:37 +01:00
enable-netconsole
More E208 fixes
2020-11-03 10:04:27 +00:00
enable-ua-subscription
Add conditional for UA registration role
2023-02-23 11:40:06 +01:00
encrypt-file
Fix encrypt files stat validation
2022-03-17 10:56:13 -07:00
ensure-babel
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
ensure-bazel
Allow overriding of Bazel installer checksum
2022-09-30 10:45:31 +02:00
ensure-bazelisk
Bump bazelisk version to 1.11.0
2022-05-13 05:05:18 +00:00
ensure-cabal
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
ensure-chart-testing
Allow customization of helm charts repos
2021-02-18 09:07:06 +00:00
ensure-devstack
More E208 (22)
2020-11-09 14:40:00 +00:00
ensure-dhall
Remove some temporary files
2020-05-06 07:54:30 +02:00
ensure-docker
Fix ensure-docker for docker-ce 23.0.0 upstream packaging
2023-02-02 09:26:20 -08:00
ensure-dstat-graph
ensure-dstat-graph: clone from opendev
2021-12-07 13:04:11 +11:00
ensure-ghc
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
ensure-go
linters: standardise on newline at end of file
2022-07-28 16:19:06 +10:00
ensure-golangci-lint
golangci-lint: add job
2020-04-01 17:30:55 -04:00
ensure-haskell-stack
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
ensure-helm
Bump default Helm version to 2.17.0
2021-06-08 09:40:15 -04:00
ensure-hlint
hlint: add haskell source code suggestions job
2020-04-26 12:05:12 +00:00
ensure-if-python
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
ensure-java
Ensure-java: update apt cache
2022-08-15 10:54:23 -07:00
ensure-javascript-build-tool
Extract ensure-javascript-build-tool role
2020-05-12 07:53:14 +02:00
ensure-javascript-packages
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
ensure-kubernetes
Support ensure-kubernetes on bookworm
2023-08-14 11:15:36 -07:00
ensure-markdownlint
Add a markdownlint job and role
2020-01-27 12:23:24 +00:00
ensure-nimble
linters: add names to blocks
2022-07-27 17:13:39 +10:00
ensure-nodejs
More E208 (22)
2020-11-09 14:40:00 +00:00
ensure-nox
Add ensure-nox role
2022-12-15 13:22:49 -08:00
ensure-openshift
Fix ansible-lint name[template]
2022-11-07 10:37:53 +11:00
ensure-output-dirs
Partial address ansible-lint E208
2020-09-29 10:29:01 +01:00
ensure-package-repositories
Upgrade ansible-lint to 5.0
2021-03-17 15:44:43 +00:00
ensure-packer
linters: standardise on newline at end of file
2022-07-28 16:19:06 +10:00
ensure-pdk-dependencies
Rename install-pdk-dependencies to ensure-pdk-dependencies for consistency
2020-04-04 15:41:29 -04:00
ensure-phoronix-test-suite
More E208 (22)
2020-11-09 14:40:00 +00:00
ensure-pip
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
ensure-podman
Pin podman on jammy
2023-06-20 18:49:14 -07:00
ensure-python
roles/ensure-python: Fix 'python_use_stow' option
2023-07-11 06:17:29 +00:00
ensure-quay-repo
Skip quay repo creation if necessary info is missing
2023-04-28 15:08:04 -07:00
ensure-rust
ensure-rust: rework global install
2021-10-04 11:43:22 +11:00
ensure-shake
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
ensure-skopeo
ensure-skopeo: fixup some typos
2023-02-07 03:04:54 +00:00
ensure-sphinx
ensure-sphix: upgrade setuptools in venv
2022-04-13 20:35:46 +05:30
ensure-terraform
linters: standardise on newline at end of file
2022-07-28 16:19:06 +10:00
ensure-tox
Flip ensure-tox to tox v4 by default
2022-12-22 15:40:11 -08:00
ensure-twine
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
ensure-virtualenv
linter: Use capitals for names
2022-11-07 10:37:53 +11:00
ensure-yarn
ensure-yarn: run ensure-nodejs before
2020-05-01 17:07:48 +02:00
ensure-zookeeper
Fix zookeeper install on debian bookworm
2023-08-11 14:59:50 -07:00
fetch-coverage-output
linters: add names to blocks
2022-07-27 17:13:39 +10:00
fetch-javascript-content-tarball
More E208 (final)
2020-11-10 19:34:45 +00:00
fetch-javascript-output
More E208 (final)
2020-11-10 19:34:45 +00:00
fetch-javascript-tarball
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
fetch-markdownlint
fetch-markdownlint: do not synchronize owner
2020-05-18 17:04:10 +02:00
fetch-output
Partial address ansible-lint E208
2020-09-29 10:29:01 +01:00
fetch-output-openshift
Add names to include tasks
2022-11-07 10:37:53 +11:00
fetch-phoronix-results
fetch-phoronix-results: do not synchronize owner
2020-05-18 17:04:10 +02:00
fetch-puppet-module-output
More E208 (final)
2020-11-10 19:34:45 +00:00
fetch-python-sdist-output
Partial address ansible-lint E208
2020-09-29 10:29:01 +01:00
fetch-sphinx-output
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
fetch-sphinx-tarball
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
fetch-subunit-output
Update fetch-subunit-output to look for nox envs
2022-12-29 13:36:03 -08:00
fetch-tox-output
Move tox logs into env specific dirs
2022-12-07 13:54:23 -08:00
fetch-translation-output
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
fetch-zuul-cloner
More E208 (final)
2020-11-10 19:34:45 +00:00
find-constraints
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
generate-zuul-manifest
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
git-prepare-nodecache
Fixes all tasks should be named rule
2021-03-08 13:30:32 +00:00
go
Adds go jobs and roles.
2019-11-20 20:27:21 +01:00
golangci-lint
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
haskell-stack-test
haskell-stack-test: add build target job variable
2020-05-08 14:11:11 +00:00
helm-lint
helm: Add job for linting helm charts
2022-11-16 15:09:07 -08:00
helm-template
Drop Helm v2 support to fix v3 issue
2023-06-20 17:06:36 +02:00
hlint
linters: add names to blocks
2022-07-27 17:13:39 +10:00
htmlify-logs
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
intercept-job
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
js-package-manager
Remove --verbose from js_build_command
2020-05-18 11:00:42 -05:00
local-log-download
Use braces for 'file' var in download-logs.sh
2020-12-24 01:49:54 +03:00
log-inventory
Partial address ansible-lint E208
2020-09-29 10:29:01 +01:00
markdownlint
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
merge-output-to-logs
Revert "Refactor fetch-sphinx-tarball to be executor safe"
2020-10-14 13:54:22 -07:00
mirror-workspace-git-repos
mirror-workspace-git-repos: Retry on failure in git update task
2023-12-08 06:37:55 -08:00
multi-node-bridge
Use release CentOS SIGS repo to install openvswitch in C9S
2023-05-22 10:06:03 +02:00
multi-node-firewall
Introduce iptables_package var
2022-01-19 15:11:08 +05:30
multi-node-hosts-file
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
multi-node-known-hosts
linter: Use capitals for names
2022-11-07 10:37:53 +11:00
nimble
linters: standardise on newline at end of file
2022-07-28 16:19:06 +10:00
nodejs-test-dependencies
Add support for nodejs testing on Debian
2022-11-29 16:28:36 +00:00
nox
Add inline comment support to nox
2022-12-19 18:41:16 -08:00
npm
Fixes all tasks should be named rule
2021-03-08 13:30:32 +00:00
packer
linters: add names to blocks
2022-07-27 17:13:39 +10:00
pause-buildset-registry
Add pause-buildset-registry role
2020-02-24 17:17:12 +00:00
persistent-firewall
More E208 fixes
2020-11-02 18:38:54 +00:00
phoronix-combine-results
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
phoronix-test-suite
Add phoronix-test-suite job
2020-04-03 13:03:07 +00:00
post-reboot-tasks
Add ubuntu to enable-fips role
2023-02-09 19:02:00 +00:00
prepare-workspace
prepare-workspace: Add Role Variable in README.rst
2020-06-22 21:17:38 +02:00
prepare-workspace-git
Deprecate mirror-workspace-git-repos
2023-09-25 14:51:26 -07:00
prepare-workspace-openshift
Add names to include tasks
2022-11-07 10:37:53 +11:00
promote-container-image
Update promote-container-image to copy from intermediate registry
2023-04-12 11:36:26 -07:00
promote-docker-image
promote-docker-image: improve failure debugability
2023-02-08 08:26:07 +11:00
publish-artifacts-to-fileserver
publish-artifacts-to-fileserver: do not synchronize owner
2020-05-18 17:05:32 +02:00
pull-from-intermediate-registry
buildset registry: run socat in new session
2022-05-24 10:46:42 -07:00
push-to-intermediate-registry
push-to-intermediate-registry: look for container_images variable
2023-03-24 10:35:35 +11:00
release-afs-volume
Add role to do a vos release on an AFS volume
2017-09-01 16:40:40 -05:00
remove-build-sshkey
Document algorithm var for remove-build-sshkey
2021-04-01 15:29:01 +00:00
remove-build-winrm-cert
Add per-build WinRM cert generation
2022-04-13 15:04:51 -07:00
remove-gpgkey
Fix exec quoting in release remove-gpgkey role
2019-03-15 14:36:14 +01:00
remove-launchpad-credentials
Add roles for adding and removing launchpadlib credentials
2017-08-30 18:53:21 -05:00
remove-registry-tag
remove-registry-tag: no_log assert
2023-04-05 07:38:54 +10:00
remove-sshkey
Capitalize task names
2020-05-16 17:46:17 +02:00
remove-zuul-sshkey
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
render-diff
render-diff: fix typo in failure messsage
2020-09-03 16:30:15 +00:00
revoke-sudo
Upgrade ansible-lint to 5.0
2021-03-17 15:44:43 +00:00
run-buildset-registry
buildset registry: run socat in new session
2022-05-24 10:46:42 -07:00
run-dstat
Update dstat to support bionic and others
2021-10-22 12:51:41 -07:00
set-zuul-log-path-fact
Capitalize task names
2020-05-16 17:46:17 +02:00
shake-build
linters: add names to blocks
2022-07-27 17:13:39 +10:00
sign-artifacts
Record artifact checksums and signatures to stdout
2020-06-16 14:39:57 +00:00
sphinx
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
stage-output
Update to ansible-lint 6.8.2
2022-11-07 10:37:53 +11:00
start-zuul-console
Update ANSIBLE_LIBRARY to use envsitepackagesdir
2018-10-18 09:23:25 -05:00
terraform
Upgrade ansible-lint to 5.0
2021-03-17 15:44:43 +00:00
test-mirror-workspace-git-repos
Use zuul_workspace_root for prepare/mirror workspace test roles
2023-06-27 14:21:38 +02:00
test-prepare-workspace-git
Deprecate mirror-workspace-git-repos
2023-09-25 14:51:26 -07:00
test-setup
linters: add names to blocks
2022-07-27 17:13:39 +10:00
test-upload-logs-swift
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
tox
tox: Do not concat stdout and stderr in getting siblings
2023-11-24 06:32:19 +00:00
trigger-readthedocs
linters: add names to blocks
2022-07-27 17:13:39 +10:00
update-json-file
update-json-file: avoid failure when destination does not exists
2021-02-12 13:26:49 +00:00
upload-afs-roots
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
upload-afs-synchronize
linters: standardise on newline at end of file
2022-07-28 16:19:06 +10:00
upload-artifactory
linters: fix spaces between filters
2022-07-27 17:13:39 +10:00
upload-container-image
Gracefully handle use of intermediate registry in container upload role
2023-05-09 16:18:42 -07:00
upload-docker-image
Always log out of docker registry after upload
2020-11-12 14:01:57 -05:00
upload-forge
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
upload-git-mirror
upload-git-mirror: no_log around key writing
2022-07-28 09:31:49 +10:00
upload-logs
linter: Use capitals for names
2022-11-07 10:37:53 +11:00
upload-logs-azure
linters: add names to blocks
2022-07-27 17:13:39 +10:00
upload-logs-base
Add prefix to azure log upload
2022-09-26 10:54:46 -07:00
upload-logs-gcs
Add no_log to all log upload tasks
2022-11-16 09:11:12 -08:00
upload-logs-ibm
linters: add names to blocks
2022-07-27 17:13:39 +10:00
upload-logs-s3
Add no_log to all log upload tasks
2022-11-16 09:11:12 -08:00
upload-logs-swift
Add no_log to all log upload tasks
2022-11-16 09:11:12 -08:00
upload-npm
upload-npm : support authToken argument
2022-09-07 13:27:01 +10:00
upload-pypi
pypi-upload: support twine --skip-existing option
2022-11-08 13:26:22 +00:00
use-buildset-registry
use-buildset-registry: support microk8s
2023-01-09 10:37:45 -08:00
use-docker-mirror
use-docker-mirror: Also run task if docker_mirror is defined
2023-01-10 14:16:39 -06:00
validate-dco-license
Add validate-dco-license role
2019-01-09 11:39:02 -05:00
validate-host
Standarise block/when ordering
2022-11-07 10:37:53 +11:00
validate-zone-db
Fix check zone role for Jammy
2022-11-02 14:26:07 -07:00
version-from-git
linters: add names to blocks
2022-07-27 17:13:39 +10:00
wait-for-pods
Add the namespace in wait-for-pods role
2020-05-29 17:40:31 +03:00
write-inventory
Remove shebang from all python ansible modules
2022-09-15 13:48:10 -07:00
yarn
Fixes all tasks should be named rule
2021-03-08 13:30:32 +00:00
__init__.py
Enable Python 2.7 unit tests
2018-08-17 10:23:20 +10:00