ansible: Enable Rocky PowerTools on Rocky Linux 8

This repository provides packages used by the babeltrace role,
eg. python3-sphinx.

Change-Id: I9817b13dfd0f93227f26bc1caad98a3d9f1721cc
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add Rocky Linux support to cross-compilers role

Change-Id: Ibb8d815ebdd358701d7bd6bc128d819b3b31a04a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add Rocky Linux support to compilers role

Change-Id: I6b632ab04d451d9eb607c8ccb94369bc395a0b45
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Correct typo in post-image-clean play

Change-Id: I585afc12fd925098212b08566ba41c0a5b67acf9
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add imagebuilder job for Rocky Linux

Change-Id: I1d2660bf36f9f145ce7f9b03e86f2663b3ed6938
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: librseq: add review portbuild job

Also remove the touchstone, they slow things down and we have plenty of
builders now.

Change-Id: I675263ca09f4052acb698a2c927ab1765beb49b0
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Required kernel headers for SLES

Change-Id: I699700c6054af13bda8b1cb68743aad3619e9e4a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add root_slesbuild jobs for sles15sp4

Change-Id: Idd3a844d2701003b403fa583175af9796166fa2f
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add play to snapshot rootnodes

Change-Id: I4bb1deaaf01c01ff97537c020ba73827260568c1
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Use alternative log4j classpath on sles 15.4+

A fresh installation of SLES15SP4 doesn't have the symbolic links that
exist on ci-node-sles15sp4, eg. `/usr/share/java/log4j-1.2.jar` ->
`/usr/share/java/log4j12/log4j-12.jar`.

I suspect that the symlinks were installed manually at some point to
simplify the build scripts. As the complexity is already added to
support SLES15SP5 from fresh installations, the proper locations for
log412 can be used on SLES15SP4 as well.

Change-Id: Id2747abd029a4b4978dd6f0214f5ed3ab1bb267c
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add sles15sp4 rootnode

Change-Id: I505912b38968535aa20c464fbd06ae6f0202ec05
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: add librseq role

Add the role to install a new optional build dependency
'libseccomp-dev'.

Change-Id: I470cdc1478109dd85f0b4f354e6d7fe27e0bd1ec
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Remove installation of curl from bookworm-backports

The configuration adjustment should be sufficient to avoid the
problem. It's not a big issue to use curl from bookworm-backports
otherwise, but the 'apt: upgrade' statement means that all the package
updates get run, violating an expectation for the default playbook
that only new packages will be installed - no updates should happen.

Change-Id: I8c083aa4d6a5d0a61a3924f52f295eab15467354
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Use java 1.8 with SLES builds

Change-Id: I087b79efbd3490f9a854625beb8c29fec082ecb5
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Ensure jq is installed on SLES12SP5

Change-Id: Ib66d4a7e5984c5d548a16448efbe6345ae288fa1
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Install java 1.8 on SLES nodes

Change-Id: I1bc39aa6b8e57a1ade363e14f8255a3ef439c58d
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Ensure maven is installed on SLES 15

Change-Id: If812dde2f528f36e8dd55f2a46f2c14a68aaeae6
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Install log4j12 on Suse nodes

This package is also required to build lttng-ust with the java agents
configuration.

Change-Id: I72d5d12f0185a7e99d40095ac7d42e9afade9035
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Gently stop instances before publication

Avoids potential issues with changes not being fully written to disk
in teh result image.

Change-Id: I0dab01038870cbc798560863de1971a3a124983a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Update java CLASSPATH for sles15sp5

Change-Id: Ic1a34fc505d1a47c1fe3021ac2b834aa68af0581
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Install bzip2 on nodes with the developer role

When vlttng fetches releases, it downloads 'tar.bz2' files which
require the libraries to unarchive them.

Change-Id: I227884490be18f0320d39b8cf4be3126223253fa
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add jobs running on sles15sp5

Change-Id: I0b699241def81453abc19334e6ef32c99b650515
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add host for sles15sp5

Change-Id: I8b6ecbed08485554da53e532723e1a18208a1e50
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add job to build sles15sp5 images

Change-Id: I933e918f1123aa363b3d2903fa1045d013a311ef
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Ignore failures when clearing history during image cleanup

Change-Id: I21b85ec6e05cc66f0874636cb212db39c8244aca
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Switch SLES product registrations to use common task

Change-Id: Ide81884d4bf64e61f0d824668455d78235715c71
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Check for SLES product using major version

docker is provided by the `sle-module-containers/12/x86_64` not
`sle-module-containers/12.5/x86_64` on SLES12 SP5.

Change-Id: Id4c2596f0954839ca8baaf0be8661c09790a8774
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Use SLES15 variables for all Suse variants in developer role

For the moment, the current overload is quite specific, and making it
more general allows the same content to be used to support SLES12SP4.

Change-Id: I9e9064912477366dde60b7f99ce7c7bb1233bdfb
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Correct variable filename for SLES12 in common role

Change-Id: Ic0e1e7e0d2293593d32d8ac2a1f6e712f30efb33
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Support Ubuntu in docker role

Change-Id: Ib68bfe59fc1c8da177ed1780876c01029478f1e8
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Remove python interpreter limit for installing vlttng

The main issue with installing it was when to add
`--break-system-packages` or not, but that ended up being well
addressed in the `extra_args` parameter.

Change-Id: I50f0851247b542891f008221866e07b446ba567d
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Support Ubuntu focal in cross-compilers role

Change-Id: I05ebf398d0732fcda8eaa1583f5b7efb183f6072
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Support Ubuntu focal, jammy, and noble in compiler role

Change-Id: I2d4e4878c761650779dd0678d030fc651cf9b885
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Limit deploying LTTng-CI PPA to Jammy

The PPA only provides packages for Bionic and Jammy at this
time. Bionic is not going to be supported by the ansible scripts.

Change-Id: Ifc28fae75b94a49840c0efc887631fd49d712efe
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add job for building Ubuntu images

Change-Id: I3b59a30b461ab170073234cd0d7737e27c755875
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

lava: Remove apt update & upgrade from lava setup

The `apt-get upgrade` will block waiting for user input unless `-y` is
specified, causing builds to time out when there are actually updates
to perform.

Rather than forcing the command to run in non-interactive mode, I
decided to remove the update and ugprade. My principal reasoning is
that most of the jobs no longer require extra packages to be installed
at run time - they are included instead in the rootfs.

Change-Id: Ia9d76aa6ddda9b1a06b27125dca10f92b0e8c2fa
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: restrict mode on internal certificate private key to user

Samba asserts that the mode is 0600, not 0640.

Change-Id: If6ca4dba54726c29caba18575f9c0796d14a6b79
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add configurable path prefix for the internal certificate

This allows a task or role to change the variable and deploy the files
in another location. Eg., for samba they can be deployed into
/etc/samba/tls instead.

Change-Id: I0ee629e7b83f2ef4304948aa2627100ebe1b8cef
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Update matchStrs for Ubuntu focal kernels

Change-Id: I5e8763951e8b4720a9dfb87c61e4de82dc5f4c01
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add lttng-modules jobs for Ubuntu noble

While Ubuntu noble isn't yet released[1], the groundwork can be laid
to start running our CI tests again the kernels they may use.

[1]: https://discourse.ubuntu.com/t/noble-numbat-release-schedule/35649/4

Change-Id: Id2e1d6f4698fa43449b081b635dbb4c460495f33
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add mirror Ubuntu noble kernel sources to git-mirror

Change-Id: I37c2a78d3f3c9fc970375cfaa6219ebf21aeadbc
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add dev_review jobs for lttng-ust-java-tests

Change-Id: I294802750dd560c56690751bb279f78270030ed2
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Test newly published images before changing aliases

Change-Id: I20d8eaf171508ff43cf31b7d89b271741fdf323b
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add support for SLES to docker role

Change-Id: Ie217bf343e8d7564cba800818cf5bb3ccc087a97
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add SLES support to developer role

Change-Id: I710a9fd8f84789bb2617255e045a36f4af784f37
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add support for SLES in i386-libs role

Change-Id: Ib2629466f055188fb1f5bd7dd0f41496f93775cd
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Allow cloud-init status to complete with an error for images

Change-Id: I7b63d76a9ce61a3cf19b2ab8f75742dde42e51a2
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Correct runcmd to deploy SSH public keys in profiles

`authorized_keys` should be a file, not a directory.

Change-Id: Ia8d250149b77f6e812a311509e70900f2a975c9b
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Reduce output when downloading go during distrobuild

Change-Id: Ia30dc11a07ea691077ca82faa8633ad1068e96e6
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb/ansible: Add support for building SLES images

Change-Id: I89af9759bb7b3c8352ea19f1f6890842cb4efe9a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Use image type to different vm and container distrobuild images

Our lxd instance doesn't support applying the same alias to multiple
image fingerprints at this time.

Change-Id: Id12ade8f6ea1c00be10bc33528448f5b0c016f37
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Support release specific distrobuilder files

Change-Id: I9f692b483356cc7f6d40f5e39372c7f633b623d3
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add dev_review_lttng-ust_lttng-tools_master for SLES

Change-Id: I20d3b65b2ffb343a16b92a39fc77f1f958733f1a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add support for SLES 12

Change-Id: I5cbc69edd7673e0bc1375f1a6720b96665d5f30f
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Register SLES nodes if necessary

Signed-off-by: Kienan Stewart <kstewart@efficios.com>
Change-Id: Iae950177ebddf2ecec67f9f719d088051cdaee2f

ansible: Activate supplementary SLES repos using suseconnect

Change-Id: I25ce4a9c6a4d47efc478b559adf7bef3c37660fa
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Install compilers on sles nodes

Change-Id: I1c487cc929ab661c091812b7ff6e9730e6bf648d
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Remove corrupted YAML when parsing TAP results on lttng-tools

While `stdbuf` helps, it doesn't guarantee that the YAML sections in
the TAP output are parseable.

Requires: jenkins-job-buidler with the following patch:
https://review.opendev.org/c/jjb/jenkins-job-builder/+/906536

Change-Id: Ibf9780fef5334d1c2abfe4a339776c40e822824a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Disable TAP timing on slesbuilds of lttng-tools

The tap results regularly have malformed YAML which causes the builds
to fail spuriously.

Change-Id: I53f28d01eb5f126d7d6803846353852bdaf2065f
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add dev_review_slesbuild for lttng-tools

Signed-off-by: Kienan Stewart <kstewart@efficios.com>
Change-Id: I5b4a78c9c4f28f050bfd19e250a81d7f51083ec7

jjb/ansible: Test lttng-ust-java-agents on slesbuilds

Change-Id: Ie3b77a9ed6276a73bc3446825c5017c67066aff2
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Update host names for SLES ci nodes

Change-Id: Ic52654e46d4e64a2deb5a0f255fa8fb026966c23

jjb: update yocto powerpc and ppc64 to kirkstone

Change-Id: Iab8529b9f716c57e5661779ebfb1ef97d63815e1
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

lava: Use custom timeout function for make check

This allows us to send SIGABRT and get coredumps for the state of the
binaries that are interesting.

Change-Id: I5304b4856a80f25389180b36c6666cf60cfbd4a7
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

Merge "jjb: babeltrace: add shellcheck to lint jobs"

jjb: babeltrace: add shellcheck to lint jobs

Change-Id: Id709f4982c66a11ae0188f257e21a9332c6fb85b
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

ansible: Deploy combined key+cert for haproxy

Change-Id: I7cbb2dee54b8322b1acbcfd440cbbf1efce302d6
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Update internal ssl cert for 2024

Change-Id: I0cc49f9fb2a963f0e12c5e6405da42189e79f750
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: test lttng-modules review jobs with the latest kernel rc

This helps in situations where an RC as just been released and that
the incoming review commit(s) that are run by the CI need to check
that version.

Change-Id: I363469fadeb7c0219c52aa0b4521a45ee0edfd10
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add docker role for developer nodes

Change-Id: If8df43b443c547f9229c8502146c4c2b9456afc2
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Limit gcc cross from bookworm snapshot to bookworm nodes

Change-Id: I572ec2499555739e7e0245f93bf0ac50efc14f60
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Use a more generic condition for installing linux headers

When building ci-node or developer images, the linux headers weren't
being installed as the node wasn't in the node_standalone group.

When the node is a virtualization host or a KVM guest, the headers
will be installed.

Change-Id: Ic19459fc6c3f7c0b47541ffb194640f01e517986
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Exclude cross compiler packages not available in Debian/i386

Change-Id: I05ee89ccf407b42ee026d3c5eb70549a05037016

ansible: Add support for Debian sid

Change-Id: I1debfebc84926c5a1f0621607a3e706b3b444b65
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add support for Debian trixie

Change-Id: I7ab2688ae11c71fcfd0893a2fdd1dfaa110bab74
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add support for Debian 11

Change-Id: Ia6a3202f5fdf130b8fc2103f7ce2c30bbf2af099
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Add jobs for building ci/dev images

Change-Id: I68ec852b8dcf4775966b8bfb4a53e1d539b58d2b
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Remove lttng-analyses role

lttng-analyses is archived and not currently maintained

Change-Id: Iae8c3172255088bec82f34fac907e05d6c206a61
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Remove lttng-analyses jobs

lttng-analyses has been archived and isn't currently maintained

Change-Id: I5d9dc404cfd4557dcab233e814910ee05a1e400d
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Install gcc5 on Debian 12 CI nodes

lttng-modules crossbuilds for arm64 were failing for kernel versions <
4.4, principally due to gcc < 5.1 being explicitly denied in
lttng-modules.

To recover compilation coverage for these versions on this
architecture, gcc 5.5.0 has been built and deployed via ansible on to
the deb12-amd64 nodes.

The compilation coverage is not quite as large, as support for gcc 5
was only introduced in linux 3.18.

Fixes: support #1604
Change-Id: I49e7fc9d081c0b86cb25487d161efc3d1cf8f484
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

lava: Install vlttng inside a venv

A number of the lava jobs were failing as the python tests couldn't
import the `bt2` module. While it may be possible to improve the
behaviour of vlttng to better address the situation two elements
combine to make the process work more systematically:

* Install `vlttng` inside a venv instead of using the
`--break-system-packages` option: once activated, this will set an
initial value for the `PYTHONPATH` environment variable
* When `vlttng` is invoked, since `PYTHONPATH` is no longer empty, the
value will be updated correctly.

In the case of the new rootfs, it also appears to be necessary to
ensure that `setuptools` is using `distutils` from Python stdlib,
although the module is deprecated and will be removed in Python 3.12

C.f. https://peps.python.org/pep-0632/

Signed-off-by: Kienan Stewart <kstewart@efficios.com>
Change-Id: If0aefb72f5c37721f88b49bd4a841b5ce61f46a0

lava: Wait until time is synchronised during test suite cleanup

Change-Id: I85d426b9167eb53777d0684d4f7f3249a6a48f3a
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

ansible: Add cron job to reboot armhf nodes that have gone read-only

Change-Id: I4f2c38244bf4135600e1e33bf9c4fe76be1de740
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: lttng-ivc: use 'lttng' upstream repo for lttng-ivc

Change-Id: I6a9acb70983e7e4bf88210a2b596ae8f5685f4f4
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: babeltrace: remove unused mjeanson dev jobs

Change-Id: I83e3fdb903bbce26d51383ba653e297e08d949a3

jjb: fix memory printing on FreeBSD

Change-Id: I0f5b56d9008e08134f81563d9c54f1bb15cb843b
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb/lava: Update system tests to use Debian bookworm rootfs

Signed-off-by: Kienan Stewart <kstewart@efficios.com>
Change-Id: If40992f99c7b484351b2f54255fc37c4d89eed8b

lava: Upload artifacts as a separate test

Change-Id: I6736aa3d1e807ef26451008cc5e2ec2f6aa93de8
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb/lava: Correct YAML loading for lava job results

Change-Id: I7d2a7d4eeb0192c4ac1b83547683fc02589ccc76
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: print hardware details

Print the hardware details of the CI node at the beginning of the build.

Change-Id: I675d950f687df72f90f89d296b1a68b9207d0f93
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-tools: remove unused mjeanson dev jobs

Change-Id: Ic53dc166092343b469cabef9ac4d8828b5a10205
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: lttng-ust: remove unused mjeanson dev jobs

Change-Id: I455a6475319c5abb1ab920dcc823da4371287b17
Signed-off-by: Michael Jeanson <mjeanson@efficios.com>

jjb: Remove lttng-ust jobs for unsupported versions

Change-Id: Ic763d668554b3745fc3aff4d81cf403ca9a1e35d
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Remove lttng-tools jobs for unsupported versions

Change-Id: I0d4bfba21560a8cdb2601a0fe0ae51c04a78df06
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Disable UST java tests by default on non-linuxbuild targets

Change-Id: I451abf33352c8953a0b909974597a0b9916898ce
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

lava: Include test logs in uploaded artifact when make check fails

Change-Id: I2c216a12f94f377de719ec128a0dae8524f08480
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

lava: Use safe loads for YAML

The version of LAVA we are using was updated last year, and includes
fixes for supporting safe YAML.

C.f. https://gitlab.com/lava/lava/-/commit/c0da3495c11936d761de4e03d709041f2f9a1d3e

Fixes Support #754

Change-Id: I34afafa5643fa45059077468536239e4b48d15ac
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: binutils-gdb: don't run tests in parallel

We see some tests failing, where GDB gets SIGKILLed, most likely some
out of memory problems.  Don't run test in parallel for now, to try to
avoid these.

Change-Id: I6e3ed399dd9376d5ab0316f85b77eb4c0b35c9e1

ansible: Install rasdaemon and prometheus exporter on CI hosts

Change-Id: Iff4018e7e4174aad321ab740e534cab4d3414255
Signed-off-by: Kienan Stewart <kstewart@efficios.com>

jjb: Rerun failed system test jobs by default

There can be occasional temporary errors launching jobs, eg. a
time-out waiting for the PXE boot, or flaky tests. Rather than stop
trying to run the test after a single failure, the failed tests will
be retried the next time to job is triggered.

Change-Id: Id996e70d46c41cf4693d6d2a9febe7a3c557e86b
Signed-off-by: Kienan Stewart <kstewart@efficios.com>