limepotato/archiso
1
0
Fork 0
mirror of https://github.com/archlinux/archiso.git synced 2024-09-19 03:30:20 -06:00
Code Issues Projects Releases Packages Wiki Activity Actions
archiso/.gitlab-ci.yml

72 lines
1.7 KiB
YAML
Raw Permalink Normal View History

Introducing shellcheck in gitlab CI archiso/mkarchiso: Quoting all variables. Changing pkg_list to be an array instead of a string for easier handling. Using read to properly populate pkg_list from OPTARG with stripped whitespaces. Not exporting iso_label anymore as there seems to be no reason to do so. Introducing line breaks. .editorconfig: Setting max_line_length to 120. Adding a section for YAML files (e.g. .gitlab-ci.yml). configs/releng/build.sh Quting nearly all variables. Introducing line breaks. configs/baseline/build.sh: Quoting all variables. Introducing line breaks. .gitlab-ci.yml: Adding gitlab CI for shelleck linting of the config build scripts, mkarchiso and startup scripts in releng. Closes #19
2020-06-25 15:01:54 -06:00
---
Add license and basic documentation LICENSE: Add GPL-3.0 license. {{archiso,configs}/*,.editorconfig,.gitlab-ci.yml}: Add SPDX license identifier. Makefile: Add SPDX license identifier. Install the `run_archiso.sh` script as global executable `run_archiso`. Use -D and -t flags to install to install files more generically (without a previous call to install the directory). README.rst: Add README outlining the project's scope, how to build images from the profiles and how to test. AUTHORS.rst: Add list of all direct contributors to the repository. CONTRIBUTING.rst: Add basic contribution guidelines, explaining the linter and the license in use. Closes #7 Closes #3
2020-05-29 16:01:28 -06:00
#
# SPDX-License-Identifier: GPL-3.0-or-later
Introducing shellcheck in gitlab CI archiso/mkarchiso: Quoting all variables. Changing pkg_list to be an array instead of a string for easier handling. Using read to properly populate pkg_list from OPTARG with stripped whitespaces. Not exporting iso_label anymore as there seems to be no reason to do so. Introducing line breaks. .editorconfig: Setting max_line_length to 120. Adding a section for YAML files (e.g. .gitlab-ci.yml). configs/releng/build.sh Quting nearly all variables. Introducing line breaks. configs/baseline/build.sh: Quoting all variables. Introducing line breaks. .gitlab-ci.yml: Adding gitlab CI for shelleck linting of the config build scripts, mkarchiso and startup scripts in releng. Closes #19
2020-06-25 15:01:54 -06:00
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
stages:
gitlab-ci: Include from ci-scripts .gitlab-ci.yml: Include a gitlab CI yaml file from the ci-scripts repository, that replaces the build-host.sh script and abstracts the .build target. Move all variables to top-level as they are useful in all build targets. Remove unnecessary before_script definitions because they are abstracted away by ci-scripts.
2021-06-30 15:25:48 -06:00
- check
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
- build
gitlab-ci: Include from ci-scripts .gitlab-ci.yml: Include a gitlab CI yaml file from the ci-scripts repository, that replaces the build-host.sh script and abstracts the .build target. Move all variables to top-level as they are useful in all build targets. Remove unnecessary before_script definitions because they are abstracted away by ci-scripts.
2021-06-30 15:25:48 -06:00
check:
Introducing shellcheck in gitlab CI archiso/mkarchiso: Quoting all variables. Changing pkg_list to be an array instead of a string for easier handling. Using read to properly populate pkg_list from OPTARG with stripped whitespaces. Not exporting iso_label anymore as there seems to be no reason to do so. Introducing line breaks. .editorconfig: Setting max_line_length to 120. Adding a section for YAML files (e.g. .gitlab-ci.yml). configs/releng/build.sh Quting nearly all variables. Introducing line breaks. configs/baseline/build.sh: Quoting all variables. Introducing line breaks. .gitlab-ci.yml: Adding gitlab CI for shelleck linting of the config build scripts, mkarchiso and startup scripts in releng. Closes #19
2020-06-25 15:01:54 -06:00
before_script:
Add the installation of latest archlinux-keyring to CI .gitlab-ci.yml: Install the latest archlinux-keyring before installing anything else. This is to make sure to not run into outdated keys upon updating, which is a problem because we can currently not even ensure a keyring that is valid longer than one month... https://gitlab.archlinux.org/archlinux/archlinux-keyring/-/issues/4
2022-01-29 09:13:24 -07:00
# NOTE: Install latest archlinux-keyring before upgrading system. In the
# future this should not be needed anymore when we can guarantee a valid
# keyring for longer:
# https://gitlab.archlinux.org/archlinux/archlinux-keyring/-/issues/4
- pacman -Sy --needed --noconfirm archlinux-keyring
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
- pacman --noconfirm -Syu --needed make shellcheck
script:
gitlab-ci: Call renamed check target .gitlab-ci.yml: Change the called make target in the gitlab CI check target to `check` (it has been renamed from `lint`).
2021-07-31 09:38:41 -06:00
- make check
gitlab-ci: Include from ci-scripts .gitlab-ci.yml: Include a gitlab CI yaml file from the ci-scripts repository, that replaces the build-host.sh script and abstracts the .build target. Move all variables to top-level as they are useful in all build targets. Remove unnecessary before_script definitions because they are abstracted away by ci-scripts.
2021-06-30 15:25:48 -06:00
stage: check
Set all build steps to be interruptable .gitlab-ci.yml: Set all build steps to be interruptable, so they will be interrupted if a newer commit is pushed on the same branch, which also triggers CI.
2022-01-30 13:47:36 -07:00
interruptible: true
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
Use VM runners[1] for building Building inside a TCG accelerated qemu VM is slow and painful, but it is the only option when running in a non-privileged container. arch-boxes has been built inside a KVM accelerated VMs ("VM runner") for over 11 months[2] and recently the MR[1] was merged into the infrastructure repo. With it now being a official part of arch's infrastructure we should switch to it and get much faster builds. Doing some quick testing, the whole pipeline is now roughly ~29-84 minutes faster (taking between 7-9 minutes, instead of 36-93 minutes). [1] https://gitlab.archlinux.org/archlinux/infrastructure/-/merge_requests/385 [2] https://gitlab.archlinux.org/archlinux/arch-boxes/-/commit/3bda5b26a675f241a1e0ba596dc94858839d96fc Fix #161
2022-08-08 08:56:45 -06:00
.build:
artifacts:
reports:
metrics: output/metrics.txt
before_script:
- pacman -Sy --needed --noconfirm archlinux-keyring
Makefile: build and install the mkarchiso(1) man page rst2man from python-docutils is required to convert the man page from reStructuredText.
2023-06-12 11:55:08 -06:00
- pacman -Syu --needed --noconfirm arch-install-scripts bash dosfstools e2fsprogs erofs-utils gnupg grub jq libarchive libisoburn mtools openssl python-docutils squashfs-tools zsync
Use VM runners[1] for building Building inside a TCG accelerated qemu VM is slow and painful, but it is the only option when running in a non-privileged container. arch-boxes has been built inside a KVM accelerated VMs ("VM runner") for over 11 months[2] and recently the MR[1] was merged into the infrastructure repo. With it now being a official part of arch's infrastructure we should switch to it and get much faster builds. Doing some quick testing, the whole pipeline is now roughly ~29-84 minutes faster (taking between 7-9 minutes, instead of 36-93 minutes). [1] https://gitlab.archlinux.org/archlinux/infrastructure/-/merge_requests/385 [2] https://gitlab.archlinux.org/archlinux/arch-boxes/-/commit/3bda5b26a675f241a1e0ba596dc94858839d96fc Fix #161
2022-08-08 08:56:45 -06:00
script:
- ./.gitlab/ci/build_archiso.sh ${BUILD_SCRIPT_ARGS}
stage: build
tags:
- vm
ci: Expand parallel matrix with build modes .gitlab-ci.yml: Expand the parallel matrix with build modes per profile. Do not run netboot with the baseline profile, as codesigning is not supported yet (#132). Remove tagging secure, as archiso builds will only ever be used for testing the project. Build ISOs using fast-single-thread (they take very long otherwise and hit the job time limit) and use any available runner for anything else.
2021-05-10 14:57:20 -06:00
build_short:
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
extends: .build
ci: Expand parallel matrix with build modes .gitlab-ci.yml: Expand the parallel matrix with build modes per profile. Do not run netboot with the baseline profile, as codesigning is not supported yet (#132). Remove tagging secure, as archiso builds will only ever be used for testing the project. Build ISOs using fast-single-thread (they take very long otherwise and hit the job time limit) and use any available runner for anything else.
2021-05-10 14:57:20 -06:00
parallel:
matrix:
ci: Use environment variables to override build settings .gitlab-ci.yml: Use environment variables to override the build settings offered by the build-host.sh script. Lower the RAM usage of the builds to 3072. Lower the COW space used by archiso to 2GiB. Remove dependency on libisoburn in the `before_script` section of the build target (libarchive and util-linux have replaced this requirement). Use size units in accordance with upstream documentation. Use the new name of the build's metrics file. Fixes #134
2021-05-12 12:37:14 -06:00
- BUILD_SCRIPT_ARGS: baseline bootstrap
- BUILD_SCRIPT_ARGS: releng bootstrap
Limit triggering a CI build to change of non-code files .gitlab-ci.yml: Only trigger builds in CI when changing code files or profiles.
2022-01-30 13:38:10 -07:00
only:
Limit CI pipelines on default branch and merge requests .gitlab-ci.yml: Only run build pipelines on default branch and merge requests if they change code or profile files.
2022-01-31 09:28:36 -07:00
refs:
- master
- merge_requests
Limit triggering a CI build to change of non-code files .gitlab-ci.yml: Only trigger builds in CI when changing code files or profiles.
2022-01-30 13:38:10 -07:00
changes:
- archiso/*
- configs/**/*
- Makefile
- .gitlab-ci.yml
- .gitlab/ci/*
Set all build steps to be interruptable .gitlab-ci.yml: Set all build steps to be interruptable, so they will be interrupted if a newer commit is pushed on the same branch, which also triggers CI.
2022-01-30 13:47:36 -07:00
interruptible: true
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
ci: Expand parallel matrix with build modes .gitlab-ci.yml: Expand the parallel matrix with build modes per profile. Do not run netboot with the baseline profile, as codesigning is not supported yet (#132). Remove tagging secure, as archiso builds will only ever be used for testing the project. Build ISOs using fast-single-thread (they take very long otherwise and hit the job time limit) and use any available runner for anything else.
2021-05-10 14:57:20 -06:00
build_long:
Add build stage for continuous integration .gitlab-ci.yml: Add a build stage to the gitlab CI, that facilitates the scripts below .gitlab/ci/, building the baseline and releng profiles in parallel. Distinguish the use-case in which builds are done for master, schedules and tags in a secure environment and any other where builds just have to be fast (for ensuring nothing is broken). Use MiB as block size for the du call when generating data for the metrics file.
2021-01-31 08:28:57 -07:00
extends: .build
ci: Expand parallel matrix with build modes .gitlab-ci.yml: Expand the parallel matrix with build modes per profile. Do not run netboot with the baseline profile, as codesigning is not supported yet (#132). Remove tagging secure, as archiso builds will only ever be used for testing the project. Build ISOs using fast-single-thread (they take very long otherwise and hit the job time limit) and use any available runner for anything else.
2021-05-10 14:57:20 -06:00
parallel:
matrix:
ci: Use environment variables to override build settings .gitlab-ci.yml: Use environment variables to override the build settings offered by the build-host.sh script. Lower the RAM usage of the builds to 3072. Lower the COW space used by archiso to 2GiB. Remove dependency on libisoburn in the `before_script` section of the build target (libarchive and util-linux have replaced this requirement). Use size units in accordance with upstream documentation. Use the new name of the build's metrics file. Fixes #134
2021-05-12 12:37:14 -06:00
- BUILD_SCRIPT_ARGS: baseline iso
gitlab-ci: Also build a baseline netboot target .gitlab-ci.yml: With #132 being fixed, it is possible to properly build the baseline netboot target without failure.
2021-06-29 13:45:56 -06:00
- BUILD_SCRIPT_ARGS: baseline netboot
ci: Use environment variables to override build settings .gitlab-ci.yml: Use environment variables to override the build settings offered by the build-host.sh script. Lower the RAM usage of the builds to 3072. Lower the COW space used by archiso to 2GiB. Remove dependency on libisoburn in the `before_script` section of the build target (libarchive and util-linux have replaced this requirement). Use size units in accordance with upstream documentation. Use the new name of the build's metrics file. Fixes #134
2021-05-12 12:37:14 -06:00
- BUILD_SCRIPT_ARGS: releng iso
- BUILD_SCRIPT_ARGS: releng netboot
Limit triggering a CI build to change of non-code files .gitlab-ci.yml: Only trigger builds in CI when changing code files or profiles.
2022-01-30 13:38:10 -07:00
only:
Limit CI pipelines on default branch and merge requests .gitlab-ci.yml: Only run build pipelines on default branch and merge requests if they change code or profile files.
2022-01-31 09:28:36 -07:00
refs:
- master
- merge_requests
Limit triggering a CI build to change of non-code files .gitlab-ci.yml: Only trigger builds in CI when changing code files or profiles.
2022-01-30 13:38:10 -07:00
changes:
- archiso/*
- configs/**/*
- Makefile
- .gitlab-ci.yml
- .gitlab/ci/*
Set all build steps to be interruptable .gitlab-ci.yml: Set all build steps to be interruptable, so they will be interrupted if a newer commit is pushed on the same branch, which also triggers CI.
2022-01-30 13:47:36 -07:00
interruptible: true
Reference in a new issue Copy permalink