Commit graph

1433 commits

Author SHA1 Message Date
David Runge
3eef5be576
Merge branch 'changelog/56'
* changelog/56:
  Add changelog for v56
2021-06-30 20:07:42 +02:00
David Runge
9e6b0d3698
Add changelog for v56
CHANGELOG.rst:
Add a changelog entry for v56.
2021-06-30 18:36:44 +02:00
David Runge
7d120315f1
Merge branch 'issues/132'
* issues/132:
  gitlab-ci: Also build a baseline netboot target
  archiso/mkarchiso: Generalize handling of ucodes
2021-06-30 17:23:03 +02:00
David Runge
97b7aebab8
gitlab-ci: Also build a baseline netboot target
.gitlab-ci.yml:
With #132 being fixed, it is possible to properly build the baseline netboot target without failure.
2021-06-30 14:36:34 +02:00
David Runge
19861e4742
archiso/mkarchiso: Generalize handling of ucodes
archiso/mkarchiso:
Generalize the handling of ucode files (e.g. copying, signing, size calculation) by introducing the global readonly
array of expected ucode names instead of hardcoding them in various functions.
When making use of ucode files in `_make_boot_on_iso9660()`, `_make_bootmode_uef-x86.systemd-boot.esp()` and
`_sign_netboot_artifacts()` create a list of files that is guaranteed to contain existing files.

Fixes #132
2021-06-30 14:36:31 +02:00
David Runge
33e4ff6294
Merge remote-tracking branch 'grazzolini/parallel_downloads'
* grazzolini/parallel_downloads:
  baseline/pacman.conf: Enable parallel downloads
  releng/pacman.conf: Enable parallel downloads
2021-06-30 14:35:57 +02:00
Giancarlo Razzolini
d75689b5f7
baseline/pacman.conf: Enable parallel downloads
Now that pacman 6 is around, enable parallel downloads to speed up the installation
process. Added to the baseline configuration to also improve the pipeline.
2021-06-29 15:20:39 -03:00
Giancarlo Razzolini
5343f5f6a4
releng/pacman.conf: Enable parallel downloads
Now that pacman 6 is around, enable parallel downloads to speed up the installation
process.
2021-06-29 15:19:36 -03:00
David Runge
e2649140dc
Merge remote-tracking branch 'nl6720/env-i-SOURCE_DATE_EPOCH'
* nl6720/env-i-SOURCE_DATE_EPOCH:
  mkarchiso: pass SOURCE_DATE_EPOCH to chroot
2021-06-29 20:13:48 +02:00
nl6720
cbac95ec9d
mkarchiso: pass SOURCE_DATE_EPOCH to chroot 2021-06-22 09:12:22 +03:00
David Runge
9c44aeedd1
Merge remote-tracking branch 'nl6720/update-wiki-url'
* nl6720/update-wiki-url:
  Update ArchWiki article URLs
2021-06-18 22:49:39 +02:00
nl6720
6e1ca35e59
Update ArchWiki article URLs
Use the new, prettier short URLs.
2021-06-18 21:17:47 +03:00
David Runge
8a01a6c88d
Merge remote-tracking branch 'sxw/issue25'
* sxw/issue25:
  Add documentation for the `script=` variable
2021-06-18 20:15:32 +02:00
Simon Wilper
bcdfe90bb2 Add documentation for the script= variable 2021-06-15 18:43:43 +00:00
David Runge
d1a93e38f0
Merge remote-tracking branch 'nl6720/pacman6'
* nl6720/pacman6:
  configs/*/pacman.conf: update configuration file for pacman 6
2021-06-12 20:20:09 +02:00
nl6720
6f671e1174
configs/*/pacman.conf: update configuration file for pacman 6
Based on accc1d2101/trunk/pacman.conf

Implements #136
2021-06-05 18:19:00 +03:00
David Runge
960b988ac6
Merge remote-tracking branch 'nl6720/ARCHISO_GNUPG_FD-unbound-variable'
* nl6720/ARCHISO_GNUPG_FD-unbound-variable:
  mkarchiso: fix unbound variable when not using GPG signing
2021-06-05 11:38:29 +02:00
nl6720
62e74c7e79
mkarchiso: fix unbound variable when not using GPG signing
Fixes #138
2021-06-05 08:23:14 +03:00
David Runge
a9a4dc4f70
Merge remote-tracking branch 'nl6720/env-i'
* nl6720/env-i:
  archiso/mkarchiso: clear environment variables when chrooting
2021-06-04 17:37:22 +02:00
nl6720
3d6651abf7
archiso/mkarchiso: clear environment variables when chrooting
Environment variables can interfere with the commands in chroot.
This causes issues when the environment variables specify a path that does not exist inside the chroot, e.g. if TMPDIR is set to a custom value.

Fixes https://bugs.archlinux.org/task/70580 .
2021-06-01 16:48:54 +03:00
David Runge
0bc62940c8
Merge branch 'changelog/55'
* changelog/55:
  Add changelog for v55
2021-05-30 23:10:45 +02:00
David Runge
5751de9753
Add changelog for v55
CHANGELOG.rst:
Add changelog entries for v55.
2021-05-30 19:44:55 +02:00
David Runge
50c5a023a4
Merge branch 'mr/118'
* mr/118:
  Add pv to the list of releng packages
2021-05-30 19:44:29 +02:00
David Runge
d3b06a0aaa
Add pv to the list of releng packages
configs/releng/packages.x86_64:
Add pv, as it was not added in the context of !118.
2021-05-30 11:17:45 +02:00
David Runge
ef9207d02b
Merge remote-tracking branch 'nl6720/baseline-erofs'
* nl6720/baseline-erofs:
  configs/baseline: use EROFS based image
2021-05-30 00:52:37 +02:00
nl6720
0b94b049e9
configs/baseline: use EROFS based image
Showcase #59.
2021-05-29 18:04:15 +03:00
David Runge
85c7cbee69
Merge remote-tracking branch 'nl6720/networkd-replace-type-with-name'
* nl6720/networkd-replace-type-with-name:
  configs/releng/airootfs/etc/systemd/network/: match by globbing the interface name instead of matching the type
2021-05-29 16:55:35 +02:00
nl6720
3b2618ff84
configs/releng/airootfs/etc/systemd/network/: match by globbing the interface name instead of matching the type
Type=ether matches virtual Ethernet interfaces (veth*) which may break networking inside containers.

Fixes https://bugs.archlinux.org/task/70892 .

Partially reverts 8a521d0bfa .
2021-05-29 15:31:02 +03:00
David Runge
254194ad6f
Merge branch 'issues/135'
* issues/135:
  Adjust documentation on IRC support channel
2021-05-29 14:25:20 +02:00
David Runge
0e61ed0a65
Adjust documentation on IRC support channel
README.rst:
Update the documentation on IRC support channel, after Arch Linux has moved to Libera Chat.
2021-05-29 10:48:06 +02:00
David Runge
e3a7f02385
Merge remote-tracking branch 'sxw/copytoram'
* sxw/copytoram:
  Apply copytoram Boot Option Menu Entries also to releng
  Fence add_binary for pv
  Reorder UEFI boot menu entries
  Update README.bootparams
  Apply 1 suggestion(s) to 1 file(s)
  add optional pv tool
2021-05-29 10:47:24 +02:00
Simon Wilper
31427eca7a Apply copytoram Boot Option Menu Entries also to releng 2021-05-14 19:47:25 +02:00
Simon Wilper
15f4ef4938 Fence add_binary for pv 2021-05-14 19:47:25 +02:00
Simon Wilper
9c783a8e71 Reorder UEFI boot menu entries 2021-05-14 19:47:25 +02:00
Simon Wilper
16742d1290 Update README.bootparams
Explain the purpose of optionally adding the "pv" program to the package
list.
2021-05-14 19:47:25 +02:00
Simon Wilper
c9cdb6d4b9 Apply 1 suggestion(s) to 1 file(s) 2021-05-14 19:46:29 +02:00
Simon Wilper
bb503b9030 add optional pv tool
use pv to give feedback on copying the airootfs to RAM when copytoram
kernel parameter is given
2021-05-14 19:46:23 +02:00
David Runge
28ab118099
Add changelog for v54
CHANGELOG.rst:
Add changelog entry for v54.
2021-05-13 22:18:47 +02:00
David Runge
9827cb19bb
ci: Use environment variables to override build settings
.gitlab-ci.yml:
Use environment variables to override the build settings offered by the build-host.sh script.
Lower the RAM usage of the builds to 3072.
Lower the COW space used by archiso to 2GiB.
Remove dependency on libisoburn in the `before_script` section of the build target (libarchive and util-linux have
replaced this requirement).
Use size units in accordance with upstream documentation.
Use the new name of the build's metrics file.

Fixes #134
2021-05-13 18:32:22 +02:00
David Runge
cde7296e6a
ci: Consolidate build-host script
.gitlab/ci/build-host.sh:
Change all script-local variables to lower-case and make some of them overridable using environment variables (by
providing defaults).
Break down overly long commands by splitting them into a list of strings.
Use local variables where possible.
Change `main()` to use rsync instead of cp to copy the project to the build location more generically.
Change `main()` to use rsync instead of cp to copy the build artifacts on the VM from the project's build directory to
the output.
Remove all unnecessary `function` keywords for function declarations.
Replace the dependency on libisoburn's `xorriso` with libarchive's `bsdtar` and util-linux's `blkid` in
`prepare_boot()`.
Add `print_section_start()` and `print_section_end()` to reduce code duplication and error potential when printing lines
for gitlab's collapsible sections (https://docs.gitlab.com/ee/ci/jobs/#custom-collapsible-sections).
Document the script's behavior and expectations.
Document the understood environment variables and add links to documentation on understood units (in case of size
units).
2021-05-13 18:32:10 +02:00
David Runge
8e44a8b72e
ci: consolidate build script
.gitlab/ci/build-inside-vm.sh:
Add `print_section_start()` and `print_section_end()` to remove code duplication when printing gitlab collapsible
sections (https://docs.gitlab.com/ee/ci/jobs/#custom-collapsible-sections).
Document further script dependencies.
Remove the temporary directory base (located in the project directory) instead of only the tempdir.
Simplify setting file and directory ownership when running with sudo, by only doing it once, recursively on the output
directory.
Make the script's output more verbose by using verbose flags for removal, ownership changes and zsyncmake actions and by
displaying e.g. created metrics and checksum files.
Change `create_metrics()` to output to a `metrics.txt` by default.
Change `create_checksums()` to create the checksums relative to the files.
2021-05-13 18:31:39 +02:00
nl6720
d0d4fa56cb
configs/releng/airootfs/etc/systemd/system/pacman-init.service: don't hardcode the keyrings
If the keyring is not specified, pacman-key will simply use all keyrings from /usr/share/pacman/keyrings/.

Fixes #133.
2021-05-12 10:24:35 +03:00
nl6720
3678bba899
configs/releng/packages.x86_64: explicitly add wanted packages instead of relying on pulling them in as dependencies
Fixes #119.
2021-05-11 23:51:00 +03:00
nl6720
bd2b861aa3
configs/*: add VM guest packages and enable their services
* virtualbox-guest-utils-nox package and vboxservice.service for VirtualBox.
* qemu-guest-agent package and qemu-guest-agent.service for QEMU & libvirt.

Implements #118.
2021-05-11 21:47:12 +03:00
David Runge
f86cb0faa2
ci: Expand parallel matrix with build modes
.gitlab-ci.yml:
Expand the parallel matrix with build modes per profile.
Do not run netboot with the baseline profile, as codesigning is not supported yet (#132).
Remove tagging secure, as archiso builds will only ever be used for testing the project.
Build ISOs using fast-single-thread (they take very long otherwise and hit the job time limit) and use any available
runner for anything else.
2021-05-11 18:09:50 +02:00
David Runge
5630a23ba1
ci: build based on buildmodes
.gitlab/ci/build-inside-vm.sh:
Expand the script to allow building based on mkarchiso's buildmodes.
Accept two parameters now: profile and buildmode.

Add gitlab collapsable sections by adding specific printfs for it to all functions.
Add extglob to be able to more specifically target files.
Change `create_checksums()` to also generate the legacy md5 and sha1 checksums.
Change `create_checksums()` and `create_zsync_delta()` to accept and process an unspecified amount of files as
parameters.
Change `create_zsync_delta()` to lower the blocksize when creating a file for the bootstrap image.
Change `create_metrics()` to create metrics depending on build mode.
Rename `create_temp_pgp_key()` to `create_ephemeral_pgp_key()`.
Add `create_ephemeral_codesigning_key()` to create a codesigning key, that is used to sign the netboot artifacts.
Change `run_mkarchiso()` to also create an ephemeral codesigning key before running mkarchiso and to run
`create_checksums()` and `create_zsync_delta()` with files depending on build mode.

.gitlab/ci/build-host.sh:
Call `build-inside-vm.sh` using the PROFILE and BUILDMODE environment variables as parameters.
2021-05-11 16:44:23 +02:00
David Runge
6b11d7be7a
mkarchiso: Also create package list for netboot
archiso/mkarchiso:
Change `_make_pkglist()` to also generate the package list when using the netboot build mode.
2021-05-10 22:42:27 +02:00
David Runge
ace88aaaca
Update project documentation related to netboot
README.rst:
Add openssl as another dependency.
Mention the export of netboot artifacts in the project introduction.
Mention that archiso may be used on other operating systems as well.
2021-05-10 12:38:31 +02:00
David Runge
4d1e898833
docs: Add netboot to buildmodes documentation
docs/README.profile.rst:
Add documentation for the netboot buildmode.
2021-05-10 12:38:28 +02:00
David Runge
d54bf635cd
mkarchiso: Add buildmode to export netboot artifacts
archiso/mkarchiso:
Implement a buildmode to export artifacts required for netboot with IPXE.
When providing the buildmode 'netboot' via profiledef.sh or the `-m` option, all targets necessary to create an ISO
medium are built, but the components required for netboot are exported to the output dir.
Optionally, it is possible to provide a set of certificates for codsigning using the `-c` option, where the first file
is considered as the signer certificate and the second as the key.

Add `_export_netboot_artifacts()` to copy build artifacts to the output directory.
Add `_sign_netboot_artifacts()` to codesign the netboot artifacts in the work directory.
Add `_validate_requirements_buildmode_netboot()` to check for openssl.
Add `_build_iso_base()` to implement common function calls between the 'iso' and the 'netboot' buildmodes.
Add `_build_buildmode_netboot()` to make use of `_build_iso_base()`, (optionally) `_sign_netboot_artifacts()` and
`_export_netboot_artifacts()`.
Change `_build_buildmode_iso()` to make use of `_build_iso_base()`.
Add `-c` as an option to mkarchiso to read in a list of file names.
Unify the output of `_usage()` by using the same definition style for lists of strings provided to options that accept
them (e.g. `-c`, `-m`, `-p`).

Closes #128
2021-05-10 12:38:18 +02:00