[Bug 2080745] Re: Subiquity curtin apt-get install fails from cdrom files
Gin
2080745 at bugs.launchpad.net
Tue Sep 24 14:24:31 UTC 2024
** Tags added: curtin
--
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to subiquity in Ubuntu.
https://bugs.launchpad.net/bugs/2080745
Title:
Subiquity curtin apt-get install fails from cdrom files
Status in subiquity package in Ubuntu:
New
Bug description:
First of all I am not sure that is about a bug or misunderstanding of
a concept.
I am trying to make a custom ISO w/ autoinstall to automatically install Ubuntu Server 24.04.1 LTS onto our machines. We of course need to install some extra apt packages as part of the customization. The problem is, this installation needs to be done entirely offline (mostly with rj45 unplugged), so I can't just add them to the apt package list and have subiquity magic take care of everything. Briefly:
- Extract iso. I'll call the extracted dir 'iso';
- Add the packages to iso/pool/universe/path/to/package.deb; added also deps (apt-get --print-uris --yes install "$package" | grep ^\' | cut -d\' -f2);
- Then to add them to the Packages and Packages.gz file that lists all the available packages by calling;
- Update the the Release file;
- Create a gpg key and sign the Release file;
- Add the public key (gpg) to trusted keys in ubuntu-server-minimal.ubuntu-server.squashfs.
- resumm md5 (cd image && find . -type f -print0 | xargs -0 md5sum | grep -v "\./md5sum.txt" > md5sum.txt)
For testing purpose I downloaded traceroute. user-data looks like:
#cloud-config
autoinstall:
version: 1
source:
id: ubuntu-server
shutdown: poweroff
packages:
- traceroute
identity:
realname: 'UntouchedWagons'
username: ubuntu
password: 'secret'
hostname: local-host
locale: en_US.UTF-8
keyboard:
layout: us
timezone: "Europe/Athena"
storage:
layout:
name: lvm
sizing-policy: all
ssh:
allow-pw: true
install-server: true
authorized-keys:
- some-keys
I've also tried variations and combinations of the above where I've
also specified a "late-commands:" or "network:" section, detailed
late. It "appears" to me that subiquity crash while
downloading/install traceroute:
Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11210]: It is, so unshare will use --mount-proc=/target/proc
Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11210]: Running command ['unshare', '--fork', '--pid', '--mount-proc=/target/proc', '--', 'chroot', '/target', 'apt-get', '--quiet', '--option=Acquire::Languages=none', 'update'] with allowed return codes [0] (capture=False)
Sep 10 21:25:27 ubuntu-server systemctl[11227]: Running in chroot, ignoring command 'start'
Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Get:1 file:/cdrom noble InRelease
Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Ign:1 file:/cdrom noble InRelease
Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Get:2 file:/cdrom noble Release [1296 B]
Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Get:2 file:/cdrom noble Release [1296 B]
Sep 10 21:25:27 ubuntu-server subiquity_event.1716[1716]: subiquity/Install/install/postinstall/install_traceroute/cmd-system-install: curtin command system-install
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11221]: Reading package lists...
... exacly what I was hoping/needing
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['unshare', '--fork', '--pid', '--mount-proc=/target/proc', '--', 'chroot', '/target', 'apt-get', '--quiet', '--assume-yes', '--option=Dpkg::options::=--force-unsafe-io', '--option=Dpkg::Options::=--force-confold', 'install', '--download-only', 'traceroute'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Reading package lists...
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Building dependency tree...
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Reading state information...
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Package traceroute is not available, but is referred to by another package.
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: This may mean that the package is missing, has been obsoleted, or
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: is only available from another source
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: E: Package 'traceroute' has no installation candidate
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['udevadm', 'settle'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: TIMED subp(['udevadm', 'settle']): 0.011
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['mount', '--make-private', '/target/usr/bin/ischroot'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['umount', '/target/usr/bin/ischroot'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['mount', '--make-private', '/target/sys/firmware/efi/efivars'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['umount', '/target/sys/firmware/efi/efivars'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['mount', '--make-private', '/target/sys'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['umount', '/target/sys'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['mount', '--make-private', '/target/run'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['umount', '/target/run'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['mount', '--make-private', '/target/proc'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['umount', '/target/proc'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['mount', '--make-private', '/target/dev'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command ['umount', '/target/dev'] with allowed return codes [0] (capture=False)
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: system install failed for ['traceroute']: Unexpected error while running command.
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Command: ['unshare', '--fork', '--pid', '--mount-proc=/target/proc', '--', 'chroot', '/target', 'apt-get', '--quiet', '--assume-yes', '--option=Dpkg::options::=--force-unsafe-io', '--option=Dpkg::Options::=--force-confold', 'install', '--download-only', 'traceroute']
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Exit code: 100
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Reason: -
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Stdout: ''
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Stderr: ''
Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: finish: cmd-system-install: FAIL: curtin command system-install
Sep 10 21:25:28 ubuntu-server curtin_event.1716.9[11210]: finish: cmd-system-install: FAIL: curtin command system-install
I searched for "has_network" in var/crash/1725992736.960986614.install_fail.crash and here are the results:
2024-09-10 18:22:47,079 DEBUG subiquitycore.models.network:469 has_network False
... also as I was expecting
When the installer crash's while still in the Live session, if I pop into the terminal and check the following:
apt-get install --download-only traceroute
- works fine
apt-get install traceroute
- works fine
I have used such a method to install our systems since ubuntu 12.04 with seed files and "d-i pkgsel/include string " worked like a charm. After a lot a research I found that somehow this is normal behavior:
cat /cdrom/etc/apt/sources.list
"deb cdrom:[Ubuntu-Server 24.04.1 LTS _Noble Numbat_ - Release amd64 (20240827)]/ noble main restricted universe"
and corecly read components from "/cdrom/dists/noble/Release" -> "Components: main restricted universe"
But in chrooted env that install run:
cat /target/cdrom/etc/apt/sources.list
"deb [check-date=no] file:///cdrom noble main restricted"
the "universe" component is missing because apt.py:L245 says:
write_file(
self.install_tree.p('etc/apt/sources.list'),
f'deb [check-date=no] file:///cdrom {codename} main restricted\n')
that looks laike a fail-safe method
*) what if I need also multiverse?
I have some workarounds for my issue like copying all my debs in a tmp
/target directory and run "dpkg -i *", also copying in
"/target/var/cache/apt/archives" but not sure if it is enought for
apt-get to install it, or even more go to debian. Anyway, none of
those looks for me an elegant one.
My question is that if am I doing something wrong because
autoinstall/subiquity/curtin was designed for different purpose, or
there is any solution?
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/subiquity/+bug/2080745/+subscriptions
More information about the foundations-bugs
mailing list