Bug #2027847 “Bump minimum /boot size in ubuntu-release-upgrader...” : Bugs : ubuntu-release-upgrader package : Ubuntu

Bump (bump55) on 2023-07-15

tags:	added: 23.04
tags:	added: linux-headers linux-image linux-modules
tags:	added: apt dpkg

Revision history for this message

Julian Andres Klode (juliank) wrote on 2023-07-15:

#1

We generally don't know how much space is going to be needed. APT only keeps 2 kernel versions around, and the /boot partition is sized accordingly for 3.

If you override this by marking kernels as manually installed, or manually installing other versions you need to ensure that there is enough space for those.

I only see two kernels installed though, so it's not clear to me how you could be running out of space in /boot in the first place.

Are there additional files in there? The kernels shouldn't fill that up.

Changed in apt (Ubuntu):
status:	New → Won't Fix
Changed in dpkg (Ubuntu):
status:	New → Invalid
Changed in kernel-package (Ubuntu):
status:	New → Won't Fix
status:	Won't Fix → Invalid
Changed in linux (Ubuntu):
status:	New → Invalid
Changed in linux-firmware (Ubuntu):
status:	New → Invalid
Changed in linux-kernel-headers (Ubuntu):
status:	New → Invalid
Changed in linux-restricted-modules (Ubuntu):
status:	New → Invalid

Revision history for this message

Bump (bump55) wrote on 2023-07-15:

#2

There are 3 kernels installed:
6.2.0-24-generic (running)
linux-image-6.2.0-23-generic
/boot/initrd.img-6.2.0-25-generic.new (file 225MB placed by apt upgrade but remember the upgrade broke).

The /boot partition is sized for 3, but maybe today in 2023. This ubuntu system has been being upgraded for several years, so maybe back in the day a kernel image didn't weight 200+ MB but 100MB.
So now I have the problem that I must resize the partition, because kernels are only getting bigger.

With time, my 707M /boot partition will only be fit for one kernel, maybe ubuntu 26.10 or whatever it be.

Revision history for this message

Bump (bump55) wrote on 2023-07-15:

#3

> APT only keeps 2 kernel versions around
Yes, but when installing a new kernel, it does not remove beforehand the oldest kernel, so there's a situation where there are 3 kernels installed at the same time, until you reboot and run upgrade again.

summary:

- Updating kernel does not check for free space left on device beforehand
+ APT installs 3 kernels at once so /boot runs out of free space left and
+ partition size does not increase alongside with newer ubuntu versions

Julian Andres Klode (juliank) on 2023-07-15

summary:

- APT installs 3 kernels at once so /boot runs out of free space left and
- partition size does not increase alongside with newer ubuntu versions
+ Bump minimum /boot size in ubuntu-release-upgrader

Revision history for this message

Julian Andres Klode (juliank) wrote on 2023-07-15:

#4

Right so it seems we forgot to bump the size requirements in ubuntu-release-upgrader when bumping them in the installer in bug 1959971, you probably should not have been able to upgrade. Albeit the size it seems is determined from the initramfs that is in /boot.

We also don't seem to acccount for system.map which is about 10MB per kernel

Unfortunately there isn't much else we can do here. You can of course opt to

1) set MODULES=dep in /etc/initramfs-tools/initramfs.conf - this will mean that you can't replace your mainboard or swap your disk into a different machine as the initrd will only include modules relevant to the device the system is running on

2) specify COMPRESS=xz or preferably if available a higher COMPRESSLEVEL=1 in the same file such that compression is higher.

I don't know why your initramfs are that big, presumably you are using nvidia gpus? With 3 kernels on my /boot and no out-of-kernel drivers I use 438MB.

tags:

added: rls-ll-incoming

Revision history for this message

Bump (bump55) wrote on 2023-07-15:

#5

I think this install was performed mid-2018, judging by my bug report: https://bugs.launchpad.net/ubuntu/+bug/1773633

Revision history for this message

Bump (bump55) wrote on 2023-07-15:

#6

I was able to upgrade because left only 1 installed kernel just before "update-manager -d". Probably I should have opened the issue by then...

Revision history for this message

Bump (bump55) wrote on 2023-07-15:

#7

These are the 'linux-' packages which I have installed:

binutils-x86-64-linux-gnu/lunar-updates,lunar-security,now 2.40-2ubuntu4.1 amd64 [installed,automatic]
linux-base/lunar,lunar,lunar,lunar,lunar,lunar,now 4.5ubuntu9 all [installed,automatic]
linux-firmware/lunar-updates,lunar-updates,lunar-security,lunar-security,now 20230323.gitbcdcfbcf-0ubuntu1.2 all [installed,automatic]
linux-headers-6.2.0-24-generic/lunar-updates,lunar-security,now 6.2.0-24.24 amd64 [installed,automatic]
linux-headers-6.2.0-24/lunar-updates,lunar-updates,lunar-security,lunar-security,now 6.2.0-24.24 all [installed,automatic]
linux-image-6.2.0-24-generic/lunar-updates,lunar-security,now 6.2.0-24.24 amd64 [installed,automatic]
linux-libc-dev/lunar-updates,lunar-security,now 6.2.0-25.25 amd64 [installed,automatic]
linux-libc-dev/lunar-updates,lunar-security,now 6.2.0-25.25 i386 [installed,automatic]
linux-modules-6.2.0-24-generic/lunar-updates,lunar-security,now 6.2.0-24.24 amd64 [installed,automatic]
linux-modules-extra-6.2.0-24-generic/lunar-updates,lunar-security,now 6.2.0-24.24 amd64 [installed,automatic]
linux-sound-base/lunar,lunar,lunar,lunar,lunar,lunar,now 1.0.25+dfsg-0ubuntu7 all [installed,automatic]
selinux-utils/lunar,lunar,lunar,now 3.4-1build4 amd64 [installed,automatic]
syslinux-common/lunar,lunar,lunar,lunar,lunar,lunar,now 3:6.04~git20190206.bf6db5b4+dfsg1-3ubuntu1 all [installed,automatic]
util-linux-extra/lunar,lunar,lunar,now 2.38.1-4ubuntu1 amd64 [installed,automatic]

Revision history for this message

Bump (bump55) wrote on 2023-07-15 (last edit on 2023-07-15):

#8

I'm using nvidia drivers.
According to stat, /boot was birth in 2018-11

sudo fdisk -l /dev/sdb2 (/boot mount point)
Disk /dev/sdb2: 735,99 MiB, 771740160 bytes, 1507305 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 33553920 bytes

df -h /boot
Filesystem Size Used Avail Use% Mounted on
/dev/sdb2 707M 252M 405M 39% /boot

Revision history for this message

Bump (bump55) wrote on 2023-07-15:

#9

Download full text (6.1 KiB)

ls -RSs1pq --block-size=1 /boot/
/boot/:
total 254656512
231763968 initrd.img-6.2.0-24-generic
13856768 vmlinuz-6.2.0-24-generic
  8155136 System.map-6.2.0-24-generic
   278528 config-6.2.0-24-generic
   147456 memtest86+x64.efi
   147456 memtest86+x64.bin
   143360 memtest86+ia32.efi
   139264 memtest86+ia32.bin
    16384 lost+found/
     4096 efi/
     4096 grub/
        0 initrd.img
        0 initrd.img.old
        0 vmlinuz
        0 vmlinuz.old
ls: cannot open directory '/boot/lost+found': Permission denied
ls: cannot open directory '/boot/efi': Permission denied

/boot/grub:
total 2445312
2396160 unicode.pf2
  20480 x86_64-efi/
  12288 grub.cfg
   4096 fonts/
   4096 locale/
   4096 grubenv
   4096 gfxblacklist.txt

/boot/grub/x86_64-efi:
total 3584000
180224 normal.mod
147456 core.efi
147456 grub.efi
135168 net.mod
81920 zstd.mod
81920 regexp.mod
61440 gfxmenu.mod
61440 zfs.mod
49152 bsd.mod
49152 functional_test.mod
49152 legacycfg.mod
45056 mpi.mod
45056 xnu.mod
36864 gcry_twofish.mod
32768 syslinuxcfg.mod
28672 video_fb.mod
28672 gcry_camellia.mod
28672 btrfs.mod
28672 relocator.mod
28672 file.mod
28672 ehci.mod
24576 multiboot2.mod
24576 ahci.mod
24576 gcry_whirlpool.mod
24576 multiboot.mod
24576 linux.mod
24576 terminfo.mod
24576 luks2.mod
24576 gcry_rijndael.mod
20480 xzio.mod
20480 font.mod
20480 pgp.mod
20480 chain.mod
20480 cryptodisk.mod
20480 gfxterm.mod
20480 gcry_serpent.mod
20480 gcry_des.mod
16384 legacy_password_test.mod
16384 ohci.mod
16384 usb.mod
16384 acpi.mod
16384 ntfs.mod
16384 gcry_cast5.mod
16384 serial.mod
16384 reiserfs.mod
16384 linuxefi.mod
16384 gcry_seed.mod
16384 gcry_tiger.mod
16384 diskfilter.mod
16384 efi_gop.mod
16384 gzio.mod
16384 iso9660.mod
16384 udf.mod
12288 gcry_crc.mod
12288 lvm.mod
12288 hfsplus.mod
12288 usbms.mod
12288 macho.mod
12288 xfs.mod
12288 png.mod
12288 zfsinfo.mod
12288 jpeg.mod
12288 efinet.mod
12288 hdparm.mod
12288 hfs.mod
12288 uhci.mod
12288 f2fs.mod
12288 video_colors.mod
12288 squash4.mod
12288 nilfs2.mod
12288 mmap.mod
12288 http.mod
12288 bfs.mod
12288 geli.mod
12288 loadenv.mod
12288 video_cirrus.mod
12288 gcry_blowfish.mod
12288 jfs.mod
12288 ata.mod
12288 video.mod
12288 linux16.mod
12288 ext2.mod
12288 fat.mod
12288 signature_test.mod
12288 exfat.mod
12288 gettext.mod
12288 smbios.mod
12288 zfscrypt.mod
12288 hashsum.mod
12288 video_bochs.mod
12288 afs.mod
12288 setpci.mod
12288 ldm.mod
  8192 affs.mod
  8192 div_test.mod
  8192 gcry_rmd160.mod
  8192 sfs.mod
  8192 ufs1_be.mod
  8192 ufs1.mod
  8192 ufs2.mod
  8192 gfxterm_menu.mod
  8192 extcmd.mod
  8192 gcry_sha1.mod
  8192 tftp.mod
  8192 pata.mod
  8192 test.mod
  8192 halt.mod
  8192 nativedisk.mod
  8192 parttool.mod
  8192 tpm.mod
  8192 lspci.mod
  8192 efi_uga.mod
  8192 lsacpi.mod
  8192 scsi.mod
  8192 crypto.mod
  8192 tga.mod
  8192 lzopio.mod
  8192 at_keyboard.mod
  8192 terminal.mod
  8192 luks.mod
  8192 cmp_test.mod
  8192 keylayouts.mod
  8192 ls.mod
  8192 elf.mod
  8192 gcry_sha512.mod
  8192 minicmd.mod
  8192 minix3_be.mod
  8192 usb_keyboard.mod
  8192 minix2_be.mod
  8192 minix3.mod
  8192 cbfs.mod
  ...

ls -RSs1pq --block-size=1 /boot/
/boot/:
total 254656512
231763968 initrd.img-6.2.0-24-generic
 13856768 vmlinuz-6.2.0-24-generic
  8155136 System.map-6.2.0-24-generic
   278528 config-6.2.0-24-generic
   147456 memtest86+x64.efi
   147456 memtest86+x64.bin
   143360 memtest86+ia32.efi
   139264 memtest86+ia32.bin
    16384 lost+found/
     4096 efi/
     4096 grub/
        0 initrd.img
        0 initrd.img.old
        0 vmlinuz
        0 vmlinuz.old
ls: cannot open directory '/boot/lost+found': Permission denied
ls: cannot open directory '/boot/efi': Permission denied

/boot/grub:
total 2445312
2396160 unicode.pf2
  20480 x86_64-efi/
  12288 grub.cfg
   4096 fonts/
   4096 locale/
   4096 grubenv
   4096 gfxblacklist.txt

/boot/grub/x86_64-efi:
total 3584000
180224 normal.mod
147456 core.efi
147456 grub.efi
135168 net.mod
 81920 zstd.mod
 81920 regexp.mod
 61440 gfxmenu.mod
 61440 zfs.mod
 49152 bsd.mod
 49152 functional_test.mod
 49152 legacycfg.mod
 45056 mpi.mod
 45056 xnu.mod
 36864 gcry_twofish.mod
 32768 syslinuxcfg.mod
 28672 video_fb.mod
 28672 gcry_camellia.mod
 28672 btrfs.mod
 28672 relocator.mod
 28672 file.mod
 28672 ehci.mod
 24576 multiboot2.mod
 24576 ahci.mod
 24576 gcry_whirlpool.mod
 24576 multiboot.mod
 24576 linux.mod
 24576 terminfo.mod
 24576 luks2.mod
 24576 gcry_rijndael.mod
 20480 xzio.mod
 20480 font.mod
 20480 pgp.mod
 20480 chain.mod
 20480 cryptodisk.mod
 20480 gfxterm.mod
 20480 gcry_serpent.mod
 20480 gcry_des.mod
 16384 legacy_password_test.mod
 16384 ohci.mod
 16384 usb.mod
 16384 acpi.mod
 16384 ntfs.mod
 16384 gcry_cast5.mod
 16384 serial.mod
 16384 reiserfs.mod
 16384 linuxefi.mod
 16384 gcry_seed.mod
 16384 gcry_tiger.mod
 16384 diskfilter.mod
 16384 efi_gop.mod
 16384 gzio.mod
 16384 iso9660.mod
 16384 udf.mod
 12288 gcry_crc.mod
 12288 lvm.mod
 12288 hfsplus.mod
 12288 usbms.mod
 12288 macho.mod
 12288 xfs.mod
 12288 png.mod
 12288 zfsinfo.mod
 12288 jpeg.mod
 12288 efinet.mod
 12288 hdparm.mod
 12288 hfs.mod
 12288 uhci.mod
 12288 f2fs.mod
 12288 video_colors.mod
 12288 squash4.mod
 12288 nilfs2.mod
 12288 mmap.mod
 12288 http.mod
 12288 bfs.mod
 12288 geli.mod
 12288 loadenv.mod
 12288 video_cirrus.mod
 12288 gcry_blowfish.mod
 12288 jfs.mod
 12288 ata.mod
 12288 video.mod
 12288 linux16.mod
 12288 ext2.mod
 12288 fat.mod
 12288 signature_test.mod
 12288 exfat.mod
 12288 gettext.mod
 12288 smbios.mod
 12288 zfscrypt.mod
 12288 hashsum.mod
 12288 video_bochs.mod
 12288 afs.mod
 12288 setpci.mod
 12288 ldm.mod
  8192 affs.mod
  8192 div_test.mod
  8192 gcry_rmd160.mod
  8192 sfs.mod
  8192 ufs1_be.mod
  8192 ufs1.mod
  8192 ufs2.mod
  8192 gfxterm_menu.mod
  8192 extcmd.mod
  8192 gcry_sha1.mod
  8192 tftp.mod
  8192 pata.mod
  8192 test.mod
  8192 halt.mod
  8192 nativedisk.mod
  8192 parttool.mod
  8192 tpm.mod
  8192 lspci.mod
  8192 efi_uga.mod
  8192 lsacpi.mod
  8192 scsi.mod
  8192 crypto.mod
  8192 tga.mod
  8192 lzopio.mod
  8192 at_keyboard.mod
  8192 terminal.mod
  8192 luks.mod
  8192 cmp_test.mod
  8192 keylayouts.mod
  8192 ls.mod
  8192 elf.mod
  8192 gcry_sha512.mod
  8192 minicmd.mod
  8192 minix3_be.mod
  8192 usb_keyboard.mod
  8192 minix2_be.mod
  8192 minix3.mod
  8192 cbfs.mod
  8192 romfs.mod
  8192 minix_be.mod
  8192 minix2.mod
  8192 ntfscomp.mod
  8192 cbls.mod
  8192 minix.mod
  8192 probe.mod
  8192 videotest.mod
  8192 usbtest.mod
  8192 search.mod
  8192 bitmap_scale.mod
  8192 appleldr.mod
  8192 gptsync.mod
  8192 lsefi.mod
  8192 videoinfo.mod
  8192 moddep.lst
  8192 gcry_sha256.mod
  8192 tar.mod
  8192 macbless.mod
  8192 json.mod
  8192 search_fs_uuid.mod
  8192 search_label.mod
  8192 loopback.mod
  8192 search_fs_file.mod
  8192 cmdline_cat_test.mod
  8192 loadbios.mod
  8192 memrw.mod
  8192 iorw.mod
  8192 gcry_md5.mod
  8192 archelp.mod
  8192 newc.mod
  8192 password_pbkdf2.mod
  8192 cbtime.mod
  8192 fshelp.mod
  8192 gfxterm_background.mod
  8192 cat.mod
  8192 hexdump.mod
  8192 lsefisystab.mod
  8192 cpio_be.mod
  8192 cpio.mod
  8192 odc.mod
  8192 hfspluscomp.mod
  8192 part_bsd.mod
  8192 gcry_md4.mod
  4096 gcry_idea.mod
  4096 cs5536.mod
  4096 play.mod
  4096 cbmemc.mod
  4096 help.mod
  4096 procfs.mod
  4096 boot.mod
  4096 testload.mod
  4096 lssal.mod
  4096 usbserial_pl2303.mod
  4096 msdospart.mod
  4096 videotest_checksum.mod
  4096 lsefimmap.mod
  4096 tr.mod
  4096 random.mod
  4096 command.lst
  4096 pcidump.mod
  4096 testspeed.mod
  4096 configfile.mod
  4096 usbserial_ftdi.mod
  4096 pbkdf2_test.mod
  4096 gcry_dsa.mod
  4096 morse.mod
  4096 sleep.mod
  4096 gcry_rsa.mod
  4096 sleep_test.mod
  4096 raid6rec.mod
  4096 bswap_test.mod
  4096 xnu_uuid.mod
  4096 bitmap.mod
  4096 strtoull_test.mod
  4096 part_gpt.mod
  4096 spkmodem.mod
  4096 memdisk.mod
  4096 xnu_uuid_test.mod
  4096 date.mod
  4096 shift_test.mod
  4096 progress.mod
  4096 gcry_rfc2268.mod
  4096 disk.mod
  4096 rdmsr.mod
  4096 datetime.mod
  4096 fixvideo.mod
  4096 datehook.mod
  4096 echo.mod
  4096 part_msdos.mod
  4096 part_apple.mod
  4096 blocklist.mod
  4096 bufio.mod
  4096 keystatus.mod
  4096 password.mod
  4096 lsmmap.mod
  4096 cmp.mod
  4096 usbserial_common.mod
  4096 dm_nv.mod
  4096 mdraid09_be.mod
  4096 mdraid09.mod
  4096 ctz_test.mod
  4096 part_dfly.mod
  4096 mdraid1x.mod
  4096 part_amiga.mod
  4096 setjmp_test.mod
  4096 cpuid.mod
  4096 part_plan.mod
  4096 backtrace.mod
  4096 part_sunpc.mod
  4096 modinfo.sh
  4096 mul_test.mod
  4096 wrmsr.mod
  4096 gcry_arcfour.mod
  4096 time.mod
  4096 usbserial_usbdebug.mod
  4096 part_acorn.mod
  4096 priority_queue.mod
  4096 read.mod
  4096 exfctest.mod
  4096 offsetio.mod
  4096 part_sun.mod
  4096 part_dvh.mod
  4096 eval.mod
  4096 efifwsetup.mod
  4096 crc64.mod
  4096 afsplitter.mod
  4096 test_blockarg.mod
  4096 trig.mod
  4096 raid5rec.mod
  4096 adler32.mod
  4096 pbkdf2.mod
  4096 true.mod
  4096 hello.mod
  4096 reboot.mod
  4096 cbtable.mod
  4096 aout.mod
  4096 div.mod
  4096 crypto.lst
  4096 setjmp.mod
  4096 all_video.mod
  4096 fs.lst
  4096 terminal.lst
  4096 partmap.lst
  4096 load.cfg
  4096 video.lst
  4096 parttool.lst

/boot/grub/fonts:
total 2396160
2396160 unicode.pf2

/boot/grub/locale:
total 131072
118784 en@quot.mo
  4096 en_GB.mo
  4096 en_AU.mo
  4096 en_CA.mo

Dave Jones (waveform) on 2023-07-20

tags:

added: foundations-todo
removed: rls-ll-incoming

Revision history for this message

Steve Langasek (vorlon) wrote on 2023-07-20:

#10

The purpose of the size check in u-r-u is to ensure that we don't fail mid-upgrade due to lack of disk space on /boot.

But AIUI that's not what happened here to the bug submitter; this is an upgrade within an Ubuntu series between individual kernel packages.

We should NOT have a check in u-r-u that refuses upgrades when /boot is less than the "ideal" size, only when we expect with a reasonable degree of confidence that /boot is too small to let the upgrade proceed.

Revision history for this message

Brian Murray (brian-murray) wrote on 2023-07-20:

#11

You can confirm the release you originally installed on the system by looking at /var/log/installer/media-info. An example:

$ cat /var/log/installer/media-info
Ubuntu-Server 18.04.1 LTS "Bionic Beaver" - Release amd64 (20180725)

Revision history for this message

Bump (bump55) wrote on 2023-07-20:

#12

$ cat /var/log/installer/media-info
Ubuntu 18.10 "Cosmic Cuttlefish" - Release amd64 (20181017.3)

Revision history for this message

Benjamin Drung (bdrung) wrote on 2023-07-24:

#13

We have a bunch of bugs to decrease initramfs size and to make it faster:

* bug #2028567: initramfs-tools: Do not re-compress compressed kernel modules and firmware files
* bug #2028568: Ship kernel modules compressed
* bug #1942260: compress firmware in /lib/firmware
* bug #2028571: klibc-utils contains identical binaries
* bug #2028574: Duplicate firmware files in /lib/firmware

This started on ubuntu-devel: https://lists.ubuntu.com/archives/ubuntu-devel/2023-July/042652.html

	Status	Importance	Assigned to
apt (Ubuntu)	Won't Fix	Undecided	Unassigned
dpkg (Ubuntu)	Invalid	Undecided	Unassigned
kernel-package (Ubuntu)	Invalid	Undecided	Unassigned
linux (Ubuntu)	Invalid	Undecided	Unassigned
linux-firmware (Ubuntu)	Invalid	Undecided	Unassigned
linux-kernel-headers (Ubuntu)	Invalid	Undecided	Unassigned
linux-restricted-modules (Ubuntu)	Invalid	Undecided	Unassigned
ubuntu-release-upgrader (Ubuntu)	New	Undecided	Unassigned

Ubuntu
ubuntu-release-upgrader package

Bump minimum /boot size in ubuntu-release-upgrader

Bug Description

Other bug subscribers

Remote bug watches

Ubuntuubuntu-release-upgrader package

Bump minimum /boot size in ubuntu-release-upgrader

Bug Description

Other bug subscribers

Remote bug watches

Ubuntu
ubuntu-release-upgrader package