Bluetooth Headset randomly has no sound anymore

I use the Sony WH1000XM3 headset, which I connect with using Bluetooth.
Connection works fine, but after x minutes (usually around 10) the sound just randomly stops.
When testing the output device in sounds, I hear nothing.
When checking with the bluetoothctl program, the headset jumps into the idle state once the sound stops.
When reconnecting with the device, the sound works fine again.
When checking with the pavucontrol program, the audio output bar hangs at a fixed location (see screenshot).
Nothing else odds that I have found

According to ubuntu-bug the pulseaudio crashed.

ProblemType: Bug
DistroRelease: Ubuntu 24.04
Package: pulseaudio 1:16.1+dfsg1-2ubuntu10
ProcVersionSignature: Ubuntu 6.8.0-31.31-generic 6.8.1
Uname: Linux 6.8.0-31-generic x86_64
NonfreeKernelModules: nvidia_modeset nvidia
ApportVersion: 2.28.1-0ubuntu3
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/seq: zoutekaas 2699 F.... pipewire
 /dev/snd/controlC2: zoutekaas 2702 F.... wireplumber
 /dev/snd/controlC1: zoutekaas 2699 F.... pipewire
                      zoutekaas 2702 F.... wireplumber
CasperMD5CheckResult: unknown
CurrentDesktop: ubuntu:GNOME
Date: Mon May 20 12:23:50 2024
InstallationDate: Installed on 2024-04-25 (25 days ago)
InstallationMedia: Ubuntu 24.04 LTS "Noble Numbat" - Release amd64 (20240424)
MachineType: Micro-Star International Co., Ltd. MS-7D31
ProcEnviron:
 LANG=en_US.UTF-8
 PATH=(custom, no user)
 SHELL=/bin/bash
 TERM=xterm-256color
 XDG_RUNTIME_DIR=<set>
PulseList: Error: command ['pacmd', 'list'] failed with exit code 1: No PulseAudio daemon running, or not running as session daemon.
SourcePackage: pulseaudio
Symptom: audio
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 01/10/2023
dmi.bios.release: 5.27
dmi.bios.vendor: American Megatrends International, LLC.
dmi.bios.version: 1.A0
dmi.board.asset.tag: Default string
dmi.board.name: MPG Z690 EDGE WIFI DDR4 (MS-7D31)
dmi.board.vendor: Micro-Star International Co., Ltd.
dmi.board.version: 1.0
dmi.chassis.asset.tag: Default string
dmi.chassis.type: 3
dmi.chassis.vendor: Micro-Star International Co., Ltd.
dmi.chassis.version: 1.0
dmi.modalias: dmi:bvnAmericanMegatrendsInternational,LLC.:bvr1.A0:bd01/10/2023:br5.27:svnMicro-StarInternationalCo.,Ltd.:pnMS-7D31:pvr1.0:rvnMicro-StarInternationalCo.,Ltd.:rnMPGZ690EDGEWIFIDDR4(MS-7D31):rvr1.0:cvnMicro-StarInternationalCo.,Ltd.:ct3:cvr1.0:skuDefaultstring:
dmi.product.family: Default string
dmi.product.name: MS-7D31
dmi.product.sku: Default string
dmi.product.version: 1.0
dmi.sys.vendor: Micro-Star International Co., Ltd.