QEMU VM: Version 2.8 Won't Boot

netblues

This post is deleted!

netblues

Not exactly the same, but its always that some devices are missing in freebsd15 and kvm

nickf1227

@netblues Interesting. So for you, it boots, but devices were just not showing up at all?
In my case, I'm doing PCI-E passthru of an Intel X710, not a virtio network adapter. Although there is a virtio network adapter in the system, even if its not being used.

netblues

@nickf1227 I get all sorts of cases.
Under redhat kvm, no virtio devices at all.

At hetzner kvm, I only get ONE!! and it misses the rest.

Certainly there is something going on with virtialization and freebsd15

Proxmox has better luck too.

What worked for me is changing the emulated machine from q35 to 440fx.
But then this doesn;t support passthrough If i recall.

nickf1227

@netblues Right...so the newer kernel works with an emulated chipset form 1996 but not an emulated chipset from 2010. Lol.

Sigh.

All I wanted was working DNS with Kea DHCP. :(

netblues

@nickf1227 The thing is, that if this is broken upstream, its hard for pfsense to fix.
Unless of course it fails on aws or azure ;-)
But I doubt it. aws is xen, not kvm.

Up to now, we can't agree on a replicated issue :( to build a solid case.

nickf1227

@netblues Sure, this is clearly a FreeBSD problem, no doubt. I just wish we'd see genuine efforts to get an open source firewall on Linux, from Netgate or otherwise. With the marketshare of KVM, this kinda thing shouldnt happen.

jimp

Are these systems using Q35+SeaBIOS or Q35+OVMF (UEFI)?

Granted I have only tried on Proxmox but mine are all working, even if I force modern virtio NICs. I don't have anything using passthrough, though.

My VMs use either i440fx+SeaBIOS or (more commonly) q35+OVMF, though I did try one q35+SeaBIOS and it still worked here, too.

That first screenshot it's hard to tell if it froze there or just stopped displaying kernel messages on that console. Maybe try adding a serial port to the VM (if it doesn't already have one) and attach to that and see if you get any other output there.

netblues

@jimp I tried the uefi path, on q35 but it fails to boot completely.
Most probably it needs a reinstall.
Reinstalling with plus to a different vm isn't an option due to licensing too.

(and I can't justify spending $120 AND put debug effort too.)

jimp

@netblues said in QEMU VM: Version 2.8 Won't Boot:

@jimp I tried the uefi path, on q35 but it fails to boot completely.
Most probably it needs a reinstall.

If you were running BIOS before, then it would need reinstalled. It needs an EFI disk added to the VM and then installed as EFI so it has a proper EFI partition/loader/etc. You'd most likely also need to make sure Secure Boot is disabled in there.

netblues

@jimp Yes, indeed. Secure boot was disabled, but still, with no efi, its futile.

netblues

@nickf1227 said in QEMU VM: Version 2.8 Won't Boot:

an open source firewall on Linux

Well, there is ipfire, but with all the bells and whistles pfsense has, rebasing to linux is only for april fools day

nickf1227

@jimp Hey man, thanks for your reply

That screenshot comes from the console itself while its booting, a-la a display device/VNC. Happy to give it another go with a serial connection, but I dont think thats possible without a virtio-VM agent?

jimp

@nickf1227 said in QEMU VM: Version 2.8 Won't Boot:

@jimp Hey man, thanks for your reply

That screenshot comes from the console itself while its booting, a-la a display device/VNC. Happy to give it another go with a serial connection, but I dont think thats possible without a virtio-VM agent?

I'm not sure what all might be available on TrueNAS but at least on Proxmox for a serial console on a guest you run qm terminal <id> from the Proxmox host (e.g. over ssh). IIRC that's just part of qemu-server so it may be there already.

It may not be printing anything there but it's good to rule it out at least.

stephenw10

Since you're hitting this locally try setting the loader value: debug.acpi.disabled="pci"

It looks like this is an ACPI bug preventing the OS finding the PCI devices. Setting that falls back to probing the bus/tree.

I expect it to still fail but the changes output would be useful in diagnosing the problem.

Edit: Actually that seems to prevent any detection in Q35....