Warning upgrading production machines with mpt raid to 1.2.3

jimp · Jun 8, 2009, 11:28 AM

Well the 1.2.3 snapshots have moved fully to 7.2, so if that bug was fixed by then, it should be OK.

Try the latest snap, pfSense-Full-Update-1.2.3-20090608-0559.tgz, and see if it helps.

Wilt · Jun 19, 2009, 3:18 PM

I can confirm there's no solution for this bug yet. pfSense 1.2.3-20090616-0459 crash with kernel panic when syncing a degraded RAID1 (LSI 1030/IBM xSeries 336)

The related PR at FreeBSD seems this one: http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/130330
There's a patch for the mpt driver but the PR remains open.

Ozzik · Jun 21, 2009, 5:36 AM

I'd like to join in on that. It's a very serious bug, which prevents most of the IBM users from testing the 1.2.3 version.
Is there a way to apply the patch on the snapshot?
I've been waiting forever to try 1.2.3, especially now that it has YANDEX em driver integrated, but since all of my servers are IBM - I can't.

jimp · Jun 21, 2009, 1:05 PM

Yeah we can definitely pull in custom patches.

Is there a link somewhere to the actual patch that has been confirmed to fix the issue?
That PR is a bit long and since I'm not terribly familiar with the hardware or the code in question, I didn't feel like reading the whole thing through this early on a Sunday :)

I can build a custom image if someone wants to test a kernel with the patch applied.
If it's confirmed to really fix the problem, then I can see about getting it committed for real.

Ozzik · Jun 21, 2009, 1:25 PM

jimp: thanks a lot!

I'm not sure about the link itself, but it's in the second half of the mentioned page.
there are 2 patches and I'm not sure if both are needed or just one of them.
after these 2 patches a guy says it's working, so…

thanks again for your help.

jimp · Jun 21, 2009, 2:24 PM

I think I got both patches, and they seem to apply.

It's building a new image now, I'll post a link when it's ready.

Ozzik · Jun 21, 2009, 2:28 PM

excellent!
can't wait:)

jimp · Jun 21, 2009, 2:52 PM

It's still building, but I figured I'd ask, do you want a firmware update file, or a full install iso?

Ozzik · Jun 21, 2009, 3:02 PM

full install.

jimp · Jun 21, 2009, 5:28 PM

Ok, if anyone is experiencing this issue with MPT controllers, please try this 1.2.3-RC full install ISO:

http://pingle.org/files/pfSense-1.2.3-mptfix.iso.gz

It has the patches from FreeBSD PR kern/130330 in it, so hopefully the issue is fixed.

If it is fixed, I can try to get the patches in.

Ozzik · Jun 21, 2009, 5:43 PM

Thank you so much!
downloading it right now.
I'm at home now, but I will test it first thing tomorrow morning.

thank you.

Ozzik · Jun 22, 2009, 8:23 AM

OK, I'm here to report and confirm it's working!
Boot live CD with RAID1 not synced - worked.
Boot live CD with only one drive of the RAID1 - worked.
Added the second drive while "online" - worked.
Installed on hard drive (with RAID1 of course), rebooted and still working!

It would be great if you could include those patches in the final release.

Thanks so much!

jimp · Jun 22, 2009, 5:02 PM

I submitted the patches, so unless they break something and get pulled, they should be in the next snapshot (or the one after, depending on where the builder is at right now).

Wilt · Jun 29, 2009, 1:55 PM

I can also confirm the patch works. No more kernel panic when rebuilding/degraded RAID. Tested with 1.2.3-20090623.

Thank you, jimp!
:)