Future Release support for Infiniband
-
the 32 port QDR switches are amazingly cheap though loud
I got 2 FDR (56 IB/40 GbE) + 1 EN (40 GbE only) which are all dual port and pci 3.0 along with several 100' fiber links for <$900. Still cheaper than the copper X540-T2 10GbE buildout I was considering, yet faster :) Switches are currently cheaper too if I decide to go that route. They all can use SFP+ 10GbE modules with a QSFP plug adapter as well. They might(?) even be able to fan out to quad 10GbE links but not sure how that works.
Sounds close to my setup. I'm running 3 ConnectX-2 VPI cards. I'm considering a DDR switch, but the noise and power consumption is unwelcome. In addition, I still need to figure out how to bridge my ethernet in some logical way which those switches will not aid in. I would like to see pfsense utilized for that bridge, but its just not there nor does it seem to be on the minds of the programers. I'm still learning infiniband, so I'm not sure how much help I will be other than to test configurations.