Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    pfsense and Riverbed CX-780

    Scheduled Pinned Locked Moved Hardware
    16 Posts 5 Posters 1.3k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M Offline
      mistera @stephenw10
      last edited by

      @stephenw10 Bios is accessible however, could not find an option to disable the relays.
      What is strange when secure boot is enables it reveals more options for the nics but still no options to disable relays.

      1 Reply Last reply Reply Quote 0
      • stephenw10S Offline
        stephenw10 Netgate Administrator
        last edited by

        Mmm, that could be a problem then. I'd expect them to be bypassed by default which would require something in pfSense to change it.

        M 1 Reply Last reply Reply Quote 0
        • M Offline
          mistera @stephenw10
          last edited by

          @stephenw10 Decided to add ESXi and pfsense on-top but the nics still need the relay disabled.
          Here are some bios screenshots:
          2023-11-08_10-00-45.jpg 2023-11-08_10-01-13.jpg 2023-11-08_10-02-28.jpg

          1 Reply Last reply Reply Quote 0
          • M Offline
            mistera
            last edited by stephenw10

            Intel NIC Details via nvmupdaten64e

            Num Description                          Ver.(hex)  DevId S:B    Status
            === ================================== ============ ===== ====== ==============
            01) Intel(R) Ethernet Connection X552   0.05(0.05)   15AC 00:003 Update not    
                10 GbE SFP+                                                  available
            02) Intel(R) I350 Gigabit Network       1.99(1.63)   1521 00:006 Update not    
                Connection                                                   available
            03) Intel(R) I350 Gigabit Network       1.99(1.63)   1521 00:008 Update not    
                Connection                                                   availabl
            
            
            [00:003:00:00]: Intel(R) Ethernet Connection X552 10 GbE SFP+
                    Vendor                 : 8086
                    Device                 : 15AC
                    Subvendor              : 8086
                    Subdevice              : 0000
                    Revision               : 0
                    LAN MAC                : 000EB6D0966E
                    Alt MAC                : 000EB6D0966E
                    SAN MAC                : 000000000000
                    ETrackId               : 800008F7
                    SerialNumber           : 0000C9FFFF000000
                    NVM Version            : 0.05(0.05)
                    PBA                    : 000600-000
                    VPD status             : Valid
                    VPD size               : 45
                    NVM update             : No config file entry
                      checksum             : Valid
                    PHY NVM update         : No config file entry
                      version              : 3.8.1
                    OROM update            : No config file entry
                      CIVD                 : 1.1275.0
                      PXE                  : 2.3.58, checksum Valid
                      EFI                  : 5.1.19, checksum None
            [00:003:00:01]: Intel(R) Ethernet Connection X552 10 GbE SFP+
                    Vendor                 : 8086
                    Device                 : 15AC
                    Subvendor              : 8086
                    Subdevice              : 0000
                    Revision               : 0
                    LAN MAC                : 000EB6D0966F
                    Alt MAC                : 000EB6D0966F
                    SAN MAC                : 000000000000
                    ETrackId               : 800008F7
                    SerialNumber           : 0000C9FFFF000000
                    NVM Version            : 0.05(0.05)
                    PBA                    : 000600-000
                    VPD status             : Valid
                    VPD size               : 45
                    NVM update             : No config file entry
                      checksum             : Valid
                    PHY NVM update         : No config file entry
                      version              : 3.8.1
                    OROM update            : No config file entry
                      CIVD                 : 1.1275.0
                      PXE                  : 2.3.58, checksum Valid
                      EFI                  : 5.1.19, checksum None
            [00:006:00:00]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6100CA8
                    Alt MAC                : 000EB6D09666
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFF100CA8
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
                    OROM update            : No config file entry
                      CIVD                 : 1.2074.0
                      PXE                  : 1.5.86, checksum Valid
                      EFI                  : 8.5.21, checksum None
            [00:006:00:01]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6100CA9
                    Alt MAC                : 000EB6D09667
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFF100CA8
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
                    OROM update            : No config file entry
                      CIVD                 : 1.2074.0
                      PXE                  : 1.5.86, checksum Valid
                      EFI                  : 8.5.21, checksum None
            [00:006:00:02]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6D09668
                    Alt MAC                : 000EB6D09668
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFF100CA8
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
                    OROM update            : No config file entry
                      CIVD                 : 1.2074.0
                      PXE                  : 1.5.86, checksum Valid
                      EFI                  : 8.5.21, checksum None
            [00:006:00:03]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6D09669
                    Alt MAC                : 000EB6D09669
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFF100CA8
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
                    OROM update            : No config file entry
                      CIVD                 : 1.2074.0
                      PXE                  : 1.5.86, checksum Valid
                      EFI                  : 8.5.21, checksum None
            [00:008:00:00]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6D0966A
                    Alt MAC                : 000EB6D0966A
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFFD0966A
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
            [00:008:00:01]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6D0966B
                    Alt MAC                : 000EB6D0966B
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFFD0966A
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
            [00:008:00:02]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6D0966C
                    Alt MAC                : 000EB6D0966C
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFFD0966A
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
            [00:008:00:03]: Intel(R) I350 Gigabit Network Connection
                    Vendor                 : 8086
                    Device                 : 1521
                    Subvendor              : 1B2E
                    Subdevice              : 1244
                    Revision               : 1
                    LAN MAC                : 000EB6D0966D
                    Alt MAC                : 000EB6D0966D
                    SAN MAC                : 000000000000
                    ETrackId               : 00000000
                    SerialNumber           : 000EB6FFFFD0966A
                    EEPROM Version         : 1.99(1.63)
                    PBA                    : 106300-000
                    VPD status             : Not set
                    VPD size               : 0
                    EEPROM update          : No config file entry
                      checksum             : Valid
            
            1 Reply Last reply Reply Quote 0
            • stephenw10S Offline
              stephenw10 Netgate Administrator
              last edited by

              Yup it's probably via a separate driver. If you're lucky there might be jumpers on the board to set the relays.

              M 1 Reply Last reply Reply Quote 0
              • M Offline
                mistera @stephenw10
                last edited by

                @stephenw10 Did not see any jumpers close to where the 4 intpah interfaces are but this might take a while to get it working.

                L 1 Reply Last reply Reply Quote 0
                • L Offline
                  lavenderfox2430 @mistera
                  last edited by

                  @mistera Bumping this two years later. Did you happen to come across anything? Or did you just settle on using the 4 available NICs rather than all 8?

                  In your photo I did notice quite a few jumpers near the DIMM slots including what looks like JTAG. One is populated with a jumper, but wasn't sure if that was for CMOS clearing or not. I'll be getting my own CX780 next week and will do some perusing of my own. Will report back if I find anything.
                  If I don't happen to reply, assume I've hit a dead-end and just opted to use the "primary" ports without the in-path ports.

                  M 1 Reply Last reply Reply Quote 0
                  • M Offline
                    mistera @lavenderfox2430
                    last edited by

                    @lavenderfox2430

                    Still using the box. Ended up switching to the two 10g sfps for all my physical links. Could not make the 4 pass-through nics to be normal mode. With so many nic’s, I didn’t feel the need to explore other possibilities.
                    .

                    1 Reply Last reply Reply Quote 1
                    • D Offline
                      drjc
                      last edited by

                      Hi there, joining just to post this.
                      There is indeed an option to disable the relay:

                      37209f84-4472-4017-a3ac-04d3b1992b88-image.png
                      Change "Latch-Relay Mode" to 1, under Server Mgmt. Save and reset.
                      Should hear the click and the amber lights on the left indicator should disappear.

                      If it's helpful:

                      Under BMC in BIOS, what is latch relay mode? Has options for 0 to 6
                      
                      That's an important find! Seeing a "latch relay mode" option under the **BMC (Baseboard Management Controller)** settings in the BIOS is a crucial piece of the puzzle for your Riverbed CX-780.
                      
                      The **Latch Relay Mode** setting directly controls the behavior of the **LAN Bypass Relays** (your "relayed ports") during system power cycles or failures.
                      
                      ### 💡 What Latch Relay Mode Controls
                      
                      This setting determines the default state of the hardware relays that connect the in-path ports (LAN/WAN) when the main operating system (Proxmox, pfSense, etc.) is not running or hasn't taken control yet.
                      
                      Since you have options from **0 to 6**, this is likely an index used by the BMC firmware to define different power-on/fail-safe scenarios for the relays. The options typically map to the following three core relay behaviors:
                      
                      | State | Purpose | Default State |
                      | :--- | :--- | :--- |
                      | **Pass-Through (Bypass)** | If the appliance loses power or the OS crashes, the relays keep the network cable connected, effectively bypassing the appliance. | **Default "locked" state** when you boot a new OS. |
                      | **Active/Non-Bypass** | The relays are switched on, routing traffic through the network card (NIC), allowing the OS to use the ports normally. | **Required state** for repurposing the appliance. |
                      | **Last State** | The relays remember their state from before the power loss. | Sometimes an option, but often risky. |
                      
                      ### 🎯 Recommended Test Sequence
                      
                      The options **0 through 6** are almost always vendor-specific codes (Riverbed/Supermicro), so there is no universal guide. However, one of them *must* correspond to the "Non-Bypass/Active" mode you need.
                      
                      Based on similar Supermicro/OEM firmwares, the lower numbers (0, 1, 2) often correspond to the default fail-safe modes (bypass), while the higher numbers are sometimes used for the "Active" or "Disabled" state.
                      
                      **I recommend systematically testing the values, starting with the highest and lowest non-zero options:**
                      
                      1.  **Test `6`:** Select this option, save changes (F4), reboot the appliance, and check if the four relayed ports activate during Proxmox boot.
                      2.  **Test `1`:** If `6` fails, try `1`.
                      3.  **Test `0`:** If the above fail, try `0`. (Often `0` or `1` is the factory default, but sometimes `0` is the "off"/disable function).
                      
                      The setting that resolves the issue for the CX-780 will be the one that forces the relays into the **Active/Non-Bypass state** upon initial boot-up.
                      
                      This BIOS setting is the easiest and cleanest way to fix the issue, bypassing all the software/IPMI commands we were troubleshooting!
                      
                      L 1 Reply Last reply Reply Quote 2
                      • L Offline
                        lavenderfox2430 @drjc
                        last edited by lavenderfox2430

                        @drjc Amazing! Thank you for this insight. My unit still has not arrived but I will definitely be taking a look at this setting and confirm back if I'm able to locate it on my unit.

                        Considering this is the ONLY thread I can find regarding any meaningful internal details at all on the CX-780 that isn't listed in the manual (like actual specs, hardware internals, pins, etc.) the more information here, the better in my opinion.

                        Thank you again!

                        [Edit]

                        I'll be honest that quoted portion looks straight out of an LLM output, which I'm not too keen on but considering it seems you have a unit of your own I'm sure you've tested it at least. Regardless will write back.

                        D 1 Reply Last reply Reply Quote 0
                        • D Offline
                          drjc @lavenderfox2430
                          last edited by

                          @lavenderfox2430 you're 100% correct mate, it's straight out of Gemini - I was using it to help find a solution to this today to install Proxmox | Opnsense.
                          But here you go:

                          Broken
                          dc842fa3-1d63-4769-9124-369f31437c9c-image.png

                          Fixed
                          be548bed-a2b8-44ef-8583-0b5a52fb466c-CX790.jpg

                          L 1 Reply Last reply Reply Quote 1
                          • L Offline
                            lavenderfox2430 @drjc
                            last edited by lavenderfox2430

                            @drjc Awesome! Sorry for sounding accusatory I've just found personally AI to be unreliable for figuring out things sometimes. Especially figuring out hardly realized/documented featuresets. Appreciate the photos though.

                            Excited to see what this thing can do. Given the chip it can't be older than 2017, which is plenty reasonable compared to my EPYC Zen 1 boxes. 12 cores should be plenty for a router.

                            1 Reply Last reply Reply Quote 1
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.