Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Chelsio T580-SO-CR

    Scheduled Pinned Locked Moved Hardware
    38 Posts 6 Posters 5.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S
      stephenw10 Netgate Administrator
      last edited by

      So can you retest with a version you didn't have a problem in?

      The Chelsio driver can update the firmware on the card if it finds it's older than the version it has. That may have happened and it may be that that's causing the problem. If it is it would probably be a problem in any OS.

      Do you actually see cxlX devices in pciconf -lv ?

      Steve

      X 1 Reply Last reply Reply Quote 0
      • X
        xlameee
        last edited by

        OK my other server is working
        R320 exactly the same configuration and firmware and T580 firmware is the same and it is working perfectly just pfsense come up with the bug see https://forum.netgate.com/topic/136203/bug-v2-4-4

        3_1538409964397_chelsio-version.jpg 2_1538409964397_2018-10-01_6-20-23.jpg 1_1538409964397_2018-10-01_6-04-53.jpg 0_1538409964392_2018-10-01_6-01-47.jpg

        1 Reply Last reply Reply Quote 0
        • X
          xlameee @stephenw10
          last edited by

          @stephenw10 yes I can I thing

          0_1538411091800_2018-10-01_11-12-38.jpg

          1_1538411091800_2018-10-01_11-13-14.jpg

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Ok so that is comparing your two systems?

            Both are running 2.4.4 and both have the same Chelsio card in?

            In that case I would try swapping the cards between the systems and see if the fault follows the card.

            Otherwise can we see the complete output of pciconf -lv from both systems?

            Steve

            X 1 Reply Last reply Reply Quote 0
            • X
              xlameee @stephenw10
              last edited by

              @stephenw10 I did still no change :(

              1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                So you swapped the cards and the issue stayed with the same system?

                Then if the same card works fine in pfSense 2.4.4 on the other system there is a difference with the system setup or something in the config that is different. The pciconf output between the two systems looks identical?

                Steve

                X 1 Reply Last reply Reply Quote 0
                • X
                  xlameee @stephenw10
                  last edited by xlameee

                  @stephenw10 Hello

                  I just compare both firmware in lifecycle controller seems the stupid dell have mind of it own the lifecycle controller had upgraded itself to a newer version

                  FIRMWARE:

                  BIOS : v2.5.1
                  Lifecycle Controller : v1.1.1.18

                  HARDWARE I USED

                  CPU: E5-2450L 1.8GHz 8-core
                  RAM : 24GB ECC Registered
                  Network adapter: Chelsio T580-SO-CR
                  SAS Controller: PERC H310 mini
                  HDD: Intel SSD 545s Series 256GB
                  IDRAC: IDRAC7 Enterprise with dedicated card

                  Some tips:
                  iDRAC7 (if) make sure you disable auto update option
                  Lifecycle Controller: Disabled - Just in-case

                  I will tested to see if it works as is without tuning it and I will post it here so if someone wants to build system like mine won't go trough hell like me

                  Thank you

                  1 Reply Last reply Reply Quote 1
                  • X
                    xlameee
                    last edited by

                    UPDATE

                    Everything is working perfectly.
                    The total price of this configuration is less then $700 including R320, Chelsio T580-SO-CR and Intel 545 SSD
                    I will lower it to $600 because I just found seller on eBay selling Chelsio T580-LP-CR for less then $200. All recommendations on the net was, that T580-LP-CR is the best choice for pfSense.
                    I've got stuck for day on configuring NEXUS 3132Q-V, but was worth it. When I am done building the HA Cluster I will have the chance to test the speed and submit it to this post.

                    Thank you all

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      So just to confirm the cause of the issue here was the "lifecycle controller"? And only in the updated firmware version?

                      Glad it wasn't a conspiracy anyway. 😉

                      Steve

                      X 1 Reply Last reply Reply Quote 1
                      • X
                        xlameee @stephenw10
                        last edited by xlameee

                        @stephenw10 Yes that was the problem stupid new auto firmware update on the idrac7 option
                        and before that to old version of the BIOS v1.5.2 upgraded to v2.5.1 and downgraded to LC v1.1.1.18 and all seems to work fine

                        Yes, sorry about that I was 24h straight trying to find the solution I am glad you are not a conspirator :)

                        Thank you

                        1 Reply Last reply Reply Quote 0
                        • X
                          xlameee
                          last edited by

                          Is that a bug or brand new Chelsio T580-SO-CR one of the ports just failed

                          "cxl1: Interface stopped DISTRIBUTING, possible flapping "

                          thank you

                          1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            It's not a bug as far as I know. What is it connected to? Does it show the link as down? Does it comes back up if you disconnect and reconnect the link?

                            Steve

                            X 1 Reply Last reply Reply Quote 0
                            • X
                              xlameee @stephenw10
                              last edited by

                              @stephenw10 the link is up does not come down but I am getting this error on the vga console and I can't make sense of it.

                              1 Reply Last reply Reply Quote 0
                              • stephenw10S
                                stephenw10 Netgate Administrator
                                last edited by

                                If it part of a lagg group? Usually that indicates it's been removed from the group because it was showing the link go up and down too rapidly to be actual disconnects.
                                Is there nothing logged in the system log when that happens?
                                Are you actually seeing it lose connectivity.

                                Steve

                                1 Reply Last reply Reply Quote 0
                                • DerelictD
                                  Derelict LAYER 8 Netgate
                                  last edited by

                                  What is it connected to? What is in the logs there?

                                  Chattanooga, Tennessee, USA
                                  A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                                  DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                                  Do Not Chat For Help! NO_WAN_EGRESS(TM)

                                  1 Reply Last reply Reply Quote 0
                                  • P
                                    pglover19
                                    last edited by

                                    xlameee… Can you provide me a link to the LC v1.1.1.18 software. I am trying to setup a DELL R320 server for pfSense and having some issues.

                                    Thanks..

                                    P 1 Reply Last reply Reply Quote 0
                                    • P
                                      pglover19 @pglover19
                                      last edited by

                                      @pglover19 said in Chelsio T580-SO-CR:

                                      xlameee… Can you provide me a link to the LC v1.1.1.18 software. I am trying to setup a DELL R320 server for pfSense and having some issues.

                                      Thanks..

                                      One more thing.. How do you install the LC without an OS installed? I can't seem to install it from the LifeCycle Controller GUI upon boot up.

                                      1 Reply Last reply Reply Quote 0
                                      • P
                                        pglover19
                                        last edited by

                                        xlameee… Can you please answer my questions about the LC version for the Dell R320.

                                        1 Reply Last reply Reply Quote 0
                                        • First post
                                          Last post
                                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.