Large file transfer crash
-
@purple-turtle They are? I've been helping folks here for 6+ years and I've never heard of any pfSense security colour scheme.
-
@kom That's fine, do you have any ideas on why I can transfer 5gb files, but when I get to 30gb it crashes?
I can transfer direct machine to machine via my switch.
Slowing down the lan speed had no impact
The LAN cards are supportedThoughts on tests or monitoring to help isolate / identify the issue?
Cheers
-
@johnpoz Ha ha quite funny
Yes I have a small NAS on the network and I have tested around 600TB of data movements during burn in testing. The problem now is large files. BTW I have one after another moved 100TB in 5TB blocks with no issues.
am looking for guidance on what to test / monitor to assist in identifying the cause.
All the hardware is supported by FREE BSD and PF sense and I have a very vanilla configuration. As I said before I slowed down the LAN speed to 100MB and it still crashed, so it does point to the size of the file in some form, or at least the link active time. -
@purple-turtle said in Large file transfer crash:
All the hardware is supported by FREE BSD
Not really those realtek chips your tplink cards are using are nothing but problematic.. What are those like 5$ nics?
What version of pfsense are you running? If you say it only happens in 1 direction via specific nic - maybe that nic is just dying..
-
@purple-turtle Is there anything useful logged in the system log at the time of the crash? Total amount of bits transferred isn't really relevant to your scenario but we rsync files at night going through 3 pfSense routers (data center and our office) without issue, and those can be up to 75-100 GB each.
-
@steveits Hi Steve, thanks for your response. its comforting to hear of people that have been able to transfer large files.
I have been able to do such from the Web to by LAN, but not from my LAN to DMZ.
It is my understanding that FreeBSD may not be using the latest driver.... I have found issues from others and the NICs that I am using. I know that the NICS and the drivers in windows work as I have tested these
.I have installed these new drivers and will recommence my burn in tests over the week end -
@purple-turtle If its all the same nic, they would all be using the same driver. So if wan to lan works fine, but lan to dmz fails - to me that says something wrong with dmz nic.
Does wan to dmz work?
Just replace the nic.. You can pick up another nic for nothing these days.. especially tplink gig nics.. I would go for intel, maybe a i340-t2, find those on ebay all day long for under $20 for sure..
-
@johnpoz Thanks John, the research indicates that FreeBSD may not have updated the drivers in the build. And that this is an issue of Watchdog failures in the past
I have rolled out new drivers and will do burn in tests over the week end
I have a constraint in that I need 1/2 height cards.
I have have tested the Reltek NICS in windows without troubles so I know that they and the drivers for Windows work, the challenge is on a FreeBSD environment. -
@purple-turtle said in Large file transfer crash:
I have a constraint in that I need 1/2 height cards.
not problem - lots of low profile cards about.
-
Hi all,
Well the correct drivers have solved the problem, moved TB of data in stings of over 8TB and no crash.....
I am however going off and getting a intel 340-t4 card as I don't want to get caught with needing to install separate drivers again, I am of the "It works out of the box" camp. Also the better card will assist in offloading etcCheers all
