Large file transfer crash

johnpoz · Sep 8, 2021, 9:01 PM

@purple-turtle said in Large file transfer crash:

These are the pfsense colour standards

Not sure where your getting that from - you mean ipcop ;) IPcop was known for color like that. Blue was wifi, etc. Use to run ipcop way way back in the day.. Is how I know that was a ipcop thing. But never ever heard/seen pfsense ever mention colors like that. In like the 14+ years running pfsense.

Purple Turtle · Sep 8, 2021, 8:53 PM

@gertjan hi thanks for the response. I have no doubts that the solution can handle large amounts of data. I have pushed terrabytes through this setup of mine. The challenge is the file size moving between the green and yellow , i can move the same file from the red to the green. These movements are using the tplink niics, as you can see one way works but not the other. This is a home system and i don't have spare intel just lying around. This does appear to be a crash, what i am looking for is what tests to run to help identify and isolate the problem

KOM · Sep 8, 2021, 9:32 PM

@purple-turtle They are? I've been helping folks here for 6+ years and I've never heard of any pfSense security colour scheme.

Purple Turtle · Sep 9, 2021, 2:21 AM

@kom That's fine, do you have any ideas on why I can transfer 5gb files, but when I get to 30gb it crashes?
I can transfer direct machine to machine via my switch.
Slowing down the lan speed had no impact
The LAN cards are supported

Thoughts on tests or monitoring to help isolate / identify the issue?

Cheers

Purple Turtle · Sep 9, 2021, 2:26 AM

@johnpoz Ha ha quite funny
Yes I have a small NAS on the network and I have tested around 600TB of data movements during burn in testing. The problem now is large files. BTW I have one after another moved 100TB in 5TB blocks with no issues.
am looking for guidance on what to test / monitor to assist in identifying the cause.
All the hardware is supported by FREE BSD and PF sense and I have a very vanilla configuration. As I said before I slowed down the LAN speed to 100MB and it still crashed, so it does point to the size of the file in some form, or at least the link active time.

johnpoz · Sep 9, 2021, 5:06 AM

@purple-turtle said in Large file transfer crash:

All the hardware is supported by FREE BSD

Not really those realtek chips your tplink cards are using are nothing but problematic.. What are those like 5$ nics?

What version of pfsense are you running? If you say it only happens in 1 direction via specific nic - maybe that nic is just dying..

SteveITS · Sep 9, 2021, 4:31 PM

@purple-turtle Is there anything useful logged in the system log at the time of the crash? Total amount of bits transferred isn't really relevant to your scenario but we rsync files at night going through 3 pfSense routers (data center and our office) without issue, and those can be up to 75-100 GB each.

Purple Turtle · Sep 9, 2021, 10:43 PM

@steveits Hi Steve, thanks for your response. its comforting to hear of people that have been able to transfer large files.
I have been able to do such from the Web to by LAN, but not from my LAN to DMZ.
It is my understanding that FreeBSD may not be using the latest driver.... I have found issues from others and the NICs that I am using. I know that the NICS and the drivers in windows work as I have tested these
.I have installed these new drivers and will recommence my burn in tests over the week end

johnpoz · Sep 9, 2021, 11:01 PM

@purple-turtle If its all the same nic, they would all be using the same driver. So if wan to lan works fine, but lan to dmz fails - to me that says something wrong with dmz nic.

Does wan to dmz work?

Just replace the nic.. You can pick up another nic for nothing these days.. especially tplink gig nics.. I would go for intel, maybe a i340-t2, find those on ebay all day long for under $20 for sure..

Purple Turtle · Sep 9, 2021, 11:51 PM

@johnpoz Thanks John, the research indicates that FreeBSD may not have updated the drivers in the build. And that this is an issue of Watchdog failures in the past
I have rolled out new drivers and will do burn in tests over the week end
I have a constraint in that I need 1/2 height cards.
I have have tested the Reltek NICS in windows without troubles so I know that they and the drivers for Windows work, the challenge is on a FreeBSD environment.

johnpoz · Sep 10, 2021, 2:10 AM

@purple-turtle said in Large file transfer crash:

I have a constraint in that I need 1/2 height cards.

not problem - lots of low profile cards about.

Purple Turtle · Sep 10, 2021, 7:22 AM

Hi all,
Well the correct drivers have solved the problem, moved TB of data in stings of over 8TB and no crash.....
I am however going off and getting a intel 340-t4 card as I don't want to get caught with needing to install separate drivers again, I am of the "It works out of the box" camp. Also the better card will assist in offloading etc

Cheers all