Load balancer (relayd) failing some SSL tests
I'm running pfSense 2.1.4-RELEASE (and a few instances of older versions). I use the load balancer/relayd in all of them. The system in question is a new install. I've setup the load balancer Pools, Virtual Servers and Monitors the same as other pfSense instances. In this instance, the load balancer tests against my hosts are failing like 20 to 30 percent of the time for SSL services only. For example, I have 4 hosts using port 80 (http) at 100% up time, the same four hosts using port 443 (https) show about 80% up time. If I go in and configure the Pool to do 2 Retries before declaring a host down, then it shows as 100% uptime.
I did a packet capture of the load balancer test traffic, all looks normal there - no missing response and all responses are in less than 100ms.
How can I figure out why relayd is declaring my hosts down unless I set 2 retries? How do I determine why it fails sometimes?
To add some more info… I was able to reproduce this on a second instance of pfSense 2.1.4-release. I'm unable to reproduce the problem in two different instances of pfSense 2.1.2-release. I enabled logging in the web server that handles the tests from the load balancer - I see them all and no errors.
This is starting to feel like a pfSense issue...