@jnpetty
When you ping the CARP VIP from a connected device, it will first send an ARP request which the master should respond to.

So to investigate, sniff the traffic and check for ARP packets and if pfSense sends a respond.
If there is no ARP request, check the ARP table on the device you're pinging from for an already existing entry.

@tboston What's the mismatch?

It is also possible to save/back up the config, edit the XML file, and do a restore. But it should be possible to edit/assign interfaces in the web GUI.

sorry both hosts are 6.5u3

@mauro-tridici said in Question about multiple WAN CARP VIPs:

So, if I understand your messages correctly, I can add additional public virtual IPs as "IP alias" on top of existing CARP VIP

Yes. At interface select the CARP VIP from the drop-down.

even if is the usage of HAproxy is a better solution

What does this mean?

Could you please confirm that the assignment of multiple WAN IPs addresses (x.x.x.1,x.x.x.2,x.x.x.3,x.x.x.4,x.x.x.5,x.x.x.6) belonging to the same subnet will be not a problem?

All right.

Refer to the docs: Virtual IP Address Feature Comparison

Remember that you have to configure the outbound NAT manually to use the CARP VIP instead of the primary interface IP.

@misterto

WAN 1:

WAN Subnet: 161.12.60.232/29
ISP Gateway: 161.12.60.233
Routed Subnet: 161.12.51.32/29
Shared CARP VIP: 161.12.60.236

WAN 2:

WAN Subnet: 161.12.60.240/29
ISP Gateway: 161.12.60.241
Routed Subnet: 161.12.51.40/29
Shared CARP VIP: 161.12.60.244

Firewall 1:

WAN 1 Interface: 161.12.60.234
WAN 2 Interface: 161.12.60.242

Firewall 2:

WAN 1 Interface: 161.12.60.235
WAN 2 Interface: 161.12.60.243

I am having the same problem.

As my primary HA member is the one on 21.7 and the secondary is on 21.8, I tried to download the configuration xml and change from 21.8 to 21.7 and then restore the configuration. This didn't work.

I can try and switch the primary from 21.7 to 21.8 (after setting it to backup with carp) but will have to do it outside operating hours, as it scares me pretty good.

Does anyone else have any feedback on what might be causing this? This seems a pretty significant issue that 21.8 isn't even an acknowledged version and my primary system has no knowledge of there being an update.

@marama said in HA + VIP + MultiWAN Issue (no internet on slave):

@keyser ok, will do.
I'm a bit afraid of removing the "any", since I need to be sure to include all the relevant networks in the alias. Do I also have to include the ipsec and openvpn networks, translations/mapping networks... ?
Is there a way to leave "any", but then have explicit NAT rule handle the firewall traffic?

Yes, you need to have vpn networks and such in the alias as Well.
I normally always make an alias called private networks i use for stuff like that.
It contains:

192.168.0.0/16
172.16.0.0/12
10.0.0.0/8

That way any private (internal thing - including future uses) is covered - But not the FW and its public addresses.
Btw - that same alias is Very good in internet access allow rules instead of ANY. Use it as destination with the NOT (!) feature.

@kd Ah, I think using your own modem it is intended as a passthrough. Around here, business Comcast accounts provide the 10.1.10.x subnet and NAT. Useful for plugging in a laptop to bypass the client's router, to test.

My home modem is accessible at 192.168.100.1 but I don't think it provides NAT out. It doesn't have a "bridge mode" setting as it just passes the public IP through to my router or a laptop.

@Foxi352

Thank you for the links. I see, it is a difficult issue. I wish they had the CARP as option to take the functionality of a virtual interface (with DHCP/MAC, etc) , rather than just IP. So this can be shared between the firewalls.

It seems i have few issues:

DHCP - perhaps setting WAN as static IP would work untill the next lease, need to check MAC spoofing.. Not sure how to handle this for the two interfaces. Folks seem to use some scripts to have the interface UP and down

Perhaps I will manually plug the WAN cable when needed , if i can not find a workaround :).

thanks for your time

@wesleywillis said in VIP setup for web hosting:

I confirmed that I only get that block as described under 'Simple IP Subnet on WAN':

Yes, in this case you'd probably better go with Proxy ARP, so you can cover the whole subnet with a single VIP assignment.
It is a good way, when you want to forward the whole subnet behind pfSense.

So I'm assuming it's easiest to just setup NAT 1:1 as such:
External IP: 1.1.1.3/26
Internal IP: 10.0.10.3/26

Possibly you may have to state the network address here, when using network type.

It works for me but breaks openVPN, see Link.

@viragomann

Your suggested settings worked perfectly for my setup thankyou👍 👍 👍

I would like to have more than one XMLRPC destination as well to sync firewall rules and aliases to all my nodes.
A daisy chain as expected here is not a reliable solution.
Many Packages (e.g. pfblocker) already allow to sync to multiple hosts so I guess the limitation is only the GUI.

@lionelmarais said in SyncNic Failing with Error 32602:

I was able to sync the image with the same version

That is good to hear..

what gets done and reported is two totally different scenarios lol

To be honest, sadly I don't think that is something limited to any specific part of the world or agency hehahehe

@im-thatoneguy https://youtu.be/VnBnnh81G7w?t=3915

Not supported. Use SLAAC or two separate pools

@viragomann
Thank you very much, that did the trick!

@erode Can you put Suricata on LAN instead? That will 1) avoid scanning any packets that would normally be blocked by the firewall anyway, and 2) show the LAN IP of devices for the alerts.

@netblues said in Secondary router in HA setup web GUI unresponsive:

@bp81 said in [Secondary router in HA setup web GUI unresponsive]
, or I will devise a way to harden web gui access from within the authenticated user vlan to only authorized machines. I am also considering setting up the Azure MFA extensions for NPS and just protect the web gui login with RADIUS that is itself backed by AD authentication and multifactor authentication via Authenticator app. That's not my first choice because an internet outage could lock me out of my web gui. (/post/1014732):

You can always disable the antilockout rule for authenticated users lan and just allow authorised ip's
A good password on top is probably all you need.
AD authentication opens up another attack surface too.
as for 2fa, its a very bad idea for the exact reasons you just mentioned.

Now, since ip's can be changed, mac's can be spoofed how much security is enough security for you.?
You could also utilise a jump-host
where you could ssh and portforward remote ports when needed, or use windows and rdp to the device first, and then login to pf.

This is probably a topic for another thread. We have good wifi security (RADIUS backed authentication) and pretty good physical security (ie, no one is walking in and plugging in a laptop to an open network port). We have the guest VLANs blocked for any traffic to the web gui as well. So is this good enough? Probably, for the moment.

Over the years our security efforts have been focused towards external threats, but the company is getting large enough now I have to start thinking about internal actors as well. This is a conversation I'd like to have on this particular issue, because I have to start somewhere, but it's probably best to go into its own topic.

@netblues Hey netblues, thank you very much, after carefully scrolling through the VLAN config on the swtich, it appears that I did not commit my settings, after rebooting both the switch and netgates, the issue disappeared.

kind regards
kkit

@joezyz said in CARP/HA Multi WAN redirect each IP to LAN IP:

That is exactly how I have it set up right now, and it is not forwarding.

What? Port forwarding or 1:1?

Should the Virtual IP be a CARP, IP Alias, Proxy ARP, or Other? I currently have it as CARP.

Both CARP and IP Alias can be used.
It's not necessary to add all your public IPs as CARP, since this type generates some overhead network traffic.
You need at least one CARP IP, the others can be added as IP Alias and hook up on the CARP IP.

Did you also add a firewall rule to allow the access?
In port forwarding rules you can set associated filter rules or simply "pass" to allow the access. When using 1:1 you have to configure rules by yourself.

Is pfSense the default gateway on the device you've forwarded traffic?

Maybe you can post screenshots so we can verify the settings.

@hpa_support Better to use two managed L2 switches with VLANs. Then you only need 2 switches for as many VLANs as you need.

A basic setup is something like:

2 x pfsense devices (i.e. CARP MASTER and BACKUP) 2 x Managed L2 switches

Plan VLANs and configure on pfSense, i.e.

VLAN 10 - WAN1 (provider 1) VLAN 11 - WAN2 (provider 2) VLAN 20 - LAN VLAN 30 - Phones etc

Run 1 cable from each of the pfsense device to each switch (2 cables leaving each pfsense device, 4 cables in total). Configure as trunk ports on the switch so pfSense can pass traffic for any VLAN. Cross connect the two pfsense devices on another network port to handle pfsync.

Now configure VLANs on pfSense on those interfaces, pfsync on the cross-connected port, you can have as many VLANs as you need (WAN, LAN, DMZ, phone, etc) without extra switches or cables now.

You will want to cross-connect (or stack) the L2 switches between each other (configure as trunk ports) so they can pass the CARP heartbeat as well as any other VLAN traffic across switches. Consider enabling spanning tree on the switches to save yourself some frustration if you accidentally create a loop.

@cjbujold providing the details of what exactly was the problem and how you solved it could help someone in the same boat in the future.

@pfsense2090
Basically you need at least 3 IPs for CARP in each network. One for each box and one CARP VIP. So you should have 3 public IPs on each WAN for proper functionality.
Though it is possible to set it up with a single public IP and use private IPs on the boxes, it might be tricky and have disadvantages.

What is your DSL WAN, a PPP or DHCP? Both are not compatible with CARP. So you probably have to use another router on this line.

I managed to get redirects working but it redirects to private service address which is obviously not accessible from outside

mbamtray_2021-12-01_21-50-12.png

Ok i found bug A) i have choose TYP = ssl / https(TCP mode) .... thats the reason i got only the TLS options etc. But if i create this ACL - save - confirm - go back - try to change the option again there are all the other options availible which shouldn´t be chooseable. Thats why this Rule will be delete after - save - confirm - but without any error.

How ever this way is to buggy and cost to much time. I got an other way to get my wildcard domain certs now on a much easier way then befor using my hosting provider and their api (Hetzner).

Thx for read anyway.

bye Maik