Intermittent packet loss related to DHCP with Multi-WAN

nazar-pc

When both WAN and WAN2 are active this happens:

Jan 4 19:37:28 	dhclient 	77676 	Creating resolv.conf
Jan 4 19:37:28 	dhclient 	77107 	RENEW
Jan 4 19:23:53 	dhclient 	20530 	Creating resolv.conf
Jan 4 19:23:53 	dhclient 	20158 	RENEW
Jan 4 19:21:59 	dhclient 	80412 	Creating resolv.conf
Jan 4 19:21:59 	dhclient 	80239 	Adding new routes to interface: vtnet1
Jan 4 19:21:59 	dhclient 	79689 	New Routers (vtnet1): x.y.z.1
Jan 4 19:21:59 	dhclient 	79547 	New Broadcast Address (vtnet1): x.y.z.63
Jan 4 19:21:59 	dhclient 	79428 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 4 19:21:59 	dhclient 	79119 	New IP Address (vtnet1): 176.x.y.z
Jan 4 19:21:59 	dhclient 	78558 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 4 19:21:59 	dhclient 	78273 	Starting add_new_address()
Jan 4 19:21:59 	dhclient 	78036 	BOUND
Jan 4 19:21:58 	dhclient 	77776 	ARPCHECK
Jan 4 19:21:56 	dhclient 	32647 	ARPSEND
Jan 4 19:21:55 	dhclient 	31681 	PREINIT
Jan 4 19:21:55 	dhclient 	31290 	Deleting old routes
Jan 4 19:21:55 	dhclient 	30510 	EXPIRE
Jan 4 19:10:33 	dhclient 	24556 	Creating resolv.conf
Jan 4 19:10:33 	dhclient 	24107 	RENEW
Jan 4 19:06:54 	dhclient 	9210 	Creating resolv.conf
Jan 4 19:06:54 	dhclient 	8757 	RENEW
Jan 4 18:53:35 	dhclient 	33672 	Creating resolv.conf
Jan 4 18:53:35 	dhclient 	33398 	RENEW
Jan 4 18:38:38 	dhclient 	38684 	Creating resolv.conf
Jan 4 18:38:38 	dhclient 	38229 	RENEW
Jan 4 18:25:27 	dhclient 	64419 	Creating resolv.conf
Jan 4 18:25:27 	dhclient 	63806 	RENEW
Jan 4 18:11:59 	dhclient 	79381 	Creating resolv.conf
Jan 4 18:11:59 	dhclient 	78788 	RENEW
Jan 4 18:10:33 	dhclient 	48157 	Creating resolv.conf
Jan 4 18:10:33 	dhclient 	48000 	RENEW
Jan 4 17:58:39 	dhclient 	7436 	Creating resolv.conf
Jan 4 17:58:39 	dhclient 	7065 	RENEW
Jan 4 17:45:05 	dhclient 	43638 	Creating resolv.conf
Jan 4 17:45:05 	dhclient 	43229 	RENEW
Jan 4 17:43:22 	dhclient 	812 	Creating resolv.conf
Jan 4 17:43:22 	dhclient 	651 	Adding new routes to interface: vtnet1
Jan 4 17:43:22 	dhclient 	21 	New Routers (vtnet1): x.y.z.1
Jan 4 17:43:22 	dhclient 	99989 	New Broadcast Address (vtnet1): x.y.z.63
Jan 4 17:43:22 	dhclient 	99799 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 4 17:43:22 	dhclient 	99369 	New IP Address (vtnet1): 176.x.y.z
Jan 4 17:43:22 	dhclient 	98438 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 4 17:43:22 	dhclient 	97826 	Starting add_new_address()
Jan 4 17:43:22 	dhclient 	96861 	BOUND
Jan 4 17:43:22 	dhclient 	58196 	ARPCHECK
Jan 4 17:43:20 	dhclient 	53815 	ARPSEND
Jan 4 17:43:19 	dhclient 	53391 	PREINIT
Jan 4 17:43:19 	dhclient 	52281 	Deleting old routes
Jan 4 17:43:19 	dhclient 	51772 	EXPIRE
Jan 4 17:28:18 	dhclient 	52590 	Creating resolv.conf
Jan 4 17:28:18 	dhclient 	52045 	RENEW
Jan 4 17:14:23 	dhclient 	59943 	Creating resolv.conf
Jan 4 17:14:23 	dhclient 	59721 	RENEW
Jan 4 17:10:33 	dhclient 	45817 	Creating resolv.conf
Jan 4 17:10:33 	dhclient 	45561 	RENEW
Jan 4 17:00:48 	dhclient 	84277 	Creating resolv.conf
Jan 4 17:00:48 	dhclient 	83993 	RENEW
Jan 4 16:47:35 	dhclient 	7230 	Creating resolv.conf
Jan 4 16:47:35 	dhclient 	6762 	RENEW
Jan 4 16:34:21 	dhclient 	35510 	Creating resolv.conf
Jan 4 16:34:21 	dhclient 	35218 	RENEW
Jan 4 16:21:12 	dhclient 	71329 	Creating resolv.conf
Jan 4 16:21:12 	dhclient 	71172 	RENEW
Jan 4 16:10:33 	dhclient 	87625 	Creating resolv.conf
Jan 4 16:10:33 	dhclient 	87361 	RENEW
Jan 4 16:07:49 	dhclient 	99596 	Creating resolv.conf
Jan 4 16:07:49 	dhclient 	99416 	RENEW
Jan 4 15:54:06 	dhclient 	32865 	Creating resolv.conf
Jan 4 15:54:06 	dhclient 	32609 	RENEW
Jan 4 15:40:54 	dhclient 	72189 	Creating resolv.conf
Jan 4 15:40:54 	dhclient 	71670 	RENEW
Jan 4 15:26:30 	dhclient 	80997 	Creating resolv.conf
Jan 4 15:26:30 	dhclient 	80622 	RENEW
Jan 4 15:12:10 	dhclient 	81358 	Creating resolv.conf
Jan 4 15:12:10 	dhclient 	80842 	RENEW
Jan 4 15:10:33 	dhclient 	33644 	Creating resolv.conf
Jan 4 15:10:33 	dhclient 	33398 	RENEW
Jan 4 14:57:43 	dhclient 	65375 	Creating resolv.conf
Jan 4 14:57:43 	dhclient 	64975 	RENEW
Jan 4 14:44:23 	dhclient 	95838 	Creating resolv.conf
Jan 4 14:44:23 	dhclient 	95274 	RENEW
Jan 4 14:30:56 	dhclient 	23764 	Creating resolv.conf
Jan 4 14:30:56 	dhclient 	23560 	RENEW
Jan 4 14:16:20 	dhclient 	23379 	Creating resolv.conf
Jan 4 14:16:20 	dhclient 	22996 	RENEW
Jan 4 14:10:32 	dhclient 	56573 	Creating resolv.conf
Jan 4 14:10:32 	dhclient 	55930 	RENEW
Jan 4 14:03:12 	dhclient 	59065 	Creating resolv.conf
Jan 4 14:03:12 	dhclient 	58644 	RENEW
Jan 4 13:49:50 	dhclient 	76595 	Creating resolv.conf
Jan 4 13:49:50 	dhclient 	76024 	RENEW
Jan 4 13:36:27 	dhclient 	9319 	Creating resolv.conf
Jan 4 13:36:27 	dhclient 	9076 	RENEW
Jan 4 13:23:09 	dhclient 	44715 	Creating resolv.conf
Jan 4 13:23:09 	dhclient 	44239 	RENEW
Jan 4 13:10:31 	dhclient 	81080 	Creating resolv.conf
Jan 4 13:10:31 	dhclient 	80762 	RENEW
Jan 4 13:09:29 	dhclient 	52906 	Creating resolv.conf
Jan 4 13:09:29 	dhclient 	52847 	RENEW
Jan 4 12:56:15 	dhclient 	96972 	Creating resolv.conf
Jan 4 12:56:15 	dhclient 	96805 	RENEW
Jan 4 12:43:06 	dhclient 	56131 	Creating resolv.conf
Jan 4 12:43:06 	dhclient 	55676 	RENEW
Jan 4 12:29:43 	dhclient 	88835 	Creating resolv.conf
Jan 4 12:29:43 	dhclient 	88604 	RENEW
Jan 4 12:16:22 	dhclient 	15174 	Creating resolv.conf
Jan 4 12:16:22 	dhclient 	14883 	RENEW
Jan 4 12:10:31 	dhclient 	65120 	Creating resolv.conf
Jan 4 12:10:31 	dhclient 	64952 	RENEW
Jan 4 12:01:48 	dhclient 	10495 	Creating resolv.conf
Jan 4 12:01:48 	dhclient 	10285 	RENEW
Jan 4 11:48:31 	dhclient 	43256 	Creating resolv.conf
Jan 4 11:48:31 	dhclient 	42870 	RENEW
Jan 4 11:34:33 	dhclient 	70702 	Creating resolv.conf
Jan 4 11:34:33 	dhclient 	70374 	RENEW
Jan 4 11:20:46 	dhclient 	73870 	Creating resolv.conf
Jan 4 11:20:46 	dhclient 	73445 	RENEW
Jan 4 11:10:31 	dhclient 	85657 	Creating resolv.conf
Jan 4 11:10:31 	dhclient 	85517 	RENEW
Jan 4 11:07:28 	dhclient 	4054 	Creating resolv.conf
Jan 4 11:07:28 	dhclient 	3668 	RENEW
Jan 4 10:54:13 	dhclient 	39060 	Creating resolv.conf
Jan 4 10:54:13 	dhclient 	38537 	RENEW
Jan 4 10:40:22 	dhclient 	38856 	Creating resolv.conf
Jan 4 10:40:22 	dhclient 	38605 	RENEW
Jan 4 10:26:38 	dhclient 	69668 	Creating resolv.conf
Jan 4 10:26:38 	dhclient 	69495 	RENEW
Jan 4 10:11:38 	dhclient 	50130 	Creating resolv.conf
Jan 4 10:11:38 	dhclient 	49804 	RENEW
Jan 4 10:10:31 	dhclient 	20441 	Creating resolv.conf
Jan 4 10:10:31 	dhclient 	20020 	RENEW
Jan 4 09:58:27 	dhclient 	89375 	Creating resolv.conf
Jan 4 09:58:27 	dhclient 	88844 	RENEW
Jan 4 09:44:11 	dhclient 	94938 	Creating resolv.conf
Jan 4 09:44:11 	dhclient 	94625 	RENEW
Jan 4 09:30:42 	dhclient 	30524 	Creating resolv.conf
Jan 4 09:30:42 	dhclient 	30068 	RENEW
Jan 4 09:16:32 	dhclient 	36959 	Creating resolv.conf
Jan 4 09:16:32 	dhclient 	36613 	RENEW
Jan 4 09:10:31 	dhclient 	98648 	Creating resolv.conf
Jan 4 09:10:31 	dhclient 	98206 	RENEW
Jan 4 09:02:43 	dhclient 	71390 	Creating resolv.conf
Jan 4 09:02:43 	dhclient 	71191 	RENEW
Jan 4 08:48:34 	dhclient 	76548 	Creating resolv.conf
Jan 4 08:48:34 	dhclient 	76324 	RENEW
Jan 4 08:35:25 	dhclient 	12378 	Creating resolv.conf
Jan 4 08:35:25 	dhclient 	12020 	RENEW
Jan 4 08:22:10 	dhclient 	42708 	Creating resolv.conf
Jan 4 08:22:10 	dhclient 	42391 	RENEW
Jan 4 08:10:30 	dhclient 	22669 	Creating resolv.conf
Jan 4 08:10:30 	dhclient 	22267 	RENEW
Jan 4 08:08:09 	dhclient 	37867 	Creating resolv.conf
Jan 4 08:08:09 	dhclient 	37693 	RENEW
Jan 4 07:54:33 	dhclient 	72934 	Creating resolv.conf
Jan 4 07:54:33 	dhclient 	72697 	RENEW
Jan 4 07:41:24 	dhclient 	12619 	Creating resolv.conf
Jan 4 07:41:24 	dhclient 	12223 	RENEW
Jan 4 07:27:12 	dhclient 	17525 	Creating resolv.conf
Jan 4 07:27:12 	dhclient 	17115 	RENEW
Jan 4 07:13:59 	dhclient 	56392 	Creating resolv.conf
Jan 4 07:13:59 	dhclient 	56202 	RENEW
Jan 4 07:10:30 	dhclient 	75136 	Creating resolv.conf
Jan 4 07:10:30 	dhclient 	74792 	RENEW
Jan 4 06:59:59 	dhclient 	2052 	Creating resolv.conf
Jan 4 06:59:59 	dhclient 	1750 	RENEW
Jan 4 06:46:50 	dhclient 	39569 	Creating resolv.conf
Jan 4 06:46:50 	dhclient 	39084 	RENEW
Jan 4 06:32:57 	dhclient 	50428 	Creating resolv.conf
Jan 4 06:32:57 	dhclient 	49896 	RENEW
Jan 4 06:19:30 	dhclient 	83731 	Creating resolv.conf
Jan 4 06:19:30 	dhclient 	83574 	RENEW
Jan 4 06:10:30 	dhclient 	33860 	Creating resolv.conf
Jan 4 06:10:30 	dhclient 	33463 	RENEW
Jan 4 06:06:20 	dhclient 	20359 	Creating resolv.conf
Jan 4 06:06:20 	dhclient 	20264 	RENEW
Jan 4 05:52:49 	dhclient 	54653 	Creating resolv.conf
Jan 4 05:52:49 	dhclient 	54390 	RENEW
Jan 4 05:38:43 	dhclient 	65146 	Creating resolv.conf
Jan 4 05:38:43 	dhclient 	64932 	RENEW
Jan 4 05:25:05 	dhclient 	97460 	Creating resolv.conf
Jan 4 05:25:05 	dhclient 	97076 	RENEW
Jan 4 05:11:49 	dhclient 	58674 	Creating resolv.conf
Jan 4 05:11:49 	dhclient 	58568 	Adding new routes to interface: vtnet1
Jan 4 05:11:49 	dhclient 	58334 	New Routers (vtnet1): x.y.z.1
Jan 4 05:11:49 	dhclient 	58090 	New Broadcast Address (vtnet1): x.y.z.63
Jan 4 05:11:49 	dhclient 	58002 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 4 05:11:49 	dhclient 	57869 	New IP Address (vtnet1): 176.x.y.z
Jan 4 05:11:49 	dhclient 	57778 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 4 05:11:49 	dhclient 	57623 	Starting add_new_address()
Jan 4 05:11:49 	dhclient 	56979 	BOUND
Jan 4 05:11:49 	dhclient 	56512 	ARPCHECK
Jan 4 05:11:47 	dhclient 	56106 	ARPSEND
Jan 4 05:11:45 	dhclient 	10230 	PREINIT
Jan 4 05:11:45 	dhclient 	9870 	Deleting old routes
Jan 4 05:11:45 	dhclient 	9613 	EXPIRE
Jan 4 05:10:30 	dhclient 	78010 	Creating resolv.conf
Jan 4 05:10:30 	dhclient 	77838 	RENEW
Jan 4 04:56:44 	dhclient 	89872 	Creating resolv.conf
Jan 4 04:56:44 	dhclient 	89600 	RENEW
Jan 4 04:42:38 	dhclient 	8400 	Creating resolv.conf
Jan 4 04:42:38 	dhclient 	8111 	RENEW
Jan 4 04:28:58 	dhclient 	56733 	Creating resolv.conf
Jan 4 04:28:58 	dhclient 	56572 	Adding new routes to interface: vtnet1
Jan 4 04:28:58 	dhclient 	56298 	New Routers (vtnet1): x.y.z.1
Jan 4 04:28:58 	dhclient 	56277 	New Broadcast Address (vtnet1): x.y.z.63
Jan 4 04:28:58 	dhclient 	56020 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 4 04:28:58 	dhclient 	55856 	New IP Address (vtnet1): 176.x.y.z
Jan 4 04:28:58 	dhclient 	55475 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 4 04:28:58 	dhclient 	55234 	Starting add_new_address()
Jan 4 04:28:58 	dhclient 	55174 	BOUND
Jan 4 04:28:58 	dhclient 	54896 	ARPCHECK
Jan 4 04:28:56 	dhclient 	46764 	ARPSEND
Jan 4 04:28:55 	dhclient 	8922 	PREINIT
Jan 4 04:28:55 	dhclient 	7910 	Deleting old routes
Jan 4 04:28:55 	dhclient 	7385 	EXPIRE
Jan 4 04:13:54 	dhclient 	75721 	Creating resolv.conf
Jan 4 04:13:54 	dhclient 	75264 	RENEW
Jan 4 04:10:30 	dhclient 	89908 	Creating resolv.conf
Jan 4 04:10:30 	dhclient 	89577 	RENEW
Jan 4 04:10:00 	newsyslog 	59136 	logfile turned over due to size>500K
Jan 4 04:10:00 	newsyslog 	59136 	logfile turned over due to size>500K
Jan 4 04:00:19 	dhclient 	15959 	Creating resolv.conf
Jan 4 04:00:19 	dhclient 	15554 	RENEW
Jan 4 03:45:47 	dhclient 	27729 	Creating resolv.conf
Jan 4 03:45:47 	dhclient 	27512 	Adding new routes to interface: vtnet1
Jan 4 03:45:47 	dhclient 	27128 	New Routers (vtnet1): x.y.z.1
Jan 4 03:45:47 	dhclient 	26943 	New Broadcast Address (vtnet1): x.y.z.63
Jan 4 03:45:47 	dhclient 	26471 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 4 03:45:47 	dhclient 	26321 	New IP Address (vtnet1): 176.x.y.z
Jan 4 03:45:47 	dhclient 	25034 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 4 03:45:47 	dhclient 	24927 	Starting add_new_address()
Jan 4 03:45:47 	dhclient 	23952 	BOUND
Jan 4 03:45:46 	dhclient 	93120 	ARPCHECK
Jan 4 03:45:44 	dhclient 	90586 	ARPSEND
Jan 4 03:45:43 	dhclient 	89675 	PREINIT
Jan 4 03:45:43 	dhclient 	88825 	Deleting old routes
Jan 4 03:45:43 	dhclient 	88191 	EXPIRE
Jan 4 03:30:42 	dhclient 	47448 	Creating resolv.conf
Jan 4 03:30:42 	dhclient 	46908 	RENEW
Jan 4 03:17:30 	dhclient 	82107 	Creating resolv.conf
Jan 4 03:17:30 	dhclient 	81909 	RENEW
Jan 4 03:10:30 	dhclient 	87149 	Creating resolv.conf
Jan 4 03:10:30 	dhclient 	86728 	RENEW
Jan 4 03:03:12 	dhclient 	92783 	Creating resolv.conf
Jan 4 03:03:12 	dhclient 	92488 	RENEW
Jan 4 02:50:02 	dhclient 	83073 	Creating resolv.conf
Jan 4 02:50:02 	dhclient 	82942 	RENEW
Jan 4 02:36:27 	dhclient 	13667 	Creating resolv.conf
Jan 4 02:36:27 	dhclient 	13391 	RENEW
Jan 4 02:22:01 	dhclient 	20117 	Creating resolv.conf
Jan 4 02:22:01 	dhclient 	19836 	RENEW
Jan 4 02:10:30 	dhclient 	85278 	Creating resolv.conf
Jan 4 02:10:30 	dhclient 	85017 	RENEW
Jan 4 02:07:12 	dhclient 	1064 	Creating resolv.conf
Jan 4 02:07:12 	dhclient 	599 	RENEW
Jan 4 01:53:54 	dhclient 	25418 	Creating resolv.conf
Jan 4 01:53:54 	dhclient 	25200 	RENEW
Jan 4 01:40:10 	dhclient 	57047 	Creating resolv.conf
Jan 4 01:40:10 	dhclient 	56663 	RENEW
Jan 4 01:25:59 	dhclient 	57558 	Creating resolv.conf
Jan 4 01:25:59 	dhclient 	57466 	RENEW
Jan 4 01:12:45 	dhclient 	87812 	Creating resolv.conf
Jan 4 01:12:45 	dhclient 	87335 	RENEW
Jan 4 01:10:30 	dhclient 	27067 	Creating resolv.conf
Jan 4 01:10:30 	dhclient 	26625 	RENEW
Jan 4 00:58:46 	dhclient 	84987 	Creating resolv.conf
Jan 4 00:58:46 	dhclient 	84750 	RENEW
Jan 4 00:45:19 	dhclient 	18900 	Creating resolv.conf
Jan 4 00:45:19 	dhclient 	18517 	RENEW
Jan 4 00:31:36 	dhclient 	35627 	Creating resolv.conf
Jan 4 00:31:36 	dhclient 	35160 	RENEW
Jan 4 00:18:17 	dhclient 	56395 	Creating resolv.conf
Jan 4 00:18:17 	dhclient 	56124 	RENEW
Jan 4 00:10:30 	dhclient 	53418 	Creating resolv.conf
Jan 4 00:10:30 	dhclient 	53017 	RENEW
Jan 4 00:04:16 	dhclient 	82504 	Creating resolv.conf
Jan 4 00:04:16 	dhclient 	82031 	RENEW
Jan 3 23:50:03 	dhclient 	90760 	Creating resolv.conf
Jan 3 23:50:03 	dhclient 	90308 	RENEW
Jan 3 23:36:06 	dhclient 	97350 	Creating resolv.conf
Jan 3 23:36:06 	dhclient 	97135 	RENEW
Jan 3 23:22:29 	dhclient 	34403 	Creating resolv.conf
Jan 3 23:22:29 	dhclient 	34055 	RENEW
Jan 3 23:10:30 	dhclient 	96413 	Creating resolv.conf
Jan 3 23:10:30 	dhclient 	96046 	RENEW
Jan 3 23:09:19 	dhclient 	66763 	Creating resolv.conf
Jan 3 23:09:19 	dhclient 	66525 	RENEW
Jan 3 22:55:54 	dhclient 	95521 	Creating resolv.conf
Jan 3 22:55:54 	dhclient 	95331 	RENEW
Jan 3 22:42:32 	dhclient 	33478 	Creating resolv.conf
Jan 3 22:42:32 	dhclient 	33167 	RENEW
Jan 3 22:40:51 	dhclient 	90179 	Creating resolv.conf
Jan 3 22:40:51 	dhclient 	90136 	Adding new routes to interface: vtnet1
Jan 3 22:40:51 	dhclient 	89539 	New Routers (vtnet1): x.y.z.1
Jan 3 22:40:51 	dhclient 	89414 	New Broadcast Address (vtnet1): x.y.z.63
Jan 3 22:40:51 	dhclient 	89300 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 3 22:40:51 	dhclient 	89169 	New IP Address (vtnet1): 176.x.y.z
Jan 3 22:40:51 	dhclient 	88736 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 3 22:40:51 	dhclient 	88455 	Starting add_new_address()
Jan 3 22:40:51 	dhclient 	88175 	BOUND
Jan 3 22:40:51 	dhclient 	56339 	ARPCHECK
Jan 3 22:40:49 	dhclient 	49751 	ARPSEND
Jan 3 22:40:48 	dhclient 	48922 	PREINIT
Jan 3 22:40:48 	dhclient 	47956 	Deleting old routes
Jan 3 22:40:48 	dhclient 	47403 	EXPIRE
Jan 3 22:25:47 	dhclient 	25872 	Creating resolv.conf
Jan 3 22:25:47 	dhclient 	25556 	RENEW
Jan 3 22:11:58 	dhclient 	54918 	Creating resolv.conf
Jan 3 22:11:58 	dhclient 	54671 	RENEW
Jan 3 22:10:30 	dhclient 	2351 	Creating resolv.conf
Jan 3 22:10:30 	dhclient 	2170 	RENEW
Jan 3 21:57:23 	dhclient 	57797 	Creating resolv.conf
Jan 3 21:57:23 	dhclient 	57422 	RENEW
Jan 3 21:43:53 	dhclient 	61898 	Creating resolv.conf
Jan 3 21:43:53 	dhclient 	61660 	RENEW
Jan 3 21:30:42 	dhclient 	92889 	Creating resolv.conf
Jan 3 21:30:42 	dhclient 	92728 	RENEW
Jan 3 21:17:10 	dhclient 	30916 	Creating resolv.conf
Jan 3 21:17:10 	dhclient 	30605 	RENEW
Jan 3 21:15:29 	dhclient 	11881 	Creating resolv.conf
Jan 3 21:15:29 	dhclient 	11667 	Adding new routes to interface: vtnet1
Jan 3 21:15:29 	dhclient 	11403 	New Routers (vtnet1): x.y.z.1
Jan 3 21:15:29 	dhclient 	11387 	New Broadcast Address (vtnet1): x.y.z.63
Jan 3 21:15:29 	dhclient 	11061 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 3 21:15:29 	dhclient 	11031 	New IP Address (vtnet1): 176.x.y.z
Jan 3 21:15:29 	dhclient 	10669 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 3 21:15:29 	dhclient 	10389 	Starting add_new_address()
Jan 3 21:15:29 	dhclient 	10107 	BOUND
Jan 3 21:15:29 	dhclient 	2977 	ARPCHECK
Jan 3 21:15:27 	dhclient 	95635 	ARPSEND
Jan 3 21:15:26 	dhclient 	59148 	PREINIT
Jan 3 21:15:26 	dhclient 	55259 	Deleting old routes
Jan 3 21:15:26 	dhclient 	52365 	EXPIRE
Jan 3 21:10:29 	dhclient 	27803 	Creating resolv.conf
Jan 3 21:10:29 	dhclient 	27690 	RENEW
Jan 3 21:00:25 	dhclient 	41834 	Creating resolv.conf
Jan 3 21:00:25 	dhclient 	41532 	RENEW
Jan 3 20:47:14 	dhclient 	73835 	Creating resolv.conf
Jan 3 20:47:14 	dhclient 	73240 	RENEW
Jan 3 20:32:57 	dhclient 	79998 	Creating resolv.conf
Jan 3 20:32:57 	dhclient 	79495 	RENEW
Jan 3 20:19:51 	dhclient 	11506 	Creating resolv.conf
Jan 3 20:19:51 	dhclient 	11055 	RENEW
Jan 3 20:10:28 	dhclient 	59679 	Creating resolv.conf
Jan 3 20:10:28 	dhclient 	59246 	RENEW
Jan 3 20:05:57 	dhclient 	19031 	Creating resolv.conf
Jan 3 20:05:57 	dhclient 	18734 	RENEW
Jan 3 19:52:42 	dhclient 	45817 	Creating resolv.conf
Jan 3 19:52:42 	dhclient 	45467 	RENEW
Jan 3 19:39:33 	dhclient 	5254 	Creating resolv.conf
Jan 3 19:39:33 	dhclient 	4938 	RENEW
Jan 3 19:25:33 	dhclient 	99848 	Creating resolv.conf
Jan 3 19:25:33 	dhclient 	99239 	RENEW
Jan 3 19:11:31 	dhclient 	2100 	Creating resolv.conf
Jan 3 19:11:31 	dhclient 	1625 	RENEW
Jan 3 19:10:28 	dhclient 	69019 	Creating resolv.conf
Jan 3 19:10:28 	dhclient 	68903 	RENEW
Jan 3 18:57:31 	dhclient 	3799 	Creating resolv.conf
Jan 3 18:57:31 	dhclient 	3350 	RENEW
Jan 3 18:44:16 	dhclient 	34883 	Creating resolv.conf
Jan 3 18:44:16 	dhclient 	34745 	RENEW
Jan 3 18:30:56 	dhclient 	58664 	Creating resolv.conf
Jan 3 18:30:56 	dhclient 	58613 	RENEW
Jan 3 18:16:19 	dhclient 	65545 	Creating resolv.conf
Jan 3 18:16:19 	dhclient 	65114 	RENEW
Jan 3 18:10:28 	dhclient 	92883 	Creating resolv.conf
Jan 3 18:10:28 	dhclient 	92393 	RENEW
Jan 3 18:02:38 	dhclient 	92060 	Creating resolv.conf
Jan 3 18:02:38 	dhclient 	91613 	RENEW
Jan 3 17:47:53 	dhclient 	75899 	Creating resolv.conf
Jan 3 17:47:53 	dhclient 	75661 	RENEW
Jan 3 17:46:02 	dhclient 	44774 	Creating resolv.conf
Jan 3 17:46:02 	dhclient 	44464 	Adding new routes to interface: vtnet1
Jan 3 17:46:02 	dhclient 	44233 	New Routers (vtnet1): x.y.z.1
Jan 3 17:46:02 	dhclient 	44093 	New Broadcast Address (vtnet1): x.y.z.63
Jan 3 17:46:02 	dhclient 	43777 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 3 17:46:02 	dhclient 	43657 	New IP Address (vtnet1): 176.x.y.z
Jan 3 17:46:02 	dhclient 	43207 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 3 17:46:02 	dhclient 	43032 	Starting add_new_address()
Jan 3 17:46:02 	dhclient 	42747 	BOUND
Jan 3 17:46:02 	dhclient 	42423 	ARPCHECK
Jan 3 17:46:00 	dhclient 	832 	ARPSEND
Jan 3 17:45:59 	dhclient 	95868 	PREINIT
Jan 3 17:45:59 	dhclient 	95319 	Deleting old routes
Jan 3 17:45:59 	dhclient 	95172 	EXPIRE
Jan 3 17:30:58 	dhclient 	99718 	Creating resolv.conf
Jan 3 17:30:58 	dhclient 	99489 	RENEW
Jan 3 17:17:51 	dhclient 	36841 	Creating resolv.conf
Jan 3 17:17:51 	dhclient 	36494 	RENEW
Jan 3 17:10:28 	dhclient 	37335 	Creating resolv.conf
Jan 3 17:10:28 	dhclient 	37111 	RENEW
Jan 3 17:03:11 	dhclient 	40060 	Creating resolv.conf
Jan 3 17:03:11 	dhclient 	39933 	RENEW
Jan 3 16:49:30 	dhclient 	49319 	Creating resolv.conf
Jan 3 16:49:30 	dhclient 	49138 	RENEW
Jan 3 16:36:23 	dhclient 	91691 	Creating resolv.conf
Jan 3 16:36:23 	dhclient 	91539 	RENEW
Jan 3 16:21:39 	dhclient 	98515 	Creating resolv.conf
Jan 3 16:21:39 	dhclient 	98092 	RENEW
Jan 3 16:10:28 	dhclient 	90553 	Creating resolv.conf
Jan 3 16:10:28 	dhclient 	90087 	RENEW
Jan 3 16:07:35 	dhclient 	3969 	Creating resolv.conf
Jan 3 16:07:35 	dhclient 	3428 	RENEW
Jan 3 16:05:43 	dhclient 	67110 	Creating resolv.conf
Jan 3 16:05:43 	dhclient 	66916 	Adding new routes to interface: vtnet1
Jan 3 16:05:43 	dhclient 	66678 	New Routers (vtnet1): x.y.z.1
Jan 3 16:05:43 	dhclient 	66538 	New Broadcast Address (vtnet1): x.y.z.63
Jan 3 16:05:43 	dhclient 	66377 	New Subnet Mask (vtnet1): 255.255.255.192
Jan 3 16:05:43 	dhclient 	66046 	New IP Address (vtnet1): 176.x.y.z
Jan 3 16:05:43 	dhclient 	65743 	ifconfig vtnet1 inet 176.x.y.z netmask 255.255.255.192 broadcast x.y.z.63
Jan 3 16:05:43 	dhclient 	65734 	Starting add_new_address()
Jan 3 16:05:43 	dhclient 	65287 	BOUND
Jan 3 16:05:43 	dhclient 	64889 	ARPCHECK
Jan 3 16:05:41 	dhclient 	37002 	ARPSEND
Jan 3 16:05:39 	dhclient 	16814 	PREINIT
Jan 3 16:05:39 	dhclient 	15698 	Deleting old routes
Jan 3 16:05:39 	dhclient 	14896 	EXPIRE
Jan 3 15:50:38 	dhclient 	13236 	Creating resolv.conf
Jan 3 15:50:38 	dhclient 	12117 	RENEW

Not only lease periodically expires on WAN2 for some reason, bringing down interface in the process, even refresh interval is all over the place rather than reliable 450 seconds.

nazar-pc

So far I'm confused why two WAN interfaces with DHCP can impact each other. I've been on stable most of the time, but see the same behavior with current 2.7.0 develoment branch as well:

2.7.0-DEVELOPMENT (amd64)
built on Wed Jan 04 06:05:22 UTC 2023

I have searched answers online and tried setting "Protocol timing" on WAN2 interface to "pfSense Default" (it was all all clear prior), but it didn't seem to fix the issue, maybe improved things a bit, hard to tell for sure.

Any thoughts what else I can debug here? I contacted ISP, everything looks perfecly fine on their end from logs.

nazar-pc

Any thoughts from the community? Some days it is bad, others it is terrible.

bavcon22

@nazar-pc Is this guide in link below for some help for you?
Link: https://www.cyberciti.biz/faq/howto-configure-dual-wan-load-balance-failover-pfsense-router/

I was successful with this guide. Redo it from scratch.

nazar-pc

@bavcon22 I don't see how that would help and why would I bother wiping the configuration I was maintaining for many years and start from scratch.
It works for me as well, it is just buggy and unstable, which in turn seems to be unlikely due to misconfiguration.

nazar-pc

Reported as an issue a while back, but not much help there either: https://redmine.pfsense.org/issues/14237

Anyone can suggest anything else to check/debug? I'm on 2.7.0 stable right now.

nazar-pc

I looked at packet capture and noticed that the packet loss happens when interface is considered down and it is considered down when DHCP server of an ISP doesn't respond to DISCOVER within a second. Is there a way to increase the timeout beyond one second so that it doesn't fail anymore?

heper

@nazar-pc said in Intermittent packet loss related to DHCP with Multi-WAN:

when interface is considered down and it is considered down when DHCP server of an ISP doesn't respond to DISCOVER within a second. Is there a way to increase the timeout beyond one second so that it doesn't fail anymore?

you could try to increase the "select-timeout" in the advanced dhcp options:

https://man.freebsd.org/cgi/man.cgi?query=dhclient.conf&sektion=5#PROTOCOL_TIMING

is this system a VM?
are you sure you don't have clock issues ? (time skipping, jumping back en forth)

nazar-pc

@heper said in Intermittent packet loss related to DHCP with Multi-WAN:

is this system a VM?
are you sure you don't have clock issues ? (time skipping, jumping back en forth)

It is a KVM machine, but I don't think it is a clock issue, that'd be weird. It is just running on a regular desktop-grade hardware with not that much load on it. Not sure how I would verify that though.

@heper I just got a response from ISP representative, they pointed out to several issues with DHCP client in pfSense. It basically doesn't follow the spec and that results in issues.
I'll try to translate and summarize it in a bug report.

For instance https://datatracker.ietf.org/doc/html/rfc2131#section-4.4.1:

The client begins in INIT state and forms a DHCPDISCOVER message.
The client SHOULD wait a random time between one and ten seconds to
desynchronize the use of DHCP at startup.

At the same time according to my observations it sends another DHCPDISCOVER right after 1 second, which it is not supposed to do. There could be several DHCP servers responding within 10 seconds, but client just gives up after 1 second.

There are a few others, not sure if I should create one bug report for each or one bigger bug report with all of them together.

Is DHCP client pfSense-specific or just comes from FreeBSD as is?

heper

@nazar-pc afaik the dhcpclient is not pfsense specific.
It would be strange that there is something inherently wrong with the dhcpclient .... but nothing is impossible i guess

perhaps @johnpoz or someone else could provide more insight

nazar-pc

@heper Whatever it is, I feel like I'm finally one step closer in figuring it out, it has been happening to me for over 6 month and at the same time I have no issues when connecting ISP to Linux machine directly.
So whoever's fault it is, I'd like to find out and help to resolve it.

UPD: It is a different story entirely though that this failure in DHCP client and one interface results in all networking in pfSense going down

nazar-pc

Posted DHCP client issues here: https://redmine.pfsense.org/issues/14604