Odd notifications…



  • I have gotten these on random, rare occasions in the past, but since the 2.3 and especially 2.3.1 update, I get them constantly, even though everything seems to work fine:

    There were error(s) loading the rules: /tmp/rules.debug:115: macro 'IPsec' not defined - The line in question reads [115]: pass out  on $IPsec all tracker 1000000961 tracker 1000000962 keep state label "IPsec internal host to host"
    

    Does anyone have a clue what this means and how to fix it?


  • Rebel Alliance Developer Netgate

    I seem to recall a ticket for that. We can't ever seem to reliably reproduce it. What appears to happen is that the rules load somehow without that macro and then very briefly afterward reload again and it's OK. Might be a race condition of some sort.



  • There is a ticket in redmine for that dating back a couple years, seemed to happen on rare occasion for a small number of people and never in a replicable manner.

    If you can replicate with any reliability rcfa, I'd like to get access to your system to check it out.



  • It may be the case, that my setup triggers it more reliably.

    Here is what I have: a unit is at a colocation provider. There's only one physical interface active, the "WAN" interface.
    I get all traffic in on that interface, and then routed it back out over the same interface in an IPSec tunnel.

    On the other end, the LAN has "public" IPs, with the entire net being funneled through the IPSec pipe.

    The IPSec configurations hence somewhat unconventionally like follows for local and remote sites.

    Maybe that's got something to do with it? If you create a similar setup, maybe you can trigger these.
    Otherwise I may be able to arrange access to my system somehow.

    NB: this setup makes it also seemingly a bit difficult to set up the firewall properly, because IPSec sucks in packages before they can be grabbed by other parts of the system, so at some point I may have to switch to a different transport mechanism…

    ![Screen Shot 2016-04-19 at 14.51.39.png](/public/imported_attachments/1/Screen Shot 2016-04-19 at 14.51.39.png)
    ![Screen Shot 2016-04-19 at 14.51.39.png_thumb](/public/imported_attachments/1/Screen Shot 2016-04-19 at 14.51.39.png_thumb)
    ![Screen Shot 2016-04-19 at 14.52.56.png](/public/imported_attachments/1/Screen Shot 2016-04-19 at 14.52.56.png)
    ![Screen Shot 2016-04-19 at 14.52.56.png_thumb](/public/imported_attachments/1/Screen Shot 2016-04-19 at 14.52.56.png_thumb)



  • Does this have anything to do with it?

    
    					Crash report begins.  Anonymous machine information:
    
    amd64
    10.3-RELEASE
    FreeBSD 10.3-RELEASE #17 3110597(RELENG_2_3): Mon Apr 18 04:07:52 CDT 2016     root@ce23-amd64-builder:/builder/pfsense/tmp/obj/builder/pfsense/tmp/FreeBSD-src/sys/pfSense
    
    Crash report details:
    
    PHP Errors:
    [19-Apr-2016 00:27:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 00:27:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 00:27:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 00:27:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 00:27:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 00:27:10 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:09:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 03:09:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:09:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:09:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:09:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 03:09:47 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:36:59 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/gateways.widget.php:0
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   2\. require_once() /usr/local/www/widgets/widgets/gateways.widget.php:62
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   3\. get_configured_interface_with_descr() /usr/local/www/guiconfig.inc:254
    [19-Apr-2016 03:36:59 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/gateways.widget.php:0
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   2\. compose_table_body_contents() /usr/local/www/widgets/widgets/gateways.widget.php:69
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   3\. return_gateways_array() /usr/local/www/widgets/widgets/gateways.widget.php:177
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:36:59 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/gateways.widget.php:0
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   2\. compose_table_body_contents() /usr/local/www/widgets/widgets/gateways.widget.php:69
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   3\. return_gateways_status() /usr/local/www/widgets/widgets/gateways.widget.php:179
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 03:36:59 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/gateways.widget.php:0
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   2\. compose_table_body_contents() /usr/local/www/widgets/widgets/gateways.widget.php:69
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   3\. return_gateways_status() /usr/local/www/widgets/widgets/gateways.widget.php:179
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 03:36:59 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 04:09:09 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 04:09:09 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 04:09:09 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 04:09:09 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 04:09:09 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 04:09:09 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 04:11:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:11:10 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/interface_statistics.widget.php:0
    [19-Apr-2016 04:11:10 Etc/UTC] PHP   2\. require_once() /usr/local/www/widgets/widgets/interface_statistics.widget.php:64
    [19-Apr-2016 04:11:10 Etc/UTC] PHP   3\. get_configured_interface_with_descr() /usr/local/www/guiconfig.inc:254
    [19-Apr-2016 04:11:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:11:10 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/interface_statistics.widget.php:0
    [19-Apr-2016 04:11:10 Etc/UTC] PHP   2\. get_configured_interface_with_descr() /usr/local/www/widgets/widgets/interface_statistics.widget.php:82
    [19-Apr-2016 04:12:10 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:12:10 Etc/UTC] PHP   1\. {main}() /usr/local/www/ifstats.php:0
    [19-Apr-2016 04:12:10 Etc/UTC] PHP   2\. require_once() /usr/local/www/ifstats.php:63
    [19-Apr-2016 04:12:10 Etc/UTC] PHP   3\. get_configured_interface_with_descr() /usr/local/www/guiconfig.inc:254
    [19-Apr-2016 04:38:21 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 04:38:21 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/installed_packages.widget.php:0
    [19-Apr-2016 04:38:21 Etc/UTC] PHP   2\. require_once() /usr/local/www/widgets/widgets/installed_packages.widget.php:63
    [19-Apr-2016 04:38:21 Etc/UTC] PHP   3\. get_configured_interface_with_descr() /usr/local/www/guiconfig.inc:254
    [19-Apr-2016 05:35:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 05:35:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:35:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:35:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:35:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 05:35:38 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:36:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 05:36:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:36:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:36:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 05:36:38 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 05:36:38 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 06:30:57 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/log.widget.php:0
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   2\. conv_log_filter() /usr/local/www/widgets/widgets/log.widget.php:123
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   3\. parse_firewall_log_line() /etc/inc/filter_log.inc:167
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   4\. convert_real_interface_to_friendly_descr() /etc/inc/filter_log.inc:354
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   5\. convert_real_interface_to_friendly_interface_name() /etc/inc/interfaces.inc:4597
    [19-Apr-2016 06:30:57 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/log.widget.php:0
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   2\. conv_log_filter() /usr/local/www/widgets/widgets/log.widget.php:123
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   3\. parse_firewall_log_line() /etc/inc/filter_log.inc:167
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   4\. convert_real_interface_to_friendly_descr() /etc/inc/filter_log.inc:354
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   5\. convert_real_interface_to_friendly_interface_name() /etc/inc/interfaces.inc:4597
    [19-Apr-2016 06:30:57 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/log.widget.php:0
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   2\. conv_log_filter() /usr/local/www/widgets/widgets/log.widget.php:123
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   3\. parse_firewall_log_line() /etc/inc/filter_log.inc:167
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   4\. convert_real_interface_to_friendly_descr() /etc/inc/filter_log.inc:354
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   5\. convert_real_interface_to_friendly_interface_name() /etc/inc/interfaces.inc:4597
    [19-Apr-2016 06:30:57 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/log.widget.php:0
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   2\. conv_log_filter() /usr/local/www/widgets/widgets/log.widget.php:123
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   3\. parse_firewall_log_line() /etc/inc/filter_log.inc:167
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   4\. convert_real_interface_to_friendly_descr() /etc/inc/filter_log.inc:354
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   5\. convert_real_interface_to_friendly_interface_name() /etc/inc/interfaces.inc:4597
    [19-Apr-2016 06:30:57 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/log.widget.php:0
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   2\. conv_log_filter() /usr/local/www/widgets/widgets/log.widget.php:123
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   3\. parse_firewall_log_line() /etc/inc/filter_log.inc:167
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   4\. convert_real_interface_to_friendly_descr() /etc/inc/filter_log.inc:354
    [19-Apr-2016 06:30:57 Etc/UTC] PHP   5\. convert_real_interface_to_friendly_interface_name() /etc/inc/interfaces.inc:4597
    [19-Apr-2016 07:32:18 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 07:32:18 Etc/UTC] PHP   1\. {main}() /usr/local/www/widgets/widgets/thermal_sensors.widget.php:0
    [19-Apr-2016 07:32:18 Etc/UTC] PHP   2\. require_once() /usr/local/www/widgets/widgets/thermal_sensors.widget.php:56
    [19-Apr-2016 07:32:18 Etc/UTC] PHP   3\. get_configured_interface_with_descr() /usr/local/www/guiconfig.inc:254
    [19-Apr-2016 10:35:49 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 10:35:49 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 10:35:49 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 10:35:49 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 10:35:49 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 10:35:49 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 11:16:56 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 11:16:56 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 11:16:56 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 11:16:56 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 11:16:56 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 11:16:56 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 12:10:06 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 12:10:06 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 12:10:06 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 12:10:06 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 12:10:06 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 12:10:06 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 15:15:36 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 15:15:36 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 15:15:36 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 15:15:36 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 15:15:36 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 15:15:36 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 16:06:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 16:06:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 16:06:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 16:06:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 16:06:47 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 16:06:47 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    
    Filename: /var/crash/minfree
    2048
    
    


  • OK, paying a bit more precise attention:

    This:

    Filter Reload
    
    There were error(s) loading the rules: /tmp/rules.debug:116: macro 'IPsec' not defined - The line in question reads [116]: pass out on $IPsec all tracker 1000000961 tracker 1000000962 keep state label "IPsec internal host to host" @ 2016-04-19 23:10:06
    

    seems to follow this:

    
    Crash report begins.  Anonymous machine information:
    
    amd64
    10.3-RELEASE
    FreeBSD 10.3-RELEASE #17 3110597(RELENG_2_3): Mon Apr 18 04:07:52 CDT 2016     root@ce23-amd64-builder:/builder/pfsense/tmp/obj/builder/pfsense/tmp/FreeBSD-src/sys/pfSense
    
    Crash report details:
    
    PHP Errors:
    [19-Apr-2016 23:10:04 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   3\. filter_generate_optcfg_array() /etc/inc/filter.inc:277
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   4\. get_configured_interface_with_descr() /etc/inc/filter.inc:1107
    [19-Apr-2016 23:10:04 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   4\. return_gateways_array() /etc/inc/filter.inc:880
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   5\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 23:10:04 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:418
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 23:10:04 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   5\. return_gateways_status() /etc/inc/gwlb.inc:891
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   6\. return_gateways_array() /etc/inc/gwlb.inc:444
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   7\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    [19-Apr-2016 23:10:04 Etc/UTC] PHP Stack trace:
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   1\. {main}() /etc/rc.filter_configure_sync:0
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   2\. filter_configure_sync() /etc/rc.filter_configure_sync:37
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   3\. filter_generate_gateways() /etc/inc/filter.inc:288
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   4\. return_gateway_groups_array() /etc/inc/filter.inc:881
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   5\. return_gateways_array() /etc/inc/gwlb.inc:892
    [19-Apr-2016 23:10:04 Etc/UTC] PHP   6\. get_configured_interface_with_descr() /etc/inc/gwlb.inc:593
    
    

    within short order. There seems to be a correlation between these two…


Log in to reply