Error after each package update



  • Hi there,

    Everytime I update my nanoBSD Alix box it works fine except for one thing. When I re-login after the reboot the packages get reinstalled, which also works. After that if I click anything I get the error you see on the screennshot. The box still is working though. I need to connect via ssh and do a reboot until everything is fine again.

    Any ideas?
    ![Internal Error.png](/public/imported_attachments/1/Internal Error.png)
    ![Internal Error.png_thumb](/public/imported_attachments/1/Internal Error.png_thumb)



  • Is this working for everybody else?



  • Has anybody fixed this? Any ideas? Still happening with 11/16 snap…



  • I have this problem once a week after I update PFsense 2.0-beta4. I have to remove all packages manually and reinstall them to get it working again. But it doesn't happen every time, about once a week.

    Nic



  • Are you also on NanoBSD? This really happens all the time with my setup…



  • Still happens all the time! Is there a ticket open for that? Who can fix that and what info do you need in addition?

    Thanks…



  • Hi there,

    still having this issue ALL the time when updating to a new snap, so I need several reboots before the system is up again! This happens for avahi and nmap packages! Who can fix this? Do you need any more info than that? We are close for a RC but with troubles like this I can hardly call it RC…


  • Rebel Alliance Developer Netgate

    Avahi is the most likely culprit. It needs some work on 2.0 in general, not just NanoBSD. The current way it's installed replaces some base system libraries with unexpected versions.

    Since it's really a problem with the package itself, and not the base system, it may not really hold back an RC. If I get some time I can look into Avahi. I haven't heard of a problem with nmap on his own, just Avahi, and in one case I also had an issue with siproxd but I didn't get to track it down all the way yet.



  • Hey jimp. Thanks. Well it is a pitty that I really 'need' avahi :-(
    When I installed nmap I couldn't access the WebGUI anymore until I rebooted…


  • Rebel Alliance Developer Netgate

    Do you have a serial console attached? It would be nice to know what kind of messages you see there when this happens.

    When I had issues it was just a bunch of repeated sig11 errors that scrolled on indefinitely.



  • Yeah, I get that error when installing nmap/avahi….

    Here is what I need to do with EVERY update:

    • Update
    • Reboot
    • 500 - Internal Server Error
    • Reboot
    • Diagnostics->Interfaces->Connect on PPPoE
    • Packages->none are installed anymore
    • Install avahi
    • 500 - Internal Server Error
    • Reboot
    • Diagnostics->Interfaces->Connect on PPPoE doesn't work anymore, interfaces goes up and right after that down again. Need to use save button on WAN!
    • Install nmap->error in system.log: Jan  5 15:12:18 voldemort kernel: pid 28656 (php), uid 0: exited on signal 11 (goes on forever)
    • 500 - Internal Server Error
    • Reboot
    • Diagnostics->Interfaces->Connect on PPPoE doesn't work anymore, interfaces goes up and right after that down again. Need to use save button on WAN!
    • Install Backup, Ubound and Shellcmd with no problem

  • Rebel Alliance Developer Netgate

    There were a bunch of commits to the package reinstall process last night, and I just fixed an issue with Avahi just now. Next time you get a chance, update it again and see if the problems persist.



  • @jimp:

    There were a bunch of commits to the package reinstall process last night, and I just fixed an issue with Avahi just now. Next time you get a chance, update it again and see if the problems persist.

    Okay. Will wait for the next snap to appear…


  • Rebel Alliance Developer Netgate

    The one that's out there now still does have some issues, but I only tried it on an ALIX with siproxd installed. I didn't try it with Avahi.



  • @jimp:

    The one that's out there now still does have some issues, but I only tried it on an ALIX with siproxd installed. I didn't try it with Avahi.

    Thanks. I'll wait for the next snap of 1/7 or even 1/8.
    Thanks for your help, hopefully the issue will be resolved…


  • Rebel Alliance Developer Netgate

    Actually waiting for tomorrow would be best. Some more commits just hit the repo and we think we got the bugs nixed this time.

    With the current set of code and some changes I committed to the Avahi package, I was able to switch slices and have the packages sync without crashing.

    So wait for the first snapshot dated after this post and it should be good.



  • @jimp:

    Actually waiting for tomorrow would be best. Some more commits just hit the repo and we think we got the bugs nixed this time.

    With the current set of code and some changes I committed to the Avahi package, I was able to switch slices and have the packages sync without crashing.

    So wait for the first snapshot dated after this post and it should be good.

    Sounds good. So should I skip the one building right now according to http://snapshots.pfsense.com/logs/pfSense_RELENG_2_0__FreeBSD_8/i386/build.log ?


  • Rebel Alliance Developer Netgate

    Yeah that one definitely wouldn't have all the commits. The last one hit the repo about 20 minutes ago.

    So the next one after that which starts up should be OK.



  • Tried with snap from 1/8 and at least my PPPoE came up by itself. After the package resync there were only Shellcmd and Unbound installed. So I had to manually install avahi, backup and nmap again. At least I did not need any more reboots, so I guess we're gettin' closer now ;-)

    Thanks jimp…

    Edit: Now my iPhone on WLAN can't connect to my iTunes on LAN anymore. Is avahi working for you jimp?


  • Rebel Alliance Developer Netgate

    I didn't try to run/configure avahi, I just had it installed.

    It is a different version of Avahi, before it was downloading and installing Avahi from FreeBSD 7. Now it's really using the version compiled for FreeBSD 8. Any logs from Avahi that are interesting?



  • Hi jimp,

    here is what a 'grep -i avahi' in system.log gives me:

    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Found user 'avahi' (UID 558) and group 'avahi' (GID 558).
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Successfully dropped root privileges.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: avahi-daemon 0.6.25 starting up.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Loading service file /usr/local/etc/avahi/services/sftp-ssh.service.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Loading service file /usr/local/etc/avahi/services/ssh.service.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Joining mDNS multicast group on interface ath0_wlan1.IPv4 with address 192.168.100.254.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: New relevant interface ath0_wlan1.IPv4 for mDNS.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Joining mDNS multicast group on interface ath0_wlan0.IPv4 with address 172.16.100.254.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: New relevant interface ath0_wlan0.IPv4 for mDNS.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Joining mDNS multicast group on interface vr0.IPv4 with address 10.0.100.254.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: New relevant interface vr0.IPv4 for mDNS.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Network interface enumeration completed.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering new address record for fe80::480:48ff:fe62:fa57 on ath0_wlan1.*.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering new address record for 192.168.100.254 on ath0_wlan1.IPv4.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering new address record for fe80::280:48ff:fe62:fa57 on ath0_wlan0.*.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering new address record for 172.16.100.254 on ath0_wlan0.IPv4.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering new address record for fe80::20d:b9ff:fe13:54a8 on vr0.*.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering new address record for 10.0.100.254 on vr0.IPv4.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Registering HINFO record with values 'I386'/'FREEBSD'.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Short read() on signal pipe.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: Short read() on signal pipe.
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: daemon_signal_next() failed
    Jan  8 16:15:50 voldemort avahi-daemon[25207]: daemon_signal_next() failed
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: iface.c: avahi_server_add_service() failed: Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: Server startup complete. Host name is voldemort.hogwarts.lan. Local service cookie is 220947134.
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: Failed to add service 'voldemort' of type '_ssh._tcp', ignoring service group (/usr/local/etc/avahi/services/ssh.service): Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: Failed to add service 'voldemort' of type '_ssh._tcp', ignoring service group (/usr/local/etc/avahi/services/ssh.service): Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: Failed to add service 'SFTP File Transfer on voldemort' of type '_sftp-ssh._tcp', ignoring service group (/usr/local/etc/avahi/services/sftp-ssh.service): Not supported
    Jan  8 16:15:51 voldemort avahi-daemon[25207]: Failed to add service 'SFTP File Transfer on voldemort' of type '_sftp-ssh._tcp', ignoring service group (/usr/local/etc/avahi/services/sftp-ssh.service): Not supported
    
    

  • Rebel Alliance Developer Netgate

    I may have to experiment with it on Monday, my brain is taking the weekend off. :-)



  • Thanks jimp. Suddenly it started to work again. Mysteriously…
    Did nothing besides wait. Will have an eye on that...

    The only thing now is that my PPPoE does take too long to come up after a upgrade so the packages sync doesn't work that well. Today it only installed one of six packages (nmap) after upgrade to 1/10 but that's another story...

    Edit: Is there a reason why not all packages are listed when I run a pkg_info on console? Have avahi, backup, shellcmd, unbound, rrd summary and nmap installed, but the output only shows the following:

    expat-2.0.1_1       XML 1.0 parser written in C
    libevent-1.4.14b_1  Provides an API to execute callback functions on certain ev
    lua-5.1.4_5         Small, compilable scripting language providing easy access 
    nmap-5.35.d1        Port scanning utility for large networks
    openssl-1.0.0_4     SSL and crypto library
    pcre-8.10           Perl Compatible Regular Expressions library
    pkg-config-0.25_1   A utility to retrieve information about installed libraries
    unbound-1.4.7       A validating, recursive, and caching DNS resolver
    
    

  • Rebel Alliance Developer Netgate

    Avahi is installed via a tgz archive, not a proper "package" file, and the other missing ones are only found in the pfSense GUI, not OS packages.

    pkg_info only lists properly registered FreeBSD packages.



  • Thanks for clearing that up, jimp ;)



  • Now with a working PPPoE connection on startup almost everything worked fine except the nmap package wasn't installed. All other five package were. Can you confirm that? Or should I open a new ticket/thread for nmap?


  • Rebel Alliance Developer Netgate

    I haven't tried that one yet. Not sure what its deal might be.

    Try to reinstall it manually one more time and see if it survives the next firmware update again.



  • All packages got reinstalled now after my latest upgrade. nmap shows up as installed but does not work. On console I get:

    [2.0-BETA5][admin@voldemort.hogwarts.lan]/root(9): nmap 
    nmap: Command not found.
    
    

    Also reinstalling the package did not work. Even completely removing and adding the package doesn't change this…


  • Rebel Alliance Developer Netgate

    Does pkg_info still show nmap installed?  What happens if you pkg_delete nmap-5.35.d1 and then reinstall?



  • @jimp:

    Does pkg_info still show nmap installed?  What happens if you pkg_delete nmap-5.35.d1 and then reinstall?

    Yes, pkg_info shows nmap installed. When I remove it and reinstall or completely delete and reinstall I now get the following error:

    /libexec/ld-elf.so.1: Shared object "libpcap.so.1" not found, required by "nmap"
    


  • I experienced the same issues with my ALIX board under 2.0-BETA4; had to revert back to 1.2.3-RELEASE because the system was too unstable.

    jlepthien, would you say most of the packaging and WebGUI freezes have been fixed ? I could install 2.0-BETA5 01/08 and provide some additional feedback.

    __.
    pac



  • Juste to let know know:
    with 2.0-BETA5 (i386) built on Tue Jan 11 14:19:18 EST 2011

    I got this message at boot time:

    One moment please, reinstalling packages...
    pkg_info: no packages match pattern(s)
    

    Don't really know what it means…

    Also, all my packages have been deinstalled but I don't know my just after the upgrade...

    System log show this:

    php: /pkg_mgr_install.php: The command '/usr/local/etc/rc.d/postfix.sh stop' returned exit code '127', the output was '/usr/local/etc/rc.d/postfix.sh: /usr/local/sbin/postfix: not found'
    

    It's not the first time that even if a package have been removed the init scripts still alive.


  • Rebel Alliance Developer Netgate

    @romainp:

    One moment please, reinstalling packages...
    pkg_info: no packages match pattern(s)
    

    Don't really know what it means…

    That's harmless but we've been trying to track it down.

    @romainp:

    Also, all my packages have been deinstalled but I don't know my just after the upgrade…

    Someone else had that happen but we weren't able to replicate it. Near as I could tell, it was due to an upgrade that was done the last time that wasn't quite right, but the next one was OK and hasn't broken since. If someone can reliably replicate it on current snapshots that might help.

    @romainp:

    System log show this:

    php: /pkg_mgr_install.php: The command '/usr/local/etc/rc.d/postfix.sh stop' returned exit code '127', the output was '/usr/local/etc/rc.d/postfix.sh: /usr/local/sbin/postfix: not found'
    

    It's not the first time that even if a package have been removed the init scripts still alive.

    That's up to the individual package maintainer to remove the script on deinstall. Not much to be done about that by the package system in general.



  • Thanks for those infos.

    Maybe the package automatic deinstall was because my pppoe connection was down at boot time? It happen in earlier release that after a release upgrade, packages are deinstalled and then reinstalled automatically. I think yesterday it happens. Today, just de deinstall. I am impatient to see what will happen tomorrow! :-)
    Just joking. I love pfSense and you all guys do a fantastic works.
    Thanks


  • Rebel Alliance Developer Netgate

    Lack of connectivity would explain it, I suppose. Might need some extra logic there to prevent that from happening.


  • Rebel Alliance Developer Netgate

    I added some code to bail on the package update if there is no connectivity when the function is called. It won't be in the next new snapshot, but the one after.



  • Oh boy. Now all packages except avahi have been automatically reinstalled…

    Still, nmap gives me an error:

    /libexec/ld-elf.so.1: Shared object "libpcap.so.1" not found, required by "nmap"
    
    

  • Rebel Alliance Developer Netgate

    Try to reinstall it now. Remove it first with "x" on the installed packages screen and then pick it from the main list.

    See if it behaves any better. I bumped it up to a newer version and made sure the dependencies were fixed.



  • Ok that worked with nmap however I tried updating the snap and after that only five of my six packages git reinstalled. But after having a closer look I saw that they were not working. avahi gives me a 404 and Backup completely misssing. Tried reinstalling all packages with Diagnostics->/Backup/Restore and after that I still have the same avahi error. So I needed to remove and install it again.

    At least all these removing/installing doesn't need any reboots anymore…

    Thanks for your help again, jimp. Some small glitches but we're on the right way...


  • Rebel Alliance Developer Netgate

    If you had the serial console hooked up while it upgraded, it would be nice to see the package reinstall messages from the console.


Locked