Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Extremely slow update 2.3.3 -> 2.3.4

    Scheduled Pinned Locked Moved Problems Installing or Upgrading pfSense Software
    14 Posts 7 Posters 5.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • N Offline
      NOYB
      last edited by

      Update Extraction Extremely Slow (USB Flash Full Install)
      https://forum.pfsense.org/index.php?topic=129994.msg716477#msg716477
      https://forum.pfsense.org/index.php?topic=129994.msg716482#msg716482
      https://forum.pfsense.org/index.php?topic=129994.msg716483#msg716483
      https://forum.pfsense.org/index.php?topic=129994.msg716489#msg716489
      https://forum.pfsense.org/index.php?topic=129994.msg716532#msg716532
      https://forum.pfsense.org/index.php?topic=129994.msg716541#msg716541
      https://forum.pfsense.org/index.php?topic=129994.msg716719#msg716719

      Re: Version 2.3.4 is available.
      https://forum.pfsense.org/index.php?topic=129994.msg716731#msg716731

      1 Reply Last reply Reply Quote 0
      • A Offline
        Alex Atkin UK
        last edited by

        Mine was extremely slow refreshing and downloading the packages too and its on an SSD, so not a USB Flash problem.

        After upgrading I'm also still getting "Unable to check for updates"/"Unable to retrieve package information" from the WebUI and updating the package manager from the shell is painfully slow.

        I see no obvious indication the SSD is failing, although "dd bs=1M count=256 if=/dev/zero of=test" only gives me 12MiB/s which seems usually low.  When I first installed pfSense I'm sure it got more like 200MiB/s.

        Otherwise though everything works fine and CPU usage remains low, so its really weird that its only package management showing a problem.

        1 Reply Last reply Reply Quote 0
        • T Offline
          Ting
          last edited by

          I'm using a SD card but I don't know, how this is connected to the system. Up to now this was not an issue. This really was the first update, which took this enormous amount of time.

          1 Reply Last reply Reply Quote 0
          • B Offline
            bimmerdriver
            last edited by

            My system was also very slow to update and the update failed. I've been using fpsense for a couple of years and never had this occur before.

            1 Reply Last reply Reply Quote 0
            • Y Offline
              YoMarK
              last edited by

              @Alex:

              Mine was extremely slow refreshing and downloading the packages too and its on an SSD, so not a USB Flash problem.

              After upgrading I'm also still getting "Unable to check for updates"/"Unable to retrieve package information" from the WebUI and updating the package manager from the shell is still painfully slow.

              I have the same issues. I've just updated to 2.3.4 and it's constantly seems to refresh packages every 11 seconds….
              /rc.start_packages: Restarting/Starting all packages.

              1 Reply Last reply Reply Quote 0
              • A Offline
                Alex Atkin UK
                last edited by

                @YoMarK:

                @Alex:

                Mine was extremely slow refreshing and downloading the packages too and its on an SSD, so not a USB Flash problem.

                After upgrading I'm also still getting "Unable to check for updates"/"Unable to retrieve package information" from the WebUI and updating the package manager from the shell is still painfully slow.

                I have the same issues. I've just updated to 2.3.4 and it's constantly seems to refresh packages every 11 seconds….
                /rc.start_packages: Restarting/Starting all packages.

                Won't that just be the dashboard constantly re-trying to see if there is a new update?  Does it happen with the WebUI not open?

                That said I haven't seen that myself, I just see "pkg update" spawning.

                I have noticed something odd, that I tried to go to the Update settings and the WebUI hung while the console showed:

                root   44337   0.0  0.2  45336  8128  -  I     8:21PM     0:00.01 pkg update
                root   44440   0.0  0.2  45336  8884  -  I     8:21PM     0:00.01 pkg update
                root   47848   0.0  0.2  45336  8112  -  I     8:21PM     0:00.02 /usr/sbin/pkg search -R --raw-format json-compact pfSense-pkg-*
                root   47937   0.0  0.2  45336  8872  -  I     8:21PM     0:00.01 /usr/sbin/pkg search -R --raw-format json-compact pfSense-pkg-*
                
                

                Is it normal for those to be called TWICE?

                1 Reply Last reply Reply Quote 0
                • A Offline
                  Alex Atkin UK
                  last edited by

                  As a follow up I tried "pkg-static upgrade -f" got:

                  Updating pfSense-core repository catalogue...
                  pfSense-core repository is up to date.
                  Updating pfSense repository catalogue...
                  pfSense repository is up to date.
                  All repositories are up to date.
                  Checking for upgrades (147 candidates):  44%
                  
                  pfSense-kernel-pfSense-2.3.4 is locked and may not be modified
                  Checking for upgrades (147 candidates): 100%
                  Processing candidates (147 candidates): 100%
                  The following 146 package(s) will be affected (of 0 checked):
                  
                  Installed packages to be REINSTALLED:
                          pkg-1.10.1_1 [pfSense]
                          xinetd-2.3.15_2 [pfSense]
                          wrapalixresetbutton-0.0.7 [pfSense]
                          wol-0.7.1_3 [pfSense]
                          whois-5.1.5_1 [pfSense]
                          vstr-1.0.15_1 [pfSense]
                          voucher-0.1_2 [pfSense]
                          unbound-1.6.1 [pfSense]
                          uclcmd-0.1_1 [pfSense]
                          strongswan-5.5.1_1 [pfSense]
                          sshlockout_pf-0.0.2 [pfSense]
                          ssh_tunnel_shell-0.1 [pfSense]
                          sqlite3-3.17.0 [pfSense]
                          smartmontools-6.5_2 [pfSense]
                          scponly-4.8.20110526_2 [pfSense]
                          rrdtool-1.6.0_1 [pfSense]
                          relayd-5.5.20140810_2 [pfSense]
                          rate-0.9_1 [pfSense]
                          radvd-1.9.1 [pfSense]
                          qstats-0.1_1 [pfSense]
                          python27-2.7.13_3 [pfSense]
                          php56-zlib-5.6.30 [pfSense]
                          php56-xmlwriter-5.6.30 [pfSense]
                          php56-xmlreader-5.6.30 [pfSense]
                          php56-xml-5.6.30 [pfSense]
                          php56-tokenizer-5.6.30 [pfSense]
                          php56-sysvshm-5.6.30 [pfSense]
                          php56-sysvsem-5.6.30 [pfSense]
                          php56-sysvmsg-5.6.30 [pfSense]
                          php56-sqlite3-5.6.30 [pfSense]
                          php56-sockets-5.6.30 [pfSense]
                          php56-simplexml-5.6.30 [pfSense]
                          php56-shmop-5.6.30 [pfSense]
                          php56-session-5.6.30 [pfSense]
                          php56-readline-5.6.30 [pfSense]
                          php56-posix-5.6.30 [pfSense]
                          php56-pfSense-module-0.13 [pfSense]
                          php56-pdo_sqlite-5.6.30 [pfSense]
                          php56-pdo-5.6.30 [pfSense]
                          php56-pcntl-5.6.30 [pfSense]
                          php56-openssl-5.6.30 [pfSense]
                          php56-opcache-5.6.30 [pfSense]
                          php56-mcrypt-5.6.30 [pfSense]
                          php56-mbstring-5.6.30 [pfSense]
                          php56-ldap-5.6.30 [pfSense]
                          php56-json-5.6.30 [pfSense]
                          php56-hash-5.6.30 [pfSense]
                          php56-gettext-5.6.30 [pfSense]
                          php56-filter-5.6.30 [pfSense]
                          php56-dom-5.6.30 [pfSense]
                          php56-curl-5.6.30 [pfSense]
                          php56-ctype-5.6.30 [pfSense]
                          php56-bz2-5.6.30 [pfSense]
                          php56-bcmath-5.6.30 [pfSense]
                          php56-5.6.30 [pfSense]
                          php-xdebug-2.5.0 [pfSense]
                          php-suhosin-0.9.38_3 [pfSense]
                          pftop-0.7_8 [pfSense]
                          pfSense-upgrade-0.22_1 [pfSense]
                          pfSense-repo-2.3.4 [pfSense]
                          pfSense-rc-2.3.4 [pfSense-core]
                          pfSense-pkg-pfBlockerNG-2.1.1_8 [pfSense]
                          pfSense-pkg-darkstat-3.1.3_4 [pfSense]
                          pfSense-pkg-System_Patches-1.1.6_1 [pfSense]
                          pfSense-pkg-RRD_Summary-1.3.2_2 [pfSense]
                          pfSense-default-config-2.3.4 [pfSense-core]
                          pfSense-base-2.3.4 [pfSense-core]
                          pfSense-Status_Monitoring-1.6.1_3 [pfSense]
                          pfSense-2.3.4 [pfSense]
                          perl5-5.24.1 [pfSense]
                          pecl-zmq-1.1.3_2 [pfSense]
                          pecl-ssh2-0.13 [pfSense]
                          pecl-rrd-1.1.3_4 [pfSense]
                          pecl-radius-1.4.0.b1 [pfSense]
                          pecl-intl-3.0.0_7 [pfSense]
                          pcre-8.40 [pfSense]
                          openvpn23-2.3.14 [pfSense]
                          openldap-client-2.4.44 [pfSense]
                          oniguruma5-5.9.6_1 [pfSense]
                          ntp-4.2.8p10_2 [pfSense]
                          norm-1.5r6 [pfSense]
                          nginx-1.10.3_1,2 [pfSense]
                          nettle-3.3 [pfSense]
                          mpd5-5.8 [pfSense]
                          mpd4-4.4.1_1 [pfSense]
                          miniupnpd-1.9.20160113,1 [pfSense]
                          minicron-0.0.2 [pfSense]
                          lzo2-2.10_1 [pfSense]
                          lua52-5.2.4 [pfSense]
                          links-2.13,1 [pfSense]
                          lighttpd-1.4.45_1 [pfSense]
                          libzmq4-4.1.5 [pfSense]
                          libxml2-2.9.4 [pfSense]
                          libucl-0.8.0 [pfSense]
                          libssh2-1.8.0,3 [pfSense]
                          libsodium-1.0.12 [pfSense]
                          libpdel-0.5.3_6 [pfSense]
                          libnghttp2-1.21.0 [pfSense]
                          libmcrypt-2.5.8_3 [pfSense]
                          libltdl-2.4.6 [pfSense]
                          libidn-1.33_1 [pfSense]
                          libiconv-1.14_10 [pfSense]
                          libffi-3.2.1 [pfSense]
                          libevent-2.1.8 [pfSense]
                          libedit-3.1.20150325_2,1 [pfSense]
                          libdaemon-0.14_1 [pfSense]
                          ldns-1.7.0 [pfSense]
                          json-c-0.12.1 [pfSense]
                          isc-dhcp43-server-4.3.5 [pfSense]
                          isc-dhcp43-relay-4.3.5 [pfSense]
                          isc-dhcp43-client-4.3.5 [pfSense]
                          ipmitool-1.8.18 [pfSense]
                          indexinfo-0.2.6 [pfSense]
                          igmpproxy-0.1_3,1 [pfSense]
                          idnkit-1.0_6 [pfSense]
                          icu-58.2,1 [pfSense]
                          grepcidr-2.0 [pfSense]
                          gmp-6.1.2 [pfSense]
                          glib-2.46.2_5 [pfSense]
                          gettext-runtime-0.19.8.1_1 [pfSense]
                          filterlog-0.1_4 [pfSense]
                          filterdns-1.0_9 [pfSense]
                          expiretable-0.6_1 [pfSense]
                          expat-2.2.0_1 [pfSense]
                          dpinger-2.0 [pfSense]
                          dnsmasq-2.76,1 [pfSense]
                          dmidecode-3.0 [pfSense]
                          dhcpleases6-0.1_2 [pfSense]
                          dhcpleases-0.3_1 [pfSense]
                          dhcp6-20080615.2 [pfSense]
                          darkstat-3.0.719 [pfSense]
                          curl-7.54.0 [pfSense]
                          cpustats-0.1_1 [pfSense]
                          cpdup-1.18 [pfSense]
                          clog-1.0.1 [pfSense]
                          choparp-20150613 [pfSense]
                          check_reload_status-0.0.7 [pfSense]
                          ca_root_nss-3.30.2 [pfSense]
                          bwi-firmware-kmod-3.130.20 [pfSense]
                          bsnmp-ucd-0.4.2 [pfSense]
                          bsnmp-regex-0.6_1 [pfSense]
                          bind-tools-9.11.1 [pfSense]
                          beep-1.0_1 [pfSense]
                          ataidle-2.7.2 [pfSense]
                          aggregate-1.6_1 [pfSense]
                          GeoIP-1.6.10 [pfSense]
                  
                  Number of packages to be reinstalled: 146
                  
                  10 MiB to be downloaded.
                  

                  Does that mean 44% of the packages were not correctly upgraded to 2.3.4 or just that its going to attempt to reinstall everything?

                  I let it go ahead but its taking FOREVER (over an hour now to download 40/146)!  Frustrating when before it would have taken a matter of seconds.

                  Its just bizarre, system and interrupt are low, I just can't see what is slowing it down as running curl for a test download while all this is going on I get:

                  [2.3.4-RELEASE][root@Router.lan]/root: curl http://ipv4.download.thinkbroadband.com/512MB.zip > test
                    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                                   Dload  Upload   Total   Spent    Left  Speed
                  100  512M  100  512M    0     0  8237k      0  0:01:03  0:01:03 --:--:-- 8893k
                  
                  
                  1 Reply Last reply Reply Quote 0
                  • A Offline
                    Alex Atkin UK
                    last edited by

                    After doing that and a reboot the dashboard finally is telling me I'm on the latest version.

                    Installed packages in the WebUI is still broken though.  Its still calling "/usr/sbin/pkg search -R –raw-format json-compact pfSense-pkg-*" and from the command line that gives:

                    [2.3.4-RELEASE][root@Router.lan]/root: /usr/sbin/pkg search -R --raw-format json-compact pfSense-pkg-*
                    /usr/sbin/pkg: No match.
                    

                    Available packages and installing packages DOES seem to be working from the WebUI now though, just very very very slowly.

                    Example, it took about 40 minutes to install "pfSense-pkg-suricata". :o

                    It spends AGES on "Updating * repository catalogue…" then downloads each package at a few KB/s with a huge delay between each file.  The actual package installation went at normal speed.

                    1 Reply Last reply Reply Quote 0
                    • A Offline
                      Alex Atkin UK
                      last edited by

                      I figured out what was going on here.  It seems to be some change in IPv6 behaviour where because I still have an IPv6 tunnel enabled but am not actually using it, pkg is still trying to use IPv6 for some reason so stalls.

                      Ticking "prefer IPv4 over IPv6" in Advanced settings fixed the problem.

                      1 Reply Last reply Reply Quote 2
                      • K Offline
                        kpa
                        last edited by

                        Yes, that's basically the same as using a dual WAN with the other WAN set to disabled but forcing the system to still try to use the disabled WAN connection, it will be slow because everything will first have to wait for the timeout to occur.

                        1 Reply Last reply Reply Quote 0
                        • A Offline
                          Alex Atkin UK
                          last edited by

                          I still believe it was a glitch as it had been working fine on this configuration previously.

                          Good news is that on pfSense 2.4.0 RC I finally have been able to get my ISPs native IPv6 to work anyway, so it should no longer be an issue.

                          1 Reply Last reply Reply Quote 0
                          • K Offline
                            kpa
                            last edited by

                            As far as I understand it the bind() system call with AF_INET6 set will succeed on a system that has a broken IPv6 interface enabled but the following connect() system call will timeout. If it was working for you previously suggests that the IPv6 interface was properly disabled (set to IFDISABLED state) but now it was enabled for some reason.

                            1 Reply Last reply Reply Quote 0
                            • V Offline
                              vegastech
                              last edited by

                              And just to keep an old thread endlessly alive..

                              Upgraded 2.3.2 to 2.3.4_1 and it took just under 4hrs. I found this thread about 30 mins into the upgrade. I used the webGUI, the platform is nanobsd, the hardware is ancient AMD BE-2350.

                              It did give me time to cobble together a newer system based on a MSI AM1M mobo, 4GB RAM, AMD 5350 cpu. I was able to restore the nanobsd config to the new 'full' platform. I'm always using HP NC365T quad port NIC cards - I've had great luck with them. You just have to remember the top port is igb3 and the bottom is igb0.

                              This was the office router. I have a home one I plan to upgrade via console. We've rolled out 10-15 of these to our clients. Yes, there's some kind of bug in this process, but, a big THANKS! to the pfSense team and their continued commitment.

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.