Upgrading from 2.3.2 -> 2.3.2-p1 issue - fetching packages times out
-
Starting the upgrade using the console, some packages got downloaded, then during a package transfer the file times out, kicking me back to the console based status.
0) Logout (SSH only) 9) pfTop 1) Assign Interfaces 10) Filter Logs 2) Set interface(s) IP address 11) Restart webConfigurator 3) Reset webConfigurator password 12) PHP shell + pfSense tools 4) Reset to factory defaults 13) Update from console 5) Reboot system 14) Disable Secure Shell (sshd) 6) Halt system 15) Restore recent configuration 7) Ping host 16) Restart PHP-FPM 8) Shell Enter an option: 13 >>> Updating repositories metadata... Updating pfSense-core repository catalogue... pfSense-core repository is up-to-date. Updating pfSense repository catalogue... pfSense repository is up-to-date. All repositories are up-to-date. >>> Unlocking package pfSense-kernel-pfSense... done. The following 42 package(s) will be affected (of 0 checked): Installed packages to be UPGRADED: php56-zlib: 5.6.23 -> 5.6.26 [pfSense] php56-xmlwriter: 5.6.23 -> 5.6.26 [pfSense] php56-xmlreader: 5.6.23 -> 5.6.26 [pfSense] php56-xml: 5.6.23 -> 5.6.26 [pfSense] php56-tokenizer: 5.6.23 -> 5.6.26 [pfSense] php56-sysvshm: 5.6.23 -> 5.6.26 [pfSense] php56-sysvsem: 5.6.23 -> 5.6.26 [pfSense] php56-sysvmsg: 5.6.23 -> 5.6.26 [pfSense] php56-sqlite3: 5.6.23 -> 5.6.26 [pfSense] php56-sockets: 5.6.23 -> 5.6.26 [pfSense] php56-simplexml: 5.6.23 -> 5.6.26 [pfSense] php56-shmop: 5.6.23 -> 5.6.26 [pfSense] php56-session: 5.6.23 -> 5.6.26 [pfSense] php56-readline: 5.6.23 -> 5.6.26 [pfSense] php56-posix: 5.6.23 -> 5.6.26 [pfSense] php56-pdo_sqlite: 5.6.23 -> 5.6.26 [pfSense] php56-pdo: 5.6.23 -> 5.6.26 [pfSense] php56-pcntl: 5.6.23 -> 5.6.26 [pfSense] php56-openssl: 5.6.23 -> 5.6.26 [pfSense] php56-opcache: 5.6.23_1 -> 5.6.26_1 [pfSense] php56-mcrypt: 5.6.23 -> 5.6.26 [pfSense] php56-mbstring: 5.6.23 -> 5.6.26 [pfSense] php56-ldap: 5.6.23 -> 5.6.26 [pfSense] php56-json: 5.6.23 -> 5.6.26 [pfSense] php56-hash: 5.6.23 -> 5.6.26 [pfSense] php56-gettext: 5.6.23 -> 5.6.26 [pfSense] php56-filter: 5.6.23 -> 5.6.26 [pfSense] php56-dom: 5.6.23 -> 5.6.26 [pfSense] php56-curl: 5.6.23 -> 5.6.26 [pfSense] php56-ctype: 5.6.23 -> 5.6.26 [pfSense] php56-bz2: 5.6.23 -> 5.6.26 [pfSense] php56-bcmath: 5.6.23 -> 5.6.26 [pfSense] php56: 5.6.23 -> 5.6.26 [pfSense] pfSense-rc: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-kernel-pfSense: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-default-config: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-base: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense: 2.3.2 -> 2.3.2_1 [pfSense] perl5: 5.20.3_13 -> 5.20.3_15 [pfSense] libxml2: 2.9.3 -> 2.9.4 [pfSense] libidn: 1.31 -> 1.33_1 [pfSense] curl: 7.49.1 -> 7.50.3 [pfSense] Number of packages to be upgraded: 42 40 MiB to be downloaded. **** WARNING **** Reboot will be required!! Proceed with upgrade? (y/N) y >>> Downloading upgrade packages... Updating pfSense-core repository catalogue... pfSense-core repository is up-to-date. Updating pfSense repository catalogue... pfSense repository is up-to-date. All repositories are up-to-date. Checking for upgrades (42 candidates): .......... done Processing candidates (42 candidates): .......... done The following 42 package(s) will be affected (of 0 checked): Installed packages to be UPGRADED: php56-zlib: 5.6.23 -> 5.6.26 [pfSense] php56-xmlwriter: 5.6.23 -> 5.6.26 [pfSense] php56-xmlreader: 5.6.23 -> 5.6.26 [pfSense] php56-xml: 5.6.23 -> 5.6.26 [pfSense] php56-tokenizer: 5.6.23 -> 5.6.26 [pfSense] php56-sysvshm: 5.6.23 -> 5.6.26 [pfSense] php56-sysvsem: 5.6.23 -> 5.6.26 [pfSense] php56-sysvmsg: 5.6.23 -> 5.6.26 [pfSense] php56-sqlite3: 5.6.23 -> 5.6.26 [pfSense] php56-sockets: 5.6.23 -> 5.6.26 [pfSense] php56-simplexml: 5.6.23 -> 5.6.26 [pfSense] php56-shmop: 5.6.23 -> 5.6.26 [pfSense] php56-session: 5.6.23 -> 5.6.26 [pfSense] php56-readline: 5.6.23 -> 5.6.26 [pfSense] php56-posix: 5.6.23 -> 5.6.26 [pfSense] php56-pdo_sqlite: 5.6.23 -> 5.6.26 [pfSense] php56-pdo: 5.6.23 -> 5.6.26 [pfSense] php56-pcntl: 5.6.23 -> 5.6.26 [pfSense] php56-openssl: 5.6.23 -> 5.6.26 [pfSense] php56-opcache: 5.6.23_1 -> 5.6.26_1 [pfSense] php56-mcrypt: 5.6.23 -> 5.6.26 [pfSense] php56-mbstring: 5.6.23 -> 5.6.26 [pfSense] php56-ldap: 5.6.23 -> 5.6.26 [pfSense] php56-json: 5.6.23 -> 5.6.26 [pfSense] php56-hash: 5.6.23 -> 5.6.26 [pfSense] php56-gettext: 5.6.23 -> 5.6.26 [pfSense] php56-filter: 5.6.23 -> 5.6.26 [pfSense] php56-dom: 5.6.23 -> 5.6.26 [pfSense] php56-curl: 5.6.23 -> 5.6.26 [pfSense] php56-ctype: 5.6.23 -> 5.6.26 [pfSense] php56-bz2: 5.6.23 -> 5.6.26 [pfSense] php56-bcmath: 5.6.23 -> 5.6.26 [pfSense] php56: 5.6.23 -> 5.6.26 [pfSense] pfSense-rc: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-kernel-pfSense: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-default-config: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-base: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense: 2.3.2 -> 2.3.2_1 [pfSense] perl5: 5.20.3_13 -> 5.20.3_15 [pfSense] libxml2: 2.9.3 -> 2.9.4 [pfSense] libidn: 1.31 -> 1.33_1 [pfSense] curl: 7.49.1 -> 7.50.3 [pfSense] Number of packages to be upgraded: 42 40 MiB to be downloaded. **** WARNING **** Reboot will be required!! Proceed with upgrade? (y/N) y >>> Downloading upgrade packages... Updating pfSense-core repository catalogue... pfSense-core repository is up-to-date. Updating pfSense repository catalogue... pfSense repository is up-to-date. All repositories are up-to-date. Checking for upgrades (42 candidates): .......... done Processing candidates (42 candidates): .......... done The following 42 package(s) will be affected (of 0 checked): Installed packages to be UPGRADED: php56-zlib: 5.6.23 -> 5.6.26 [pfSense] php56-xmlwriter: 5.6.23 -> 5.6.26 [pfSense] php56-xmlreader: 5.6.23 -> 5.6.26 [pfSense] php56-xml: 5.6.23 -> 5.6.26 [pfSense] php56-tokenizer: 5.6.23 -> 5.6.26 [pfSense] php56-sysvshm: 5.6.23 -> 5.6.26 [pfSense] php56-sysvsem: 5.6.23 -> 5.6.26 [pfSense] php56-sysvmsg: 5.6.23 -> 5.6.26 [pfSense] php56-sqlite3: 5.6.23 -> 5.6.26 [pfSense] php56-sockets: 5.6.23 -> 5.6.26 [pfSense] php56-simplexml: 5.6.23 -> 5.6.26 [pfSense] php56-shmop: 5.6.23 -> 5.6.26 [pfSense] php56-session: 5.6.23 -> 5.6.26 [pfSense] php56-readline: 5.6.23 -> 5.6.26 [pfSense] php56-posix: 5.6.23 -> 5.6.26 [pfSense] php56-pdo_sqlite: 5.6.23 -> 5.6.26 [pfSense] php56-pdo: 5.6.23 -> 5.6.26 [pfSense] php56-pcntl: 5.6.23 -> 5.6.26 [pfSense] php56-openssl: 5.6.23 -> 5.6.26 [pfSense] php56-opcache: 5.6.23_1 -> 5.6.26_1 [pfSense] php56-mcrypt: 5.6.23 -> 5.6.26 [pfSense] php56-mbstring: 5.6.23 -> 5.6.26 [pfSense] php56-ldap: 5.6.23 -> 5.6.26 [pfSense] php56-json: 5.6.23 -> 5.6.26 [pfSense] php56-hash: 5.6.23 -> 5.6.26 [pfSense] php56-gettext: 5.6.23 -> 5.6.26 [pfSense] php56-filter: 5.6.23 -> 5.6.26 [pfSense] php56-dom: 5.6.23 -> 5.6.26 [pfSense] php56-curl: 5.6.23 -> 5.6.26 [pfSense] php56-ctype: 5.6.23 -> 5.6.26 [pfSense] php56-bz2: 5.6.23 -> 5.6.26 [pfSense] php56-bcmath: 5.6.23 -> 5.6.26 [pfSense] php56: 5.6.23 -> 5.6.26 [pfSense] pfSense-rc: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-kernel-pfSense: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-default-config: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense-base: 2.3.2 -> 2.3.2_1 [pfSense-core] pfSense: 2.3.2 -> 2.3.2_1 [pfSense] perl5: 5.20.3_13 -> 5.20.3_15 [pfSense] libxml2: 2.9.3 -> 2.9.4 [pfSense] libidn: 1.31 -> 1.33_1 [pfSense] curl: 7.49.1 -> 7.50.3 [pfSense] Number of packages to be upgraded: 42 40 MiB to be downloaded. Fetching pfSense-base-2.3.2_1.txz: .. done pkg: https://pkg.pfsense.org/pfSense_v2_3_2_amd64-core/All/pfSense-base-2.3.2_1.txz: Operation timed out >>> Locking package pfSense-kernel-pfSense... done. *** Welcome to pfSense 2.3.2-RELEASE (amd64 full-install) on pfSense ***Is this something I just need to wait out, or just keep banging away at it until all the packages get downloaded?
-
Wait it out or keep trying. Got updated after a few attempts.
-
Same here it took 4 try's.
-
Fetching php56-bz2-5.6.26.txz: .. done
Fetching php56-bcmath-5.6.26.txz: .. done
Fetching php56-5.6.26.txz: …....... done
Fetching pfSense-rc-2.3.2_1.txz: . done
Fetching pfSense-kernel-pfSense-2.3.2_1.txz: ....... done
pkg: https://pkg.pfsense.org/pfSense_v2_3_2_amd64-core/All/pfSense-kernel-pfSense-2.3.2_1.txz: Operation timed outLocking package pfSense-kernel-pfSense... done.
FailedSame here. Will try again later I guess.
-
Got it. Will keep banging away at the update server(s). Going on try #9 now :(
EDIT: manually downloading https://pkg.pfsense.org/pfSense_v2_3_2_amd64-core/All/pfSense-base-2.3.2_1.txz via a web browser works just fine, not sure why it's timing out on the router.
-
Same here.
What's the procedure to recover from this? Starting the upgrade process again?thanks!
-
The do over seems to resume from where it left off.
-
yes, just restart the upgrade. I've found (in the past at least) that the console is a more reliable method, more so since it lets you see in real time what's going on.
-
Ya.. same deal…
Fetching pfSense-base-2.3.2_1.txz: ... done
pkg: https://pkg.pfsense.org/pfSense_v2_3_2_amd64-core/All/pfSense-base-2.3.2_1.txz: Operation timed outLast 3 upgrades actually been quite unimpressed with download/update speeds. Previous upgrade took over half and hour on 150Mbit line.
Doesn't reflect well on the product as naturally people assume that the network serving it out is using it itself and therefore it may be the cause of the slow speed... not reassuring by any means.
*Note: It finally did install correctly.. but..
O damn..
Serial: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Please don't sell out guys. -
Last 3 upgrades actually been quite unimpressed with download/update speeds. Previous upgrade took over half and hour on 150Mbit line.
Ehhhh previous upgrade took longer to actually update then to download for me. On two 300 mbit lines and a 35 mbit line.
Doesn't reflect well on the product as naturally people assume that the network serving it out is using it itself and therefore it may be the cause of the slow speed… not reassuring by any means.
Or it could be the mirror it's being pulled from could be having issues. Having issues downloading a package doesn't make the product look bad, especially if it's a back end problem.
This type of issue definatley wouldn't sit well with a paid customer trying to update their device as its virtually non existent with any of the competitions hardware (firmware) updates.
Its scary to think if something as simple as the update wont work, how the rest of the code is actually checked.Jesus …. I guess haters gonna find a reason to hate. They do offer paid support, and if I was paying for support I'd probably have this issue resolved already. But I'm cheap, and I'm getting what I paid for right now. Which is fine with me, I can wait for the issue to be resolved.
Doesn't reflect well on the product as naturally people assume that the network serving it out is using it itself and therefore it may be the cause of the slow speed… not reassuring by any means.
Sigh. I didn't say it was… I clear state that people may assume that is the issue which doesn't help their sales in terms of paid model.
Not sure what you are trying to prove if not trolling but If you are going to quote a post quote the final version, note my final edit time is a full minute before what you quote here.
-
Sorry, I do apologize for assuming you are being thorough before you post.
We are now aware that its basically just slow speed on download servers.. just have to keep trying until it works.
-
I think we've gotten off the topic. I'm going to delete my previous unhelpful posts in a few minutes.
-
Just kept banging away on option 13, update finally went through. Yay :D
-
I ran into this problem when upgrading from 2.3.2 to 2.3.2_1 as well. I've never had a problem previously with an upgrade via the web UI before, but had to resort to the console for pfSense-upgrade. Even that took two tries to get through all of the packages.
As other reporters of these timeouts have noted, fetching the package manually from a host inside the firewall (e.g. via curl) works fine and in a reasonable d/l time. No problems on the pfSense host or internal hosts with DNS timeouts or other DNS (mis-)configuration issues. No CPU load, disk utilization or other such obvious stuff on the pfSense host. The WAN network appears to be performing swimmingly in both latency and bandwidth. In other words: no smoking guns.
EDIT: My web UI update attempts also consistently timed out on pfSense-base-2.3.2_1.txz. The first pfSense-console attempt got past that, but timed out on the perl package. The second pfSense-console update completed successfully.
-
First attempt from 2.3.2 to 2.3.2_P1 made it this far:
Fetching php56-5.6.26.txz: .......... done Fetching pfSense-rc-2.3.2_1.txz: . done Fetching pfSense-kernel-pfSense_wrap_vga-2.3.2_1.txz: .......... done Fetching pfSense-default-config-2.3.2_1.txz: . done Fetching pfSense-base-2.3.2_1.txz: .......... done Fetching pfSense-2.3.2_1.txz: . done Fetching perl5-5.20.3_15.txz: . done pkg: https://pkg.pfsense.org/pfSense_v2_3_2_i386-pfSense_v2_3_2/All/perl5-5.20.3_15.txz: Operation timed out >>> Locking package pfSense-kernel-pfSense_wrap_vga... done. *** Welcome to pfSense 2.3.2-RELEASE (i386 full-install) on pfSense ***Second attempt pick up where first left off. But the reboot in 10 seconds was more like 30+ seconds.
Then during extraction when booting up. Got a couple of these.
maketwhatis: not found maketwhatis: not found -
Just curious. IPv4 or IPv6?
-
-
So today I tried the update again.
The system downloaded all packages - Yeah!
But then:Number of packages to be upgraded: 41 [1/41] Upgrading perl5 from 5.20.3_13 to 5.20.3_15... [1/41] Extracting perl5-5.20.3_15: .. pkg: archive_read_next_header(): Damaged tar archive [1/41] Extracting perl5-5.20.3_15... done >>> Locking package pfSense-kernel-pfSense_wrap... done. pkg: open(/bin/sh): No such file or directory pkg: open(/bin/sh): No such file or directory pkg: Unable to determine ABI pkg: Cannot parse configuration file! pkg: open(/bin/sh): No such file or directory pkg: open(/bin/sh): No such file or directory pkg: Unable to determine ABI pkg: Cannot parse configuration file!That is worrying.
I had package corruption messages on that system as well when I wanted to upgrade from 2.3.1 to 2.3.2 and thought it might be a faulty flash card. So I flashed a new card, restored backup and had my version updated with that.
Now - I run into the same issue. Very unlikely that the next CF is also faulty. Must be something different. -
Seems like the pfsense package repositories are struggling with the load. Have you considered putting Cloudflare in front of it? It could cache all the packages for you and serve them from the global CDN.
