Files.pfsense.org is slow
-
Hi,
I barely can get any package from files.pfsense.org.
It takes more than 1 hour for downloading https://files.pfsense.org/packages/amd64/8/All/squid-2.7.9_3-amd64.pbiHow can I add & use a mirror? (if any!)
PS: my internet speed is 100 Mbps. I downloaded the pfSENSE from UK mirror in less than a minute!
But installing additional packages is taking huge time - the download part! -
What's a traceroute look like from your connection to files.pfsense.org? That isn't hosted out of someone's basement or something, it's in a class A datacenter, on a /24 we have direct-assigned from ARIN, announced via redundant Ethernet connections into the datacenter core plus via a 100 Mb fiber pipe to twtelecom. You'll come in via whichever path is better (as determined by Internet BGP). Both have capacity to spare.
There is a mirror at files.nyi.pfsense.org but it's not really easy to just switch over to use it instead.
-
I am not having any issues grabbing that file
100%[======================================>] 15,114,567 3.11MB/s in 4.2s
2014-06-02 15:40:04 (3.41 MB/s) - ‘squid-2.7.9_3-amd64.pbi’ saved [15114567/15114567]
-
Hi.
Today the time decreased to ~3 minutes for 17 MB (time given by Firefox)
Much better!Tracing route to files.pfsense.org [208.123.73.81] over a maximum of 30 hops: 1 5 ms 1 ms 1 ms pfsense-FW-GTW 2 3 ms 2 ms 2 ms 10.0.0.1 3 3 ms 2 ms 2 ms 10.30.0.225 4 6 ms 4 ms 4 ms 213.154.128.72 5 34 ms 33 ms 33 ms 213.154.125.41 6 29 ms 28 ms 28 ms 80.81.192.182 7 51 ms 76 ms 65 ms 207.88.15.77 8 131 ms 145 ms 130 ms 207.88.13.202 9 168 ms 167 ms 167 ms 207.88.12.74 10 165 ms 163 ms 160 ms 207.88.12.99 11 162 ms 163 ms 161 ms 207.88.12.128 12 165 ms 164 ms 164 ms 207.88.14.189 13 167 ms 168 ms 166 ms 65.47.204.6 14 163 ms 161 ms 168 ms 66.109.6.178 15 164 ms 163 ms 163 ms 66.109.6.53 16 177 ms 179 ms 179 ms 24.175.41.47 17 167 ms 167 ms 166 ms 24.175.42.233 18 171 ms 169 ms 174 ms 97.77.1.251 19 166 ms 166 ms 170 ms 66.219.34.173 20 161 ms 160 ms 160 ms 208.123.73.3 21 171 ms 165 ms 164 ms 208.123.73.81 Trace complete.Attached is my speed test with one site in Montose, CO (Elite Broadbandprovider): 13 Mbps
And to Frankfurt (my-works.de?): I get 75 Mbps!NY TowerStream only 3,7 Mbps :(
I don't find twtelecom on OOkla…
 -
My squid deployment crashed.
After one reboot the install process started again.
And now my box barely downloads the squidx.pib file…
Will take ages to finish!Strange fact: using the browser, I download the file much faster.
So there is a strange problem inside my APU1C4-pfSENSE setup box.and after 9% suddenly process starts to unpack: and is blocked there for the past 20-25 minutes
-
Hi again,
I discovered that my pfSENSE box is incredibly slow in writing file on the Memory Stick.
I've downloaded with Chrome, on my PC, the squid file (squid-2.7.9_3-amd64.pbi) - download was pretty ok as time (less than a minute).
Then I've tried to upload it on the pfSENSE box via WinSCP.The upload speed from my PC to the pfSENSE box is incredibly low: 8 KB/s!
I am directly connected to the box! And through the box I did the download!Is there a setting somewhere that affects my writing speed?
See the print screen.
 -
maybe the flash drive is broken?
-
This is the second one!
Initially I had an USB memory stick and now I am using an SD card inside an USB to SD adapter :(PS: I plugged the storage on the external USB port of the APU1C4 board.
Q: is there tool to check the speed of my USb / SD card? Hdparm is not available :(
These are my mounts:
/dev/ufs/pfsense0 on / (ufs, local, noatime, synchronous) devfs on /dev (devfs, local) /dev/ufs/cf on /cf (ufs, local, noatime, synchronous) /dev/md0 on /tmp (ufs, local) /dev/md1 on /var (ufs, local) devfs on /var/dhcpd/dev (devfs, local) -
try diskinfo - what does it report. Here is mine from my pfsense VM
[2.1.3-RELEASE][root@pfsense.local.lan]/root(4): diskinfo -c /dev/da0s1a
/dev/da0s1a
512 # sectorsize
3219813888 # mediasize in bytes (3G)
6288699 # mediasize in sectors
0 # stripesize
40448 # stripeoffset
391 # Cylinders according to firmware.
255 # Heads according to firmware.
63 # Sectors according to firmware.
# Disk ident.I/O command overhead:
time to read 10MB block 0.072753 sec = 0.004 msec/sector
time to read 20480 sectors 3.865589 sec = 0.189 msec/sector
calculated command overhead = 0.185 msec/sector[2.1.3-RELEASE][root@pfsense.local.lan]/root(5): diskinfo -t /dev/da0s1a
/dev/da0s1a
512 # sectorsize
3219813888 # mediasize in bytes (3G)
6288699 # mediasize in sectors
0 # stripesize
40448 # stripeoffset
391 # Cylinders according to firmware.
255 # Heads according to firmware.
63 # Sectors according to firmware.
# Disk ident.Seek times:
Full stroke: 250 iter in 0.048566 sec = 0.194 msec
Half stroke: 250 iter in 0.050277 sec = 0.201 msec
Quarter stroke: 500 iter in 0.084324 sec = 0.169 msec
Short forward: 400 iter in 0.088012 sec = 0.220 msec
Short backward: 400 iter in 0.101186 sec = 0.253 msec
Seq outer: 2048 iter in 0.366242 sec = 0.179 msec
Seq inner: 2048 iter in 0.303852 sec = 0.148 msec
Transfer rates:
outside: 102400 kbytes in 0.516057 sec = 198428 kbytes/sec
middle: 102400 kbytes in 0.708514 sec = 144528 kbytes/sec
inside: 102400 kbytes in 0.235931 sec = 434025 kbytes/sec[2.1.3-RELEASE][root@pfsense.local.lan]/root(6):
-
Many thanks johnpoz!
Here are the outputs:
diskinfo -c /dev/da0s1 /dev/da0s1 512 # sectorsize 67092480 # mediasize in bytes (64M) 131040 # mediasize in sectors 0 # stripesize 16384 # stripeoffset 8 # Cylinders according to firmware. 255 # Heads according to firmware. 63 # Sectors according to firmware. 058F63666485 # Disk ident. I/O command overhead: time to read 10MB block 1.249086 sec = 0.061 msec/sector time to read 20480 sectors 21.801318 sec = 1.065 msec/sector calculated command overhead = 1.004 msec/sectorAnd:
diskinfo -t /dev/da0s1 /dev/da0s1 512 # sectorsize 67092480 # mediasize in bytes (64M) 131040 # mediasize in sectors 0 # stripesize 16384 # stripeoffset 8 # Cylinders according to firmware. 255 # Heads according to firmware. 63 # Sectors according to firmware. 058F63666485 # Disk ident. Seek times: Full stroke: 250 iter in 0.248761 sec = 0.995 msec Half stroke: 250 iter in 0.241605 sec = 0.966 msec Quarter stroke: 500 iter in 0.477022 sec = 0.954 msec Short forward: 400 iter in 0.378283 sec = 0.946 msec Short backward: 400 iter in 0.378650 sec = 0.947 msec Seq outer: 2048 iter in 1.033889 sec = 0.505 msec Seq inner: 2048 iter in 1.031825 sec = 0.504 msec Transfer rates: outside: 64512 kbytes in 7.670279 sec = 8411 kbytes/sec middle: 64512 kbytes in 7.573060 sec = 8519 kbytes/sec inside: 64512 kbytes in 7.582332 sec = 8508 kbytes/secNewbie question: I have 2 cards inside the APU1C4 box. How can I be sure that da0s1a is the one used by pfSENSE?
fstab loks like this:
less /etc/fstab /dev/ufs/pfsense0 / ufs ro,sync,noatime 1 1 /dev/ufs/cf /cf ufs ro,sync,noatime 1 1Late edit:
diskinfo -t /dev/da1s1 /dev/da1s1 512 # sectorsize 1968357888 # mediasize in bytes (1.9G) 3844449 # mediasize in sectors 0 # stripesize 32256 # stripeoffset 239 # Cylinders according to firmware. 255 # Heads according to firmware. 63 # Sectors according to firmware. # Disk ident. Seek times: Full stroke: 250 iter in 0.161972 sec = 0.648 msec Half stroke: 250 iter in 0.155893 sec = 0.624 msec Quarter stroke: 500 iter in 0.321150 sec = 0.642 msec Short forward: 400 iter in 0.252276 sec = 0.631 msec Short backward: 400 iter in 0.250348 sec = 0.626 msec Seq outer: 2048 iter in 0.966766 sec = 0.472 msec Seq inner: 2048 iter in 0.961144 sec = 0.469 msec Transfer rates: outside: 102400 kbytes in 5.106516 sec = 20053 kbytes/sec middle: 102400 kbytes in 5.084638 sec = 20139 kbytes/sec inside: 102400 kbytes in 5.086434 sec = 20132 kbytes/sec -
Summary of the topic:
Problem: packages are not installed because download never finishes.
Sometimes the package manager do not wait for download to finish and start unpacking - and never ending the job.1. Initially my package download were very very slow and package installation crashed. I checked the download speed with USA and I got 13 mbps. With Frankfurt I get 75. If I manually download the package with my laptop (through pfSENSE!) then I get it in less than a minute. Inside pfSENSE (using the package manager GUI) usually takes 1 hour for 14 MB (squid is a good example) -> https://files.pfsense.org/packages/amd64/8/All/squid-2.7.9_3-amd64.pbi
2. I've manually downloaded the file on my laptop and tried to put is in tmp folder. Now I discovered that even with WinSCP I can't get a decent upload speed inside pfSENSE box. The upload speed was hilarious: 8 B/s!
3. As suggested, I've tested the SD / USB speed: diskinfo shows a write speed over 10 MB/sWhat else can I try? I am unable to install any package higher than 2-5 MB!
Late edit: all crashed packages appear as installed in package manager but none started: squid did not start, snort did not start, dansguardian did not start. Worst: the GUI does not have in the menus the entries for these services!
Later edit: I've used package manager to reinstall the GUI part for each package installed (snort, squid, dansguardian). The XML and CONF file were replaced and now I have the menus to configure the services.
I MANAGED to finally start them!
The big question remains: what is the problem? And how can I fix it?
I am using APU1C4 box with 2 pfSENSE memories: one USB stick and one USB-to-SD adapter and SD card inside adapter. Both connected on external USB port of the APU1C4.
Inside APU1C4 I have another SD (on the board) with ipFIRE. If my pfSENSE crash, I reboot with ipFIRE.
