Files.pfsense.org is slow



  • Hi,

    I barely can get any package from files.pfsense.org.
    It takes more than 1 hour for downloading https://files.pfsense.org/packages/amd64/8/All/squid-2.7.9_3-amd64.pbi

    How can I add & use a mirror? (if any!)

    PS: my internet speed is 100 Mbps. I downloaded the pfSENSE from UK mirror in less than a minute!
    But installing additional packages is taking huge time - the download part!



  • What's a traceroute look like from your connection to files.pfsense.org? That isn't hosted out of someone's basement or something, it's in a class A datacenter, on a /24 we have direct-assigned from ARIN, announced via redundant Ethernet connections into the datacenter core plus via a 100 Mb fiber pipe to twtelecom. You'll come in via whichever path is better (as determined by Internet BGP). Both have capacity to spare.

    There is a mirror at files.nyi.pfsense.org but it's not really easy to just switch over to use it instead.


  • LAYER 8 Global Moderator

    I am not having any issues grabbing that file

    100%[======================================>] 15,114,567  3.11MB/s  in 4.2s

    2014-06-02 15:40:04 (3.41 MB/s) - ‘squid-2.7.9_3-amd64.pbi’ saved [15114567/15114567]



  • Hi.
    Today the time decreased to ~3 minutes for 17 MB (time given by Firefox)
    Much better!

    Tracing route to files.pfsense.org [208.123.73.81]
    over a maximum of 30 hops:
    
      1     5 ms     1 ms     1 ms  pfsense-FW-GTW
      2     3 ms     2 ms     2 ms  10.0.0.1
      3     3 ms     2 ms     2 ms  10.30.0.225
      4     6 ms     4 ms     4 ms  213.154.128.72
      5    34 ms    33 ms    33 ms  213.154.125.41
      6    29 ms    28 ms    28 ms  80.81.192.182
      7    51 ms    76 ms    65 ms  207.88.15.77
      8   131 ms   145 ms   130 ms  207.88.13.202
      9   168 ms   167 ms   167 ms  207.88.12.74
     10   165 ms   163 ms   160 ms  207.88.12.99
     11   162 ms   163 ms   161 ms  207.88.12.128
     12   165 ms   164 ms   164 ms  207.88.14.189
     13   167 ms   168 ms   166 ms  65.47.204.6
     14   163 ms   161 ms   168 ms  66.109.6.178
     15   164 ms   163 ms   163 ms  66.109.6.53
     16   177 ms   179 ms   179 ms  24.175.41.47
     17   167 ms   167 ms   166 ms  24.175.42.233
     18   171 ms   169 ms   174 ms  97.77.1.251
     19   166 ms   166 ms   170 ms  66.219.34.173
     20   161 ms   160 ms   160 ms  208.123.73.3
     21   171 ms   165 ms   164 ms  208.123.73.81
    
    Trace complete.
    

    Attached is my speed test with one site in Montose, CO (Elite Broadbandprovider): 13 Mbps
    And to Frankfurt (my-works.de?): I get 75 Mbps!

    NY TowerStream only 3,7 Mbps :(

    I don't find twtelecom on OOkla…

    ![2014-06-03 08_37_56-files.pfsense.org-squid-2.7.9_3-amd64.pbi.jpg](/public/imported_attachments/1/2014-06-03 08_37_56-files.pfsense.org-squid-2.7.9_3-amd64.pbi.jpg)
    ![2014-06-03 08_37_56-files.pfsense.org-squid-2.7.9_3-amd64.pbi.jpg_thumb](/public/imported_attachments/1/2014-06-03 08_37_56-files.pfsense.org-squid-2.7.9_3-amd64.pbi.jpg_thumb)
    ![2014-06-03 09_04_29-FRANKFURT - Speedtest.net by Ookla - The Global Broadband Speed Test.jpg_thumb](/public/imported_attachments/1/2014-06-03 09_04_29-FRANKFURT - Speedtest.net by Ookla - The Global Broadband Speed Test.jpg_thumb)
    ![2014-06-03 09_04_29-FRANKFURT - Speedtest.net by Ookla - The Global Broadband Speed Test.jpg](/public/imported_attachments/1/2014-06-03 09_04_29-FRANKFURT - Speedtest.net by Ookla - The Global Broadband Speed Test.jpg)
    ![2014-06-03 09_01_11-Speedtest.net by Ookla - The Global Broadband Speed Test.jpg_thumb](/public/imported_attachments/1/2014-06-03 09_01_11-Speedtest.net by Ookla - The Global Broadband Speed Test.jpg_thumb)
    ![2014-06-03 09_01_11-Speedtest.net by Ookla - The Global Broadband Speed Test.jpg](/public/imported_attachments/1/2014-06-03 09_01_11-Speedtest.net by Ookla - The Global Broadband Speed Test.jpg)



  • My squid deployment crashed.

    After one reboot the install process started again.
    And now my box barely downloads the squidx.pib file…
    Will take ages to finish!

    Strange fact: using the browser, I download the file much faster.
    So there is a strange problem inside my APU1C4-pfSENSE setup box.

    and after 9% suddenly process starts to unpack: and is blocked there for the past 20-25 minutes



  • Hi again,

    I discovered that my pfSENSE box is incredibly slow in writing file on the Memory Stick.

    I've downloaded with Chrome, on my PC, the squid file (squid-2.7.9_3-amd64.pbi) - download was pretty ok as time (less than a minute).
    Then I've tried to upload it on the pfSENSE box via WinSCP.

    The upload speed from my PC to the pfSENSE box is incredibly low: 8 KB/s!
    I am directly connected to the box! And through the box I did the download!

    Is there a setting somewhere that affects my writing speed?

    See the print screen.

    ![2014-06-18 20_21_28-WSCP write to pfSENSE inside APU1C4.jpg_thumb](/public/imported_attachments/1/2014-06-18 20_21_28-WSCP write to pfSENSE inside APU1C4.jpg_thumb)
    ![2014-06-18 20_21_28-WSCP write to pfSENSE inside APU1C4.jpg](/public/imported_attachments/1/2014-06-18 20_21_28-WSCP write to pfSENSE inside APU1C4.jpg)



  • maybe the flash drive is broken?



  • This is the second one!
    Initially I had an USB memory stick and now I am using an SD card inside an USB to SD adapter :(

    PS: I plugged the storage on the external USB port of the APU1C4 board.

    Q: is there  tool to check the speed of my USb / SD card? Hdparm is not available :(

    These are my mounts:

    /dev/ufs/pfsense0 on / (ufs, local, noatime, synchronous)
    devfs on /dev (devfs, local)
    /dev/ufs/cf on /cf (ufs, local, noatime, synchronous)
    /dev/md0 on /tmp (ufs, local)
    /dev/md1 on /var (ufs, local)
    devfs on /var/dhcpd/dev (devfs, local)
    

  • LAYER 8 Global Moderator

    try diskinfo - what does it report.  Here is mine from my pfsense VM

    [2.1.3-RELEASE][root@pfsense.local.lan]/root(4): diskinfo -c /dev/da0s1a
    /dev/da0s1a
            512            # sectorsize
            3219813888      # mediasize in bytes (3G)
            6288699        # mediasize in sectors
            0              # stripesize
            40448          # stripeoffset
            391            # Cylinders according to firmware.
            255            # Heads according to firmware.
            63              # Sectors according to firmware.
                            # Disk ident.

    I/O command overhead:
            time to read 10MB block      0.072753 sec      =    0.004 msec/sector
            time to read 20480 sectors  3.865589 sec      =    0.189 msec/sector
            calculated command overhead                    =    0.185 msec/sector

    [2.1.3-RELEASE][root@pfsense.local.lan]/root(5): diskinfo -t /dev/da0s1a
    /dev/da0s1a
            512            # sectorsize
            3219813888      # mediasize in bytes (3G)
            6288699        # mediasize in sectors
            0              # stripesize
            40448          # stripeoffset
            391            # Cylinders according to firmware.
            255            # Heads according to firmware.
            63              # Sectors according to firmware.
                            # Disk ident.

    Seek times:
            Full stroke:      250 iter in  0.048566 sec =    0.194 msec
            Half stroke:      250 iter in  0.050277 sec =    0.201 msec
            Quarter stroke:  500 iter in  0.084324 sec =    0.169 msec
            Short forward:    400 iter in  0.088012 sec =    0.220 msec
            Short backward:  400 iter in  0.101186 sec =    0.253 msec
            Seq outer:      2048 iter in  0.366242 sec =    0.179 msec
            Seq inner:      2048 iter in  0.303852 sec =    0.148 msec
    Transfer rates:
            outside:      102400 kbytes in  0.516057 sec =  198428 kbytes/sec
            middle:        102400 kbytes in  0.708514 sec =  144528 kbytes/sec
            inside:        102400 kbytes in  0.235931 sec =  434025 kbytes/sec

    [2.1.3-RELEASE][root@pfsense.local.lan]/root(6):



  • Many thanks johnpoz!

    Here are the outputs:

    diskinfo -c /dev/da0s1
    /dev/da0s1
            512             # sectorsize
            67092480        # mediasize in bytes (64M)
            131040          # mediasize in sectors
            0               # stripesize
            16384           # stripeoffset
            8               # Cylinders according to firmware.
            255             # Heads according to firmware.
            63              # Sectors according to firmware.
            058F63666485    # Disk ident.
    
    I/O command overhead:
            time to read 10MB block      1.249086 sec       =    0.061 msec/sector
            time to read 20480 sectors  21.801318 sec       =    1.065 msec/sector
            calculated command overhead                     =    1.004 msec/sector
    

    And:

    diskinfo -t /dev/da0s1
    /dev/da0s1
            512             # sectorsize
            67092480        # mediasize in bytes (64M)
            131040          # mediasize in sectors
            0               # stripesize
            16384           # stripeoffset
            8               # Cylinders according to firmware.
            255             # Heads according to firmware.
            63              # Sectors according to firmware.
            058F63666485    # Disk ident.
    
    Seek times:
            Full stroke:      250 iter in   0.248761 sec =    0.995 msec
            Half stroke:      250 iter in   0.241605 sec =    0.966 msec
            Quarter stroke:   500 iter in   0.477022 sec =    0.954 msec
            Short forward:    400 iter in   0.378283 sec =    0.946 msec
            Short backward:   400 iter in   0.378650 sec =    0.947 msec
            Seq outer:       2048 iter in   1.033889 sec =    0.505 msec
            Seq inner:       2048 iter in   1.031825 sec =    0.504 msec
    Transfer rates:
            outside:        64512 kbytes in   7.670279 sec =     8411 kbytes/sec
            middle:         64512 kbytes in   7.573060 sec =     8519 kbytes/sec
            inside:         64512 kbytes in   7.582332 sec =     8508 kbytes/sec
    

    Newbie question: I have 2 cards inside the APU1C4 box. How can I be sure that da0s1a is the one used by pfSENSE?

    fstab loks like this:

    less /etc/fstab
    /dev/ufs/pfsense0 / ufs ro,sync,noatime 1 1
    /dev/ufs/cf /cf ufs ro,sync,noatime 1 1
    

    Late edit:

    diskinfo -t /dev/da1s1
    /dev/da1s1
            512             # sectorsize
            1968357888      # mediasize in bytes (1.9G)
            3844449         # mediasize in sectors
            0               # stripesize
            32256           # stripeoffset
            239             # Cylinders according to firmware.
            255             # Heads according to firmware.
            63              # Sectors according to firmware.
                            # Disk ident.
    
    Seek times:
            Full stroke:      250 iter in   0.161972 sec =    0.648 msec
            Half stroke:      250 iter in   0.155893 sec =    0.624 msec
            Quarter stroke:   500 iter in   0.321150 sec =    0.642 msec
            Short forward:    400 iter in   0.252276 sec =    0.631 msec
            Short backward:   400 iter in   0.250348 sec =    0.626 msec
            Seq outer:       2048 iter in   0.966766 sec =    0.472 msec
            Seq inner:       2048 iter in   0.961144 sec =    0.469 msec
    Transfer rates:
            outside:       102400 kbytes in   5.106516 sec =    20053 kbytes/sec
            middle:        102400 kbytes in   5.084638 sec =    20139 kbytes/sec
            inside:        102400 kbytes in   5.086434 sec =    20132 kbytes/sec
    
    


  • Summary of the topic:

    Problem: packages are not installed because download never finishes.
    Sometimes the package manager do not wait for download to finish and start unpacking - and never ending the job.

    1. Initially my package download were very very slow and package installation crashed. I checked the download speed with USA and I got 13 mbps. With Frankfurt I get 75.  If I manually download the package with my laptop (through pfSENSE!) then I get it in less than a minute. Inside pfSENSE (using the package manager GUI) usually takes 1 hour for 14 MB (squid is a good example) -> https://files.pfsense.org/packages/amd64/8/All/squid-2.7.9_3-amd64.pbi
    2. I've manually downloaded the file on my laptop and tried to put is in tmp folder. Now I discovered that even with WinSCP I can't get a decent upload speed inside pfSENSE box. The upload speed was hilarious: 8 B/s!
    3. As suggested, I've tested the SD / USB speed: diskinfo shows a write speed over 10 MB/s

    What else can I try? I am unable to install any package higher than 2-5 MB!

    Late edit: all crashed packages appear as installed in package manager but none started: squid did not start, snort did not start, dansguardian did not start. Worst: the GUI does not have in the menus the entries for these services!

    Later edit: I've used package manager to reinstall the GUI part for each package installed (snort, squid, dansguardian). The XML and CONF file were replaced and now I have the menus to configure the services.

    I MANAGED to finally start them!

    The big question remains: what is the problem? And how can I fix it?
    I am using APU1C4 box with 2 pfSENSE memories: one USB stick and one USB-to-SD adapter and SD card inside adapter. Both connected on external USB port of the APU1C4.
    Inside APU1C4 I have another SD (on the board) with ipFIRE. If my pfSENSE crash, I reboot with ipFIRE.


Log in to reply