Speedtest CLI. Run speedtest on pfSense box
-
johnpoz LAYER 8 Global Moderatorlast edited by johnpoz Dec 22, 2022, 12:34 AM Dec 22, 2022, 12:24 AM
@sergei_shablovsky said in Speedtest CLI. Run speedtest on pfSense box:
BOTH OF THIS TESTING ARE NEEDED.
And that could often confuse them even more.. When they test from their router and do not see the speed they expect..
There is a huge difference between a router, and a server/client when it comes to processing power needed and what it is optimized to do.
There is big difference in requirements in hardware to move a packet from one interface to another and change its source IP and port, etc. ie nat.. and processing all things needed to test speed..
Just because a "router" can process packets and get speed X, doesn't mean that the "router" can do that when acting as the client.. If your internet speed is low, your prob fine - of your router is beefy enough, etc. But when you start talking high speeds like gig, and low resource hardware used in "routers" that can quite easy route/firewall traffic at gig.. Doesn't always mean that it can be a client at those speeds.
I get why that might be confusing for the new user - not saying testing from the router can not be of some use in some cases, but I sure would not use a test from router to troubleshoot not seeing speed X from isp, unless you have tested before from that router and seen the speeds, etc.
If you had tested from router before and seen speed X, and then test it another day and only see something much lower than X - then sure that is an indication that something is wrong.
What I wouldn't assume is isp says I should see 900mbps, and then never seeing 900mbps from some cli running on my router and only seeing 700mbps for example that isp is problem, etc. Or that there is anything wrong or needing adjustment on the router.
example:
I see my speed from client that I pay for 500mbps, but from pfsense I do not - there is nothing wrong.. I wouldn't expect to see full speed from my router. What I expect is my router to be be able to route at my isp speed.
-
@stephenw10 I see but it doesn't explain to me why not on my side. How to troubleshoot it?
-
FWIW, my server that runs the Python CL version of Speedtest started failing to provide data. After some searching I found I needed to add the ' --secure ' switch to my batch file. YMMV.
This is the line I use to retrieve the list of servers:
C:\Python27\python.exe C:\Python27\Lib\site-packages\speedtest.py --list --secure > serverlist.txt
-
Yes I would try
--list
and see if that fails with or without--secure
.I assume you can ping other targets?
Steve
-
# speedtest --secure Retrieving speedtest.net configuration... Testing from Free SAS (82.XXX.XXX.XXX)... Retrieving speedtest.net server list... Selecting best server based on ping... ERROR: Unable to connect to servers to test latency.
# speedtest --list Retrieving speedtest.net configuration...
From my computer :
c:\>ping speedtest.net Envoi d’une requête 'ping' sur speedtest.net [151.101.2.219] avec 32 octets de données : Réponse de 151.101.2.219 : octets=32 temps=3 ms TTL=59 Réponse de 151.101.2.219 : octets=32 temps=3 ms TTL=59 Réponse de 151.101.2.219 : octets=32 temps=3 ms TTL=59 Réponse de 151.101.2.219 : octets=32 temps=3 ms TTL=59 Statistiques Ping pour 151.101.2.219: Paquets : envoyés = 4, reçus = 4, perdus = 0 (perte 0%), Durée approximative des boucles en millisecondes : Minimum = 3ms, Maximum = 3ms, Moyenne = 3ms
-
That version seems to work fine for me from the FW even w/o --secure. Maybe check out your FW logs. Maybe you're blocking yourself.
[22.05-RELEASE][root@fw.workgroup]/root: pkg-static install py38-speedtest-cli Updating pfSense-core repository catalogue... pfSense-core repository is up to date. Updating pfSense repository catalogue... pfSense repository is up to date. All repositories are up to date. pkg-static: warning: database version 36 is newer than libpkg(3) version 35, but still compatible The following 1 package(s) will be affected (of 0 checked): New packages to be INSTALLED: py38-speedtest-cli: 2.1.3 [pfSense] Number of packages to be installed: 1 38 KiB to be downloaded. Proceed with this action? [y/N]: y [1/1] Fetching py38-speedtest-cli-2.1.3.pkg: 100% 38 KiB 39.0kB/s 00:01 Checking integrity... done (0 conflicting) [1/1] Installing py38-speedtest-cli-2.1.3... [1/1] Extracting py38-speedtest-cli-2.1.3: 100% [22.05-RELEASE][root@fw.workgroup]/root: rehash [22.05-RELEASE][root@fw.workgroup]/root: speedtest Retrieving speedtest.net configuration... Testing from Comcast Cable (73.111.129.66)... Retrieving speedtest.net server list... Selecting best server based on ping... Hosted by Windstream (Chicago, IL) [69.50 km]: 14.881 ms Testing download speed............................................................................... .Download: 81.45 Mbit/s Testing upload speed...................................................................................................... Upload: 12.02 Mbit/s [22.05-RELEASE][root@fw.workgroup]/root:
-
But can you ping things from pfSense where the script is running?
However if it fails to pull a list of servers it's probably not a ping problem.
-
Ping result from pfSense :
PING speedtest.net (151.101.194.219): 56 data bytes 64 bytes from 151.101.194.219: icmp_seq=0 ttl=60 time=3.154 ms 64 bytes from 151.101.194.219: icmp_seq=1 ttl=60 time=3.471 ms 64 bytes from 151.101.194.219: icmp_seq=2 ttl=60 time=2.920 ms --- speedtest.net ping statistics --- 3 packets transmitted, 3 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 2.920/3.182/3.471/0.226 ms
-
I still STRONGLY NOT RECOMMEND testing uplink speed by speedtest - nowadays MOST ISP creating special ACLs and ruleset for speedtest servers BOTH on aggregate level and on core level to “looks better than counterpart that You compare to”.
By other words, all speedtest results would be looks really great (hi speed, low latency, low jitter..) BUT all Your REAL traffic would be not so good. ;)
And another one important factor: most ISP make a little shaping (frequently on aggregate level than on core) to pay a little less for traffic ;) Depend on state and ISP this may be -7-15% of total uplink bandwidth. As a result You have 85-93% of bandwidth You pay for.
But NO ONE of sysadmins told You this truth... No any conspiracy, just business.
And I RECOMMEND TO CONFIGURE FREEBSD TCP/IP STACK TO USING QUICK ALGORITHM, because most of nowadays ISPs use QUICK on both aggregate and core level.
(Please read posts about QUIC on this forum) - 4 months later
-
Can You send-me the tutorial to create the speedtest_cli.js?
-
@patrick-pesegodinski
Hi,
that files will be created and is only a property bag that is loaded when the widget is called.
Cheers -
@marco42 I don't understand your respost.
In the .zip no is included the speedtest-cli.js
-
speettest_cli.js
is a temporary file that is created byspeedtest.sh
. It's not supposed to be in the file. -
Hi,
Great script, il works well for me, but I ghave a little problem with speedtest.
I don't check every day the speed, and sometime it "stop" to work.
The reason is that speedtest don't send result because it s waiting that I accept the licence.
So i must connect with putty on my pfsence, start speedtest and validate licence:speedtest ============================================================================== Ookla collects certain data through Speedtest that may be considered personally identifiable, such as your IP address, unique device identifiers or location. Ookla believes it has a legitimate interest to share this data with internet providers, hardware manufacturers and industry regulators to help them understand and create a better and faster internet. For further information including how the data may be shared, where the data may be transferred and Ookla's contact details, please see our Privacy Policy at: http://www.speedtest.net/privacy ============================================================================== Do you accept the license? [type YES to accept]: YES License acceptance recorded. Continuing.
Do you now a solution to stop to ask me to accept licence every month (or something like this)?
-
@carbonejf did you install it?
Like:pkg install py37-speedtest-cli-2.1.3
-
@marco42 Sorry I did it a long time ago and I don't rememberhow I install it :(
I installed a package yes, but maybe not this one -
@carbonejf Maybe you update or uninstall/reinstall to get the latest version? That could help.
-
@marco42 I don't use this version, my speedtest is: Speedtest by Ookla 1.0.0.2 (5ae238b) FreeBSD 12.3-STABLE amd64
-
@carbonejf Ok, that one I don't know, sorry.
-
@icewraithuk how you import the "urllib2" in the pfsense?
I don't search for install.