Caching Steam game downloads

agixdota

sorry out of topic, can you teach me how to intergrated/install storeid squid 3.4 on pfsense 2.2

KOM

can you teach me how to intergrated/install to squid 3.4 on pfsense 2.2

There are a million YouTube videos and other resources you can find through a search engine on how to do that. Don't hijack someone's else's thread to ask something totally unrelated.

agixdota

@KOM:

can you teach me how to intergrated/install to squid 3.4 on pfsense 2.2

There are a million YouTube videos and other resources you can find through a search engine on how to do that. Don't hijack someone's else's thread to ask something totally unrelated.

I'm so sorry sir, I'm mean storeid into squid 3.4 ;D

wagex

a little late dunno if you are still around as that was your only post, i am working on a solution for this as well.

i looked at the same pages you listed before and the issue with the best option is they didnt put the functions into squid until 3.4 and we are on 3.2 or something im not quite sure how to read the versions… squid3 v0.2.8.

been searching all morning looking how to change the location of the caches so that valve1-200.steampowere.com all save to one folder and get cached / hit using the same name... im a complete noob with squid how to do this tho ive seen some stuff possibly using symlinks, though im not sure.

right now im getting about a 50/50 chance the object has been cached which isnt terrible and will help a bit for my lan party. though i wish i could fix the cache so it would be a 100% hit rate.

edit: i tink i might have found a solution, im going to have to read through it for a little bit and try to understand how it works completely. http://wiki.squid-cache.org/Features/StoreUrlRewrite

mutiny1

Bump….? I too would like to achieve this. Is the store_rewrite function built in yet?

whiztech

@mutiny1:

Bump….? I too would like to achieve this. Is the store_rewrite function built in yet?

i gave up and use pfsense + lancache (http://blog.multiplay.co.uk/2014/04/lancache-dynamically-caching-game-installs-at-lans-using-nginx/)

mutiny1

Thanks for the reply. I'm not smart enought to use that yet. I tried but it didn't work out too well.

C0RR0SIVE

@whiztech:

@mutiny1:

Bump….? I too would like to achieve this. Is the store_rewrite function built in yet?

i gave up and use pfsense + lancache (http://blog.multiplay.co.uk/2014/04/lancache-dynamically-caching-game-installs-at-lans-using-nginx/)

Are you using Lancache on PFSense, or on a dedicated server? If on PFSense, could you write a guide for those that wish to use this with pfsense?

bonbonboi

waiting for the guide as well ::)

wscott

So I have been playing with this and not having any luck yet, but I thought I would post what I have learned.

Your rewrite patterns are wrong.

^http:\/\/(.*)\.cs\.steampowered\.com\/(.*)          http://steamcdn.cs.steampowered.com/$1

In a regex, the $1 returns the first () in the pattern and $2 the second etc. So you created a URL that looks like http://steamcdn.cs.streampowered.com/valve32

better would be something like this:

^http:\/\/.*\.cs\.steampowered\.com\/(depot\/\d+\/chunk\/.*)          http://valveN.steamcdn.cs.steampowered.com.squid.internal/$1

I used more of the url to make sure we are only matching the actual game downloads and used squid.internal like this collection: http://wiki.squid-cache.org/Features/StoreID/DB

The next problem I had is that the /usr/pbi/bin/libexec/squid/storeid_file_rewrite program doesn't seem to actually work. When I run it directly from the shell it returns immediately. It should read URLs on stdin and write the results to stdout. Not seeing what I did wrong but when I use it I just get this in cache.log.


2016/03/12 07:50:21 kid1| Starting new store_id helpers...
2016/03/12 07:50:21 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:21 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:21 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:22 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:22 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:22 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:22 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:22 kid1| WARNING: store_id #Hlpr0 exited
2016/03/12 07:50:22 kid1| WARNING: store_id #Hlpr0 exited

Also I tried using my own perl script but had troubles getting a perl to run.

I will keep poking as a have time but perhaps someone can shed light.

rudiservo

I tried to make it work with perl in pfsense 2.6 with little success.

anyways I did make a helper in PHP with and loaded with some configs and rewrite parterns

works pretty fine altough I had some hangs in steam do not know why.

https://github.com/rudiservo/pfsense_storeid