Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Varnish help on setting up for multiple internal webservers

    Scheduled Pinned Locked Moved pfSense Packages
    66 Posts 10 Posters 29.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K
      kegler
      last edited by

      @marcelloc:

      The file is there and package is installed, it should work.  ???

      Just to check, see if varnish package is installed with pkg_info on console.

      ps ax | grep varnish will show if there is any varnish process running.

      18796  0  S+    0:00.00 grep varnish

      looks like not running?

      1 Reply Last reply Reply Quote 0
      • marcellocM
        marcelloc
        last edited by

        What about pkg_info cmd?

        What does returns /usr/local/etc/rc.d/varnish.sh start

        Treinamentos de Elite: http://sys-squad.com

        Help a community developer! ;D

        1 Reply Last reply Reply Quote 0
        • K
          kegler
          last edited by

          @marcelloc:

          What about pkg_info cmd?

          What does returns /usr/local/etc/rc.d/varnish.sh start

          sorry what is the cmd to check the above ?

          1 Reply Last reply Reply Quote 0
          • K
            kegler
            last edited by

            [2.0-RELEASE][admin@kegpfs.kegnet.com]/usr/local/etc/rc.d(6): varnish.sh start
            varnish.sh: Command not found.

            seems something not installed ?

            1 Reply Last reply Reply Quote 0
            • marcellocM
              marcelloc
              last edited by

              Do not chdir to rc.d, Run varnish.sh with full path

              Treinamentos de Elite: http://sys-squad.com

              Help a community developer! ;D

              1 Reply Last reply Reply Quote 0
              • K
                kegler
                last edited by

                @marcelloc:

                Do not chdir to rc.d, Run varnish.sh with full path

                kern.ipc.nmbclusters: 65536
                sysctl: kern.ipc.nmbclusters: Invalid argument
                kern.ipc.somaxconn: 16384 -> 16384
                kern.maxfiles: 131072 -> 131072
                kern.maxfilesperproc: 104856 -> 104856
                kern.threads.max_threads_per_proc: 4096 -> 4096

                wondering could it be due to my domain is host by no-ip.com?

                1 Reply Last reply Reply Quote 0
                • K
                  kegler
                  last edited by

                  php: /pkg_edit.php: The command '/usr/local/etc/rc.d/varnish.sh' returned exit code '2', the output was 'kern.ipc.nmbclusters: 65536 sysctl: kern.ipc.nmbclusters: Invalid argument kern.ipc.somaxconn: 16384 -> 16384 kern.maxfiles: 131072 -> 131072 kern.maxfilesperproc: 104856 -> 104856 kern.threads.max_threads_per_proc: 4096 -> 4096 storage_malloc: max size 1024 MB. Message from VCC-compiler: Expected ';' got '/' (program line 369), at (input Line 28 Pos 26) .url = ""/""; –-----------------------#--- In backend specification starting at: (input Line 21 Pos 1) backend kegapp33BACKEND { #######------------------ Running VCC-compiler failed, exit 1 VCL compilation failed'

                  saw this in my log… but i dont quite understand what went wrong

                  and i kvm into my pfsense and saw this on the screen.... seems like its stucked at the loading of varnish....

                  i think i messed up the pfsense somewhere

                  1 Reply Last reply Reply Quote 0
                  • marcellocM
                    marcelloc
                    last edited by

                    Remove quotes from your backend Test url

                    .url = ""/"";

                    Treinamentos de Elite: http://sys-squad.com

                    Help a community developer! ;D

                    1 Reply Last reply Reply Quote 0
                    • K
                      kegler
                      last edited by

                      omg…it worked now...thank you very much....

                      1 Reply Last reply Reply Quote 0
                      • C
                        canefield
                        last edited by

                        @marcelloc:

                        Each backend means a webserver

                        inside each configuration, you must provide:

                        • Backend name = WindowsServer

                        • Ip Address = 192.168.1.4

                        • Port = 80 <– Q

                        • Probe URL = "/"(if your server has a valid page on "/")

                        • Probe Interval = 5

                        • Probe Timeout = 1

                        • Probe window = 5

                        • Probe Threshold = 3

                        Q:
                        Can I enter multiple listening ports e.g. port: "80, 443"? Or should I configure that host several times according to how many ports it is listening on?

                        Thanks,
                        Canefield

                        1 Reply Last reply Reply Quote 0
                        • marcellocM
                          marcelloc
                          last edited by

                          I think you need one port for each config as varnish is going to check backend health as well send traffic based on this port.

                          Keep in mind That varnish implemets http balance/cache only. If you what to balance https as well, haproxy can do this.

                          Pound and relayd can do client/firewall ssl comunication and then forward client request to varnish, but there is no gui options for this yet.

                          Treinamentos de Elite: http://sys-squad.com

                          Help a community developer! ;D

                          1 Reply Last reply Reply Quote 0
                          • L
                            Landmine
                            last edited by

                            Hate to jump on someone else's thread, but I've gone threw all the same motions, but still no results.

                            web1.domain.com
                            web2.domain.com

                            All end up pointing to the pfSense login, so my question is simply this… What IP do you point the Rule to? the pfSense box that host Varnish?

                            1 Reply Last reply Reply Quote 0
                            • marcellocM
                              marcelloc
                              last edited by

                              Did you changed  pfsense gui port?
                              This current varnish gui implementation listens deamon on all interfaces.

                              Treinamentos de Elite: http://sys-squad.com

                              Help a community developer! ;D

                              1 Reply Last reply Reply Quote 0
                              • L
                                Landmine
                                last edited by

                                I did now and it works!

                                Guess next time I need to slow down and read all the helpful text.

                                Thank you

                                1 Reply Last reply Reply Quote 0
                                • L
                                  Landmine
                                  last edited by

                                  Correction, it was working. I didnt change anything and I'm getting the 503 errors again  :(

                                  –---------- Update ------------

                                  I only get the 503 error on 1 of the 2 domains.

                                  ------------ Update ------------

                                  Removing the Backend mapping with the http:// on it seemed to fix the issue.

                                  ------------ Update ------------

                                  Down again after about 30 seconds.  >:(

                                  1 Reply Last reply Reply Quote 0
                                  • marcellocM
                                    marcelloc
                                    last edited by

                                    That's probably a backend health url check problem.

                                    Add varnish widget to dashboard to see backend status.

                                    The 503 error means could not find any available backend.

                                    Also try to see backend configuration file on view configuration.

                                    Treinamentos de Elite: http://sys-squad.com

                                    Help a community developer! ;D

                                    1 Reply Last reply Reply Quote 0
                                    • L
                                      Landmine
                                      last edited by

                                      Here is my config

                                      
                                      # Varnish configuration file
                                      # Automatically generated by the pfSense package system
                                      
                                      # This file is located in /var/etc/default.vcl
                                      
                                      sub vcl_error {
                                      		if (obj.status == 503 && req.restarts < 1) {
                                      			restart;
                                      		}
                                      
                                      	set obj.http.Content-Type = "text/html; charset=utf-8";
                                      	synthetic {"
                                      "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
                                      
                                      <title>"} obj.status " " obj.response {"</title>
                                      
                                       **We are very sorry but an error occurred during this request.** 
                                      
                                      Please press refresh in your browser to try again.
                                      
                                      Varnish Error "} obj.status " " obj.response {"
                                      
                                      "} obj.response {"
                                      
                                      ### Guru Meditation:
                                      
                                      XID: "} req.xid {"
                                      
                                      "};
                                      	return(deliver);
                                      
                                      }
                                      
                                      backend MinecraftBACKEND {
                                      	# used in catch_all 
                                      	.host = "10.0.0.50";
                                      	.port = "80";
                                      	.first_byte_timeout = 300s;
                                      	.connect_timeout = 25s;
                                      	.probe = {
                                      		.url = "/index.php";
                                      		.interval = 5s;
                                      		.timeout = 3s;
                                      		.window = 5;
                                      		.threshold = 3;
                                      	}
                                      }
                                      
                                      sub vcl_recv {
                                      
                                      	#BASIC VCL RULES SETTING
                                      	#Fix gzip compression
                                      	if (req.http.Accept-Encoding) {
                                      	if (req.url ~ "\.(gif|jpg|jpeg|bmp|png|ico|img|tga|wmf|gz|tgz|bz2|tbz|mp3|ogg)$") {
                                      		unset req.http.Accept-Encoding;
                                      		}
                                      	else if (req.http.Accept-Encoding ~ "gzip") {
                                      		set req.http.Accept-Encoding = "gzip";
                                      		}
                                      	else if (req.http.Accept-Encoding ~ "deflate") {
                                      		set req.http.Accept-Encoding = "deflate";
                                      		}
                                      	else	{
                                      		unset req.http.Accept-Encoding;
                                      		}
                                      	}
                                      	#set client balance identity
                                      	set client.identity = client.ip;
                                      
                                      	#set X-forward
                                      	set req.http.X-Forwarded-For = client.ip;
                                      
                                      	if (req.http.host == "minecraft.domain.com") {
                                      		set req.backend = MinecraftBACKEND;
                                      	} 
                                      
                                      	#respect client wish to refresh the page
                                      	if (req.http.Pragma ~ "no-cache")
                                      		{
                                      		return(pass);
                                      		}
                                      
                                      	#BASIC VCL RULES ACTIONS
                                      	#Disable post cache
                                      	if (req.request == "POST") {
                                      		return(pass);
                                      		}
                                      	#Enable static cache
                                      	if (req.request=="GET" && req.url ~ "\.(css|js|txt|zip|rtf|flv|swf|html|htm)$") {
                                      		return(pass);
                                      		}
                                      	if (req.request=="GET" && req.url ~ "\.(gif|jpg|jpeg|bmp|png|ico|img|tga|wmf|mp3|ogg)$") {
                                      		return(pass);
                                      		}
                                      	#Disable session cache
                                      	if (req.http.Cookie && req.http.Cookie ~ "(PHPSESSID|phpsessid)") {
                                      		return(pass);
                                      		}
                                      	if (req.http.Cookie && req.http.Cookie ~ "(JSESSION|jsession)") {
                                      		return(pass);
                                      		}
                                      	if (req.http.X-Requested-With == "XMLHttpRequest" || req.url ~ "nocache") {
                                      		return(pass);
                                      		}
                                      	#Be rfc2616 compliant
                                      	if (req.request ~ "^(GET|HEAD|PUT|POST|TRACE|OPTIONS|DELETE)$") {
                                      		return(lookup);
                                      		}
                                      	else	{
                                      		return(pipe);
                                      		}
                                      
                                      	return(lookup);
                                      }
                                      
                                      sub vcl_pipe {
                                      
                                      	# If we don't set the Connection: close header, any following
                                      	# requests from the client will also be piped through and
                                      	# left untouched by varnish. We don't want that.
                                      	set req.http.connection = "close";
                                      	# Note: no "pipe" action here - we'll fall back to the default
                                      	# pipe method so that when any changes are made there, we
                                      	# still inherit them.
                                      
                                      }
                                      
                                      sub vcl_fetch {
                                      
                                      	#Disable cache when backend is starting a session
                                      	if (beresp.http.Set-Cookie && beresp.http.Set-Cookie ~ "(PHPSESSID|phpsessid)") {
                                      		return(pass);
                                      		}
                                      	if (beresp.http.Set-Cookie && beresp.http.Set-Cookie ~ "(JSESSION|jsession)") {
                                      		return(pass);
                                      		}
                                      	if (beresp.http.X-Requested-With == "XMLHttpRequest" || req.url ~ "nocache") {
                                      		return(pass);
                                      		}
                                      
                                      	# Varnish respects the wishes of the backend application.
                                      	if (beresp.http.Pragma ~ "no-cache" || beresp.http.Cache-Control ~ "(no-cache|no-store|private)") {
                                      	return(pass);
                                      	}
                                          ## If the request to the backend returns a code other than 200, restart the loop
                                          ## If the number of restarts reaches the value of the parameter max_restarts,
                                          ## the request will be error'ed.  max_restarts defaults to 4.  This prevents
                                          ## an eternal loop in the event that, e.g., the object does not exist at all.
                                          if (beresp.status != 200 && beresp.status != 403 && beresp.status != 404 && 
                                          	beresp.status != 303 && beresp.status != 302 && beresp.status != 301 && beresp.status != 401 ) {
                                      		restart;
                                              }
                                      
                                      	return(deliver);
                                      }
                                      
                                      sub vcl_deliver {
                                      	##set resp.http.X-Served-By = server.hostname;
                                        	if (obj.hits > 0) {
                                          	set resp.http.X-Cache = "HIT";	
                                          	set resp.http.X-Cache-Hits = obj.hits;
                                        	} else {
                                          	set resp.http.X-Cache = "MISS";	
                                        	}
                                      	return(deliver);
                                      }
                                      
                                      
                                      1 Reply Last reply Reply Quote 0
                                      • marcellocM
                                        marcelloc
                                        last edited by

                                        can you try to access backend test url?

                                        http://10.0.0.50/index.php

                                        Also, what you get on dashboard varnish widget?

                                        Treinamentos de Elite: http://sys-squad.com

                                        Help a community developer! ;D

                                        1 Reply Last reply Reply Quote 0
                                        • L
                                          Landmine
                                          last edited by

                                          The URL works get when I'm at home and here is a pic of what the widget looks like.

                                          Thank you for taking the time to help me.

                                          1 Reply Last reply Reply Quote 0
                                          • marcellocM
                                            marcelloc
                                            last edited by

                                            Varnish could not get this url from your web server.

                                            Can you try an static html, a full http request or something else?

                                            Treinamentos de Elite: http://sys-squad.com

                                            Help a community developer! ;D

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.