Navigation

    Netgate Discussion Forum
    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search

    Creating pfSense 2.0 Developers ISO on FreeBSD Beta 8.1

    Development
    6
    70
    41893
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • T
      trijames last edited by

      Hi All,

      apologies if this is posted anywhere else…

      I'm trying to build a pfsense developers ISO...

      I've tried 2 things:

      1.) tried to follow the instructions DevelopersBootStrapAndDevIso on http://devwiki.pfsense.org/DevelopersBootStrapAndDevIso

      with FreeBSD Beta 8.1 RC1.  But, with no success.  I am getting an error during the ISO creation stage:

      ">>> Checking BSDInstaller health... dfuife_curses missing [ERROR!]

      ####################################
      Something went wrong, check errors!
      ####################################
      "

      If anybody has some insight on where to start looking - you would be a tremendous help!

      2.) And I've also tried to to grab one of the pre-made developer ISO's from:
      http://devwiki.pfsense.org/UsingProjectEvilOnpfSense
      It doesn't look like any 2.0 are available (obviously since this is still beta)…
      Is this page still maintained?  Or is no 2.0 there because it is still beta?

      On a general note:  What can I do at this stage of flux-development?  I really would like to contribute - but can't seem to get an environment setup where I could be of any help.

      thanks
      James

      Is this page still up

      1 Reply Last reply Reply Quote 0
      • jimp
        jimp Rebel Alliance Developer Netgate last edited by

        We don't use the Dev ISO any more, to be honest. If you want to build something, a standard FreeBSD 8.1-RC box would be fine.

        That said, I just made a builder VM the other day and didn't get that error, but I didn't use the menu.

        I did something like this:

        Install FreeBSD 8.0
        Update source with csup and then build and install world and kernel
        Update ports tree (I use csup for ports, not portsnap as on the instructions)

        From http://devwiki.pfsense.org/DevelopersBootStrapAndDevIso
        Do steps 1, 2, 3
        Step 4 was already done when I updated the base system above

        For Step 5, I ran ./set_version.sh and set the branch and such I wanted

        Run ./apply_kernel_patches.sh

        cd /home/pfsense/tools/pfPorts/php5/; make all install clean
        cd /home/pfsense/tools/pfPorts/php5-pfSense-module/; make all install clean
        cd /usr/ports/devel/readline/; make all install clean
        (That last one may not be needed, but I had a vague recollection of running it the last time I made a VM for this)

        Then:
        cd /home/pfsense/tools/builder_scripts
        ./build_iso.sh

        1 Reply Last reply Reply Quote 0
        • T
          trijames last edited by

          Hi Jimp,

          thanks for the heads up.  Just curious - you mentioned you can build with standard freebsd 8.1 rc1 - but in your instructions you referenced 8.0.  Does that mean that I should definitely only try this with 8.0?  I Just want to make sure I'm not over-thinking this.

          regards
          trijames

          1 Reply Last reply Reply Quote 0
          • jimp
            jimp Rebel Alliance Developer Netgate last edited by

            If you start with an ISO for 8.1-RC then it should be OK - but you still must install the source and such anyhow, and IIRC you need the files that a buildworld/buildkernel makes anyhow, so it really doesn't matter where you start as long as you end up with a recent RELENG_8_1 world, kernel, sources, etc.

            1 Reply Last reply Reply Quote 0
            • T
              trijames last edited by

              HI Jimp,

              thanks again for the updated procedures - that seems to be getting me further.
              Unfortunately, I'm still having an issue:
              when I try to apply kernel patches - I get the following error:
              WARNING!  Rejected patches found!  Please fix before building!

              /usr/pfSensesrc/src/contrib/pf/pfctl/parse.y.rej
              /usr/pfSensesrc/src/sbin/ipfw/ipfw2.c.rej
              /usr/pfSensesrc/src/sys/contrib/pf/net/pf.c.rej
              …. (omitted for e-z reading)
              /usr/pfSensesrc/src/usr.bin/netstat/unix.c.rej
              ####################################
              Something went wrong, check errors!
              ####################################

              Did I screw up somewhere?  or is this a known problem.
              Sorry If I'm not too familiar with this build process - I'm doing it for the first time and trying to do it as systematic and logical as possible.
              How do I go about fixing this error?

              regards
              Trijames

              1 Reply Last reply Reply Quote 0
              • jimp
                jimp Rebel Alliance Developer Netgate last edited by

                That doesn't look familiar, but rejected patches are usually a sign that your source tree doesn't match up with what is expected, or that something was updated upstream (in FreeBSD) and the patches on pfSense may need adjusted.

                What settings did you use when you set the version to build?

                The contents of /home/pfsense/tools/builder-scripts/pfsense-build.conf would help.

                1 Reply Last reply Reply Quote 0
                • T
                  trijames last edited by

                  Hi Jimp,

                  thanks. 
                  just fyi… I ended up using freebsd 8.1 RC1 as my base.
                  Then i run through the steps as outlined.
                  The version I set is RELENG_8_1...
                  But it seems that my FREEBSD_BRANCH is 8_0 as shown below...
                  Is there something wrong with that?

                  Here's my pfsense-build.conf below.

                  export PFSENSE_VERSION=2.0-BETA3
                  export FREEBSD_VERSION=8
                  export FREEBSD_BRANCH=RELENG_8_0
                  export PFSENSETAG=HEAD
                  export PFSPATCHFILE=/usr/home/pfsense/tools/builder_scripts/../builder_scripts/patches.RELENG_8_1
                  export PFSPATCHDIR=/usr/home/pfsense/tools/builder_scripts/../patches/RELENG_8_1
                  export SUPFILE=/usr/home/pfsense/tools/builder_scripts/../builder_scripts/RELENG_8-supfile
                  export CUSTOM_COPY_LIST=/usr/home/pfsense/tools/builder_scripts/../builder_scripts/copy.list.RELENG_8_0
                  export OVERRIDE_FREEBSD_CVSUP_HOST=cvsup4.us.freebsd.org
                  export BASE_DIR=/usr/home/pfsense/tools/builder_scripts/../..
                  export BUILDER_TOOLS=/usr/home/pfsense/tools/builder_scripts/..
                  export BUILDER_SCRIPTS=/usr/home/pfsense/tools/builder_scripts
                  export PFSPORTSFILE=buildports.RELENG_2_0
                  freebsd81rc1386#

                  1 Reply Last reply Reply Quote 0
                  • jimp
                    jimp Rebel Alliance Developer Netgate last edited by

                    No that all looks right. Some things are named 8_0 and haven't been renamed to 8_1 yet, but they work for any 8, not just 8_0.

                    1 Reply Last reply Reply Quote 0
                    • T
                      trijames last edited by

                      hi Jimp,

                      interesting… I wonder why it's not working...
                      here's the full text of the error I'm getting during apply-kernel-patches.sh
                      If you have any ideas - I'm more than happy to try it out...

                      Setting CVSUp host to cvsup4.us.freebsd.org
                      Removing needed files listed in patches.RELENG_8_1 HEAD
                      Obtaining FreeBSD sources RELENG_8-supfile...Done!
                      Removing old patch rejects...
                      Applying patches, please wait...Hunk #1 failed at 1637.
                      Hunk #2 failed at 1669.
                      2 out of 2 hunks failed--saving rejects to sys/net/if.c.rej
                      Hunk #1 failed at 875.
                      1 out of 1 hunks failed--saving rejects to sys/net/if_var.h.rej
                      Hunk #1 failed at 519.
                      Hunk #2 failed at 686.
                      Hunk #3 failed at 797.
                      3 out of 3 hunks failed--saving rejects to sys/net/route.c.rej
                      Hunk #1 failed at 55.
                      Hunk #2 failed at 674.
                      2 out of 2 hunks failed--saving rejects to sys/net/rtsock.c.rej
                      Hunk #1 failed at 1379.
                      1 out of 1 hunks failed--saving rejects to sys/netinet/in.c.rej
                      Hunk #1 failed at 590.
                      Hunk #2 failed at 707.
                      2 out of 2 hunks failed--saving rejects to sys/netinet/in_pcb.c.rej
                      Hunk #1 failed at 230.
                      1 out of 1 hunks failed--saving rejects to sys/netinet/ip_options.c.rej
                      Hunk #1 failed at 247.
                      1 out of 1 hunks failed--saving rejects to sys/netinet/ip_output.c.rej
                      Done!

                      Finding patch rejects...

                      WARNING!  Rejected patches found!  Please fix before building!

                      /usr/pfSensesrc/src/sys/net/if.c.rej
                      /usr/pfSensesrc/src/sys/net/if_var.h.rej
                      /usr/pfSensesrc/src/sys/net/route.c.rej
                      /usr/pfSensesrc/src/sys/net/rtsock.c.rej
                      /usr/pfSensesrc/src/sys/netinet/in.c.rej
                      /usr/pfSensesrc/src/sys/netinet/in_pcb.c.rej
                      /usr/pfSensesrc/src/sys/netinet/ip_options.c.rej
                      /usr/pfSensesrc/src/sys/netinet/ip_output.c.rej

                      ####################################
                      Something went wrong, check errors!
                      ####################################

                      1 Reply Last reply Reply Quote 0
                      • T
                        trijames last edited by

                        Hi Jimp,

                        in case it helps - here's exactly the steps I'm doing:

                        1.) install freebsd 8.1 RC1

                        2.) update the kernel source with csup
                        2a.) copy the supfile to the /etc

                        cp /usr/share/examples/cvsup/standard-supfile /etc/supfile

                        2b.) edit the supfile

                        vi /etc/supfile

                        2c.) add the csup server
                        host=CHANGE_THIS.FreeBSD.org
                        Change to:
                        host=cvsup4.us.FreeBSD.org
                        2d.) run csup
                        #> csup /etc/supfile

                        3.) build the kernel

                        cd /usr/src

                        make buildworld

                        make buildkernel

                        make installkernel

                        shutdown -r now

                        4.) boot into single user mode

                        boot -s from the boot loader prompt

                        adjkerntz -i

                        mount -a -t ufs

                        mergemaster -p

                        cd /usr/src

                        make installworld

                        mergemaster

                        reboot

                        5.) update the ports directory using csup

                        rm -fr /usr/ports/*

                        csup -L 2 /etc/supfile

                        6.) configure make (step 1 from devwiki.pfsense/org/DevelopersBootStrapAndevIso)

                        echo "WITHOUT_X11=yo" >> /etc/make.conf

                        mkdir -p /home/pfsense/pfSenseGITREPO /home/pfsense/installer /usr/pfSensesrc

                        7.) grab ports and build GIT

                        portsnap fetch extract

                        cd /usr/ports/textproc/expat2 && make depends install

                        cd /usr/ports/devel/git && make depends install

                        (take the standard default settings from the menu's)

                        cd /usr/ports/sysutils/fastest_cvsup/ && make depends install

                        (take the standard default settings from the menu's)

                        rehash

                        8.) continue on with the GIT repo checkouts

                        cd /home/pfsense && git clone http://gitweb.pfsense.org/pfsense-tools/mainline.git tools

                        cd /home/pfsense && git clone http://gitweb.pfsense.org/freesbie2/mainline.git freesbie2

                        cd /home/pfsense/tools/builder_scripts && chmod a+rx *.sh

                        9.) now do the pfsense stuff

                        cd /home/pfsense/tools/builder_scripts

                        ./set_version.sh RELENG_8_1 cvsup4.us.freebsd.org

                        ./apply_kernel_patches.sh

                        (here's where I get the reject errors…)

                        (the rest I don't get to because of the above errors)

                        cd /home/pfsense/tools/pfPorts/php5; make all install clean

                        cd /home/pfsense/tools/pfPorts/php5-pfSense-module/; make all install clean

                        cd /usr/ports/devel/readline/; make all install clean

                        10 now create the ISO

                        cd/ home/pfsense/tools/builder_scripts

                        ./build_iso.sh

                        1 Reply Last reply Reply Quote 0
                        • T
                          trijames last edited by

                          Hi Jimp,

                          one more thing - I'm building this as a VM… could that be the cause?

                          regards
                          TJ

                          1 Reply Last reply Reply Quote 0
                          • jimp
                            jimp Rebel Alliance Developer Netgate last edited by

                            VM is fine, nothing wrong with that.

                            Just checked on our main snapshot builder and the patches are failing there, too, so it must be an upstream update that happened.

                            EDIT: I restarted the build and it worked. Try updating the sources, git repos, etc, and then make another attempt.

                            1 Reply Last reply Reply Quote 0
                            • T
                              trijames last edited by

                              Hi Jimp,

                              ok I guess that's good news - and will get fixed soon. 
                              What I notice is that the errors are all related to the tcp stack
                              ip.c
                              route.c
                              rtsock.c
                              etc…

                              So, would seem to me that something has changed there.
                              What does it mean when these are "rejects"?  Is it basically a 'diff' that found between the freebsd baseline and pfrsense baseline?

                              regards
                              TJ

                              1 Reply Last reply Reply Quote 0
                              • T
                                trijames last edited by

                                Oh - I just saw your updated EDIT…
                                Ok - I'll try to update and see if that works...
                                Which source should I update?  kernel? or pfsense? or both?

                                regards
                                TJ

                                1 Reply Last reply Reply Quote 0
                                • jimp
                                  jimp Rebel Alliance Developer Netgate last edited by

                                  Try this:

                                  # cd/ home/pfsense/tools/builder_scripts
                                  # ./update_git_repos.sh
                                  # ./build_iso.sh
                                  
                                  
                                  1 Reply Last reply Reply Quote 0
                                  • T
                                    trijames last edited by

                                    Jimp,

                                    not sure if I understand…
                                    Just in case - I want to check my thinking:
                                    1.) should I not do the following:
                                      # ./apply_kernel_patches.sh
                                      # cd /home/pfsense/tools/pfPorts/php5; make all install clean
                                      # cd /home/pfsense/tools/pfPorts/php5-pfSense-module/; make all install clean
                                      # cd /usr/ports/devel/readline/; make all install clean

                                    So even though apply_kernel_patches.sh failed - I should instead do update_git_repos.sh?
                                    And also skip the rest?  Is that right?

                                    Or should I still do the above steps and then also do the update_git_repos.sh?

                                    regards
                                    TJ

                                    1 Reply Last reply Reply Quote 0
                                    • jimp
                                      jimp Rebel Alliance Developer Netgate last edited by

                                      Whatever you do, do update_git_repos.sh first. I'd just try to build the iso first and see what happens. It should do some of that automatically, but if it fails, then fall back to doing those steps (apply patches, build those ports, etc)

                                      Though you can compile those ports whether or not the kernel patches apply

                                      1 Reply Last reply Reply Quote 0
                                      • T
                                        trijames last edited by

                                        ah ok - excellent.  I'll give that a try.

                                        1 Reply Last reply Reply Quote 0
                                        • jimp
                                          jimp Rebel Alliance Developer Netgate last edited by

                                          That didn't work. I had to adjust the supfile to have a date, and go back a few days. If you update_git_repos.sh again and then redo the build it should succeed.

                                          1 Reply Last reply Reply Quote 0
                                          • T
                                            trijames last edited by

                                            Jimp,

                                            does it matter which which shell I use to run these?
                                            I just saw a warning about ksh as below in the build_iso.sh

                                            "the O_NONBLOCK symbol with a syntax error.  This is apparently a
                                            sh error.  Rerunning Configure with ksh apparently fixes the
                                            error, then please read the section "64 bit data in perl 5.6.0 and 5.6.1"

                                            (I'm building the i386 version)

                                            regards
                                            TJ

                                            1 Reply Last reply Reply Quote 0
                                            • T
                                              trijames last edited by

                                              Hi Jimp,

                                              I am getting the following errors when running build_iso.sh - but it continues to run…
                                              Did I forget a step?

                                              ERROR Building dnsmasq
                                              ERROR Building php5-curl
                                              ERROR Building php5-mhash
                                              ERROR Building php5-pcre
                                              ERROR Building php5-pfSense-module
                                              ERROR Building php5-readline
                                              ERROR Building syslog-ng
                                              ERROR Building 3gstat_um175
                                              ERROR Building wrapalixresetbutton

                                              1 Reply Last reply Reply Quote 0
                                              • T
                                                trijames last edited by

                                                Hi Jimp,

                                                one more post …

                                                at the end of build_iso.sh - I still get the error.
                                                (sorry about all the posts...)

                                                WARNING!  Rejected patches found!  Please fix before building!

                                                /usr/pfSensesrc/src/sys/net/if.c.rej
                                                /usr/pfSensesrc/src/sys/net/if_var.h.rej
                                                /usr/pfSensesrc/src/sys/net/route.c.rej
                                                /usr/pfSensesrc/src/sys/net/rtsock.c.rej
                                                /usr/pfSensesrc/src/sys/netinet/in.c.rej
                                                /usr/pfSensesrc/src/sys/netinet/in_pcb.c.rej
                                                /usr/pfSensesrc/src/sys/netinet/ip_options.c.rej
                                                /usr/pfSensesrc/src/sys/netinet/ip_output.c.rej

                                                1 Reply Last reply Reply Quote 0
                                                • jimp
                                                  jimp Rebel Alliance Developer Netgate last edited by

                                                  Not sure what is up with those port building errors, especially the wrapalixresetbutton port as that is very simple and should not fail. You might try to make that one by hand to see what the actual error is:

                                                  # cd tools/pfPorts/wrapalixresetbutton/; make all
                                                  

                                                  As for those rejects, they may be leftover from when they did fail. You might need to run:

                                                  # ./clean_build.sh
                                                  
                                                  1 Reply Last reply Reply Quote 0
                                                  • T
                                                    trijames last edited by

                                                    Hi Jimp,

                                                    thanks.
                                                    I went ahead and tried to compile each of the failed builds by hand.

                                                    1.) dnsmasq built fine
                                                    2.) php5-curl did not (see below - looks like it is expecting curl5)
                                                    3.) php5-mhash built fine
                                                    4.) php5-pcre built fine
                                                    5.) php5-pfSense-module built fine
                                                    6.) php5-readline module failed (see below)

                                                    === php5-curl build errors ===
                                                    freebsd81rc1386# cd php5-curl/
                                                    freebsd81rc1386# make all
                                                    ===>  Vulnerability check disabled, database not found
                                                    ===>  License check disabled, port has not defined LICENSE
                                                    ===>  Extracting for php52-curl-5.2.13
                                                    => MD5 Checksum OK for php-5.2.13.tar.bz2.
                                                    => SHA256 Checksum OK for php-5.2.13.tar.bz2.
                                                    ===>  Patching for php52-curl-5.2.13
                                                    ===>  php52-curl-5.2.13 depends on file: /usr/local/bin/phpize - found
                                                    ===>  php52-curl-5.2.13 depends on file: /usr/local/bin/autoconf-2.62 - found
                                                    ===>  php52-curl-5.2.13 depends on shared library: curl.5 - not found
                                                    ===>    Verifying install for curl.5 in /usr/ports/ftp/curl
                                                    ===>  Returning to build of php52-curl-5.2.13
                                                    Error: shared library "curl.5" does not exist
                                                    *** Error code 1

                                                    Stop in /usr/home/pfsense/tools/pfPorts/php5-curl.

                                                    === php5-readline build error ====
                                                    ===>  Script "configure" failed unexpectedly.
                                                    Please report the problem to admin@lissyara.su [maintainer] and attach the
                                                    "/usr/home/pfsense/tools/pfPorts/php5-readline/work/php-5.2.13/ext/readline/config.log"
                                                    including the output of the failure of your make command. Also, it might be
                                                    a good idea to provide an overview of all packages installed on your system
                                                    (e.g. an ls /var/db/pkg).
                                                    *** Error code 1

                                                    1 Reply Last reply Reply Quote 0
                                                    • jimp
                                                      jimp Rebel Alliance Developer Netgate last edited by

                                                      Did you ever go back and try to install readline on its own?

                                                      cd /usr/ports/devel/readline/; make all install clean

                                                      You might have to do the same with curl:

                                                      cd /usr/ports/ftp/curl; make all install clean

                                                      1 Reply Last reply Reply Quote 0
                                                      • T
                                                        trijames last edited by

                                                        Hi Jimp,

                                                        yes I did - sorry I accidentally omitted that in the earlier post.
                                                        I did manually build readline - and it built fine - no issues.
                                                        I'm going to try and manually build all the packages that failed - and see what the error is.
                                                        Hopefully that can produce some new findings.

                                                        So, my understanding is
                                                        1.) run clean_build.sh
                                                        2.) run apply_kernel_patches.sh
                                                        3.) then for all that failed - manually build each of those packages
                                                        4.) if errors from manual build - check errors to try and resolve…

                                                        Sound good?  Or am I missing something here?

                                                        1 Reply Last reply Reply Quote 0
                                                        • jimp
                                                          jimp Rebel Alliance Developer Netgate last edited by

                                                          Sounds about right, though usually it isn't that complicated. Not sure why so many things are failing there.

                                                          1 Reply Last reply Reply Quote 0
                                                          • T
                                                            trijames last edited by

                                                            Jimp,

                                                            so maybe there is something wrong with the procedure I've listed.
                                                            Can you check it through?
                                                            Maybe I have some of the steps in the wrong order (in particular the later steps)?

                                                            1.) install freebsd 8.1 RC1

                                                            2.) update the kernel source with csup
                                                            (taken from http://www.freebsd.org/doc/en/books/handbook/makeworld.html)

                                                            2a.) copy the supfile to the /etc

                                                            cp /usr/share/examples/cvsup/standard-supfile /etc/supfile

                                                            2b.) edit the supfile

                                                            vi /etc/supfile

                                                            2c.) add the csup server
                                                            host=CHANGE_THIS.FreeBSD.org
                                                            Change to:
                                                            host=cvsup4.us.FreeBSD.org
                                                            2d.) run csup
                                                            #> csup /etc/supfile

                                                            3.) build the kernel

                                                            cd /usr/src

                                                            make buildworld

                                                            make buildkernel

                                                            make installkernel

                                                            shutdown -r now

                                                            4.) boot into single user mode

                                                            boot -s from the boot loader prompt

                                                            adjkerntz -i

                                                            mount -a -t ufs

                                                            mergemaster -p

                                                            cd /usr/src

                                                            make installworld

                                                            mergemaster

                                                            reboot

                                                            5.) update the ports directory using csup

                                                            rm -fr /usr/ports/*

                                                            csup -L 2 /etc/supfile

                                                            6.) configure make (step 1 from devwiki.pfsense/org/DevelopersBootStrapAndevIso)

                                                            echo "WITHOUT_X11=yo" >> /etc/make.conf

                                                            mkdir -p /home/pfsense/pfSenseGITREPO /home/pfsense/installer /usr/pfSensesrc

                                                            7.) grab ports and build GIT

                                                            portsnap fetch extract

                                                            cd /usr/ports/textproc/expat2 && make depends install

                                                            cd /usr/ports/devel/git && make depends install

                                                            (take the standard default settings from the menu's)

                                                            cd /usr/ports/sysutils/fastest_cvsup/ && make depends install

                                                            (take the standard default settings from the menu's)

                                                            rehash

                                                            8.) continue on with the GIT repo checkouts

                                                            cd /home/pfsense && git clone http://gitweb.pfsense.org/pfsense-tools/mainline.git tools

                                                            cd /home/pfsense && git clone http://gitweb.pfsense.org/freesbie2/mainline.git freesbie2

                                                            cd /home/pfsense/tools/builder_scripts && chmod a+rx *.sh

                                                            9.) now do the pfsense stuff

                                                            cd /home/pfsense/tools/builder_scripts

                                                            ./set_version.sh RELENG_8_1 cvsup4.us.freebsd.org

                                                            # ./clean_build.sh

                                                            ./apply_kernel_patches.sh

                                                            (here's where I get the reject errors…)

                                                            ./update_git_repos.sh

                                                            (the below items might need to be manually built for anything that failed - E.G.: )

                                                            cd /home/pfsense/tools/pfPorts/php5; make all install clean

                                                            cd /home/pfsense/tools/pfPorts/php5-pfSense-module/; make all install clean

                                                            cd /usr/ports/devel/readline/; make all install clean

                                                            # cd /usr/ports/curl; make all install clean

                                                            ./build_iso.sh

                                                            1 Reply Last reply Reply Quote 0
                                                            • K
                                                              kpa last edited by

                                                              About point 5.), I think you need to use cvs tag "." instead of "RELENG_8_1" for fetching ports, /usr/bin/csup -h cvsup.uk.FreeBSD.org
                                                              /usr/share/examples/cvsup/ports-supfile should do the job (replace cvsup.uk with a mirror close to you).

                                                              1 Reply Last reply Reply Quote 0
                                                              • jimp
                                                                jimp Rebel Alliance Developer Netgate last edited by

                                                                @kpa:

                                                                About point 5.), I think you need to use cvs tag "." instead of "RELENG_8_1" for fetching ports, /usr/bin/csup -h cvsup.uk.FreeBSD.org
                                                                /usr/share/examples/cvsup/ports-supfile should do the job (replace cvsup.uk with a mirror close to you).

                                                                He's using portsnap to get the ports, that supfile was just for the system sources (though since it was done earlier, it doesn't need to be done again)

                                                                1 Reply Last reply Reply Quote 0
                                                                • jimp
                                                                  jimp Rebel Alliance Developer Netgate last edited by

                                                                  I also noticed that I used this:

                                                                  ./set_version.sh HEAD

                                                                  1 Reply Last reply Reply Quote 0
                                                                  • jimp
                                                                    jimp Rebel Alliance Developer Netgate last edited by

                                                                    and for some reason, that still uses RELENG_8-supfile, instead of RELENG_8_1-supfile.

                                                                    Whichever supfile shows in your pfsense-build.conf, make sure it has a line like this in it, if it uses RELENG_8_1

                                                                    date=2010.06.25.00.00.00
                                                                    

                                                                    I committed an update to that file, too, so it should work. Or it does for me again…

                                                                    builder# ./set_version.sh RELENG_8_1 cvsup.livebsd.org
                                                                    
                                                                    >>> Setting builder environment to use RELENG_8_1 ...
                                                                    # Comment out the following line if you would like to automatically select an update server.
                                                                    
                                                                    >>> Custom pfsense-build.conf contains:
                                                                    ---------------------------------------------------------------------------------------
                                                                    # set_version.sh generated defaults
                                                                    export PFSENSE_VERSION=2.0-BETA3
                                                                    export FREEBSD_VERSION=8
                                                                    export FREEBSD_BRANCH=RELENG_8_0
                                                                    export PFSENSETAG=HEAD
                                                                    export PFSPATCHFILE=/usr/home/pfsense/tools/builder_scripts/../builder_scripts/patches.RELENG_8_1
                                                                    export PFSPATCHDIR=/usr/home/pfsense/tools/builder_scripts/../patches/RELENG_8_1
                                                                    export SUPFILE=/usr/home/pfsense/tools/builder_scripts/../builder_scripts/RELENG_8-supfile
                                                                    export CUSTOM_COPY_LIST=/usr/home/pfsense/tools/builder_scripts/../builder_scripts/copy.list.RELENG_8_0
                                                                    export OVERRIDE_FREEBSD_CVSUP_HOST=cvsup.livebsd.org
                                                                    export BASE_DIR=/usr/home/pfsense/tools/builder_scripts/../..
                                                                    export BUILDER_TOOLS=/usr/home/pfsense/tools/builder_scripts/..
                                                                    export BUILDER_SCRIPTS=/usr/home/pfsense/tools/builder_scripts
                                                                    export PFSPORTSFILE=buildports.RELENG_2_0
                                                                    ---------------------------------------------------------------------------------------
                                                                    
                                                                    NOTE: pfsense-build.conf values updated.  These values override pfsense_local.sh !!
                                                                    
                                                                    NOTE2: pfPorts will be rebuilt!
                                                                    
                                                                    builder# ./update_git_repos.sh 
                                                                    >>> Updating GIT REPO freesbie2...Done!
                                                                    >>> Updating GIT REPO tools...Done!
                                                                    builder# ./apply_kernel_patches.sh    
                                                                    >>> Setting CVSUp host to cvsup.livebsd.org
                                                                    >>> Removing needed files listed in patches.RELENG_8_1 HEAD
                                                                    >>> Obtaining FreeBSD sources RELENG_8-supfile...Done!
                                                                    >>> Removing old patch rejects...
                                                                    >>> Applying patches, please wait...Done!
                                                                    >>> Finding patch rejects...
                                                                    builder# 
                                                                    
                                                                    1 Reply Last reply Reply Quote 0
                                                                    • T
                                                                      trijames last edited by

                                                                      HI guys,

                                                                      good news is that it now is able to get past the apply-kernel-patches.sh - thanks to the changes and info sent on how to properly setup the environment by Jimp.  thanks for that.
                                                                      So - that is great.  I'm now trying to build the iso - and hopefully will have some good news for you in about 1 hour…

                                                                      cross my fingers (or press my thumbs in german)...

                                                                      regards
                                                                      TJ

                                                                      1 Reply Last reply Reply Quote 0
                                                                      • T
                                                                        trijames last edited by

                                                                        HI Guys,

                                                                        the apply-kernel-patches.sh went through clean as I mentioned earlier…
                                                                        But when I ran the build-iso.sh... I got a few errors seen below:
                                                                        I'm not sure if openssl for php is really needed.  But, it then looks like it is failing on dfuife_curses...

                                                                        /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:153: error: 'zif_openssl_crl_new' undeclared here (not in a function)
                                                                        /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:154: error: 'zif_openssl_crl_revoke_cert_by_serial' undeclared here (not in a function)
                                                                        /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:155: error: 'zif_openssl_crl_revoke_cert' undeclared here (not in a function)
                                                                        /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:156: error: 'zif_openssl_crl_export' undeclared here (not in a function)
                                                                        /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:157: error: 'zif_openssl_crl_export_file' undeclared here (not in a function)
                                                                        *** Error code 1
                                                                        1 error
                                                                        *** Error code 1

                                                                        ERROR Building dnsmasq
                                                                        ERROR Building php5-curl
                                                                        ERROR Building php5-openssl
                                                                        ERROR Building php5-readline
                                                                        ERROR Building syslog-ng
                                                                        Building athstats...main.c: In function 'getfmt':
                                                                        main.c:73: warning: implicit declaration of function 'strcasecmp'

                                                                        and then at the very end...

                                                                        Checking BSDInstaller health... dfuife_curses missing [ERROR!]

                                                                        1 Reply Last reply Reply Quote 0
                                                                        • T
                                                                          trijames last edited by

                                                                          Hi Jimp,

                                                                          I'm going to and give it a try again and first run clean_build.sh before hand.
                                                                          Here's the steps that I'm going to try.
                                                                          btw… I've been trying the cvsup.livebsd.org mirror - but it doesn't seem to work.  I assume the livebsd.org mirror is the same as the freebsd - right?

                                                                          cd /home/pfsense/tools/builder_scripts

                                                                          ./clean_build.sh

                                                                          ./set_version.sh RELENG_8_1 cvsup.livebsd.org

                                                                          ./update_git_repos.sh

                                                                          ./apply_kernel_patches.sh

                                                                          # ./build-iso.sh

                                                                          regards
                                                                          TJ

                                                                          1 Reply Last reply Reply Quote 0
                                                                          • jimp
                                                                            jimp Rebel Alliance Developer Netgate last edited by

                                                                            A fix for curl and readline just went into the repo from another dev.

                                                                            1 Reply Last reply Reply Quote 0
                                                                            • T
                                                                              trijames last edited by

                                                                              Hi Jimp,

                                                                              I went through the steps that I outlined in my earlier post and
                                                                                # ./clean_build.sh (ok)
                                                                                # ./set_version.sh RELENG_8_1 cvsup4.us.freebsd.org (livebsd.org doesn't seem to connect)..
                                                                                # ./update_git_repos.sh (ok)
                                                                                # ./apply_kernel_patches.sh (ok)
                                                                                # ./build-iso.sh (errors below…)

                                                                              so far... still a few errors during build-iso.sh.
                                                                              It still doesn't generate an iso...
                                                                              Any tips on what I can do to try and help to track these down?

                                                                              .
                                                                              .
                                                                              ...
                                                                              the O_NONBLOCK symbol with a syntax error.  This is apparently a
                                                                              sh error.  Rerunning Configure with ksh apparently fixes the
                                                                              error, then please read the section "64 bit data in perl 5.6.0 and 5.6.1"
                                                                                /usr/local/lib/perl5/5.10.1/perl/man/man3/CPANPLUS::Error.3

                                                                              Build dependency freetype2 of rrdtool
                                                                              .
                                                                              .
                                                                              ...

                                                                              Building olsrd
                                                                              src/NetworkInterfaces.c:54:47: error: linux/if_ether.h: No such file or directory
                                                                              src/NetworkInterfaces.c:55:92: error: linux/if_packet.h: No such file or directory
                                                                              src/NetworkInterfaces.c:56:46: error: linux/if_tun.h: No such file or directory
                                                                              src/Bmf.c:52:47: error: linux/if_ether.h: No such file or directory
                                                                              src/Bmf.c:53:75: error: linux/if_packet.h: No such file or directory

                                                                              Building pftop
                                                                              .
                                                                              .
                                                                              ...

                                                                              Building php5-openssl
                                                                              /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:153: error: 'zif_openssl_crl_new' undeclared here (not in a function)
                                                                              /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:154: error: 'zif_openssl_crl_revoke_cert_by_serial' undeclared here (not in a function)
                                                                              /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:155: error: 'zif_openssl_crl_revoke_cert' undeclared here (not in a function)
                                                                              /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:156: error: 'zif_openssl_crl_export' undeclared here (not in a function)
                                                                              /usr/ports/security/php5-openssl/work/php-5.2.13/ext/openssl/openssl.c:157: error: 'zif_openssl_crl_export_file' undeclared here (not in a function)
                                                                              *** Error code 1
                                                                              1 error
                                                                              *** Error code 1
                                                                              .
                                                                              .
                                                                              ...

                                                                              Building php5-readline
                                                                              configure: error: Please reinstall libedit - I cannot find readline.h
                                                                              .
                                                                              .
                                                                              ...

                                                                              ERROR Building dnsmasq
                                                                              ERROR Building php5-openssl
                                                                              ERROR Building php5-readline
                                                                              ERROR Building syslog-ng
                                                                              .
                                                                              .
                                                                              ...
                                                                              cp: directory /usr/home/pfsense/tools/builder_scripts/../../installer/installer/scripts/build does not exist
                                                                              .: Can't open ./pfsense_local.sh: No such file or directory
                                                                              .
                                                                              .
                                                                              ...

                                                                              Checking BSDInstaller health... dfuife_curses missing [ERROR!]

                                                                              ####################################
                                                                              Something went wrong, check errors!
                                                                              ####################################

                                                                              Press enter to continue.

                                                                              Terminated…

                                                                              1 Reply Last reply Reply Quote 0
                                                                              • jimp
                                                                                jimp Rebel Alliance Developer Netgate last edited by

                                                                                Looks like someone is working on some PHP fixes in the tools repo, I'd hold off for a day or so and try again.

                                                                                Looks like FreeBSD's switch to using php52 ports instead of php5 (which is now php 5.3) might have caused some problems.

                                                                                1 Reply Last reply Reply Quote 0
                                                                                • T
                                                                                  trijames last edited by

                                                                                  HI Jimp,

                                                                                  ok thanks for the heads up. What about the other errors?
                                                                                  Are they all critical?  Or can I manage to build an ISO with the other errors after php is fixed?

                                                                                  e.g.:

                                                                                  ERROR Building dnsmasq
                                                                                  ERROR Building syslog-ng
                                                                                  and

                                                                                  Building olsrd
                                                                                  src/NetworkInterfaces.c:54:47: error: linux/if_ether.h: No such file or directory
                                                                                  src/NetworkInterfaces.c:55:92: error: linux/if_packet.h: No such file or directory
                                                                                  src/NetworkInterfaces.c:56:46: error: linux/if_tun.h: No such file or directory
                                                                                  src/Bmf.c:52:47: error: linux/if_ether.h: No such file or directory
                                                                                  src/Bmf.c:53:75: error: linux/if_packet.h: No such file or directory

                                                                                  Building pftop
                                                                                  and
                                                                                  the O_NONBLOCK symbol with a syntax error.  This is apparently a
                                                                                  sh error.  Rerunning Configure with ksh apparently fixes the
                                                                                  error, then please read the section "64 bit data in perl 5.6.0 and 5.6.1"
                                                                                    /usr/local/lib/perl5/5.10.1/perl/man/man3/CPANPLUS::Error.3

                                                                                  Build dependency freetype2 of rrdtool

                                                                                  1 Reply Last reply Reply Quote 0
                                                                                  • jimp
                                                                                    jimp Rebel Alliance Developer Netgate last edited by

                                                                                    not sure about dnsmasq and syslog-ng, but the olsr and other errors are not really errors, they are normal output that just happens to contain the string "error", or harmless.

                                                                                    1 Reply Last reply Reply Quote 0
                                                                                    • First post
                                                                                      Last post

                                                                                    Products

                                                                                    • Platform Overview
                                                                                    • TNSR
                                                                                    • pfSense Plus
                                                                                    • Appliances

                                                                                    Services

                                                                                    • Training
                                                                                    • Professional Services

                                                                                    Support

                                                                                    • Subscription Plans
                                                                                    • Contact Support
                                                                                    • Product Lifecycle
                                                                                    • Documentation

                                                                                    News

                                                                                    • Media Coverage
                                                                                    • Press
                                                                                    • Events

                                                                                    Resources

                                                                                    • Blog
                                                                                    • FAQ
                                                                                    • Find a Partner
                                                                                    • Resource Library
                                                                                    • Security Information

                                                                                    Company

                                                                                    • About Us
                                                                                    • Careers
                                                                                    • Partners
                                                                                    • Contact Us
                                                                                    • Legal
                                                                                    Our Mission

                                                                                    We provide leading-edge network security at a fair price - regardless of organizational size or network sophistication. We believe that an open-source security model offers disruptive pricing along with the agility required to quickly address emerging threats.

                                                                                    Subscribe to our Newsletter

                                                                                    Product information, software announcements, and special offers. See our newsletter archive to sign up for future newsletters and to read past announcements.

                                                                                    © 2021 Rubicon Communications, LLC | Privacy Policy