Errors in kernel config building image

dmadiedo

Hi, First let me thank you in advance for any help you can give.

I'm following the instructions on http://devwiki.pfsense.org/DevelopersBootStrapAndDevIso, select my version as pfSense RELENG_1_2 + FreeBSD RELENG_7_2, and start the process (on a Virtualbox 7.2 FreeBSD).

The process finishes with this error:


Stop in /usr/home/pfsense/freesbie2.
Could not locate /tmp/kernels/uniprocessor/boot/kernel.gz

####################################
Something went wrong, check errors!
####################################

NOTE: a lot of times you can run ./clean_build.sh to resolve.

Looking back at the output, I find this:


>>> Installing uniprocessor kernel...
>>> KERNCONFDIR: /usr/pfSensesrc/src/sys/i386/conf
>>> ARCH:        i386
>>> SRC_CONF:    src.conf.7
>>> Kernel build for pfSense.7 started on Wed Jan 26 16:54:48 COT 2011
>>> stage 1: configuring the kernel
Something went wrong, check errors!
Log saved on /usr/obj.pfSense/usr/home/pfsense/freesbie2/.tmp_buildkernel

So I check the .tmp_buildkernel file, and got this:


--------------------------------------------------------------
>>> Kernel build for pfSense.7 started on Wed Jan 26 16:54:48 COT 2011
--------------------------------------------------------------
===> pfSense.7
mkdir -p /usr/obj.pfSense/usr/pfSensesrc/src/sys
--------------------------------------------------------------
>>> stage 1: configuring the kernel
--------------------------------------------------------------
cd /usr/pfSensesrc/src/sys/i386/conf;  PATH=/usr/obj.pfSense/usr/pfSensesrc/src/tmp/legacy/usr/sbin:/usr/obj.pfSense/usr/pfSensesrc/src/tmp/legacy/usr/bin:/usr/obj.pfSense/usr/pfSensesrc/src/tmp/legacy/usr/games:/usr/obj.pfSense/usr/pfSensesrc/src/tmp/usr/sbin:/usr/obj.pfSense/usr/pfSensesrc/src/tmp/usr/bin:/usr/obj.pfSense/usr/pfSensesrc/src/tmp/usr/games:/sbin:/bin:/usr/sbin:/usr/bin  config  -d /usr/obj.pfSense/usr/pfSensesrc/src/sys/pfSense.7  /usr/pfSensesrc/src/sys/i386/conf/pfSense.7
config: Error: device "siba_bwn" is unknown
config: Error: device "bwn" is unknown
config: Error: device "run" is unknown
config: 3 errors

so, I check the contents of the /usr/pfSensesrc/src/sys/i386/conf/pfSense.7 file, and found this on the last line of the file:


devices	siba_bwn,bwn,run

I don't know how to remove those devices from my build, or if they are really needed. Can I remove them from the config file? If so, whats the process to make that change permanent?

Thank You,

Diego Madiedo

jimp

Add

export EXTRA_DEVICES=

To the end of your pfsense-build.conf

dmadiedo

Thank you, Jimp.

I'm testing it right now and will get back as soon as I can verify the procedure works.

Regards,

Diego Madiedo

dmadiedo

Hi Jimp, your suggested fix didn't work.

Edited the file /home/pfsense/tools/builder_scripts/pfsense-build.conf

started pfSense menu:


cd /home/pfsense/tools/builder_scripts 
./menu.sh

Cleaned previous build, selected "Build ISO", and got exactly the same behavior as in my first post. Maybe I edited the wrong file?

sullrich

This was our fault.

Run this:

./update_git_repos.sh
./build_iso.sh

dmadiedo

[code]Thanks Scott, great help. The kernel process continued without errors, but now, i get:

[/code]
Fatal error: Call to undefined function: xml_parser_create() in /etc/inc/xmlparse.inc on line 154 

An error occured while testing the php installation in /usr/local/pfsense-fs

####################################
Something went wrong, check errors!
####################################

So I'm stuck again.

Thanks in advance for your kind help,

Diego Madiedo.

sullrich

That's strange, I have not encountered that error.

dmadiedo

mmmm…. that's odd.

What is your recommendation? to reinstall my environment?

Any pointers you can give me will be most welcome.

Thank you,

awebster

Same problem here…

Build dies on the PHP test...
Build environment: 7.2-p8 in a jail per http://devwiki.pfsense.org/DevelopersBootStrapAndDevIso.

Error output:

>>> Installing collected library information (usr/local), please wait...
>>> Testing PHP installation in /usr/local/pfsense-fs:PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/apc.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/apc.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/bcmath.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/bcmath.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/ctype.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/ctype.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/curl.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/curl.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/mbstring.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/mbstring.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/overload.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/overload.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/pcntl.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/pcntl.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/pcre.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/pcre.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/posix.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/posix.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/radius.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/radius.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/readline.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/readline.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/session.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/session.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/sysvsem.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/sysvsem.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/tokenizer.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/tokenizer.so" in Unknown on line 0
PHP Warning:  Unknown(): Unable to load dynamic library '/usr/local/lib/php/extensions/no-debug-non-zts-20020429/xml.so' - Cannot open "/usr/local/lib/php/extensions/no-debug-non-zts-20020429/xml.so" in Unknown on line 0

Fatal error: Call to undefined function: xml_parser_create() in /etc/inc/xmlparse.inc on line 154 

An error occured while testing the php installation in /usr/local/pfsense-fs

php -m output:


[php]
openssl
standard

[Zend Modules]

/usr/local/lib/php/extensions/no-debug-non-zts-20020429 is empty.

I looked back through the build output but didn't spot anything that might indicate what went wrong.

--
Andrew[/php]

jimp

There are known issues with the ports on 7.2/1.2.3 builders. In particular, none of the PHP ports build due to autoconf issues.

awebster

Thanks, I am going to take a stab at sorting it out as I need to prepare a custom 1.2.3 image for a project I'm working on, but seeing as 2.0 is still Beta, I can't really put that in a production environment.

Specifically, I've added a tftp-server option to the DHCP options, as the existing next-server option in 1.2.3 does not work with a number of devices, but I need to make a CF card image of the final product to put on a Soekris platform, unless anyone can suggest an easier way…

IMHO, not having a working DEV environment for a STABLE/RELEASE version cripples the flexibility of the product somewhat.

--
Andrew

sullrich

Agree'd but we are about to release RC1 so all of our focus is on it. Sorry about that.

awebster

Good to hear about RC1…

For those who are trying to get a build of 7.2/1.2.3 to work, here is where I'm at so far...

I've discovered that the php4-xxx port building problems were due to autoconf and autoheaders versions being hardcoded into the build scripts, but can be overridden with some additional environment variables. Strangely, however, they aren't being read as expected from pfsense-build.conf, so I had to patch them in manually...The following two variables fix the php4-xxxx ports building problems:


 PHP_AUTOCONF=autoconf-2.68
 PHP_AUTOHEADER=autoheader-2.68

This one fixes dnsmasq building problem and any other port that may have known vulnerabilities:


 DISABLE_VULNERABILITIES=YES

As I mentioned, building the ports from /home/pfsense/tools/builder_scripts/build_pfPorts.sh doesn't import the above mentioned variables, possibly because the actual port building is being invoked through an su to run /home/pfsense/tools/pfPorts/buildports.RELENG_1_2, which is where I ended up defining the aforementioned variables.
The ports for the most part built okay, with a few errors:

ERROR Building choparp
ERROR Building minicron
ERROR Building pftpx
ERROR Building sshlockout_pf
ERROR Building dnswatch

I am looking into the failures, and so far…
choparp: references dprintf which doesn't exist in glibc of 7.2, so an older version of choparp would be required, or a dprintf substitute.
minicron: references closefrom which doesn't exist in glibc, so older version or closefrom substitute.
sshlockout_pf: references closefrom (same as above)
pftpx: missing files for pftpx-0.8
dnswatch: missing from ports tree

jokohp

Since i am a newbie and i am also have the same error, which file i should put that code in?
Please help.

Regards
JokoHP

@awebster:

I've discovered that the php4-xxx port building problems were due to autoconf and autoheaders versions being hardcoded into the build scripts, but can be overridden with some additional environment variables. Strangely, however, they aren't being read as expected from pfsense-build.conf, so I had to patch them in manually…The following two variables fix the php4-xxxx ports building problems:
 PHP_AUTOCONF=autoconf-2.68
 PHP_AUTOHEADER=autoheader-2.68
This one fixes dnsmasq building problem and any other port that may have known vulnerabilities:
 DISABLE_VULNERABILITIES=YES

jimp

DISABLE_VULNERABILITIES=YES should only be needed if you have portaudit installed, which usually wouldn't be the case on a builder if you followed the directions.

I'm still poking at the autoconf issues, but I just did a commit now that should make the other ports happier for building on 7.2 for 1.2.3. Give those another go after updating your tools repo.

jimp


>>> Ports with failures:        0
>>> Building athstats...Done!
>>> Building tools/crytpo...Done!
==> End of pfPorts...
>>> Operation ./build_pfPorts.sh has ended at Mon Feb 21 21:19:43 EST 2011

All good now. Make sure you do a "portsnap fetch extract" after updating the git repos, or update your ports with csup. Also make sure you have a good and current version of autoconf and autoconf-wrapper installed.