Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Transfer image from one CF to another

    Problems Installing or Upgrading pfSense Software
    11
    33
    46.1k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • R
      rsw686
      last edited by

      @rsw686:

      Forgot to mention…

      The miniupnpd.tar.gz files are the latest files with the 20060924 binary. I tried out the 20060930 binary and it seems to have regressed with errors filling the system log. You can read about here

      http://forum.pfsense.org/index.php/topic,551.msg13483.html#msg13483

      Miniupnpd uses the miniupnp.sh script to start the service. This file contains your ip address and nic interface hardcoded. Not a big deal as the sync_package_miniupnpd() recreates it. However it doesn't seem to run this when syncing packages at startup. I looked in the code and it looks like the miniupnpd.xml file should have a custom_php_resync_config_command section which calles sync_package_miniupnpd(). I think the thought was that once its configured theres really no need to keep recreating the same startup file.

      All I did was go to the miniupnpd settings page and click change (this calles sync_package_miniupnpd) and the service restarted and it worked from then on out. The ideal way, which I do now is to modify the miniupnpd.sh file which is in miniupnpd.tar.gz link above. Find the below line. Change fxp2 to your wan interface name and the 10.10.1.1 to your lan ip address.

      killall miniupnpd; /usr/local/sbin/miniupnpd -p 2869 -i fxp2 -a 10.10.1.1

      Now when you build and flash your image you can stick it in and your good to go.

      With the recent comitted changes it is no longer necessary to configure the miniupnpd.sh file. It will be automatically created upon first boot. It's as simple as using my scripts with the included files and your good to go.

      1 Reply Last reply Reply Quote 0
      • Z
        ZPrime
        last edited by

        Your method didn't work for me, I tried to embed my config but it didn't seem to take.  I edited in the appropriate XML stuff first and no worky…

        Maybe it's because it couldn't find an RC3f patch to apply?  All that is on the mirrors is RC3e, at least as of yesterday night.

        1 Reply Last reply Reply Quote 0
        • J
          jeroen234
          last edited by

          here is the link to rc3f
          http://www.pfsense.com/~sullrich/pfSense-1.0-RC3f-Full-Embedded.tgz

          1 Reply Last reply Reply Quote 0
          • R
            rsw686
            last edited by

            @bradenmcg:

            Your method didn't work for me, I tried to embed my config but it didn't seem to take.  I edited in the appropriate XML stuff first and no worky…

            Maybe it's because it couldn't find an RC3f patch to apply?  All that is on the mirrors is RC3e, at least as of yesterday night.

            RC3f was in the sullrich folder or on my site with the scripts. Although now it doesn't matter as 1.0 is out. Check out the following files they should do what you want.

            http://wgnrs.dynalias.com:81/pfsense/sh-replace-config.sh
            http://wgnrs.dynalias.com:81/pfsense/sh-add-miniupnpd.sh
            http://wgnrs.dynalias.com:81/pfsense/miniupnpd.tar.gz
            http://wgnrs.dynalias.com:81/pfsense/cfg-add-miniupnpd.xml

            OR

            http://wgnrs.dynalias.com:81/pfsense/sh-custom-image.sh

            As I rewrote the the above script. It is updated for 1.0-RELEASE, includes error checking, and the ability to specify a config file at the command line. If no config file is specified it will use the default config file with the miniupnpd package section added.

            Download file to freebsd machine
            chmod +x sh-custom-image.sh
            ./sh-custom-image.sh
            or
            ./sh-custom-image.sh yourconfig.xml

            Try the above and let me know if it doesn't work.

            1 Reply Last reply Reply Quote 0
            • J
              jeroen234
              last edited by

              and more for the colection:  sh-add-files.sh
              this file will read the file  filelist and add the files listed there to the image
              start the file with sh-add-files.sh pfSense.img
              use the complete filepath to the file in file filelist
              like this: /bin/routed

              sh-add-files.sh.txt
              filelist.txt

              1 Reply Last reply Reply Quote 0
              • J
                jeroen234
                last edited by

                added some text to sh-add-miniupnpd.sh
                it will now check of the config for miniupnp is in the config.xml
                if its not it will download the file cfg-add-miniupnpd.xml
                and add it to the correct place in config.xml

                
#!/bin/sh
# This script adds the miniupnpd files to image specified.
# Make sure the miniupnpd.tar.gz file is in the script directory.
#
#
# The miniupnpd.tar.gz file was made by creating a directory named
# miniupnpd. In there should be the following files:
# miniupnpd, miniupnpd.sh, miniupnpd.inc, miniupnpd.xml, status_upnp.php
# Then you execute the command "tar cfz miniupnpd.tar.gz miniupnpd/"
#
# Usage {miniupnpd} {imagefile}
# Example ./sh-add-miniupnpd.sh miniupnpd.tar.gz pfSense.img

TARFILE="$1"
IMGFILE="$2"
WORKDIR=`pwd`
UPNPDIR="$WORKDIR/miniupnpd"
MD=`mdconfig -a -t vnode -f $WORKDIR/$IMGFILE`
mkdir $WORKDIR/a
mount /dev/${MD}a $WORKDIR/a

tar zxf $TARFILE

cp $UPNPDIR/miniupnpd.inc $WORKDIR/a/usr/local/pkg/miniupnpd.inc
chmod 755 $WORKDIR/a/usr/local/pkg/miniupnpd.inc

cp $UPNPDIR/miniupnpd.xml $WORKDIR/a/usr/local/pkg/miniupnpd.xml
chmod 644 $WORKDIR/a/usr/local/pkg/miniupnpd.xml

cp $UPNPDIR/miniupnpd $WORKDIR/a/usr/local/sbin/miniupnpd
chmod 755 $WORKDIR/a/usr/local/sbin/miniupnpd

cp $UPNPDIR/status_upnp.php $WORKDIR/a/usr/local/www/status_upnp.php
chmod 755 $WORKDIR/a/usr/local/www/status_upnp.php
cd $UPNPDIR
echo -n "looking for miniupnp config in config.xml.."
if grep -q miniupnp $WORKDIR/a/conf/config.xml
then echo "..miniupnp config found."
else
echo "..miniupnp config not found."
cp $WORKDIR/a/conf/config.xml $UPNPDIR/test.xml
echo "downloading miniupnp xml config"
fetch -q -o cfg_add_miniupnp.xml  http://wgnrs.dynalias.com:81/pfsense/cfg-add-m
iniupnpd.xml

# the downloaded file has <installedpackages>and</installedpackages> #the test.xml has them to so we remove them from the downloaded file
echo "removing not needed text"
 sed -e '/<installedpackages>/ d' -e '/<\/installedpackages>/ d' cfg_add_miniupn
p.xml >upnp.xml

# now we add upnp.xml to test.xml afther <installedpackages>echo  "adding miniupnp config."

sed '/<installedpackages>/ r upnp.xml' test.xml > output.xml
mv output.xml $WORKDIR/a/conf/config.xml

fi
echo “all done”

rm -rf miniupnpd

umount $WORKDIR/a
rm -rf $WORKDIR/a
mdconfig -d -u ${MD}</installedpackages></installedpackages></installedpackages>
                1 Reply Last reply Reply Quote 0
                • R
                  rsw686
                  last edited by

                  @jeroen234:

                  added some text to sh-add-miniupnpd.sh
                  it will now check of the config for miniupnp is in the config.xml
                  if its not it will download the file cfg-add-miniupnpd.xml
                  and add it to the correct place in config.xml

                  
#!/bin/sh
# This script adds the miniupnpd files to image specified.
# Make sure the miniupnpd.tar.gz file is in the script directory.
#
#
# The miniupnpd.tar.gz file was made by creating a directory named
# miniupnpd. In there should be the following files:
# miniupnpd, miniupnpd.sh, miniupnpd.inc, miniupnpd.xml, status_upnp.php
# Then you execute the command "tar cfz miniupnpd.tar.gz miniupnpd/"
#
# Usage {miniupnpd} {imagefile}
# Example ./sh-add-miniupnpd.sh miniupnpd.tar.gz pfSense.img

TARFILE="$1"
IMGFILE="$2"
WORKDIR=`pwd`
UPNPDIR="$WORKDIR/miniupnpd"
MD=`mdconfig -a -t vnode -f $WORKDIR/$IMGFILE`
mkdir $WORKDIR/a
mount /dev/${MD}a $WORKDIR/a

tar zxf $TARFILE

cp $UPNPDIR/miniupnpd.inc $WORKDIR/a/usr/local/pkg/miniupnpd.inc
chmod 755 $WORKDIR/a/usr/local/pkg/miniupnpd.inc

cp $UPNPDIR/miniupnpd.xml $WORKDIR/a/usr/local/pkg/miniupnpd.xml
chmod 644 $WORKDIR/a/usr/local/pkg/miniupnpd.xml

cp $UPNPDIR/miniupnpd $WORKDIR/a/usr/local/sbin/miniupnpd
chmod 755 $WORKDIR/a/usr/local/sbin/miniupnpd

cp $UPNPDIR/status_upnp.php $WORKDIR/a/usr/local/www/status_upnp.php
chmod 755 $WORKDIR/a/usr/local/www/status_upnp.php
cd $UPNPDIR
echo -n "looking for miniupnp config in config.xml.."
if grep -q miniupnp $WORKDIR/a/conf/config.xml
then echo "..miniupnp config found."
else
echo "..miniupnp config not found."
cp $WORKDIR/a/conf/config.xml $UPNPDIR/test.xml
echo "downloading miniupnp xml config"
fetch -q -o cfg_add_miniupnp.xml  http://wgnrs.dynalias.com:81/pfsense/cfg-add-m
iniupnpd.xml

# the downloaded file has <installedpackages>and</installedpackages> #the test.xml has them to so we remove them from the downloaded file
echo "removing not needed text"
 sed -e '/<installedpackages>/ d' -e '/<\/installedpackages>/ d' cfg_add_miniupn
p.xml >upnp.xml

# now we add upnp.xml to test.xml afther <installedpackages>echo  "adding miniupnp config."

sed '/<installedpackages>/ r upnp.xml' test.xml > output.xml
mv output.xml $WORKDIR/a/conf/config.xml

fi
echo “all done”

rm -rf miniupnpd

umount $WORKDIR/a
rm -rf $WORKDIR/a
mdconfig -d -u ${MD}</installedpackages></installedpackages></installedpackages>

                  Have you tested this script out?? As you need to mount the other partition in the image as thats where the config is stored. Look at my sh-mount-image.sh or sh-replace-config.sh

                  http://wgnrs.dynalias.com:81/pfsense/sh-mount-image.sh
                  http://wgnrs.dynalias.com:81/pfsense/sh-replace-config.sh

                  Regardless I like the script. Billm had suggested that the script automatically add the required section last night and you beat me to writing it  :). I will update mine with the changes. Thanks!

                  1 Reply Last reply Reply Quote 0
                  • J
                    jeroen234
                    last edited by

                    hmm i have only tested the part that add's the miniupnp code to config.xml on my soekris
                    will look at the replace config file
                    [edit]
                    oke the config is on party D not on A

                    took from the replace config file what was needed

                    
#!/bin/sh
# This script adds the miniupnpd files to image specified.
# Make sure the miniupnpd.tar.gz file is in the script directory.
#
#
# The miniupnpd.tar.gz file was made by creating a directory named
# miniupnpd. In there should be the following files:
# miniupnpd, miniupnpd.sh, miniupnpd.inc, miniupnpd.xml, status_upnp.php
# Then you execute the command "tar cfz miniupnpd.tar.gz miniupnpd/"
#
# Usage {miniupnpd} {imagefile}
# Example ./sh-add-miniupnpd.sh miniupnpd.tar.gz pfSense.img

TARFILE="$1"
IMGFILE="$2"
WORKDIR=`pwd`
UPNPDIR="$WORKDIR/miniupnpd"
MD=`mdconfig -a -t vnode -f $WORKDIR/$IMGFILE`
mkdir $WORKDIR/a
mount /dev/${MD}a $WORKDIR/a

tar zxf $TARFILE

cp $UPNPDIR/miniupnpd.inc $WORKDIR/a/usr/local/pkg/miniupnpd.inc
chmod 755 $WORKDIR/a/usr/local/pkg/miniupnpd.inc

cp $UPNPDIR/miniupnpd.xml $WORKDIR/a/usr/local/pkg/miniupnpd.xml
chmod 644 $WORKDIR/a/usr/local/pkg/miniupnpd.xml

cp $UPNPDIR/miniupnpd $WORKDIR/a/usr/local/sbin/miniupnpd
chmod 755 $WORKDIR/a/usr/local/sbin/miniupnpd

cp $UPNPDIR/status_upnp.php $WORKDIR/a/usr/local/www/status_upnp.php
chmod 755 $WORKDIR/a/usr/local/www/status_upnp.php

cd $UPNPDIR
MD1=`mdconfig -a -t vnode -f $WORKDIR/$IMGFILE`
mkdir $WORKDIR/d
mount /dev/${MD1}d $WORKDIR/d

echo -n "looking for miniupnp config in config.xml.."
if grep -q miniupnp $WORKDIR/d/conf/config.xml
then echo "..miniupnp config found."
else
echo "..miniupnp config not found."
cp $WORKDIR/d/conf/config.xml $UPNPDIR/test.xml
echo "downloading miniupnp xml config"
fetch -q -o cfg_add_miniupnp.xml  http://wgnrs.dynalias.com:81/pfsense/cfg-add-m
iniupnpd.xml

# the downloaded file has <installedpackages>and</installedpackages> #the test.xml has them to so we remove them from the downloaded file
echo "removing not needed text"
 sed -e '/<installedpackages>/ d' -e '/<\/installedpackages>/ d' cfg_add_miniupn
p.xml >upnp.xml

# now we add upnp.xml to test.xml afther <installedpackages>echo  "adding miniupnp config."

sed '/<installedpackages>/ r upnp.xml' test.xml > output.xml
mv output.xml $WORKDIR/d/conf/config.xml
chmod 640 $WORKDIR/d/conf/config.xml
fi
echo “all done”

rm -rf miniupnpd

umount $WORKDIR/a
rm -rf $WORKDIR/a
mdconfig -d -u ${MD}
umount $WORKDIR/d
rm -rf $WORKDIR/d
mdconfig -d -u ${MD1}</installedpackages></installedpackages></installedpackages>
                    1 Reply Last reply Reply Quote 0
                    • R
                      rsw686
                      last edited by

                      Since we are downloading the current config section might as well get the current miniupnpd files as well.

                      
#!/bin/sh
# This script adds the miniupnpd files to image specified.
#
# Usage {imagefile}
# Example ./sh-add-miniupnpd.sh pfSense.img

IMGFILE="$1"
WORKDIR=`pwd`

MD=`mdconfig -a -t vnode -f $WORKDIR/$IMGFILE`
mkdir $WORKDIR/d
mount /dev/${MD}d $WORKDIR/d
mkdir $WORKDIR/a
mount /dev/${MD}a $WORKDIR/a

echo "downloading miniupnp files..."

fetch -q -o $WORKDIR/a/usr/local/sbin/miniupnpd "http://pfsense.com/packages/config/packages/miniupnpd/sbin/miniupnpd"
fetch -q -o $WORKDIR/a/usr/local/pkg/miniupnpd.inc "http://pfsense.com/packages/config/packages/miniupnpd/miniupnpd.inc"
fetch -q -o $WORKDIR/a/usr/local/pkg/miniupnpd.xml "http://pfsense.com/packages/config/packages/miniupnpd/miniupnpd.xml"
fetch -q -o $WORKDIR/a/usr/local/www/status_upnp.php "http://pfsense.com/packages/config/packages/miniupnpd/status_upnp.php"

chmod 755 $WORKDIR/a/usr/local/pkg/miniupnpd.inc
chmod 644 $WORKDIR/a/usr/local/pkg/miniupnpd.xml
chmod 755 $WORKDIR/a/usr/local/sbin/miniupnpd
chmod 755 $WORKDIR/a/usr/local/www/status_upnp.php

echo "looking for miniupnp config in config.xml..."

if grep -q miniupnp $WORKDIR/d/conf/config.xml
	then echo "  miniupnpd config already exists!"
else
	cp $WORKDIR/d/conf/config.xml $WORKDIR/config.xml

	echo "  downloading miniupnp config..."
	fetch -q "http://wgnrs.dynalias.com:81/pfsense/cfg-add-miniupnpd.xml"

	# lets remove <installedpackages>and</installedpackages> 
	sed -e '/<installedpackages>/ d' -e '/<\/installedpackages>/ d' cfg-add-miniupnpd.xml > cfg-miniupnpd.xml

	echo  "  adding miniupnp config..."
	# add miniupnpd section after <installedpackages>sed '/<installedpackages>/ r cfg-miniupnpd.xml' config.xml > $WORKDIR/d/conf/config.xml
	chmod 640 $WORKDIR/d/conf/config.xml

	rm -f cfg-add-miniupnpd.xml cfg-miniupnpd.xml config.xml
fi

echo "miniupnpd successfully added!"

umount $WORKDIR/d
rm -rf $WORKDIR/d
umount $WORKDIR/a
rm -rf $WORKDIR/a
mdconfig -d -u ${MD}</installedpackages></installedpackages></installedpackages>
                      1 Reply Last reply Reply Quote 0
                      • J
                        jeroen234
                        last edited by

                        looking nice
                        is it me or is the file now less lines ?

                        1 Reply Last reply Reply Quote 0
                        • R
                          rsw686
                          last edited by

                          @jeroen234:

                          looking nice
                          is it me or is the file now less lines ?

                          Yes, there is less lines now. Downloading the miniupnpd files saved space. I consolidated some of the file copying back and forth. Also removed the second mdconfig as it was unneeded. I verified the script works and will be using it to build my images once I modify my other script. Thanks.

                          1 Reply Last reply Reply Quote 0
                          • S
                            shreckbull
                            last edited by

                            maybe, with a "ghost like program" and with IDE to CF adapter you can create a image of the old and you can reinject it on new CF …

                            OR, with a soft as "winimage" you can create and image from CF in your usb card reader ...
                            no ?

                            PS : i use a 1GB CF in a IDE to CF adapter. So, i don't use embedded, but full install from CD Live.

                            1 Reply Last reply Reply Quote 0
                            • F
                              falcon
                              last edited by

                              Heres a tip

                              what ever you do DONT use ghost!

                              I just tried making a ghost image, ghost made a 1 gig image from a 1gig cf card, (install wasnt 1gig) i then rebooted and it no longer boots, it just beeps at me at Default: F1

                              I then tried to ghost on the image i had made and it wont it says theres not enough space

                              So yeah pretty much a disaster.

                              1 Reply Last reply Reply Quote 0
                              • G
                                goudkamp
                                last edited by

                                I used the windows version of dd to copy my working 128MB CF to an image, using this command:

                                dd id=f: (replace with yours) of=pfsense128mb.img

                                Then I inserted the new 1024MB CF into the USB reader and used physdiskwrite.exe to restore the image. Ofcourse, my 1GB CF is now seen as a 128MB one. My Alix2c3's are now booting from the new 1GB CF cards.

                                1 Reply Last reply Reply Quote 0
                                • First post
                                  Last post
                                Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.