Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Critical issues with 2.3CE nanobsd amd64 4g on SD card

    Scheduled Pinned Locked Moved Problems Installing or Upgrading pfSense Software
    22 Posts 5 Posters 6.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M Offline
      Melphiz
      last edited by

      But it can get to the internet (after all it upgraded itself this way), ping works (for IP and DNS), client (I'm typing from it) has internet, too.

      I also don't see anything being blocked in the (for now used as WAN gateway on this pfsense) main pfsense.

      Where else can I check this?

      Edit: Just to see, I ticked "Disable hardware checksum offload" and rebooted, no difference. Ofc I can't get packages with this issue, too.

      1 Reply Last reply Reply Quote 0
      • M Offline
        Melphiz
        last edited by

        Maybe it's related, maybe not but I did not have this issue on 2.2.6

        When tryin to change a monitoring IP for a gateway I get the error message
        "Unable to open /cf/conf/config.xml for writing in write_config()"

        What can I do now?

        1 Reply Last reply Reply Quote 0
        • M Offline
          Melphiz
          last edited by

          So now I get these crash errors every few minutes after I did a reboot (and the pfsense is after the 3rd reboot able to check for packages and update status)

          Crash report begins.  Anonymous machine information:

          amd64
          10.3-RELEASE
          FreeBSD 10.3-RELEASE #6 05adf0a(RELENG_2_3_0): Mon Apr 11 18:52:07 CDT 2016    root@ce23-amd64-builder:/builder/pfsense-230/tmp/obj/builder/pfsense-230/tmp/FreeBSD-src/sys/pfSense

          Crash report details:

          PHP Errors:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP Stack trace:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  4. copy() /etc/inc/config.lib.inc:920
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP Stack trace:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  4. filesize() /etc/inc/config.lib.inc:927
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP Stack trace:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  4. fopen() /etc/inc/config.lib.inc:928
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP Stack trace:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  4. fwrite() /etc/inc/config.lib.inc:929
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP Stack trace:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  4. fclose() /etc/inc/config.lib.inc:930
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP Stack trace:
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  3. safe_write_file() /etc/inc/config.lib.inc:565
          [13-Apr-2016 11:28:01 Europe/Berlin] PHP  4. fopen() /etc/inc/config.lib.inc:495

          The hardware is completely new (at least from a customer view), so the CF should work w/o problems. (was the 2.2.6 was pre-installed, bought so I would not have the work to do all this)

          So I tried to set nanobsd to read/write always but get this message

          Warning: copy(/cf/conf/backup/config-1460536801.xml): failed to open stream: Read-only file system in /etc/inc/config.lib.inc on line 920 Call Stack: 0.0002 231792 1. {main}() /usr/local/www/diag_nanobsd.php:0 0.2315 1227704 2. write_config() /usr/local/www/diag_nanobsd.php:134 0.2318 1228104 3. backup_config() /etc/inc/config.lib.inc:553 0.2324 1228368 4. copy() /etc/inc/config.lib.inc:920 Warning: filesize(): stat failed for /cf/conf/backup/config-1460536801.xml in /etc/inc/config.lib.inc on line 927 Call Stack: 0.0002 231792 1. {main}() /usr/local/www/diag_nanobsd.php:0 0.2315 1227704 2. write_config() /usr/local/www/diag_nanobsd.php:134 0.2318 1228104 3. backup_config() /etc/inc/config.lib.inc:553 0.2341 1234064 4. filesize() /etc/inc/config.lib.inc:927 Warning: fopen(/cf/conf/backup/backup.cache): failed to open stream: Read-only file system in /etc/inc/config.lib.inc on line 928 Call Stack: 0.0002 231792 1. {main}() /usr/local/www/diag_nanobsd.php:0 0.2315 1227704 2. write_config() /usr/local/www/diag_nanobsd.php:134 0.2318 1228104 3. backup_config() /etc/inc/config.lib.inc:553 0.2351 1234456 4. fopen() /etc/inc/config.lib.inc:928 Warning: fwrite() expects parameter 1 to be resource, boolean given in /etc/inc/config.lib.inc on line 929 Call Stack: 0.0002 231792 1. {main}() /usr/local/www/diag_nanobsd.php:0 0.2315 1227704 2. write_config() /usr/local/www/diag_nanobsd.php:134 0.2318 1228104 3. backup_config() /etc/inc/config.lib.inc:553 0.2361 1235512 4. fwrite() /etc/inc/config.lib.inc:929 Warning: fclose() expects parameter 1 to be resource, boolean given in /etc/inc/config.lib.inc on line 930 Call Stack: 0.0002 231792 1. {main}() /usr/local/www/diag_nanobsd.php:0 0.2315 1227704 2. write_config() /usr/local/www/diag_nanobsd.php:134 0.2318 1228104 3. backup_config() /etc/inc/config.lib.inc:553 0.2370 1234440 4. fclose() /etc/inc/config.lib.inc:930 Warning: fopen(/cf/conf/config.xml.49850): failed to open stream: Read-only file system in /etc/inc/config.lib.inc on line 495 Call Stack: 0.0002 231792 1. {main}() /usr/local/www/diag_nanobsd.php:0 0.2315 1227704 2. write_config() /usr/local/www/diag_nanobsd.php:134 0.2730 1259504 3. safe_write_file() /etc/inc/config.lib.inc:565 0.2730 1259696 4. fopen() /etc/inc/config.lib.inc:495

          1 Reply Last reply Reply Quote 0
          • M Offline
            Melphiz
            last edited by

            OK I am rolling back now, thanks for the trouble.

            I now took a brand new SDHC CF card, wrote the nanobsd amd 64 4g on it, set it all up and the moment I change the gateway's monitoring IP I get this crash report again.

            Crash report begins.  Anonymous machine information:

            amd64
            10.3-RELEASE
            FreeBSD 10.3-RELEASE #6 05adf0a(RELENG_2_3_0): Mon Apr 11 18:52:07 CDT 2016    root@ce23-amd64-builder:/builder/pfsense-230/tmp/obj/builder/pfsense-230/tmp/FreeBSD-src/sys/pfSense

            Crash report details:

            PHP Errors:
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP Stack trace:
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  4. copy() /etc/inc/config.lib.inc:920
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP Stack trace:
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  4. filesize() /etc/inc/config.lib.inc:927
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP Stack trace:
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  4. fopen() /etc/inc/config.lib.inc:928
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP Stack trace:
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  4. fwrite() /etc/inc/config.lib.inc:929
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP Stack trace:
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  1. {main}() /usr/local/www/system_gateways_edit.php:0
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  2. write_config() /usr/local/www/system_gateways_edit.php:544
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  3. backup_config() /etc/inc/config.lib.inc:553
            [13-Apr-2016 12:15:16 Europe/Berlin] PHP  4. fclose() /etc/inc/config.lib.inc:930

            And on this new install pfsense was also not able to check its version.

            Anyway, then I enabled OPT1 again, changed the name, set it up as static, too, put the IP in and save + apply.
            After that (so when it was all applied and the new name was working) I wanted to add the gateway (still at this menu) and bam

            Unable to open /cf/conf/config.xml for writing in write_config()

            I doubt two new, from different companies, CF cars are at fault.

            So I have to roll back.

            Oh, the funny thing: The issue I had when I created that topic is then gone when I enable ALL interfaces. When OPT1 was enabled, pfsense was able to check for updates (though there is not active link on OPT1, only WAN and LAN have active links and cables connected). Before that: endless mode.

            EHM, where do I get an old 2.2.6 version? I don't have one for nanobsd and on http://files.pfsense.org/mirror/downloads/old/ I only see 2.2.5.

            EDIT: So on 2.2.5 everything works, but you cannot upgrade to 2.2.6 only to 2.3

            1 Reply Last reply Reply Quote 0
            • R Offline
              robi
              last edited by

              Check out here for 2.2.6:
              http://files.pfsense.org/mirror/downloads/
              (seems they forgot to move the files to the /old/ subdirectory)

              1 Reply Last reply Reply Quote 0
              • jimpJ Offline
                jimp Rebel Alliance Developer Netgate
                last edited by

                Sounds like the disk was stuck read only. If that happens again, go to Diag > NanoBSD and see if you can nudge it RW. And while you're there, just set the box to keep it RW permanently.

                Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                Need help fast? Netgate Global Support!

                Do not Chat/PM for help!

                1 Reply Last reply Reply Quote 0
                • M Offline
                  Melphiz
                  last edited by

                  @jimp:

                  Sounds like the disk was stuck read only. If that happens again, go to Diag > NanoBSD and see if you can nudge it RW. And while you're there, just set the box to keep it RW permanently.

                  I did write that I tried that and was not able to do so, see my 2nd last comment, bottom part.
                  And as it was with both CF cards it's a pfsense version issue to me (which I was not able to resolve, thus not able to change any config, thus am running 2.2.6 now again where everything works fine.)

                  I don't tend to mess with 2.3 more for now, I don't have a spare pfsense with CF to play around with. My focus is to have a working firewall for our branch office.

                  1 Reply Last reply Reply Quote 0
                  • C Offline
                    cmb
                    last edited by

                    What CF cards are those specifically (make and model), and what hardware are you using?

                    1 Reply Last reply Reply Quote 0
                    • M Offline
                      Melphiz
                      last edited by

                      @cmb:

                      What CF cards are those specifically (make and model), and what hardware are you using?

                      Was a prebuild pfsense from a german official reseller (on your list)

                      AMD APU1D4 [3x 1Gbit Realtek; 1GhZ Dualcore; 4GB DDR3]
                      came with 8GB Transcend SDHC Class 10 (TS8GSDHC10)

                      The other CF I tried was a PNY 32GB SDHC Class 10 (SD32GBHC6-EF)

                      1 Reply Last reply Reply Quote 0
                      • C Offline
                        cmb
                        last edited by

                        Ah, APU so SD rather than CF. Thanks for the info.

                        All our release testing on APUs is with Sandisk SD cards, which do fine with the mount speed. I have some other cards that are slow to re-mount though, will give one of those a shot.

                        1 Reply Last reply Reply Quote 0
                        • M Offline
                          Melphiz
                          last edited by

                          I usually call them CF somehow I'm used to, but yeah, I should correct it to SD I think.
                          Sorry for the misleading.

                          Do you test with a specific type of SanDisk? I might consider getting one of those to have better compatibility with your upcoming releases then. (And I'd need an other backup card anyway in case an update went terribly wrong so the guy at the branch office could switch cards in a worst case scenario)

                          1 Reply Last reply Reply Quote 0
                          • jimpJ Offline
                            jimp Rebel Alliance Developer Netgate
                            last edited by

                            For those who are seeing "Device busy" or similar and unable to force the disk read-write, try the following (preferably from the console):

                            umount -f /cf; fsck -t ufs -y /cf; mount -f -o rw /cf

                            Not something we'd normally recommend but somehow it seems that just the /cf slice is getting wedged for some people at the OS level.

                            Once that is done, set the permanent RW flag on Diagnostics > NanoBSD.

                            If you're running on an APU+SD card, I'd seriously consider reinstalling from a memstick-serial image as a full install. Activating the option to keep /tmp and /var in RAM will keep writes low, and the sizes can be tweaked so you have decent space there. Your overall experience is likely to be much better that way on APU than with NanoBSD. Short of using an mSATA anyhow.

                            Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                            Need help fast? Netgate Global Support!

                            Do not Chat/PM for help!

                            1 Reply Last reply Reply Quote 0
                            • M Offline
                              Melphiz
                              last edited by

                              @jimp:

                              If you're running on an APU+SD card, I'd seriously consider reinstalling from a memstick-serial image as a full install.

                              Any recommendations for a good memstick, maybe a type you test with?

                              Oh, and - that would only increase the performance for the one who administrates it, right? Not the firewall performance itself.

                              1 Reply Last reply Reply Quote 0
                              • jimpJ Offline
                                jimp Rebel Alliance Developer Netgate
                                last edited by

                                @Melphiz:

                                @jimp:

                                If you're running on an APU+SD card, I'd seriously consider reinstalling from a memstick-serial image as a full install.

                                Any recommendations for a good memstick, maybe a type you test with?

                                The specific memstick doesn't matter much for what I meant – that's only used for the installer. I test using a wide variety of USB thumb drives for installing pfSense, but at the moment my favorites are this PNY 16GB drive and these Sandisk Cruzer 16GB drives.

                                @Melphiz:

                                Oh, and - that would only increase the performance for the one who administrates it, right? Not the firewall performance itself.

                                It depends on the specific features used. It wouldn't affect packet processing, though it might affect daemons on the firewall that might touch the disk for one reason or another. If you're primarily using basic firewall/routing/NAT functions it wouldn't likely be any difference in speed.

                                Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                                Need help fast? Netgate Global Support!

                                Do not Chat/PM for help!

                                1 Reply Last reply Reply Quote 0
                                • M Offline
                                  Melphiz
                                  last edited by

                                  I'm using it for firewalling (dual wan), snort (one wan gateway only) and openvpn client.
                                  Would it still be ok to keep running the SD (tbh I had no idea when I purchased this model, I just didn't want to spend too much money for a 1-2PC branch office being connected to our main office ^^)

                                  1 Reply Last reply Reply Quote 0
                                  • R Offline
                                    robi
                                    last edited by

                                    You just use the memstick image to boot the appliance into the installer, just as you would do with a CD-ROM, if you had a drive in it. You do a full install on the SD card.

                                    1 Reply Last reply Reply Quote 0
                                    • M Offline
                                      Melphiz
                                      last edited by

                                      Oh, I see, then I misread it at first. Will try this when I get the SDHC-Card 16GB, SanDisk Extreme Pro 95MB/s, maybe 2.3 will run on it like it should (the firewall goes live next week, so there's still time to mess with it ^^)

                                      1 Reply Last reply Reply Quote 0
                                      • R Offline
                                        robi
                                        last edited by

                                        Note that when installing "Full" on flash-based media (CF or SD or DOM, etc), my advice would be to avoid creating a Swap partition.
                                        If there's a swap partition present pfSense will mount it - and using flash media as swap space can be really hard on flash wear. Of course, if swap space is really used - but to be on the safe side, I'd suggest not to use swap at all - on NanoBSD it didn't exist anyway - on embedded platform swap was not present…

                                        I guess there should be an extra option during setup - Automatic install on flash-based media, to avoid automatic creation of swap space.

                                        1 Reply Last reply Reply Quote 0
                                        • T Offline
                                          Technigogo
                                          last edited by

                                          @jimp:

                                          For those who are seeing "Device busy" or similar and unable to force the disk read-write, try the following (preferably from the console):

                                          umount -f /cf; fsck -t ufs -y /cf; mount -f -o rw /cf

                                          Not something we'd normally recommend but somehow it seems that just the /cf slice is getting wedged for some people at the OS level.

                                          Once that is done, set the permanent RW flag on Diagnostics > NanoBSD.

                                          Jimp, is this safe to do over SSH from a LAN computer that I am RDP'd into? (I am not onsite)

                                          1 Reply Last reply Reply Quote 0
                                          • jimpJ Offline
                                            jimp Rebel Alliance Developer Netgate
                                            last edited by

                                            @Technigogo:

                                            @jimp:

                                            umount -f /cf; fsck -t ufs -y /cf; mount -f -o rw /cf

                                            Jimp, is this safe to do over SSH from a LAN computer that I am RDP'd into? (I am not onsite)

                                            We have done that exact thing remotely several times with no ill effects, but there is always a chance it could go sideways so I can't say it's completely safe.

                                            Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                                            Need help fast? Netgate Global Support!

                                            Do not Chat/PM for help!

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.