Bypass At&t fiber BGW210-700

sherpagoodness · Feb 15, 2020, 2:29 AM

hey, the best thing you can do is read these threads online. nobody wants to hold your hand while you do this.

that being said, you can upload files under diagnostics>command prompt ..... that will place them in the /tmp/ directory, then i'll give you another useful bit of information you can use ssh and the cp command to copy something, like this cp /tmp/pfatt.sh /bin/

also steve you could have pointed out that chris posted this a few months ago; much easier

run the below bold commands when your on console or ssh

Just a quick note that the etf kernel module is now available as a command-line-installable package from the Netgate repos.

[2.4.4-RELEASE][root@pfSense]/root: pkg search etf
ng_etf-kmod-0.1 ng_etf kernel module
[2.4.4-RELEASE][root@pfSense]/root: pkg install ng_etf-kmod
Updating pfSense-core repository catalogue...
pfSense-core repository is up to date.
Updating pfSense repository catalogue...
pfSense repository is up to date.
All repositories are up to date.
The following 1 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
ng_etf-kmod: 0.1 [pfSense]

Number of packages to be installed: 1

3 KiB to be downloaded.

Proceed with this action? [y/N]:

No need to scp it from another FreeBSD node and it should track updates by FreeBSD.

Phantom_Stage · Feb 15, 2020, 2:51 AM

Dude thank you for this info!!!!!!! OMG this is exactly what i was looking for...straight forward even for this nube. thank you thank you thank you

stephenw10 · Feb 15, 2020, 2:04 PM

Ah, I missed that post. Didn't realise that was in our repo now. That's good as it will probably be updated for 2.4.5 which would otherwise have required a new module uploading.

Steve

Phantom_Stage · Feb 17, 2020, 7:08 AM

@sherpagoodness said in Bypass At&t fiber BGW210-700:

pfSense-core repository

ok I have done my best with no success...I copied and edited the files as such and placed it in root/bin

ONT_IF=igb1
RG_IF= igb0
RG_ETHER_ADDR=xx:xx:xx:xx:xx:xx replaced with mac of BGW210-700
OPNSENSE=no

edited my xml file as such above system as instructed.
<?xml version="1.0"?>
<pfsense>
<version>19.1</version>
<lastchange></lastchange>
<earlyshellcmd>/root/bin/pfatt.sh</earlyshellcmd>
<system>

placed NG_etf.ko in /boot/kernel

Any further suggestions I would really like to get rid of BGW210-700

Phantom_Stage · Feb 17, 2020, 7:07 AM

I also did a clean install of pfsense and tried the package install of etf with no success.

sherpagoodness · Feb 17, 2020, 3:26 PM

you had it going correctly....and just so you understand you're still keeping the gateway, its just off to the side now

make sure you search 'pkg search etf' then 'pkg install ng_etf-kmod'

and use the shellcmd package from the package manager rather than editing that xml file; that gave me problems trying to edit it manually

Phantom_Stage · Feb 17, 2020, 9:09 PM

ok thanks...will try the shellcmd to edit the xml

Phantom_Stage · Feb 18, 2020, 3:54 AM

installed pkg shellcmd

<earlyshellcmd>/root/bin/pfatt.sh</earlyshellcmd> earlyshellcmd ATT bridge

getting an error stating sh: syntax error: end of file unexpected (expecting word)
directly after loading configuration completes.

stephenw10 · Feb 18, 2020, 12:27 PM

Do you get that same error if you just run the script at the command line?

It seems like the script may not be complete if it's showing that error. How did you copy it onto your firewall?

Steve

sherpagoodness · Feb 18, 2020, 4:22 PM

this is how your file should be - just replace with your modems mac address

#!/bin/sh
set -e

ONT_IF='igb0'
RG_IF='igb1'
RG_ETHER_ADDR='********LEAVE Apostrophes****************'
OPNSENSE='no'
LOG=/var/log/pfatt.log

getTimestamp(){
    echo `date "+%Y-%m-%d %H:%M:%S :: [pfatt.sh] ::"`
}

{
    echo "$(getTimestamp) pfSense + AT&T U-verse Residential Gateway for true bridge mode"
    echo "$(getTimestamp) Configuration: "
    echo "$(getTimestamp)        ONT_IF: $ONT_IF"
    echo "$(getTimestamp)         RG_IF: $RG_IF"
    echo "$(getTimestamp) RG_ETHER_ADDR: $RG_ETHER_ADDR"
    echo "$(getTimestamp)      OPNSENSE: $OPNSENSE"

    echo -n "$(getTimestamp) loading netgraph kernel modules... "
    /sbin/kldload -nq ng_etf
    echo "OK!"

    if [ ${OPNSENSE} != 'yes' ]; then
        echo -n "$(getTimestamp) attaching interfaces to ng_ether... "
        /usr/local/bin/php -r "pfSense_ngctl_attach('.', '$ONT_IF');" 
        /usr/local/bin/php -r "pfSense_ngctl_attach('.', '$RG_IF');"
        echo "OK!"
    fi 

    echo "$(getTimestamp) building netgraph nodes..."

    echo -n "$(getTimestamp)   creating ng_one2many... "
    /usr/sbin/ngctl mkpeer $ONT_IF: one2many lower one
    /usr/sbin/ngctl name $ONT_IF:lower o2m
    echo "OK!"

    echo -n "$(getTimestamp)   creating vlan node and interface... "
    /usr/sbin/ngctl mkpeer o2m: vlan many0 downstream
    /usr/sbin/ngctl name o2m:many0 vlan0
    /usr/sbin/ngctl mkpeer vlan0: eiface vlan0 ether

    /usr/sbin/ngctl msg vlan0: 'addfilter { vlan=0 hook="vlan0" }'
    /usr/sbin/ngctl msg ngeth0: set $RG_ETHER_ADDR
    echo "OK!"

    echo -n "$(getTimestamp)   defining etf for $ONT_IF (ONT)... "
    /usr/sbin/ngctl mkpeer o2m: etf many1 downstream
    /usr/sbin/ngctl name o2m:many1 waneapfilter
    /usr/sbin/ngctl connect waneapfilter: $ONT_IF: nomatch upper
    echo "OK!"

    echo -n "$(getTimestamp)   defining etf for $RG_IF (RG)... "
    /usr/sbin/ngctl mkpeer $RG_IF: etf lower downstream
    /usr/sbin/ngctl name $RG_IF:lower laneapfilter
    /usr/sbin/ngctl connect laneapfilter: $RG_IF: nomatch upper
    echo "OK!"

    echo -n "$(getTimestamp)   bridging etf for $ONT_IF <-> $RG_IF... "
    /usr/sbin/ngctl connect waneapfilter: laneapfilter: eapout eapout
    echo "OK!"

    echo -n "$(getTimestamp)   defining filters for EAP traffic... "
    /usr/sbin/ngctl msg waneapfilter: 'setfilter { matchhook="eapout" ethertype=0x888e }'
    /usr/sbin/ngctl msg laneapfilter: 'setfilter { matchhook="eapout" ethertype=0x888e }'
    echo "OK!"

    echo -n "$(getTimestamp)   enabling one2many links... "
    /usr/sbin/ngctl msg o2m: setconfig "{ xmitAlg=2 failAlg=1 enabledLinks=[ 1 1 ] }"
    echo "OK!"

    echo -n "$(getTimestamp)   removing waneapfilter:nomatch hook... "
    /usr/sbin/ngctl rmhook waneapfilter: nomatch
    echo "OK!"

    echo -n "$(getTimestamp) enabling $RG_IF interface... "
    /sbin/ifconfig $RG_IF up
    echo "OK!"

    echo -n "$(getTimestamp) enabling $ONT_IF interface... "
    /sbin/ifconfig $ONT_IF up
    echo "OK!"

    echo -n "$(getTimestamp) enabling promiscuous mode on $RG_IF... "
    /sbin/ifconfig $RG_IF promisc
    echo "OK!"

    echo -n "$(getTimestamp) enabling promiscuous mode on $ONT_IF... "
    /sbin/ifconfig $ONT_IF promisc
    echo "OK!"

    echo "$(getTimestamp) ngeth0 should now be available to configure as your pfSense WAN"
    echo "$(getTimestamp) done!"
} >> $LOG

Phantom_Stage · Feb 18, 2020, 7:00 PM

(1) I copied PFatt.sh as raw file to notepad.
(2) Made the changes as noted saving changes using semi colon " at beginning and at end of name to ensure it save as correct file type .sh
(3) used command prompt in pfsense webgui to upload to tmp directory.
(4) SSH into pfsense using putty to create directory root/bin.
(5) used file editor in pfsense to copy file to root/bin.

stephenw10 · Feb 18, 2020, 7:54 PM

Notepad can break stuff completely. I recommend Notepad++ in Windows, though it's been a few years since I last used it.

If you open the file in Diag > Edit file does it looks correct?

Steve

Phantom_Stage · Feb 18, 2020, 9:20 PM

It looks correct from what I can tell...what if I copied it directly to the pfsense file edit made the changes there then save it as file type .sh? Does that eliminate the possibility of coruption?

stephenw10 · Feb 18, 2020, 10:45 PM

Yes. Or just pull it directly into pfSense and then edit it in the webgui:

Steve

Phantom_Stage · Feb 18, 2020, 10:41 PM

@stephenw10 said in Bypass At&t fiber BGW210-700:

/root/bin/pfatt.sh

Did it got the same syntax error.

stephenw10 · Feb 18, 2020, 10:46 PM

Sorry wrong file path there. Try this:

[2.5.0-DEVELOPMENT][admin@fw321.stevew.lan]/root: fetch -o /root/bin https://raw.githubusercontent.com/aus/pfatt/master/bin/pfatt.sh
/root/bin/pfatt.sh                                    3309  B   11 MBps    00s

Phantom_Stage · Feb 18, 2020, 11:19 PM

now I am getting the following error...kldload: an error occurred while loading the module. Please check dmesg(8) for more details. It appears I might be out of luck.

stephenw10 · Feb 18, 2020, 11:22 PM

Can you load the module manually?:

kldload ng_etf.ko

Phantom_Stage · Feb 18, 2020, 11:26 PM

nope same error...can I download ng_etf.ko to /boot/kernel directly.

stephenw10 · Feb 18, 2020, 11:25 PM

Hmm, and you got that module from the repo using pkg install?

Phantom_Stage · Feb 18, 2020, 11:28 PM

@stephenw10 it says the pkg is installed gonna delete it and reinstall now.

stephenw10 · Feb 18, 2020, 11:30 PM

That sort of error can often be because the module is wrong, from the wrong FreeBSD version or wrong architecture, but that cannot be the case if you installed it from the repo.

Phantom_Stage · Feb 18, 2020, 11:49 PM

ok ran the pkg installer again it says installed but when I look in /boot/kernel I don't see the ng_etf-kmod file.
the original file was from https://github.com/aus/pfatt/blob/master/bin/ng_etf.ko

stephenw10 · Feb 18, 2020, 11:58 PM

It installs it to /boot/modules. It installs and load fine or me here.

What hardware are you running this on?

Phantom_Stage · Feb 19, 2020, 12:06 AM

It's a Qotom I5 mini pc...gonna try my original pfsense computer build now just copied over the current xml config.

stephenw10 · Feb 19, 2020, 12:07 AM

Can you show the exact command you're using and the error you're seeing?

Phantom_Stage · Feb 19, 2020, 9:22 PM

pkg install ng_etf-kmod-0.1 I don't get an error on the install it says it completed...maybe my expectation is wrong. I am assuming (which I know I should not) that the pkg installs all the variables and I simply have to connect the att gateway to the wan port on the pfsense box and the att ont to the lan side of the pfsense box and reboot.

stephenw10 · Feb 19, 2020, 3:37 AM

Right and I assume you see the install happen after that rather than an error? The more info you give us the better we can help you here.

Please give the full console output of you trying to load that module and the error it returns.

Steve

Phantom_Stage · Feb 19, 2020, 9:57 PM

using the shellcmd configuration Shellcmd Type earlyshellcmd...do I need to put

the full <earlyshellcmd>/root/bin/pfatt.sh</earlyshellcmd>

or simply /root/bin/pfatt.sh

also where do I find those logs you mentioned?

stephenw10 · Feb 19, 2020, 10:00 PM

You don't need the tags just the full path to the command: /root/bin/pfatt.sh

Just copy and paste the console showing you running the command and whatever the output is.

Steve

Phantom_Stage · Apr 16, 2020, 7:32 PM

ok also do I still need to run those chmod commands?

noted: chmod +x /root/bin/pfatt.sh

       chmod 555 /boot/kernel/ng_etf.ko

stephenw10 · Feb 19, 2020, 10:08 PM

I did not after installing from the pkg. You might well have to if you uploaded the module manually.

It would show a permissions error if that were the case though.

Steve

Phantom_Stage · Feb 20, 2020, 2:43 AM

I ran dmesg -a and got the out put below.

Initializing.................. done.
Starting device manager (devd)...kldload: can't load ums: No such file or directory
done.
Loading configuration......done.
linker_load_file: Unsupported file type
kldload: an error occurred while loading the module. Please check dmesg(8) for more details.
Updating configuration...done.
Checking config backups consistency.................................done.
Setting up extended sysctls...done.
Setting timezone...done.
Configuring loopback interface...done.
Starting syslog...done.
Starting Secure Shell Services...done.
Setting up interfaces microcode...done.
Configuring loopback interface...done.
Creating wireless clone interfaces...done.
Configuring LAGG interfaces...done.
Configuring VLAN interfaces...done.
Configuring QinQ interfaces...done.
Configuring IPsec VTI interfaces...done.
Configuring WAN interface...
em0: link state changed to UP
done.
Configuring OPT1 interface...done.
Configuring OPT2 interface...done.
Configuring OPT3 interface...done.
Configuring LAN interface...done.
Configuring CARP settings...done.
Syncing OpenVPN settings...done.
pflog0: promiscuous mode enabled
Configuring firewall......done.
Starting PFLOG...done.
Setting up gateway monitors...done.
Setting up static routes...done.
Setting up DNSs...
Starting DNS Resolver...
em4: link state changed to UP
em2: link state changed to UP
em3: link state changed to UP
em1: link state changed to UP
done.
Synchronizing user settings...done.
Starting webConfigurator...done.
Configuring CRON...done.
Starting NTP time client...done.
Starting DHCP service...done.
Starting DHCPv6 service...done.
Configuring firewall......done.
Generating RRD graphs...done.
Starting syslog...done.
Starting CRON... done.
Starting package Shellcmd...done.
pfSense 2.4.4-RELEASE (Patch 3) amd64 Wed May 15 18:53:44 EDT 2019
Bootup complete

stephenw10 · Feb 20, 2020, 1:59 PM

Ok you are saying the module will not load. We need to see exactly how you're trying to load it and what errors it produces. Here's me doing the same on a local device:

[2.4.4-RELEASE][admin@pfsense.fire.box]/root: kldstat
Id Refs Address            Size     Name
 1   21 0xffffffff80200000 2ddcbe8  kernel
 2    1 0xffffffff83221000 10a0     cpuctl.ko
 3    1 0xffffffff83223000 2ed0     cryptodev.ko
 4    1 0xffffffff83226000 10810    dummynet.ko
 5    1 0xffffffff83237000 a34      ng_etf.ko
[2.4.4-RELEASE][admin@pfsense.fire.box]/root: kldunload ng_etf
[2.4.4-RELEASE][admin@pfsense.fire.box]/root: kldload ng_etf
[2.4.4-RELEASE][admin@pfsense.fire.box]/root: kldload ng_etf
kldload: can't load ng_etf: module already loaded or in kernel

I first check what modules are loaded with kldstat. Then unload ng_etf. The load it. Then try to load it again which produces an error.

Steve

Phantom_Stage · Feb 20, 2020, 7:31 PM

This is what came back

[2.4.4-RELEASE[admin@pfSense.localdomain]/root: kldstat
Id Refs Address Size Name
1 3 0xffffffff80200000 2ddcbe8 kernel
2 1 0xffffffff83221000 10a0 cpuctl.ko
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: kldunload ng_etf
kldunload: can't find file ng_etf
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: kldload ng_etf
kldload: an error occurred while loading the module. Please check dmesg(8) for more details.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root:]
1 3 0xffffffff80200000 2ddcbe8 kernel
2 1 0xffffffff83221000 10a0 cpuctl.ko
[2.4.4-RELEASE][admin@pfSense.localdomain]/root:

stephenw10 · Feb 20, 2020, 7:37 PM

Ok, if you run dmesg after trying to load the module does it give any further information?

Phantom_Stage · Feb 20, 2020, 9:17 PM

@stephenw10 said in Bypass At&t fiber BGW210-700:

kldload ng_etf

%(#000000)[%(#000000)[linker_load_file: Unsupported file type
linker_load_file: Unsupported file type
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: kldstat
Id Refs Address Size Name
1 3 0xffffffff80200000 2ddcbe8 kernel
2 1 0xffffffff83221000 10a0 cpuctl.ko
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: kldunload ng_etf
kldunload: can't find file ng_etf
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: kldload ng_etf
kldload: an error occurred while loading the module. Please check dmesg(8) for more details.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: dmesg
linker_load_file: Unsupported file type
[2.4.4-RELEASE][admin@pfSense.localdomain]/root:]]

stephenw10 · Feb 20, 2020, 9:53 PM

Hmm, OK I suggest you have a bad module file there somewhere. Remove the package:

[2.4.4-RELEASE][admin@pfsense.fire.box]/root: pkg remove ng_etf-kmod
Checking integrity... done (0 conflicting)
Deinstallation has been requested for the following 1 packages (of 0 packages in the universe):

Installed packages to be REMOVED:
	ng_etf-kmod-0.1

Number of packages to be removed: 1

Proceed with deinstalling packages? [y/N]: y
[1/1] Deinstalling ng_etf-kmod-0.1...
[1/1] Deleting files for ng_etf-kmod-0.1: 100%

Then search for any remaining rogue module files:

[2.4.4-RELEASE][admin@pfsense.fire.box]/root: find / -name "*ng_etf*"
/root/var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz
/root/var/cache/pkg/ng_etf-kmod-0.1.txz

On my system they are only in the package cache which is fine. If you have others remove them.

Then reboot, check you still don't have any module file present and then re-install the package and retry.

Steve

Phantom_Stage · Feb 20, 2020, 10:09 PM

[2.4.4-RELEASE][admin@pfSense.localdomain]/root: find / -name "ng_etf"
/root/bin/ng_etf.ko
/var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz
/var/cache/pkg/ng_etf-kmod-0.1.txz
/boot/kernel/ng_etf.ko
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: [2.4.4-RELEASE][admin@pfSense.localdomain]/root: find / -name "ng_etf"
[2.4.4-RELEASE][admin@pfSense.localdomain]/root:: Too many arguments.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: /root/bin/ng_etf.ko
/root/bin/ng_etf.ko: Permission denied.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: /var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz
/var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz: Permission denied.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: /var/cache/pkg/ng_etf-kmod-0.1.txz
/var/cache/pkg/ng_etf-kmod-0.1.txz: Permission denied.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: /boot/kernel/ng_etf.ko
/boot/kernel/ng_etf.ko: Exec format error. Binary file not executable.
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: [2.4.4-RELEASE][admin@pfSense.localdomain]/root:
[2.4.4-RELEASE][admin@pfSense.localdomain]/root:

Phantom_Stage · Feb 20, 2020, 10:18 PM

@stephenw10 said in Bypass At&t fiber BGW210-700:

find / -name "ng_etf"

2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /root/bin/ng_etf.ko
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /var/cache/pkg/ng_etf-kmod-0.1.txz
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /boot/kernel/ng_etf.ko
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /root/bin/ng_etf.ko
rm: /root/bin/ng_etf.ko: No such file or directory
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz
rm: /var/cache/pkg/ng_etf-kmod-0.1-10b4f7c3eb.txz: No such file or directory
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /var/cache/pkg/ng_etf-kmod-0.1.txz
rm: /var/cache/pkg/ng_etf-kmod-0.1.txz: No such file or directory
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: rm /boot/kernel/ng_etf.ko
rm: /boot/kernel/ng_etf.ko: No such file or directory
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: find / -name "ng_etf"
[2.4.4-RELEASE][admin@pfSense.localdomain]/root: