Alternate definitions for ClamAV

Stewart · Jul 14, 2016, 9:25 PM

I see that there is the option for Optional ClamAV Database Update Servers in the Squid AV page. I've searched and found only one entry from a few years ago where someone put in the optional signatures from SaneSecurity. Has anyone tried this? I've found ClamAV to be somewhat ineffective and others have posted that the additional signatures from SaneSecurity has helped. I'm not sure how to add them to the optional database field. Would it just be "http://sanesecurity.com/usage/signatures/"?

Alternately, has anyone used this field to add optional definitions for the ClamAV and had good success? I've searched but can't really find anything. Thanks!

Stewart · Jul 18, 2016, 1:09 PM

Update: I've spoken with Steve over at SaneSecurity and he gave me the links to manually put into the freshclam.conf file. After running the freshclam update ClamAV had a much higher detection rate. This morning ClamAV's general definitions found only 12 out of my 46 infections. The box with the new definitions found 45 of them! It's gone from a check-box item to an actual protection mechanism. Iis there a place that pfSense can mirror these? I guess the current hosts don't offer a great deal of traffic and there may be some concern about sudden spikes of people using it.

Pippin · Jul 18, 2016, 1:49 PM

Can also add them under "Optional ClamAV Database Update Servers"?

db.12.clamav.net;db.34.clamav.net;db.56.clamav.net

These are free definitions?

Stewart · Jul 18, 2016, 5:55 PM

Yes, they are free definitions although donations wouldn't hurt and are accepted. I don't think we can just add them under optional servers. The way I read it is that the optional servers will just download the predefined definitions from another place. These need to be added manually to the freshclam.conf location to see the additional files. At least that's how I read it. I haven't tried it so I may be wrong.

AR15USR · Jul 18, 2016, 6:19 PM

I'd be interested in adding the Sane Security definitions to ClamAV. Please give us the 'How To' scoop when you are able..

johnabbot · Jul 19, 2016, 3:18 PM

I would be very interested in adding this as well.

AR15USR · Jul 21, 2016, 3:42 AM

OP, any more light you can shed on this?

johnabbot · Aug 19, 2016, 4:08 AM

Any update on this?

The current ClamAV definitions are pretty useless, they don't even detect Regin a year after it was disclosed.

Stewart · Sep 7, 2016, 4:41 PM

I thought I would get notices about new postings in the thread. Just came back to check and noticed there had been some activity. I'm so sorry and don't want to leave everyone hanging.

The updates can be changed in Services -> Squid Proxy Server -> Antivirus
1. Enable Manual Configuration
2. Click Load Advanced to load the default files for editing.
(I think at this point you need to save)
3. Click Show Advanced Options
4. Make the changes in the DatabaseCustomURL section of freshclam.conf

The additions I've used are:
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/junk.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/phish.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/rogue.hdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/foxhole_filename.cdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/foxhole_generic.cdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/foxhole_js.cdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/badmacro.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/scam.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sanesecurity.ftm
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sigwhitelist.ign2

(Click Save)
(At this point you may or may not need to go back to the General Tab and re-save.)

As all this appears to be freely and openly distributed I'm confident I can share this. However, I can't vouch for how long these files will be hosted at this mirror as there was a bandwidth concern expressed to me. I would love it if pfSense would host it or provide some alternate mirror but at this point it seems we are on our own. These definitions have worked well for me. @Pippin did mention that the foxhole definitions (when exclusively check inside archives) blocked an Adobe update so YMMV.

I'll keep checking this thread so that any further discussion doesn't get overlooked again.

Peen · Sep 13, 2016, 12:21 AM

Thanks for the how to,

How do you know for sure if it's working in pfSense?

My ClamAV update logs looks ok (at first they were failing)

Message
bytecode.cvd is up to date (version: 283, sigs: 53, f-level: 63, builder: neo)
daily.cld is up to date (version: 22205, sigs: 609122, f-level: 63, builder: neo)
main.cvd is up to date (version: 57, sigs: 4218790, f-level: 60, builder: amishhammer)
sigwhitelist.ign2 is up to date (version: custom database)
sanesecurity.ftm is up to date (version: custom database)
scam.ndb is up to date (version: custom database)
badmacro.ndb is up to date (version: custom database)
foxhole_js.cdb is up to date (version: custom database)
foxhole_generic.cdb is up to date (version: custom database)
foxhole_filename.cdb is up to date (version: custom database)
rogue.hdb is up to date (version: custom database)
phish.ndb is up to date (version: custom database)
junk.ndb is up to date (version: custom database)
ClamAV update process started at Mon Sep 12 17:00:00 2016
–------------------------------------
bytecode.cvd is up to date (version: 283, sigs: 53, f-level: 63, builder: neo)
daily.cld is up to date (version: 22205, sigs: 609122, f-level: 63, builder: neo)
main.cvd is up to date (version: 57, sigs: 4218790, f-level: 60, builder: amishhammer)
sigwhitelist.ign2 is up to date (version: custom database)
sanesecurity.ftm is up to date (version: custom database)
scam.ndb is up to date (version: custom database)
badmacro.ndb is up to date (version: custom database)
foxhole_js.cdb is up to date (version: custom database)
foxhole_generic.cdb is up to date (version: custom database)
foxhole_filename.cdb is up to date (version: custom database)
rogue.hdb is up to date (version: custom database)
phish.ndb is up to date (version: custom database)
junk.ndb is up to date (version: custom database)
ClamAV update process started at Mon Sep 12 16:00:00 2016

bytecode.cvd is up to date (version: 283, sigs: 53, f-level: 63, builder: neo)
daily.cld is up to date (version: 22205, sigs: 609122, f-level: 63, builder: neo)
main.cvd is up to date (version: 57, sigs: 4218790, f-level: 60, builder: amishhammer)
sigwhitelist.ign2 is up to date (version: custom database)
sanesecurity.ftm is up to date (version: custom database)
scam.ndb is up to date (version: custom database)
badmacro.ndb is up to date (version: custom database)
foxhole_js.cdb is up to date (version: custom database)
foxhole_generic.cdb is up to date (version: custom database)
foxhole_filename.cdb is up to date (version: custom database)
rogue.hdb is up to date (version: custom database)
phish.ndb is up to date (version: custom database)
junk.ndb is up to date (version: custom database)
ClamAV update process started at Mon Sep 12 15:00:00 2016

But when I look here, I don't see them being a part of the DB? If I go to the sanesecurity website and check out the signature testing link, it gets blocked. I tried using a different connection to email myself the tests, but it didn't seem to do anything.

johnabbot · Sep 16, 2016, 2:29 AM

my update log is also ok but in Squid Anti-Virus on the dashboard I see this

Statistics Unknown (no log exists)

Have I set up ClamAV correctly?

Anyone else get this?

AR15USR · Sep 17, 2016, 1:55 PM

@johnabbot:

my update log is also ok but in Squid Anti-Virus on the dashboard I see this

Statistics Unknown (no log exists)

Have I set up ClamAV correctly?

Anyone else get this?

Maybe you haven't detected a virus yet, so nothing to show?

AR15USR · Sep 17, 2016, 2:30 PM

I am having a lot of legitimate updates being blocked by these additional definitions. I do till see a lot of traffic from these same apps/vendors (Apple, Sophos, Adobe, MS) making it through still though.

Here a a few examples:

Date-Time	Message	Virus	URL	Host	User
16.09.2016 21:46:03	VIRUS FOUND	Sanesecurity.Foxhole.Zip_JsNum_wrd.UNOFFICIAL	http://appldnld.apple.com/ios10.0/...[i]/com_apple_MobileAsset_CoreSuggestions/6a3ed2b4a6e1de61c084583a57a0efdff20d2b48.zip	-	-

16.09.2016 17:24:44	VIRUS FOUND	Sanesecurity.Foxhole.Zip_fs211.UNOFFICIAL	http://d1.sophosupd.com/update/5bd003b17a6fd2d057620295800499acx000.dat	-	-

16.09.2016 17:17:06	VIRUS FOUND	Sanesecurity.Foxhole.Zip_doc_js.UNOFFICIAL	http://bg2.v4.a.dl.ws.microsoft.com/dl/content/c/updt/2016/09/19c9cb69-f6ed-49d2-81d5-24c8f4de9cb9_96035d20a923a671f386073b34d004fa5125bd7b.appxbundle?P1=1474071897

5.09.2016 05:12:44	VIRUS FOUND	Sanesecurity.Foxhole.Zip_jsname.UNOFFICIAL	http://a1.mzstatic.com/us/r30/Purple71/v4/6d/30/a2/6d30a250-66eb-9f40-80d9-07fa321fe70f/icon1280x768.lsr

I have removed the Foxhole definitions source from freshclam but that hasn't stopped the blocks above. Here is my additional definitions list:

[code]DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/junk.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/phish.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/rogue.hdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/badmacro.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/scam.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sanesecurity.ftm
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sigwhitelist.ign2[/code]

Any thoughts/ideas?

Edit: Maybe the "icon1280x768.lsr is a legit virus? 
https://www.virustotal.com/en/file/7f2c0860d6810f8557cf921f1604c01da5f4eae5155bdbf53ed7cafb2d6aeb3a/analysis/

The mzstatic.com domain is an apple domain I believe.[/i]

Stewart · Sep 19, 2016, 2:11 PM

The Foxhole definitions are the ones responsible for scanning inside of Zip files I believe. If it's still being blocked then what is it saying is blocking it? If it still says Foxhole then there should be some way of clearing those definitions out of ClamAV. Maybe a Freshclam? I'm not sure.

Looking at the virustotal link it appears it is not a virus so maybe it is a false positive?

AR15USR · Sep 19, 2016, 6:26 PM

Stewart you can see in my above post, in the first 'code' section it reports that sane security.foxhole.xxx is the responsible database(s). I'm not exactly sure which that is though.

I removed the 3 foxhole databases and it still blocked. I have just removed the sanesecurity database and I will see if it still blocks.

In the end I might try and reporting the blocks to SaneSecurity as false positives and see what they say. Although on their site they say and database with 'unofficial' on it is not theirs.

Peen · Sep 20, 2016, 5:06 AM

Any insight on my previous post? Set it up as instructed. The DB's all update, and I checked the DB's were there. But I don't see them being applied. Also doesn't seem to be blocking anything more in my tests.

This is what my DB says…

Squid Version 3.5.19_1
Antivirus Scanner ClamAV 0.99.2 C-ICAP 0.4.3 + SquidClamav 6.10
Antivirus Bases
Database Date Version Builder
daily.cld 2016.09.19 22224 neo
bytecode.cvd 2016.06.23 283 neo
main.cvd 2016.03.16 57 amishhammer
Last Update Mon Sep 19 17:03:48 2016
Statistics Found 3 virus(es) total.

sanesecurity · Sep 20, 2016, 1:56 PM

Hi All,

Just popped in to say if you find any more FP's on files with foxhole_filename.cdb

I'll need a direct file download url, so I can download and scan this end.

I've fixed a couple of the FP's already, so thanks for pointing them out.

Cheers,

Steve
Sanesecurity

AR15USR · Sep 20, 2016, 4:15 PM

Sanesecurity, good to see you here!

I have several. How would you like me to get those to you?

AR15USR · Sep 20, 2016, 4:18 PM

@Peen:

Any insight on my previous post? Set it up as instructed. The DB's all update, and I checked the DB's were there. But I don't see them being applied. Also doesn't seem to be blocking anything more in my tests.

This is what my DB says…

Squid Version 3.5.19_1
Antivirus Scanner ClamAV 0.99.2 C-ICAP 0.4.3 + SquidClamav 6.10
Antivirus Bases
Database Date Version Builder
daily.cld 2016.09.19 22224 neo
bytecode.cvd 2016.06.23 283 neo
main.cvd 2016.03.16 57 amishhammer
Last Update Mon Sep 19 17:03:48 2016
Statistics Found 3 virus(es) total.

Based on the logs you posed above it looks like its working. I don't get the additional databases showing up in the dashboard widget either, but I know they are working due to the blocking happening. Also when I run freshclam I see them updating.

I'm guessing the Squid Antivirus Widget doesn't report on custom databases, would be nice to have that fixed.

Peen · Sep 20, 2016, 6:09 PM

Good to know it's working and you have the same thing happening. I did try to open that link you posted with the icon.lsr and it did let me download it. On the WICAR malware test page, I get some blocks so I do know ClamAV is working.