Alternate definitions for ClamAV

Stewart

Yes, they are free definitions although donations wouldn't hurt and are accepted. I don't think we can just add them under optional servers. The way I read it is that the optional servers will just download the predefined definitions from another place. These need to be added manually to the freshclam.conf location to see the additional files. At least that's how I read it. I haven't tried it so I may be wrong.

AR15USR

I'd be interested in adding the Sane Security definitions to ClamAV. Please give us the 'How To' scoop when you are able..

johnabbot

I would be very interested in adding this as well.

AR15USR

OP, any more light you can shed on this?

johnabbot

Any update on this?

The current ClamAV definitions are pretty useless, they don't even detect Regin a year after it was disclosed.

Stewart

I thought I would get notices about new postings in the thread. Just came back to check and noticed there had been some activity. I'm so sorry and don't want to leave everyone hanging.

The updates can be changed in Services -> Squid Proxy Server -> Antivirus
1. Enable Manual Configuration
2. Click Load Advanced to load the default files for editing.
(I think at this point you need to save)
3. Click Show Advanced Options
4. Make the changes in the DatabaseCustomURL section of freshclam.conf

The additions I've used are:
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/junk.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/phish.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/rogue.hdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/foxhole_filename.cdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/foxhole_generic.cdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/foxhole_js.cdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/badmacro.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/scam.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sanesecurity.ftm
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sigwhitelist.ign2

(Click Save)
(At this point you may or may not need to go back to the General Tab and re-save.)

As all this appears to be freely and openly distributed I'm confident I can share this. However, I can't vouch for how long these files will be hosted at this mirror as there was a bandwidth concern expressed to me. I would love it if pfSense would host it or provide some alternate mirror but at this point it seems we are on our own. These definitions have worked well for me. @Pippin did mention that the foxhole definitions (when exclusively check inside archives) blocked an Adobe update so YMMV.

I'll keep checking this thread so that any further discussion doesn't get overlooked again.

Peen

Thanks for the how to,

How do you know for sure if it's working in pfSense?

My ClamAV update logs looks ok (at first they were failing)

Message
bytecode.cvd is up to date (version: 283, sigs: 53, f-level: 63, builder: neo)
daily.cld is up to date (version: 22205, sigs: 609122, f-level: 63, builder: neo)
main.cvd is up to date (version: 57, sigs: 4218790, f-level: 60, builder: amishhammer)
sigwhitelist.ign2 is up to date (version: custom database)
sanesecurity.ftm is up to date (version: custom database)
scam.ndb is up to date (version: custom database)
badmacro.ndb is up to date (version: custom database)
foxhole_js.cdb is up to date (version: custom database)
foxhole_generic.cdb is up to date (version: custom database)
foxhole_filename.cdb is up to date (version: custom database)
rogue.hdb is up to date (version: custom database)
phish.ndb is up to date (version: custom database)
junk.ndb is up to date (version: custom database)
ClamAV update process started at Mon Sep 12 17:00:00 2016
–------------------------------------
bytecode.cvd is up to date (version: 283, sigs: 53, f-level: 63, builder: neo)
daily.cld is up to date (version: 22205, sigs: 609122, f-level: 63, builder: neo)
main.cvd is up to date (version: 57, sigs: 4218790, f-level: 60, builder: amishhammer)
sigwhitelist.ign2 is up to date (version: custom database)
sanesecurity.ftm is up to date (version: custom database)
scam.ndb is up to date (version: custom database)
badmacro.ndb is up to date (version: custom database)
foxhole_js.cdb is up to date (version: custom database)
foxhole_generic.cdb is up to date (version: custom database)
foxhole_filename.cdb is up to date (version: custom database)
rogue.hdb is up to date (version: custom database)
phish.ndb is up to date (version: custom database)
junk.ndb is up to date (version: custom database)
ClamAV update process started at Mon Sep 12 16:00:00 2016

bytecode.cvd is up to date (version: 283, sigs: 53, f-level: 63, builder: neo)
daily.cld is up to date (version: 22205, sigs: 609122, f-level: 63, builder: neo)
main.cvd is up to date (version: 57, sigs: 4218790, f-level: 60, builder: amishhammer)
sigwhitelist.ign2 is up to date (version: custom database)
sanesecurity.ftm is up to date (version: custom database)
scam.ndb is up to date (version: custom database)
badmacro.ndb is up to date (version: custom database)
foxhole_js.cdb is up to date (version: custom database)
foxhole_generic.cdb is up to date (version: custom database)
foxhole_filename.cdb is up to date (version: custom database)
rogue.hdb is up to date (version: custom database)
phish.ndb is up to date (version: custom database)
junk.ndb is up to date (version: custom database)
ClamAV update process started at Mon Sep 12 15:00:00 2016

But when I look here, I don't see them being a part of the DB? If I go to the sanesecurity website and check out the signature testing link, it gets blocked. I tried using a different connection to email myself the tests, but it didn't seem to do anything.

ClamAV_DB.JPG_thumb

SaneSecurity.JPG_thumb

johnabbot

my update log is also ok but in Squid Anti-Virus on the dashboard I see this

Statistics Unknown (no log exists)

Have I set up ClamAV correctly?

Anyone else get this?

AR15USR

@johnabbot:

my update log is also ok but in Squid Anti-Virus on the dashboard I see this

Statistics Unknown (no log exists)

Have I set up ClamAV correctly?

Anyone else get this?

Maybe you haven't detected a virus yet, so nothing to show?

AR15USR

I am having a lot of legitimate updates being blocked by these additional definitions. I do till see a lot of traffic from these same apps/vendors (Apple, Sophos, Adobe, MS) making it through still though.

Here a a few examples:

Date-Time	Message	Virus	URL	Host	User
16.09.2016 21:46:03	VIRUS FOUND	Sanesecurity.Foxhole.Zip_JsNum_wrd.UNOFFICIAL	http://appldnld.apple.com/ios10.0/...[i]/com_apple_MobileAsset_CoreSuggestions/6a3ed2b4a6e1de61c084583a57a0efdff20d2b48.zip	-	-

16.09.2016 17:24:44	VIRUS FOUND	Sanesecurity.Foxhole.Zip_fs211.UNOFFICIAL	http://d1.sophosupd.com/update/5bd003b17a6fd2d057620295800499acx000.dat	-	-

16.09.2016 17:17:06	VIRUS FOUND	Sanesecurity.Foxhole.Zip_doc_js.UNOFFICIAL	http://bg2.v4.a.dl.ws.microsoft.com/dl/content/c/updt/2016/09/19c9cb69-f6ed-49d2-81d5-24c8f4de9cb9_96035d20a923a671f386073b34d004fa5125bd7b.appxbundle?P1=1474071897

5.09.2016 05:12:44	VIRUS FOUND	Sanesecurity.Foxhole.Zip_jsname.UNOFFICIAL	http://a1.mzstatic.com/us/r30/Purple71/v4/6d/30/a2/6d30a250-66eb-9f40-80d9-07fa321fe70f/icon1280x768.lsr

I have removed the Foxhole definitions source from freshclam but that hasn't stopped the blocks above. Here is my additional definitions list:

[code]DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/junk.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/phish.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/rogue.hdb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/badmacro.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/scam.ndb
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sanesecurity.ftm
DatabaseCustomURL http://ftp.swin.edu.au/sanesecurity/sigwhitelist.ign2[/code]

Any thoughts/ideas?

Edit: Maybe the "icon1280x768.lsr is a legit virus? 
https://www.virustotal.com/en/file/7f2c0860d6810f8557cf921f1604c01da5f4eae5155bdbf53ed7cafb2d6aeb3a/analysis/

The mzstatic.com domain is an apple domain I believe.[/i]

Stewart

The Foxhole definitions are the ones responsible for scanning inside of Zip files I believe. If it's still being blocked then what is it saying is blocking it? If it still says Foxhole then there should be some way of clearing those definitions out of ClamAV. Maybe a Freshclam? I'm not sure.

Looking at the virustotal link it appears it is not a virus so maybe it is a false positive?

AR15USR

Stewart you can see in my above post, in the first 'code' section it reports that sane security.foxhole.xxx is the responsible database(s). I'm not exactly sure which that is though.

I removed the 3 foxhole databases and it still blocked. I have just removed the sanesecurity database and I will see if it still blocks.

In the end I might try and reporting the blocks to SaneSecurity as false positives and see what they say. Although on their site they say and database with 'unofficial' on it is not theirs.

Peen

Any insight on my previous post? Set it up as instructed. The DB's all update, and I checked the DB's were there. But I don't see them being applied. Also doesn't seem to be blocking anything more in my tests.

This is what my DB says…

Squid Version 3.5.19_1
Antivirus Scanner ClamAV 0.99.2 C-ICAP 0.4.3 + SquidClamav 6.10
Antivirus Bases
Database Date Version Builder
daily.cld 2016.09.19 22224 neo
bytecode.cvd 2016.06.23 283 neo
main.cvd 2016.03.16 57 amishhammer
Last Update Mon Sep 19 17:03:48 2016
Statistics Found 3 virus(es) total.

sanesecurity

Hi All,

Just popped in to say if you find any more FP's on files with foxhole_filename.cdb

I'll need a direct file download url, so I can download and scan this end.

I've fixed a couple of the FP's already, so thanks for pointing them out.

Cheers,

Steve
Sanesecurity

AR15USR

Sanesecurity, good to see you here!

I have several. How would you like me to get those to you?

AR15USR

@Peen:

Any insight on my previous post? Set it up as instructed. The DB's all update, and I checked the DB's were there. But I don't see them being applied. Also doesn't seem to be blocking anything more in my tests.

This is what my DB says…

Squid Version 3.5.19_1
Antivirus Scanner ClamAV 0.99.2 C-ICAP 0.4.3 + SquidClamav 6.10
Antivirus Bases
Database Date Version Builder
daily.cld 2016.09.19 22224 neo
bytecode.cvd 2016.06.23 283 neo
main.cvd 2016.03.16 57 amishhammer
Last Update Mon Sep 19 17:03:48 2016
Statistics Found 3 virus(es) total.

Based on the logs you posed above it looks like its working. I don't get the additional databases showing up in the dashboard widget either, but I know they are working due to the blocking happening. Also when I run freshclam I see them updating.

I'm guessing the Squid Antivirus Widget doesn't report on custom databases, would be nice to have that fixed.

Peen

Good to know it's working and you have the same thing happening. I did try to open that link you posted with the icon.lsr and it did let me download it. On the WICAR malware test page, I get some blocks so I do know ClamAV is working.

sanesecurity

@AR15USR:

Sanesecurity, good to see you here!

I have several. How would you like me to get those to you?

You can copy/paste the links and I'll download them with wget to test.
or perhaps you can pop them into dropbox or some other file storage and send me the link.

Cheers,

Steve
Sanesecurity.com

Stewart

@Peen:

Any insight on my previous post? Set it up as instructed. The DB's all update, and I checked the DB's were there. But I don't see them being applied. Also doesn't seem to be blocking anything more in my tests.

This is what my DB says…

Squid Version 3.5.19_1
Antivirus Scanner ClamAV 0.99.2 C-ICAP 0.4.3 + SquidClamav 6.10
Antivirus Bases
Database Date Version Builder
daily.cld 2016.09.19 22224 neo
bytecode.cvd 2016.06.23 283 neo
main.cvd 2016.03.16 57 amishhammer
Last Update Mon Sep 19 17:03:48 2016
Statistics Found 3 virus(es) total.

If you run a freshclam and see them updating then they are in there. What if you download a file to the box and run a clamscan on it? If it catches it then it may be a proxy integration thing.

AR15USR

@Stewart:

@Peen:

Any insight on my previous post? Set it up as instructed. The DB's all update, and I checked the DB's were there. But I don't see them being applied. Also doesn't seem to be blocking anything more in my tests.

This is what my DB says…

Squid Version 3.5.19_1
Antivirus Scanner ClamAV 0.99.2 C-ICAP 0.4.3 + SquidClamav 6.10
Antivirus Bases
Database Date Version Builder
daily.cld 2016.09.19 22224 neo
bytecode.cvd 2016.06.23 283 neo
main.cvd 2016.03.16 57 amishhammer
Last Update Mon Sep 19 17:03:48 2016
Statistics Found 3 virus(es) total.

If you run a freshclam and see them updating then they are in there. What if you download a file to the box and run a clamscan on it? If it catches it then it may be a proxy integration thing.

2 days with no more of the FP's. Looks like they are fixed, thanks sanesecurity…