Latest spam filter test shows spam catch rates have bounced back

Posted by   Virus Bulletin on   Nov 21, 2012

Spam catch rates improve, but performance on phishing lags behind that on other spam.

Earlier this week we published the results of the 22nd VBSpam comparative spam filter test, which saw 19 products win a VBSpam award.

Overall, products performed well and most products' spam catch rates improved, thus reversing a trend we reported earlier this year. The highest catch rates were achieved by OnlyMyEmail, which missed only one email in the spam feed, and Libra Esva. Both products also missed only one legitimate email out of the 12,000 sent during the 16-day test period.

Four anti-spam solutions - SpamTitan, ESET, Netmail and Halon Security - managed to avoid false positives altogether, while also catching more than 99.5 per cent of all spam. They each earned a VBSpam+ award.

For the first time, the test also included a dedicated feed of phishing emails, courtesy of Wombat Security. In general, a lot of effort goes into making phishing emails appear legitimate, and the relatively low volume of phishing campaigns compared with traditional spam campaigns also makes it harder to catch the emails.

Our test results confirmed that these emails are harder for products to filter correctly: with two exceptions (SPAMfighter and OnlyMyEmail, which both caught all the phishing emails), the products' performance on the phishing feed was worse than on other spam emails: most products caught less than 90 per cent of them, with several products putting in a significantly worse performance than this.

This is not good news. It indicates that many home and corporate users are exposed to phishing emails - some of which are very difficult to distinguish from legitimate emails. Making the mistake of believing such emails are legitimate could result in financial loss and/or identity theft - if not directly, then via the malware served by the links present in many of today's phishing emails. We hope to see some improvement in products' ability to identify phishing emails in the not-too-distant future.

The basic pass/fail results of the VBSpam test can be viewed free of charge here.

For Virus Bulletin subscribers, the full test report is available here. Non-subscribers can purchase the report as a standalone article ($19.95) here.

More on the VBSpam tests, including historical performance of the participating products, can be found here.

Posted on 21 November 2012 by Martijn Grooten



Latest posts:

VB2019 paper: Fantastic Information and Where to Find it: A guidebook to open-source OT reconnaissance

A VB2019 paper by FireEye researcher Daniel Kapellmann Zafra explained how open source intelligence (OSINT) can be used to learn crucial details of the inner workings of many a system. Today we publish Daniel's paper and the recording of his…

VB2019 paper: Different ways to cook a crab: GandCrab Ransomware-as-a-Service (RaaS) analysed in depth

Though active for not much longer than a year, GandCrab had been one of the most successful ransomware operations. In a paper presented at VB2019 in London, McAfee researchers John Fokker and Alexandre Mundo looked at the malware code, its evolution…

VB2019 paper: Domestic Kitten: an Iranian surveillance program

At VB2019 in London, Check Point researchers Aseel Kayal and Lotem Finkelstein presented a paper detailing an Iranian operation they named 'Domestic Kitten' that used Android apps for targeted surveillance. Today we publish their paper and the video…

VB2019 video: Discretion in APT: recent APT attack on crypto exchange employees

At VB2019 in London, LINE's HeungSoo Kang explained how cryptocurrency exchanges had been attacked using Firefox zero-days. Today, we publish the video of his presentation.

VB2019 paper: DNS on fire

In a paper presented at VB2019, Cisco Talos researchers Warren Mercer and Paul Rascagneres looked at two recent attacks against DNS infrastructure: DNSpionage and Sea Turtle. Today we publish their paper and the recording of their presentation.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.