VB100 certification report - October 2020

VB Test Team

Virus Bulletin

Copyright © 2020 Virus Bulletin


 

Introduction

For more than two decades, Virus Bulletin has set a minimum standard for anti-malware products – requiring them to block malicious executables that have recently been seen in the wild, while at the same time blocking few to no legitimate programs – and providing those products that live up to expectation with the VB100 ‘stamp of approval’.

This report details the VB100 certification results of 41 such products from 35 different vendors during September and October 2020.

 

The VB100 set-up

In the VB100 test, a copy of the product to be tested is installed on two platforms: Windows 10 and Windows 7. On each platform, and at three different times in the test, the product is asked to scan both the latest version of the WildList1 and a selection of clean files taken from Virus Bulletin’s own set of files belonging to widely used legitimate software.

A legitimate file that is blocked at least once is considered a false positive, while a WildList file that isn’t blocked is considered a miss.

A product achieves a VB100 certification if:

  • No more than 0.5% of WildList samples are missed

and

  • No more than 0.01% of legitimate files are blocked

For full details, we refer to the VB100 methodology on the Virus Bulletin website: https://www.virusbulletin.com/testing/vb100/vb100-methodology/vb100-methodology-ver1-1/. This test used version 1.1 of the VB100 methodology.

 

Diversity Test

The malware part of the VB100 certification uses the WildList, a regularly updated list of extremely well-vetted malware samples, guaranteed to have been spotted in the wild multiple times. This makes them very suitable for a certification test like VB100.

The ‘Diversity Test’ looks at products’ detection of another set of recent malware samples, to acknowledge the fact that products detect malware samples beyond a standard set of samples, and provides a measure of that detection.

 

Products & results

Products were allowed to download updates during the course of the test. The version numbers listed in the results that follows refer to those at the start of the test.

Acronis Cyber Protect

Windows 7 version 12.5.23140  10-20.jpg
Windows 10 version 12.5.23140 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Acronis True Image 2021

Windows 7 version Build 30480  10-20.jpg
Windows 10 version Build 30480 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Adaware Antivirus Free

Windows 7 version 12.8.1241.0  10-20.jpg
Windows 10 version 12.8.1241.0 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Adaware Antivirus Pro

Windows 7 version 12.8.1241.0  10-20.jpg
Windows 10 version 12.8.1241.0 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Ad-Spider

Windows 7 version 2020.09.15-7.85918 10-20.jpg
Windows 10 version 2020.09.07-7.85809 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.70% 

 

AhnLab V3 Endpoint Security

Windows 7 version 9.0.63.3  10-20.jpg
Windows 10 version 9.0.63.3 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Arcabit AntiVirus

Windows 7 version 2020.09.15  10-20.jpg
Windows 10 version 2020.09.07 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Avast Free Antivirus

Windows 7 version 20.7.2425  10-20.jpg
Windows 10 version 20.7.2425 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00%

 

AVG Internet Security

Windows 7 version 20.7.3140  10-20.jpg
Windows 10 version 20.7.3140 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

CORE Antivirus

Windows 7 version 1.0.48.0  10-20.jpg
Windows 10 version 1.0.48.0 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Cynet 360

Windows 7 version 8.3.62.8  10-20.jpg
Windows 10 version 8.3.62.8 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

CyRadar Endpoint Detection and Response

Windows 7 version 1.0.0.54  10-20.jpg
Windows 10 version 1.0.0.54 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Defenx Security Suite

Windows 7 version 1.7.0.5  10-20.jpg
Windows 10 version 1.7.0.5 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Emsisoft Anti-Malware

Windows 7 version 2020.9.0.10390  10-20.jpg
Windows 10 version 2020.9.0.10390 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

eScan Internet Security Suite for Windows

Windows 7 version 14.0.1400.2228  10-20.jpg
Windows 10 version 14.0.1400.2228 
WildList detection 100.0%
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

ESTsecurity ALYac

Windows 7 version 4.0.2.23116  10-20.jpg
Windows 10 version 4.0.2.23116 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 54.25% 

 

Exosphere Endpoint Protection

Windows 7 version 1.5.22.1  10-20.jpg
Windows 10 version 1.5.22.1 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Faronics Anti-Virus

Windows 7 version 4.21.3102.484  10-20.jpg
Windows 10 version 4.21.3102.484 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

FireEye Endpoint Security

Windows 7 version 32.30.0  10-20.jpg
Windows 10 version 32.30.0 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.80% 

 

Fortinet FortiClient

Windows 7 version 6.2.7.0984  10-20.jpg
Windows 10 version 6.2.7.0984 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

G DATA Antivirus

Windows 7 version 25.5.8.14  10-20.jpg
Windows 10 version 25.5.8.14 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

IKARUS anti.virus

Windows 7 version 3.1.16  10-20.jpg
Windows 10 version 3.1.16 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Intego AV

Windows 7 version 1.0.1.4  10-20.jpg
Windows 10 version 1.0.1.4 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.00% 

 

ITL Total Security

Windows 7 version 1.0.0.16  10-20.jpg
Windows 10 version 1.0.0.16 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

K7 Total Security

Windows 7 version 16.0.0652  10-20.jpg
Windows 10 version 16.0.0652 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.50% 

 

PCProtect

Windows 7 version 5.5.83  10-20.jpg
Windows 10 version 5.5.83 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Qi-ANXIN Tianqing Endpoint Security Management System

Windows 7 version v10.0 build: 6.6.0.4086  10-20.jpg
Windows 10 version v10.0 build: 6.6.0.4086 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00%

 

Rising Enterprise Security Management System

Windows 7 version 3.0.0.97  10-20.jpg
Windows 10 version 3.0.0.97 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 85.79% 

 

Scanguard

Windows 7 version 5.5.83  10-20.jpg
Windows 10 version 5.5.83 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

SecureAge SecureAPlus Pro

Windows 7 version 6.3.0  10-20.jpg
Windows 10 version 6.3.0 
WildList detection 99.7% 
False positive rate 0.001% 
Diversity Test rate 99.60% 

 

Systweak Anti-virus

Windows 7 version 1.0.1000.10447  10-20.jpg
Windows 10 version 1.0.1000.10447 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

TACHYON Endpoint Security

Windows 7 version 5.0.1.33  10-20.jpg
Windows 10 version 5.0.1.33 
WildList detection 99.8% 
False positive rate 0.000% 
Diversity Test rate 99.70% 

 

TeamViewer Endpoint Protection

Windows 7 version 20.9.1  10-20.jpg
Windows 10 version 20.9.1 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

Tencent PC Manager

Windows 7 version 12.3.26609.901  10-20.jpg
Windows 10 version 12.3.26609.901 
WildList detection 100.0%
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

TotalAV

Windows 7 version 5.5.83  10-20.jpg
Windows 10 version 5.5.83 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

Total Defense Premium

Windows 7 version 12.0.0.280  10-20.jpg
Windows 10 version 12.0.0.280 
WildList detection 99.9% 
False positive rate 0.000% 
Diversity Test rate 99.90% 

 

TUXGUARD Endpoint Protection

Windows 7 version 1.0.1.46  10-20.jpg
Windows 10 version 1.0.1.46 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

United Endpoint Protector

(See notes in Appendix 2)

Windows 7 version N/A 10-20.jpg
Windows 10 version 1.0 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 100.00% 

 

VIPRE Endpoint Cloud Business

Windows 7 version 12.0.7874  10-20.jpg
Windows 10 version 12.0.7874 
WildList detection 99.8% 
False positive rate 0.000% 
Diversity Test rate 99.80% 

 

VirIT eXplorer PRO

Windows 7 version 9.2.67  10-20.jpg
Windows 10 version 9.2.64 
WildList detection 100.0% 
False positive rate 0.000% 
Diversity Test rate 63.46% 

 

Appendix 1: products not certified

The following products did not receive VB100 certification in this test:

  • SecureAge SecureAPlus Pro with offline settings. This product failed to meet the requirements for VB100 certification.

 

Appendix 2: testing notes

  • Tabidus Technology’s United Endpoint Protector was tested only on Windows 10 as there is no Windows 7 version of the product.

 

Appendix 3: sample set sizes

The Certification Set contained 1,666 malicious samples. The set of clean samples used for the false positive test contained 99,999 files, of which 29,152 were portable executable (PE) files. The set used for the Diversity Test contained 999 malicious samples.

 

Footnotes

1 The WildList is an extremely well-vetted set of malware recently observed in the wild by researchers: http://www.wildlist.org/.

Download PDF

twitter.png
fb.png
linkedin.png
hackernews.png
reddit.png

 

Latest reviews:

VBSpam comparative review Q4 2024

In the Q4 2024 VBSpam test we measured the performance of 11 full email security solutions and one open‑source solution against various streams of wanted, unwanted and malicious emails.

VBSpam comparative review Q3 2024

The Q3 2024 VBSpam test measured the performance of ten full email security solutions and one open‑source solution.

VBSpam comparative review Q2 2024

The Q2 2024 VBSpam test measured the performance of ten full email security solutions, one custom configured solution and one open‑source solution.

VBSpam comparative review Q1 2024

The Q1 2024 VBSpam test measured the performance of nine full email security solutions, one custom configured solution and one open‑source solution.

VBSpam comparative review

The Q4 2023 VBSpam test measured the performance of eight full email security solutions, one custom configured solution, one open-source solution and one blocklist.

We have placed cookies on your device in order to improve the functionality of this site, as outlined in our cookies policy. However, you may delete and block all cookies from this site and your use of the site will be unaffected. By continuing to browse this site, you are agreeing to Virus Bulletin's use of data as outlined in our privacy policy.