MRG Effitas Q2 2019 360 Degree Assessment and Certification

Test Lab

MRG Effitas

Test Title

MRG Effitas Q2 2019 360 Degree Assessment and Certification

AMTSO Test ID

AMTSO-LS1-TP010

Platform

Windows

Vendor

AVAST, Avira, Bitdefender, CrowdStrike, ESET, F-Secure, Kaspersky, McAfee, Microsoft, Sophos, Symantec, Trend Micro

Publication date

2019-08-21

Statement from Test Lab

“A first-of-its-kind test that covers all angles, our pioneering 360 Degree Protection Test targets the key threats faced by internet users. In each test case we employ the full spectrum of Early Life Malware. We use a Time-To-Detect metric to measure how long it takes each application to detect and neutralize missed threats.”

Tested products

VendorProductVendor status
AVASTBusiness Antivirusparticipant
AviraAntivirus Proparticipant
BitdefenderEndpoint Securityparticipant
CrowdStrikeFalcon Protectparticipant
ESETEndpoint Securityincluded
F-SecureComputer Protection Premiumparticipant
KasperskySmall Office Securityparticipant
MicrosoftWindows Defenderincluded
McAfeeEndpoint Securityincluded
SophosIntercept Xparticipant
SymantecEndpoint Protectionparticipant
Trend MicroWorry-Free Business Securityincluded

AMTSO Standard compliance info

Notification issued

2019-04-09

Notification method

Publicly posted test plan, Contact list notification

Test plan

Commencement date

2019-04-23

Participants

7
These Vendors chose to adopt Participant status under the AMTSO Standard, gaining certain guaranteed rights in return for attestations.

“Included” Vendors

5

These Vendors did not chose to adopt Participant status under the AMTSO Standard, but may have engaged with the test lab in other ways.

Commentary dates
CommentaryStart dateEnd date
Phase 1 Commentary2019-05-092019-05-17
Phase 2 Commentary2019-08-262019-09-03

Commentary received

VendorCommentary phaseComment
SymantecPhase 1

Section 4.b: The Window File Explorer has an known issue that incorrectly reports the actual disk utilization where ‘hardlinks’ are used with applications. Norton Security uses hardlinks and Windows File Explorer incorrectly repots the amount of space being used by Norton Security. For the detailed description of Windows File Explorer, please refer to the Microsoft documentation (https://blogs.technet.microsoft.com/mrsnrub/2008/10/25/dont-trust-all-your-eyes-tell-you-hard-links-in-windows-vista/). Our recommendation is to consider using an advanced tool called ‘Disk Usage’ from Microsoft. The tool is available at this link https://docs.microsoft.com/en-us/sysinternals/downloads/du and it reports the correct and accurate disk utilization of Windows applications. We can provide a document that has an example of Windows Explorer is reporting a disk utilization of 9.10 TB where the actual size of C drive is only 753GB. Section 4.d: “”Working set”” displayed in the task manager is not a good representation of how much memory is being used by a process. A better reflection would be “”virtual private bytes”” as a measure. General performance: c. 3 iterations for evaluating performance is too less. Ideally the each set should consist of at least 10 iterations.

AMTSO Standard compliance status

Confirmed compliant with AMTSO Standard v1.1Compliance Report