Today, the independent testing lab AV-Test released their findings from a comprehensive review of 22 Android security apps, looking at how these portable protectors performed on handled Android devices. The competition was tight, but TrustGo and Lookout took the top slots.
The good news is that most apps faired very well in the test, with only GFI Mobile Security failing to receive AV-Test certification. Despite GFI’s abysmal 71 percent detection rate for malicious software, the average detection rate across the apps was 94 percent with a median rate of 97 percent. In general, there were very few false-positive results generated during the test.
The Whole App
Of course, security companies no longer rely on mere malware identification to define their product. Many companies provide anti-theft, secure browsing, parental controls, and data encryption with their mobile apps. What’s more, mobile security apps need to be unobtrusive and easy on battery life in order to actually be helpful. If it sucks up too much power, or disrupts the normal operation of the device, users will likely uninstall the app.
To that end, AV-Test devised a complex and multi-tiered testing methodology to not only examine battery life, user experience, and malware detection, but also the extra features for each app.
Interestingly, AV-Test looked how the anti-malware apps affected battery life by looking at their CPU usage. “Our approach is to measure the CPU time used by the Anti-Malware while known clean apps from Google Play are installed on an Android device,” wrote AV-Test. “The Anti-Malwares real-time protection feature will check the newly installed apps for malware and it will therefore consume CPU time.” AV-Test believes that this methodology is solid, but does concede that environment factors—such as temperature—might skew the results slightly.
To test the security apps, AV-Test also uses an impressively large sample set of malicious software: 850 to 1000 samples comprising 20 different families of malware. The company also tested for false-positive detection by using clean apps from the Google Play store. In each test AV-Test used an SD card pre-loaded with malware samples and performed a full system scan. Any undetected samples were accessed to gauge the software’s real-time protection capabilities.
The company looks the percent of malware detected, along with pluses and minuses for extra features and impact on the user, to deliver a total score. This is critical because, as the test showed, most security software already scores very high in malware detection and takes the whole app into account.
They require a minimum of eight points to receive certification. While TrustGo Mobile Security topped the list with 13 points and a 100% malware detection rate, it was followed closely by Lookout Antivirus & Security at 12.5 points. Trend Micro Mobile Security and Symantec Mobile Security also did very well with 12 points. Though they scored a respectable 11.5 points, both Bitdefender Mobile Security and Antiy AVL notably had a 100% malware detection rate.
See our breakdown of the results below.