Consumer Reports - SEPTEMBER 2007 - Best Security Software

Question

The following summary of rankings are from CR's website, which is scanty on details as to testing. It appears that tests from suites were extrapolated to compare with the stand-alones, for AV and AS tests, which might well skew the results.

More info might be available if you purchase the magazine. If so, please feel free to let us all know if I am wrong in any assumptions!

Software Suites

1.Trend Micro PC-cillin Internet Security 2007
2.Check Point ZoneAlarm Internet Security Suite 7.0
3.McAfee Total Protection 2007
4.McAfee Internet Security Suite 2007
5.Microsoft Live OneCare
6.BitDefender Internet Security 10
7.F-Secure Internet Security 2007
8.Symantec Norton 360
9.Symantec Norton Internet Security 2007

---------------------------------------------------

Antivirus Programs

1.Trend Micro AntiVirus plus AntiSpyware (PC-cillin Internet Security 2007)
2.Check Point ZoneAlarm Antivirus (Internet Security Suite 7.0)
3.Microsoft Windows Live OneCare (Vista) 1.5
4.BitDefender Antivirus (Internet Security) 10
5.McAfee ViruScan Plus (Internet Security Suite) 2007
6.Symantec Norton Antivirus (Internet Security) 2007
7.Kaspersky Labs Anti-Virus 6.0
8.Symantec Norton Antivirus (for Macintosh) 10.1
9.F-Secure Anti-Virus (Internet Security) 2007
10.CA/eTrust Antivirus 2007
11.Alwil avast! Home Edition 4.7 [ rated as the best pick for free AVs]
12.Grisoft AVG Anti-Virus Free 7.5

Notes:
-Ranking is based on "Overall" score, which includes detection, features, ease of use, scan speed.
-As far as I can tell, they did not test the standalone AVs (with the exception of KAV 6.0, NAV for Macintosh 10.1, CA/eTrust, avast! 4.7, and AVG Free 7.5), but extrapolated findings from the Suites. Thus I can't be sure that "features" found only in suites did not affect the ranking.
- They only tested the 9 apps listed/ranked. Conspicuous by their absence in this test are Avira's AntiVir, and Eset's Nod32.

--------------------------------------

Antispyware Programs

1.Trend Micro AntiSpyware (PC-cillin Internet Security 2007)
2.Sunbelt Software CounterSpy 2
3.F-Secure Internet Security 2007
4.McAfee Internet Security 2007
5.BitDefender Internet Security 10
6.Check Point ZoneAlarm Anti-Spyware (Internet Security Suite 7.0)
7.Microsoft Windows Defender ( a Quick Pick recommended free app)
8.PCTools Spyware Doctor 5.0
9.Webroot Spy Sweeper 5.3
10.Spybot - Search & Destroy 1.4 [a Quick Pick recommended free app]
11.Symantec Norton Internet Security 2007
12.Lavasoft Ad-Aware SE Plus [ the paid version. SE free, and 2007 not tested]

Notes:
- Again, it appears that apps from both security suites, and from some stand-alones are compared.
- Again, only apps tested were ranked. Conspicuous by their absence in this test: SuperAntiSpyware, AVG AntiSpyware, Ad-Aware 2007, and a-squared 3.0

Message Edited by joe53 on 08-09-2007 10:56 PM

Bugbatter · Answer

Our issue arrived last week. I was disappointed and noticed right away that NOD32 and Super AntiSpyware were missing. The magazine was also "scanty on details as to testing". The tests were done last spring. CR noted that the version of Ad-aware tested has been discontinued and the 2007 version (released June 7) will be tested and results posted online.

The article mentions that testing was done by their labs and "an independent research lab". They "used real malware, including slightly modified versions of those found online". I wonder what that means??

joe53 · Answer

Thanks, BB.

One of the problems with research published in the print/hard copy media is the time lag factor.

In the field I work in, it is not so important, but with computers, a few months can equal a new generation! So if CR releases test results on its website to co-incide with its print copy, I guess one has to take it with a grain of salt.

This is from CR's website:

"For our antivirus and antispyware tests, we enlisted help from Independent Security
Evaluators (ISE), a computer security consulting firm. ISE's presidsent, Avi Rubin, is
a former technical advisory board member of a company acquired by software vendor
McAfee before ISE began work for Consumer Reports. He continues to act as an adviser
to that company and was not involved in our testing."

My interpretation of that is:

"Consumer Reports enlisted help from a firm whose president is an advisor to McAfee.
But he didn't influence our recommendations".

Take it FWIW.

Message Edited by joe53 on 08-10-2007 01:17 AM

ky331 · Answer

joe,   you (probably quoting CR) used the term 'Quick Pick'... in both cases, for a free application.   Did they define what is meant by 'Quick Pick'???   For example, does it mean anything more than being 1) 'decent' & 2) FREE ???

Bugbatter · Answer

'Ratings rank products by performance and features. Quick Picks also considers value.' It appears that there are 'Quick Picks' for paid software and also 'Quick Picks' for free versions.

joe53 · Answer

Sorry, I should have listed CR's Quick Picks for the paid products as well:   Security suites:- Trend Micro PC-cillin Internet Security 2007 ( $50 to buy, $50 to renew) - Check Point ZoneAlarm Internet Security Suite 7.0 ( $50/$35) - McAfee Total Protection 2007 ( $80/$80) - McAfee Internet Security Suite 2007 ( $70/$70) Antivirus:- Trend Micro Antivirus plus AntiSpyware ( $40/$40) - Check Point ZoneAlarm Antivirus 7.0 ( $30/$20)   Antispyware:- Trend Micro AntiSpyware 2007 ( $30/$30) - Sunbelt CounterSpy 2 ( $20/$15) ----------------------------------------------- Not what I would recommend. To be honest,  for the money I think one would be better off investing in a hardware firewall/router. (A one-time expense).

MoneyGuyBK · Answer

That is the exact reason I asked for Trend Micro when I ordered my Beast from Dell. But due to their advertising alliance, Dell made me take McAfee.  I even offered to pay the difference for their price to get TM's PCCillin suite :smileysurprised: .... and Dell refused.  :smileymad:   *** And I thought Dell advertised they make PCs just for me?  :smileymad: I sure hope Dell is reading this and does something to remedy customer concerns.   Peace   joe53 wrote: The following summary of rankings are from CR's website, which is scanty on details as to testing. It appears that tests from suites were extrapolated to compare with the stand-alones, for AV and AS tests, which might well skew the results.   More info might be available if you purchase the magazine. If so, please feel free to let us all know if I am wrong in any assumptions!   Software Suites   1.Trend Micro PC-cillin Internet Security 20072.Check Point ZoneAlarm Internet Security Suite 7.0 3.McAfee Total Protection 20074.McAfee Internet Security Suite 20075.Microsoft Live OneCare 6.BitDefender Internet Security 10 7.F-Secure Internet Security 2007 8.Symantec Norton 360 9.Symantec Norton Internet Security 2007   ---------------------------------------------------   Antivirus Programs   1.Trend Micro AntiVirus plus AntiSpyware (PC-cillin Internet Security 2007)2.Check Point ZoneAlarm Antivirus (Internet Security Suite 7.0) 3.Microsoft Windows Live OneCare (Vista) 1.5 4.BitDefender Antivirus (Internet Security) 10 5.McAfee ViruScan Plus (Internet Security Suite) 20076.Symantec Norton Antivirus (Internet Security) 2007 7.Kaspersky Labs Anti-Virus 6.0 8.Symantec Norton Antivirus (for Macintosh) 10.1 9.F-Secure Anti-Virus (Internet Security) 2007 10.CA/eTrust Antivirus 2007 11.Alwil avast! Home Edition 4.7 [ rated  as the best  pick for free AVs] 12.Grisoft AVG Anti-Virus Free 7.5   Notes:-Ranking is based on 'Overall' score, which includes detection, features, ease of use, scan speed.-As far as I can tell, they did not test the standalone AVs (with the exception of  KAV 6.0, NAV for Macintosh 10.1, CA/eTrust, avast! 4.7, and AVG Free 7.5), but extrapolated findings from the Suites. Thus I can't be sure that 'features' found only in suites did not affect the ranking.- They only tested the 9 apps listed/ranked. Conspicuous by their absence  in this test are Avira's AntiVir, and Eset's Nod32.   --------------------------------------   Antispyware Programs   1.Trend Micro AntiSpyware (PC-cillin Internet Security 2007)2.Sunbelt Software CounterSpy 2 3.F-Secure Internet Security 2007 4.McAfee Internet Security 20075.BitDefender Internet Security 10 6.Check Point ZoneAlarm Anti-Spyware (Internet Security Suite 7.0) 7.Microsoft Windows Defender ( a Quick Pick recommended free app)8.PCTools Spyware Doctor 5.0 9.Webroot Spy Sweeper 5.3 10.Spybot - Search & Destroy 1.4 [a Quick Pick recommended free app] 11.Symantec Norton Internet Security 2007 12.Lavasoft Ad-Aware SE Plus  [ the paid version. SE free, and 2007 not tested]   Notes:- Again, it appears that apps from both security suites, and from some stand-alones are compared.- Again, only apps tested were ranked. Conspicuous by their absence in this test: SuperAntiSpyware, AVG AntiSpyware, Ad-Aware 2007, and a-squared 3.0               Message Edited by joe53 on 08-09-2007 10:56 PM

MaximusHQ · Answer

Consumer reports isn't where I would go to get any idea on how a security app performs or compares to others. Consumer reports should stick to maytags or whatever they review there normally.

joe53 · Answer

MaximusHQ   It certainly was not my intention to endorse CR's recommendations. It appears that they limited their evaluations mainly to the security suites that are commonly pre-installed on new systems, and extrapolated findings from these suite evaluations to rank the stand-alone AVs.   But CR is a respected organization, and when the topic of 'Best AV' comes up again in these boards, as it periodically does, no doubt that some will quote CR to support their favorite. I posted merely to outline the limitations of CR's tests.

MaximusHQ · Answer

I realize that you posted this without endorsing CR's recommendations and didn't mean to imply that. I just have seen this posted on different message boards lately and it's funny to see that in some cases people actually take CR seriously when it comes to security apps. I am surprised that CR even gets into security apps. Seems like it is out of their scope a bit.

Virus & Spyware

Consumer Reports - SEPTEMBER 2007 - Best Security Software

Was this post helpful?