Posted by: David Harley | August 4, 2010

Out of the Shadows

I came across an interesting article at Shadowserver which doesn’t directly mention AMTSO, but I suspect that freed0 had in mind some of the recent controversy on the AMTSO blog and in other blogs and articles.

However, the the article “Of Opinions and Anti-Virus Testing” mainly describes what he calls as Shadowserver’s testing. I’m not altogether convinced that this is testing in the sense of product testing at all, and while he’s equivocal about whether it’s meant to be comparative testing, I guess it’s inevitable that people are tempted to use it as a means of ranking products according to the percentage of detections. I don’t think this really works because it’s a long way from being whole product testing.

Still, an interesting blog, though I can’t say I’ve come across those criticisms in reference to Shadowserver at all. Interesting 0-day detection statistics, too: I’ll be spending some more time tracking those, I think, though probably not in the comparative testing context.

David Harley CITP FBCS CISSP
ESET Senior Research Fellow

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Categories

%d bloggers like this: