December 07, 2009 08:57 ET

uTest "Battle of the E-Tailers" Uncovers More Than 500 Bugs in, and

Software Testing Leader Holds Competition to Compare E-Tailers Based on Pricing, Usability, Product Search and Other Feature Sets

BOSTON, MA--(Marketwire - December 7, 2009) - uTest, the world's largest software testing marketplace, today announced the results of its E-Tailer Bug Battle. Nearly 600 uTesters from 20+ countries around the world participated in the quarterly competition, reporting a total of 505 technical, functional, security and GUI bugs in, and

The uTest community also ranked the e-tailers for best product search, pricing, reviews and ratings, product comparison tools and usability. emerged as the clear leader, followed by, leaving a distant third (see full Bug Battle report for details).

Top-Line Findings:

  • had the most reported bugs (261), followed by (150) and Amazon (94).
  • Amazon ranked highest in most categories (pricing, ease of use, product reviews), while Walmart ranked highest in product search tools and also earned good marks for pricing.
  • ranked lowest in all five categories and accounted for 261 bugs, more than half of all bugs reported in the competition.
  • 67% did not choose "lowest prices" when asked to identify their most important criteria (as was unexpected given the current economy). Said differently, only 1 in 3 chose lowest prices as their primary decision making criteria.
  • Nearly 75% of all survey respondents said they trust Amazon most for their holiday shopping.

E-Tailer Comparison (Top-two box score of testers who rated each site as "excellent" or "good"):

                               AMAZON    WALMART    TARGET
Price Competitive               66%        65%        29%
Ease of Use                     72%        56%        41%
Product Search Capability       71%        74%        46%
User Reviews & Ratings          76%        40%        34%
Product Comparison Tools        62%        50%        25%

Final Bug Battle Results:

    • 94 bugs reported
    • 11% classified as "showstoppers"
    • 21% Technical, 67% Functional and 12% GUI
    • 150 bugs reported
    • 9% classified as "showstoppers"
    • 23% Technical, 54% Functional and 23% GUI
    • 261 bugs reported
    • 7 percent classified as "showstoppers"
    • 20% Technical, 56% Functional and 25% GUI

"According to a recent Forrester Research report, online sales are expected to reach $44.7 billion during November and December -- a year-over-year increase of 8%," said uTest VP of Marketing and Community, Matt Johnston. "The purpose of this Bug Battle was to compare the three leading e-tailers, as well as to demonstrate that application quality matters a great deal to online shoppers. The uTest community once again demonstrated how quickly they can mobilize to provide professional testing coverage and usability feedback for any application."

Detailed results of this study are available at

About uTest, Inc.
uTest is the world's largest marketplace for software testing services. The company provides real-world testing services through its community of 21,000+ professional testers from 159 countries around the world. More than 1,000 companies -- from web startups to global software leaders -- have signed up for the uTest marketplace to get their web, desktop and mobile applications tested. More information can be found at or the company's Software Testing Blog at

Contact Information