Click here to Skip to main content
15,891,906 members

Survey Results

Do you test your applications using real, live users?

Survey period: 20 May 2013 to 27 May 2013

Do you test against actual users, or rely on those closest to the product? "Real user" means someone who would use your product day-to-day and who wasn't involved in any aspect of development (other than testing)

OptionVotes% 
Yes, we test against real users45242.40
We sometimes test against real users28827.02
We rarely test against real users14513.60
We never test against real users. All testing is done in-house.18116.98



 
General"Against real users" Pin
_Amy23-May-13 18:00
professional_Amy23-May-13 18:00 
GeneralChimpanzees make better testers than humans Pin
Vivi Chellappa22-May-13 15:59
professionalVivi Chellappa22-May-13 15:59 
GeneralSoftware is a war PinPopular
Nelek22-May-13 6:32
protectorNelek22-May-13 6:32 
GeneralRe: Software is a war Pin
Brisingr Aerowing23-May-13 17:00
professionalBrisingr Aerowing23-May-13 17:00 
GeneralUse the CP Test Case Pin
Nagy Vilmos21-May-13 4:52
professionalNagy Vilmos21-May-13 4:52 
GeneralIt's the last test before official release to production... Pin
AlexCode20-May-13 22:45
professionalAlexCode20-May-13 22:45 
GeneralWe also test our users, using the application PinPopular
Joezer BH20-May-13 21:21
professionalJoezer BH20-May-13 21:21 
GeneralRe: We also test our users, using the application Pin
Tim Corey21-May-13 6:09
professionalTim Corey21-May-13 6:09 
GeneralWe keep them... PinPopular
CDP180220-May-13 19:25
CDP180220-May-13 19:25 
GeneralWe leave a few bugs PinPopular
HaBiX20-May-13 9:09
HaBiX20-May-13 9:09 
GeneralMostly Against Real Users Pin
Matt U.20-May-13 8:28
Matt U.20-May-13 8:28 
GeneralUnfortunately Pin
Clifford Nelson20-May-13 7:42
Clifford Nelson20-May-13 7:42 
GeneralSometimes, in-house testing is impractical Pin
Gary Wheeler20-May-13 7:03
Gary Wheeler20-May-13 7:03 
Generalaltho sometimes it seems like they're ... dead Pin
Peter N Roth20-May-13 6:04
Peter N Roth20-May-13 6:04 
GeneralOmega Test Pin
Pualee20-May-13 4:43
Pualee20-May-13 4:43 
Generalalways being tested Pin
Dennis E White20-May-13 4:23
professionalDennis E White20-May-13 4:23 
General"against" Pin
Marc Clifton20-May-13 3:53
mvaMarc Clifton20-May-13 3:53 
Interesting choice of words. As in, we beat our software against the user's head. Probably not that far from the truth, although it can be mutual, they then beat the bug reports against the developer's head.

But it also smacks (pun intended) of a sort of "us and them" attitude. I much prefer the soft glove, the new age, touchy-feely "we test WITH the user", following the mantra of "it's so much more productive to work together as a team", barf, barf.

That said, I do experience that when testing is done with the user, and as early as possible (frankly, I see no reason not to get rid of the QA department, replacing with automated integration / acceptance tests the ornery people who don't know how to even write down accurately what they did) the result is a much more productive-enhancing product.

Then again, that requires that the user is engaged and interested and devotes time to testing. It requires that the user isn't a burnt out shell of an underpaid and overabused participant in a servitude-based social order, but is actually motivated to improve the quality of their lives and the quality of the company's process and product.

Everyone is my enemy, myself being the worst. Wink | ;)

Marc

Generalwe test against real users Pin
chriselst20-May-13 3:18
chriselst20-May-13 3:18 
GeneralEveryone tests against users: release to production PinPopular
newton.saber20-May-13 2:22
newton.saber20-May-13 2:22 
GeneralRe: Everyone tests against users: release to production PinPopular
Nemanja Trifunovic20-May-13 2:27
Nemanja Trifunovic20-May-13 2:27 
GeneralRe: Everyone tests against users: release to production Pin
Brian Schummer23-May-13 5:22
Brian Schummer23-May-13 5:22 
AnswerWe do... lots of testing Pin
Joan M20-May-13 1:59
professionalJoan M20-May-13 1:59 
GeneralRe: We do... lots of testing Pin
R. Erasmus22-May-13 1:21
R. Erasmus22-May-13 1:21 
GeneralDammed right we do Pin
Mycroft Holmes20-May-13 0:50
professionalMycroft Holmes20-May-13 0:50 
GeneralSort of... Pin
Sander Rossel20-May-13 0:15
professionalSander Rossel20-May-13 0:15 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.