Wisdom from the Sawtooth Software Conference


My friend Jon Godin, CMB's Director of Analytic Services, is a brilliant guy but clearly never feels quite smart enough. So he recently attended the Sawtooth Software Conference to lean more about the latest and greatest trade off tools and techniques. We'll be posting some of what he learned over the coming weeks. First up is a presentation from our friend Chris Goglia at Critical Mix.... Here is the abstract from his presentation.

“To Drag-n-Drop or Not? Do Interactive Survey Elements Improve the Respondent Experience and Data Quality?” by Chris Goglia and Alison Strandberg Turner:

Abstract: Chris Goglia presented a paper on the increasing demand for interactive survey elements in questionnaires (like sliders instead of rating scales and drag-and-drop functionality instead of numeric rankings). What they found is that these interactive elements increase time-to-complete but there were not significant differences in the resulting data. Furthermore, other studies on slider bars suggest that the use of sliders will result in a higher dropout rate, longer response times, more missing data, and no improvement in the resulting distributions of data. Interactive elements may be more appropriate for certain (i.e., younger) audiences who are more used to experiencing and using these types of activities online, however, older audiences may actually experience a lot of trouble using them.


So the upshot is that you should be very careful in using these interactive elements in studies, as they may increase engagement for some, but may actually hinder others, and they provide little to no improvement over traditional questions otherwise.


As always, think about who you are researching and adjust your plans accordingly.


Comments

Post a Comment

Popular posts from this blog

Is market research recession proof?

Bob Skolnick , North American CEO of Synovate seems to think so in this month's Marketing News... This heightened need to understand competitors and consumers may well prove a boon to the market research industry, despite the struggles of the economy at large. Bob Skolnick , North American CEO of Chicago-based market research firm Synovate , predicts "was abobe average growth" in the overall demand for data. Because of the demand for data, Skolnick notes, Synovate has been under greater pressure to yield applicable results. "Client companies need to see smart research done to make sure they are satisfying their best customers and developing new business where they can," he says. "The market research business, while not recession-proof, is much less susceptible to budgets being cut."
Keep reading

2009 Market Research Predictions, Forrester Style

Forrester's 2009 Market Research Predictions are out and if you're not a subscriber, you can at least read the executive summary here... One prediction of note: "Traditional qualitative research will see erosion as market research online communities (MROCs) and fusions of quantitative and qualitative research from firms such as Invoke Solutions gain steam. In short, everyone will be looking for ways to gain insights to succeed in a troubling market in as cost-effective a manner as possible. This means that newer research modes will gain traction and grab more share of stable or declining market research budgets — even among research buyers who have been more traditional in the past."
Keep reading

McCafe? Its Not Possible

Image
Over the weekend I noticed and more and more McCafe's popping up within my local McDonald's and am curious (cough, skeptical, cough) whether or not this can possibly work. Starbucks has done such a good job over the last few years of teaching the public that a latte requires the love and care that only Starbucks' Baristas or local coffee houses can provide in making a high end coffee that I barely trust Dunkin Donuts to make a latte correctly (and I love Dunkin in a not so healthy way!). What I certainly don't trust is that the 14 year olds who currently make a breakfast sandwich an iffy proposition care enough to even attempt to make my drink correctly. Maybe I have become a coffee snob, but I see the McCafe winding up in a room somewhere with salad McShakers and McPizzas.
Keep reading