Popular searches

Request consultation

Do you need support in running a pricing or product study? We can help you with agile consumer research and conjoint analysis.

Looking for an online survey platform?

Conjointly offers a great survey tool with multiple question types, randomisation blocks, and multilingual support. The Basic tier is always free.

Back
Getting participants for your study
List of articles Back

Get Quick Feedback on Your Survey

If you want to “try before you buy”, i.e. test a survey and see potential research outputs ahead of launching it with your target audience, you can use Quick Feedback to assess your survey. For a small price of $20, you can get ~50 survey-takers (Amazon Mechanical Turk “workers”) to give you feedback within approximately 6 hours.

What is included?

  1. Example research outputs based on the settings of your experiment.
  2. Testers’ suggestions for:
    • The wording of questions, features, attributes, product descriptions.
    • Presentation of items, for instance, alerting you when the survey contains excessive text and needs images for better illustration.
    • Improvements to make your survey more enjoyable so that your respondents stay engaged.
  3. Testers’ rating of the survey in terms of “Enjoyment”, “Recommendability”, and “Understandability”. Below is an example output of workers’ rating of one survey:
Overall feedback scores from Amazon MTurk survey respondents

Testers will also comment on which part of the survey is “hard to understand” and “what needs improvement”. Below is an example output of the open-ended feedback:

Example output of open-ended feedback from Amazon MTurk survey respondents

Get started with quick feedback

To get your survey tested, select the Get quick feedback option from Other actions in your experiment settings:

Selecting the Quick Feedback option to add survey respondents from Amazon MTurk

You can also select the “Quick Feedback” option before launching your experiment by clicking on Save and prepare for launch. You will be redirected to a page where you can choose to get a quick feedback before officially launching.

Selecting the Quick Feedback option to add survey respondents from Amazon MTurk

Important caveats

  • Amazon Mechanical Turks are not representative of most target audiences.
  • They are not guaranteed to be located in any particular country or to use any particular language, but most will know English.
  • Occasionally, some or all feedbackers may be marked as “low-quality responses”, which will give you an indication of the level of engagement your survey will evoke.
  • You should only use this service for “quick-and-dirty” feedback, and not rely on any findings in the tests.
  • Please do not ask for any personally identifiable information, such as first or last names, emails, addresses, and phone numbers.
  • If you add any screening questions or logic to your survey, the number of complete responses will probably be lower than 50.