Response Quality Management and Warnings

Conjointly offers a wide range of options to improve response quality, eliminate low-quality responses, and restrict responses to certain devices or geographic areas.

If you recruit respondents through Conjointly, you do not pay for low-quality responses. Conjointly employs automated quality checks based on your enabled response quality management options, so that you will only pay for complete, real human responses.

These options can be found within the Response quality management and Response quality warnings tabs under Advanced Settings .

Response quality management options

Anonymise responses

To comply with privacy standards, including GDPR, you can increase the anonymity of your respondents by ticking the Anonymise Responses checkbox.

By checking this box, your experiment will not record the following respondent details:

• IP address and associated location.
• Browser location.
• Browser cookies and identification strings.
• Type of device used.

To learn more about what information we store and how it is used, please refer to our Terms and Conditions and Privacy Policy.

Prevent respondents from repeating the survey

• Disable respondents from the same IP address
  Prevent duplicated or fraudulent responses from the same IP address. Note that this setting should not be used when surveying employees of the same company.
• Disable respondents from the same cookie
  Prevent duplicated or fraudulent responses by assigning unique “cookies” to each respondent.
• Required unique GET variables
  Specify a unique GET variable to allow only one unique entry. The survey cannot be accessed without this GET variable.

Filter low-quality responses

• Terminate low-quality respondents early
  Prevent respondents marked as low-quality by the system from continuing with the survey.
• Filter for sloppy text input
  Identify and filter out inattentive respondents, including those with low character counts or gibberish characters detected.
• Filter for duplicate text responses
  Detect and filter duplicated text responses from different participants. This setting applies to all open-ended responses of more than 50 characters.

Set accepted device

Specify the device type respondents can use to answer the survey by choosing an option from the dropdown menu next to Accepted device. By default, any mobile device and desktop are accepted.

Geofencing

Specify the geographic locations where respondents are allowed to participate in your survey.

• Ask respondents to share browser location
  Browser location can be more precise than location determined from respondents’ IP addresses. However, it requires additional permissions from respondents that they may refuse to provide. This setting is automatically selected when you select the Only allow respondents from within certain geographic area option.
• Check time zone based on location
  Automatically detect respondents’ time zones to crosscheck the veracity of their locations.
• Allowed locations of respondents
  This option allows you to limit your survey to respondents from specific countries based on their location determined from IP addresses. You can use the field as a search bar to find and select your desired countries. This setting is automatically activated for paid samples. Please note that the check will only apply after the experiment is launched.

  

• Only allow respondents from within certain geographic area
  This option provides an alternative approach to geofencing your survey based on respondents’ device location. It allows you to define a rectangular area on the map where only respondents within this region can participate in the survey. This check will only apply after the experiment is launched.

Detect low-quality open-ended responses

Easily identify and exclude low-quality open-ended responses using a large language model (LLM). The system analyses each response and categorises it into one of the following:

• Test: Responses that appear to be test submissions or are irrelevant to the survey topic.
• Keyjamming: Responses containing nonsensical or random characters.
• Careless: Responses that are overly brief, vague, or fail to address the question adequately.
• Copy-pasted: Responses that appear to be copied and pasted from other sources.
• Good: Responses that are relevant and related to the survey question.

To review the categorisation of open-ended responses in your experiment, navigate to the Quality Checker page by clicking the Quality Checker button on the experiment settings page, or by adding /quality-checker/ to your experiment URL. For example, https://run.conjoint.ly/experiments/533289/quality-checker/.

At the bottom right of the Quality Checker page, a table lists all risk signals recorded for each respondent. Find the on-review label in the Occasion column; the categories of the open-ended responses are listed in the Signal column next to the label.

You can easily exclude any low-quality responses by clicking on the Exclude button in the top-right corner of the page.

Detecting low-quality open-ended responses using a LLM is free when you source respondents through Conjointly’s Predefined panels, Self-serve sample, and Managed general sample.

When you bring your own respondents or send an email campaign, you have the option to enable this quality check. A fee of USD 0.10 per complete response with an open-end will be charged from your team balance. In order to activate this option, a minimum team balance of USD 100 or its equivalent is required.

Warnings to respondents

• Warn respondents who do not scroll enough
  Prompt respondents to attentively consider the questions and choices.
• Warn at-risk respondents once
  Warn low-quality respondents once before termination.
• Force respondents to read conjoint questions
  Force respondents to stay on each choice set for a specified duration before they can make a choice.

Redirect for low-quality responses

You can also specify a separate redirect for respondents who have given low-quality responses:

• Open the Redirects upon survey completion module under the Advanced settings tab.
• Insert the redirect URL in the URL for low quality responses field.
• Click the Save changes button at the bottom of your screen.