Question Order Bias: How to Eliminate

Human nature tends negative - earlier questions in surveys will generally score higher than later questions. Not only is this academic, we've tested and proved it in a national A/B test!

To eliminate question order bias, full support for randomization of the presentation order of the questions asked in Pulse surveys. The feature is enabled as a Loop admin configuration setting. The effect of the feature is:

• On the kiosk: question order is randomized after each submission; each new kiosk user will receive a random question order.
• On the mobile: question order is randomized for that individual. Subsequent refreshes will yield the same question order (to prevent confusion).