How many questions can be added?

You can add as many questions to the survey as you like!

Please notice that in the survey, the questions are randomized, this means that no matter how many questions you add, each participant will be asked a maximum of 20 questions.

Why are questions randomized?

A problem we have been facing is that webmasters have a hard time redefining surveys when they need to gather new information. After a certain number of questions, the survey gets to long. And every time you want to add something, you need to remove something to keep the length down. And removing something breaks historical data series which also must be considered. 

In other words, making changes to an already running survey requires thought and attention. That is why we have introduced a random rotation of questions in the survey widget.

Surveys are still suffering from the constraints imposed when a survey was something printed on a piece of paper. Instead, try to imagine a survey as a long list of questions you would like to know the answers to. Sort of a 'Questions and Answers'. With the new UserReport survey widget, you don't really build a survey as a traditional serialized sequence of questions.

You just define those questions you would like answered - Nothing else!

The UserReport survey widget dynamically builds a custom survey for each and every visitor that takes the survey. We use a random selection of questions to make sure you get enough answers to each question. This means that no single survey will be longer than 20 questions.

 When you edit your survey widget in the survey editor, you may preview your survey - either in full length or randomized like a respondent will experience it.

But how does it affect my data?

Let's say you have 20 questions in your survey and you collect 2000 interviews/responses. In this case, you got less than the max limit of 20 questions pr. survey, so you will get 2000 answers to each and every question. 

If you increase the number of questions in your survey to 40 questions - and conduct another 2000 interviews - you will get 1000 answers to each of the 40 questions. But each participant will still experience the survey as being only 20 questions long.

Clever right? No matter how many questions you add, the survey experience will be the same. And all 40 questions can be cross-tabulated with each other due to the fact that the order of each survey is randomized.

 The randomization is a bit more advanced than just 'randomizing'.

The randomization algorithm will always try to split the 20 questions between 50% personal questions and 50% opinion questions. Why? Because if you ask too many personal questions, the participants will be bored and leave the survey. So we need to strike a nice balance between personal and opinion questions.

Another important detail is that personal questions should always be asked at the end of the survey. That will ensure higher completion rates. Opinions first - then personal questions. But don't worry - we automated that behaviour as well.

Finally - Questions about the overall satisfaction score and gender and age will always be asked in your survey. It would not be a user satisfaction survey without those questions. So they are (still) mandatory.



How did we do?

Controlling invitation frequency when using UserReport script and Google Tag Manager

How many surveys answers do I need?