STEP BY STEP
There are ten different phases in developing a questionnaire. Keep in mind that this is an iterative process
– it is necessary to revisit earlier steps if it turns out that something does not work in practice. If the field
test (step eight) for instance indicates that the questionnaire only generates garbage, a review of steps one
through seven is recommended.
Step Description
Identify assessment
objectives and information
needs
Decide on the source of
information, data collection
technique and modality
Draft questionnaire
Review feasibility
Finalise analysis plan
Structure and format the
questionnaire
Translate
Field test
Instruct enumerators
Review
the questionnaire
The first step to questionnaire building is not to think of a list of questions, but to identify the answers that the
questions should generate. Establishing these information needs involves, at a minimum:
• Identifying the specific topics of interest
• Designing an analytical framework
• Identifying the desired summary metrics (number, percent, etc.) and the degree of precision for each topic.
•
Ask the right question to the right person using the right technique:
•
Identify the most appropriate information sources for each information need (e.g. key informant),
• The best way to obtain the information (e.g. structured interview) and the best modality (e.g. face-to-face)
Draft the questions required to meet the information needs. A good place to start is to review questions
already used within the country, region or during similar disasters. Review length of questionnaire – a KI/HH
questionnaire should not last longer than 50 minutes.
Consider whether the planned exercise is feasible, particularly looking at costs, required speed and quality,
and the experience and safety of enumerators. Revise and adapt the questionnaire according to cost, speed
and quality requirements.
Finalise the analysis plan, the blueprint of the assessment which captures how a question fits within the
analysis framework, where the information will be obtained, which data collection technique and tool will be
used, how the data should be processed and the analysis steps that are to be undertaken.
Reserve some time to make the questionnaire format functional and pretty. Take into account the order of
questions, flow of the interview, space available to report and instructions for the interviewer
Decide at an early stage whether translation of the tools is required. Translation is costly, time-consuming
and if done inappropriately, can greatly reduce data quality. Effective translation consists of a preliminary
translation followed by reverse translation to test the appropriateness of the wording. Test the translated
questionnaire by administering both versions to bilingual and bicultural respondents.
Test the questionnaire to see if the exercise provides the required results. Start with testing the
questionnaire with colleagues who have not worked on the project. Revise accordingly. Test the improved
version of the questionnaire with three to ten respondents, under conditions close, or identical to, those of
the main assessment.
Train the enumerators and explain their roles and responsibilities. Explain the interviewer approach, either
standardised or conversational, and provide a comprehensive training on the questionnaire and good
assessment practices to all staff involved.
After the data has been collected and analysed, review the questionnaire, debriefing forms and analysis
results to assess the effectiveness of each question. Document and share the lessons learned among all
assessment stakeholders to incorporate into future questionnaire design.
1 2
1
2
3
4
5
6
7
8
9
10
