How To Design A Questionnaire Or Survey | Research Methods Tutorial

How to Design a Questionnaire for Research

Introduction to Questionnaire Design

• The video discusses the essentials of designing a questionnaire or survey, emphasizing its importance for both beginner and advanced researchers.

• The speaker, an experienced university lecturer, offers insights based on years of marking research projects and dissertations.

Key Considerations in Designing Questionnaires

• A questionnaire is defined as a series of written questions arranged in a fixed order, serving as an instrument for collecting factual data.

• Researchers must decide how the questionnaire will be administered: self-administered (completed by respondents) or interviewer-administered (filled out by the researcher).

Advantages and Disadvantages of Administration Methods

• Self-administered Questionnaires:

• Benefits include low cost, anonymity for respondents, convenience in completion time, and no interviewer influence.

• Disadvantages involve lower response rates, potential misunderstandings of questions, and challenges for illiterate individuals or those with language barriers.

• Interviewer-administered Questionnaires:

• Benefits include easier participation for illiterate respondents, opportunities for clarification during questioning, quicker data collection, and higher response rates.

• Limitations include possible interviewer bias and increased time/effort required from the researcher.

Designing Your Questionnaire

• Researchers should clarify their objectives: what they aim to achieve with the questionnaire.

• Questions regarding format (paper vs. online), necessary information to gather, question wording structure, and overall layout are crucial considerations.

Testing Your Questionnaire

• It is recommended to test the draft questionnaire on a small group to ensure clarity and understanding before final distribution.

Common Mistakes in Questionnaire Design

• Questions must be relevant; avoid asking unnecessary demographic information that does not contribute to research goals.

• Ensure that respondents have access to needed information; consider age-related memory issues when asking about past events like exam grades.

Importance of Clarity in Questions

• Assess whether respondents can understand your questions; testing helps identify unclear phrasing that could lead to inaccurate answers.

• Be cautious with jargon or specific terminology that may confuse participants unfamiliar with certain fields (e.g., aviation acronyms).

Understanding Questionnaire Design

Types of Questions in Research

• Understanding the audience is crucial; consider if non-experts can comprehend your questions.

• There are two main types of questions: open-ended and closed questions, each with distinct advantages and disadvantages.

Open-Ended Questions

• Open-ended questions allow respondents to answer freely, providing a wide range of responses. An example includes asking what individuals look for most in a job.

• They yield more reliable data as answers reflect the respondent's perspective rather than the researcher's bias. However, analyzing these responses can be time-consuming and complex.

• Respondents must have adequate reading and writing skills to provide meaningful answers, which may limit participation.

Closed Questions

• Closed questions offer fixed response options, making them easier to analyze and compare across respondents (e.g., "What do you look for most in a job?").

• Benefits include simplicity for respondents and reduced interviewer bias; however, they restrict self-expression and may not capture nuanced opinions.

Scaled Questions

• Scaled questions use a rating system (e.g., satisfaction scales) that simplifies coding and statistical analysis but can confuse respondents regarding how to answer accurately. Examples include satisfaction ratings from "very satisfied" to "very dissatisfied."

• Clarity in question structure is essential for effective data collection using scaled formats like Likert scales.

Designing an Effective Questionnaire

Key Considerations

• Aim for accurate responses by keeping the questionnaire simple and easy to understand; ask one question at a time without combining them to avoid confusion.

• Start with qualifying questions relevant to your study population (e.g., confirming if participants are students). This helps filter out irrelevant responses early on.

Informed Consent

• Include an informed consent statement at the beginning of your survey explaining the research purpose and ensuring participants agree to participate before proceeding with the questionnaire.

Question Flow

• Begin with straightforward opening questions that ease participants into the survey while maintaining logical flow throughout the questionnaire design process. This approach helps keep respondents engaged without overwhelming them initially.

Survey Design Tips

Organizing Questions Effectively

• When designing a survey, group related questions together to maintain logical order and coherence. This approach enhances the respondent's experience and understanding.

• Avoid scattering similar questions throughout the survey; instead, cluster them to facilitate easier comprehension for participants.

Layout Considerations

• Pay attention to the layout of your survey. Ensure that elements are not too cramped, and use an appropriate font size for readability.

• If using online tools like Google Forms or SurveyMonkey, review their formats before starting your design to ensure they meet your needs.

Visual Clarity

• Strive for a clear and simple visual presentation in your survey. Consider using colors, bold text, or boxes to enhance clarity.

• After finalizing the design choices, document the rationale behind these decisions as part of your research write-up.