A note on the evaluation criteria for selection of research method to use in research: for Housing Studies students [information from poe.com].
My question 1: "I am a student currently learning the subject of Research Methods. I have a question about selection of research methods to use. Let's say, if I want to examine a research issue (such as to learn more about housing affordability perceptions of gen Z in Hong Kong) and I need to choose the better research method to use out of two research method options (such as narrative interview and questionnaire survey), what evaluation criteria should I use for the research method evaluation exercise?"
The reply: "When selecting a research method to examine issues like housing affordability perceptions of Gen Z in Hong Kong, it's important to evaluate your options systematically. Here are some key evaluation criteria to consider:
1. Research Objectives
Qualitative vs. Quantitative: Determine if your goal is to explore in-depth experiences and perceptions (qualitative) or to quantify attitudes and trends (quantitative).
2. Depth of Data
Narrative Interview: Provides rich, detailed insights into individual experiences and perceptions.
Questionnaire Survey: Offers broader data but may lack depth in understanding the nuances of individual experiences.
3. Sample Size
Consider how many participants you can realistically include. Surveys can gather data from larger samples, while interviews typically focus on fewer participants.
4. Data Collection Time and Resources
Time Required: Interviews can be time-consuming to conduct and analyze, while surveys can often be distributed and collected more quickly.
Resource Availability: Assess the resources you have (time, funding, personnel) for data collection and analysis.
5. Analysis Method
Complexity of Analysis: Qualitative data from interviews require thematic or content analysis, which can be complex. Survey data can often be analyzed using statistical methods, which may be more straightforward.
6. Participant Engagement
Consider how each method will engage participants. Interviews can foster deeper engagement but may require more trust and rapport, while surveys can be less personal.
7. Flexibility
Adaptability: Interviews allow for follow-up questions and deeper dives into specific topics, whereas surveys are generally fixed once distributed.
8. Generalizability
Findings Applicability: Survey findings may be more easily generalized to the larger population, while interview findings may provide context-specific insights that are not easily generalizable.
9. Ethical Considerations
Evaluate how each method addresses issues of confidentiality, consent, and participant comfort.
10. Feasibility
Assess practical considerations, including logistics, accessibility of participants, and the potential for response bias.
Conclusion
Weigh these criteria based on your specific research question and context. For examining housing affordability perceptions of Gen Z, if you seek in-depth understanding, narrative interviews may be more suitable. If you aim to gather quantifiable data from a larger group, a questionnaire survey may be the better choice."
My question 2: "How does my positionality as a researcher affect my choice of research method to use and are there additional evaluation criteria to use in this case that take into my consideration of the concern of "researcher's positionality"?"
The reply: "Your positionality as a researcher plays a crucial role in the selection of research methods and can influence various aspects of your study. Here are some ways your positionality might affect your choice, along with additional evaluation criteria to consider:
1. Subjectivity and Bias
Awareness of Bias: Your background, experiences, and beliefs can shape how you interpret data. Qualitative methods like narrative interviews might require you to reflect on your biases more intensely, as personal engagement is deeper.
Method Selection: If you are aware of potential biases, you might choose a method that minimizes your influence, such as using standardized surveys.
2. Relationship with Participants
Insider vs. Outsider: If you belong to the Gen Z demographic in Hong Kong, you may have an insider perspective that can enrich narrative interviews. Conversely, being an outsider may require you to use surveys to maintain objectivity.
Trust and Rapport: Your positionality can affect participants' willingness to share information. Consider methods that align with your ability to build trust.
3. Access to Participants
Network and Influence: Your social or professional connections may facilitate or hinder access to certain groups. This can influence whether you choose interviews (which may require deeper engagement) or a broader survey approach.
4. Reflexivity
Self-Reflection: Regularly reflect on how your positionality impacts the research process, including data collection and analysis. This is particularly important in qualitative research.
Documentation: Maintain a reflexive journal to document your thoughts and feelings about how your positionality might influence the research.
5. Ethical Considerations
Cultural Sensitivity: Your positionality may necessitate a more nuanced understanding of cultural dynamics, particularly in qualitative methods. Consider how this affects your choice of method.
Informed Consent: Ensure that your positionality does not compromise the informed consent process, especially if your background influences participants' perceptions of you.
Additional Evaluation Criteria
Reflexivity
Assess how well the method allows for ongoing self-reflection about your role and influence as a researcher.
Cultural Competence
Evaluate your ability to engage with participants from various backgrounds. Choose a method that aligns with your skills in cultural sensitivity.
Power Dynamics
Consider how power relations between you and participants might affect data collection. Methods that empower participants (like interviews) may be more appropriate in some contexts.
Alignment with Research Ethics
Ensure that your chosen method aligns with ethical guidelines, particularly as they relate to your positionality and the potential impact on participants.
Impact on Data Interpretation
Reflect on how your positionality might shape the interpretation of data collected through different methods.
Conclusion
Your positionality is a vital consideration in research design. By incorporating these additional evaluation criteria, you can make more informed choices about which research methods to employ, ultimately enhancing the credibility and depth of your study."
My question 3: "How does an evaluation table with criteria and criteria weights look like in this case?"
The reply: "Creating an evaluation table with criteria and weights can help you systematically compare research methods. Below is an example of how such a table might look for evaluating the narrative interview and questionnaire survey methods based on the criteria discussed.
Total Scores
Total Weighted Score (NI): 25 + 25 + 6 + 6 + 12 + 20 + 15 + 8 + 16 + 25 = 158
Total Weighted Score (QS): 15 + 10 + 15 + 15 + 16 + 12 + 6 + 20 + 16 + 10 = 129
Interpretation
Total Weighted Score: The method with the higher total weighted score (in this case, the narrative interview) may be considered more suitable based on the selected criteria and their importance.
Weights: The weights (1-5) reflect the importance of each criterion, with 5 being the most important. Adjust these as necessary based on your specific research context.
You can customize the criteria and weights according to your priorities and the specific nuances of your research topic."
No comments:
Post a Comment