A note on the evaluation criteria for selection of research method to use in research: for MBA students

A note on the evaluation criteria for selection of research method to use in research: for MBA students [information from poe.com].

My question 1: "I am an MBA student currently learning the subject of Research Methods. I have a question about selection of research methods to use. Let's say, if I want to examine a research issue (such as to learn more about the preference on various corporate work from home policy options for gen z in Hong Kong) and I need to choose the better research method to use out of two research method options (such as semi-structured interview and questionnaire survey with my friends), what evaluation criteria should I use for the research method evaluation exercise?"

The reply: "When evaluating research methods for your study on the preferences of Gen Z in Hong Kong regarding corporate work-from-home policies, you can consider the following evaluation criteria:

1. Research Objectives

Alignment: Does the method align with your research objectives? For example, if you want in-depth insights, semi-structured interviews might be preferable.

2. Nature of Data

Qualitative vs. Quantitative: Determine whether you need qualitative data (detailed insights and narratives) or quantitative data (statistical analysis and generalizability).

3. Population Characteristics

Accessibility: Consider how easily you can reach your target demographic (Gen Z in Hong Kong) with each method.

Sample Size: Think about the number of participants you can realistically engage in each method.

4. Depth of Insight

Exploratory Needs: If you're exploring new ideas or concepts, semi-structured interviews can provide richer insights.

Breadth of Data: If you need generalizable data across a larger group, a questionnaire may be more effective.

5. Time and Resources

Time Commitment: Consider how much time you have to conduct the research and analyze the results.

Cost: Assess the costs associated with each method, including possible incentives for participants.

6. Flexibility

Adaptability: Semi-structured interviews allow you to adapt questions based on responses, while questionnaires are fixed.

7. Data Analysis

Complexity: Consider the level of complexity in analyzing the data. Qualitative analysis can be more time-consuming than quantitative.

8. Bias and Reliability

Subjectivity: Assess potential biases in each method. Interviews may introduce interviewer bias, while surveys may suffer from response bias.

9. Ethical Considerations

Informed Consent: Ensure that both methods can comply with ethical standards, including obtaining informed consent from participants.

10. Outcome Usability

Application of Findings: Consider how the results will be used. Will stakeholders prefer detailed narratives or summarized data?

Conclusion

After evaluating these criteria, you should be able to determine which method best suits your research needs. For your specific case, if you seek to understand nuanced preferences and motivations, semi-structured interviews might be more beneficial. If you aim to gather broader data that can be statistically analyzed, a questionnaire survey could be the better option."

My question 2: "How does my positionality as a researcher affect my choice of research method to use and are there additional evaluation criteria to use in this case that take into my consideration of the concern of "researcher's positionality?"

The reply: "Your positionality as a researcher—your background, experiences, beliefs, and social identity—can significantly influence your choice of research method. Here are some ways it can impact your decision, along with additional evaluation criteria to consider:

Influence of Positionality on Research Method Choice

Perspective and Bias

Subjectivity: Your personal experiences and beliefs may lead to biases in interpreting data. Consider how this might affect the selection of qualitative vs. quantitative methods.

Relationship with Participants

Trust and Rapport: If you have a shared identity with your participants (e.g., being part of Gen Z), semi-structured interviews may facilitate deeper connections and insights.

Power Dynamics: Reflect on how your positionality influences the power dynamics in the research process. This is particularly relevant in qualitative methods.

Cultural Sensitivity

Understanding Context: Your familiarity with the cultural context of your participants can shape the appropriateness of certain methods. For instance, culturally sensitive approaches may require qualitative methods.

Access and Engagement

Networking: Your social networks may provide easier access to certain participant groups, influencing the feasibility of your chosen method.

Ethical Considerations

Reflexivity: Being aware of your positionality allows you to navigate ethical considerations more thoughtfully, particularly in qualitative research where participant experiences are central.

Additional Evaluation Criteria Considering Positionality

Reflexivity

Self-Awareness: Consider how aware you are of your biases and how they might influence your research choices. This awareness can guide the selection of methods that mitigate bias.

Participant Voice

Empowerment: Reflect on which method better empowers participants to express their views. Qualitative methods may allow for richer participant input.

Methodological Fit

Cultural Appropriateness: Evaluate whether the chosen method respects and reflects the cultural contexts of your participants.

Transparency

Disclosure: Consider how you will disclose your positionality in the research process. Transparency can enhance the credibility of your findings.

Methodological Rigor

Validity and Reliability: Assess how your positionality may impact the validity and reliability of the chosen method. For example, qualitative methods may require more rigorous checks for credibility.

Feedback Mechanisms

Participant Feedback: Implement mechanisms for participants to provide feedback on your interpretations, ensuring their voices are heard and understood.

Conclusion

Your positionality is a critical factor in shaping your research methods. By considering additional evaluation criteria related to reflexivity, participant empowerment, and cultural appropriateness, you can make a more informed choice that acknowledges and addresses potential biases and ethical concerns. This reflective approach enhances the overall integrity and impact of your research."

Reference: a collection of blog notes on using chatgpt for research purpose.