A comparison of research method quality criteria in qualitative and quantitative research: for Housing Studies students
In the
context of Research Methods study for the Housing Studies program, compare the
concepts of (a) "internal validity" of quantitative research and
"credibility" of qualitative research and (b) "external
validity" of quantitative research and "transferability" of
qualitative research, notably on the differences of ways to achieve them.
In Housing Studies
research, internal validity and credibility both ask whether a
study’s findings are trustworthy within the studied setting; external
validity and transferability both ask whether findings can be
meaningfully applied beyond it. The key difference is that quantitative
research usually seeks statistical generalization from a sample to a defined
population, whereas qualitative research enables readers to judge whether its
context-rich findings fit another housing setting.
(a) Internal validity vs. credibility
|
Aspect |
Internal validity (quantitative) |
Credibility (qualitative) |
|
Core question |
Did the
intervention or explanatory variable truly cause the observed outcome, rather
than another factor? |
Do the findings
accurately and plausibly represent participants’ experiences and the
phenomenon studied? |
|
Main threat |
Confounding,
selection bias, measurement error, reverse causation, history, maturation,
and other extraneous influences. |
Researcher
misinterpretation, insufficient engagement with participants, bias, and weak
correspondence between data and interpretations. |
|
Way to achieve
it |
Research design
controls: random assignment, control/comparison groups, pre–post measurement,
matching, statistical controls, validated instruments, and clearly specified
procedures. |
Interpretive
strategies: prolonged engagement, triangulation of sources/methods/theories,
member checking, peer debriefing, reflexivity, and transparent analysis. |
|
Housing example |
In an experiment
on whether a rent-support programme reduces arrears, random assignment and a
comparison group help show that the programme—not tenants’ prior income or
landlord type—produced the change. |
In interviews
with tenants in subdivided flats, repeated interviews, observations, multiple
data sources, and asking participants to review interpretations help
establish that the account reflects their lived housing experiences. |
The parallel is
useful but not exact: internal validity concerns causal attribution under a
controlled design, while credibility concerns the “truth value” of qualitative
interpretations. In both cases, the researcher must show that the reported
result is not an artefact of the study procedure or the researcher’s
assumptions.
(b) External validity vs. transferability
|
Aspect |
External validity (quantitative) |
Transferability (qualitative) |
|
Core question |
Can the
sample-based estimate or causal effect be generalized to a wider population,
settings, times, or measures? |
Could the
findings be applicable to another housing context, group, policy setting, or
time? |
|
Main logic |
Statistical or
population generalization: the sample must represent the target population
and the study conditions must resemble the intended real-world conditions. |
Contextual
reasoning: the reader/user decides, from detailed contextual evidence,
whether the findings fit their situation. |
|
Way to achieve
it |
Probability or
representative sampling, adequate sample size, replication across
sites/populations, realistic field settings, and clear specification of the
population and conditions to which results apply. |
Thick or rich
description of participants, setting, social relations, housing type, policy
context, and study boundaries; the researcher supplies the evidence, but does
not claim universal generalization. |
|
Housing example |
A survey using a
probability sample of private-rental tenants across Hong Kong can support an
estimate of the prevalence of overcrowding in that defined population. |
A qualitative
study of older residents’ experiences in one public-estate renewal project
may help policymakers understand similar renewal contexts, provided the study
describes the estate’s tenure mix, resident demographics, management
arrangements, and local policy conditions. |
External validity
is strengthened by designing the study to represent the target population and
by replication; transferability is strengthened by giving enough contextual
detail for an external user to make a reasoned judgement about relevance. This
creates an important trade-off: highly controlled experiments may strengthen
internal validity but reduce external validity because their artificial
conditions may not resemble everyday housing environments.
Practical implication
For a Housing Studies
dissertation or research proposal, state the quality standard appropriate to
your method rather than applying quantitative labels mechanically to
qualitative work. A quantitative study should demonstrate how it
minimizes bias and defines its generalization boundary; a qualitative study
should demonstrate how it earns confidence in its interpretations and
provides the contextual description needed for transferability.
A concise
formulation is:
- Internal
validity / credibility: “Can I trust what this
study says about the case or sample studied?”
- External
validity / transferability: “Can this study’s
conclusion be used beyond the case or sample studied?”
- Quantitative
route: control, representativeness, measurement, and
replication.
- Qualitative
route: engagement, triangulation, participant
validation, reflexivity, and thick description.