Video 4 of 4

Quality and rigor in qualitative and mixed methods research

Without statistical significance or confidence intervals, qualitative research is judged on credibility, transferability, dependability and confirmability. The tactics behind each, from triangulation and thick description to audit trails, reflexivity and negative case analysis, and the extra bar mixed methods studies have to clear: the quality of integration.

4:34 · 11 slides · printable slides · transcript

Slides

Printable deck →

Quality and rigor in qualitative and mixed methods research

1 / 11
▶Transcript11 sections

Generated from the narration script. Plain text version.

1If qualitative research doesn't have statistical significance, confidence intervals, or effect sizes, how do we judge whether it's any good?

2Qualitative research does have quality criteria. They're different from the ones quantitative research uses, and they reflect a different epistemology. Quantitative research tries to control for bias through design. Qualitative research treats bias as inevitable, and it demands that researchers make their decisions, assumptions, and analytical moves transparent enough that readers can judge them.

3Most qualitative researchers work from a four-part framework: credibility, transferability, dependability, and confirmability. Each maps loosely onto a quantitative concept: internal validity, external validity, reliability, and objectivity. But the underlying logic is different.

4Credibility asks whether the findings believably represent participants' perspectives. The classical tactics are prolonged engagement, triangulation across multiple data sources, member checking with participants, and peer debriefing with colleagues who are willing to challenge your interpretations. The vaccination governance study in Syria triangulated key-informant interviews, a validation workshop, and ethnographic observations. When all three converged on the same governance gaps, that convergence was the source of credibility.

5Transferability asks whether findings travel. The key tactic is thick description: enough detail about context, participants, and processes that readers in different settings can judge applicability themselves. Purposive sampling that deliberately captures variation strengthens transferability further. One peer mental health worker study sampled across two distinct contexts and found that the relative importance of peer-worker characteristics varied by setting, a finding that itself tells readers something about when and where the work might transfer.

6Dependability asks whether another researcher following the same process could reach similar conclusions. The answer hinges on documentation. A serious qualitative project maintains an audit trail of methodological decisions, codebooks showing how categories were defined and applied, analytic memos showing how interpretation evolved, and drafts showing how the argument was sharpened. I read the transcripts and themes emerged does not meet this standard.

7Confirmability asks whether findings are grounded in data and not in the researcher's prior commitments. Three habits keep work confirmable. The first is reflexivity: explicitly examining your own assumptions, positionality, and potential biases, and naming them in the paper. The second is clear linkage to data, where every major claim traces to a quote, field note, or document excerpt that readers can see. The third is negative case analysis. If your analysis claims all participants experienced stigma but three interviews suggest otherwise, those exceptions are the finding, not a problem to hide.

8A scoping review of qualitative research's contributions to clinical and epidemiological understanding makes the same point. Rigor emerges through systematic collection, transparent analysis, and ongoing questioning of researcher assumptions. Only when work is conducted that way can qualitative findings reliably illuminate causal mechanisms, identify important subgroups, or explain how associations operate.

9Mixed methods studies have to clear the quality bar for both strands, and then clear one more bar that neither strand alone has to: the quality of integration. This is where most weak mixed methods studies fail. The numbers and the stories are each fine in isolation, but they sit side by side on the page without ever truly talking to each other.

10Three dimensions of integration quality are worth checking. Design integration asks whether the choice of design fits the question. The Syria study used a convergent design because the team needed coverage data and stakeholder perspectives in parallel, and the Ethiopia study used explanatory sequential design because they needed clinicians to explain the capacity gaps. Analytical integration asks whether the team actually brought the two strands into contact and explored convergence, divergence, and expansion. Interpretive integration asks whether the discussion produces meta-inferences: claims that neither strand could have made alone.

11A useful self-test: if you removed either the quantitative or the qualitative section from your paper, would the remaining section still tell a complete story? If yes, you probably have not integrated. True integration means both strands are necessary for the full picture.

RigorTrustworthinessTriangulationMixed Methods