Standards for Evaluating Qualitative Data
As with quantitative research, certain standard criteria are accepted for evaluat-
ing qualitative studies. These were developed because quantitative criteria such
as internal validity, external validity, generalizability, reliability, and objectivity
were for evaluating numbers and did not fit well when evaluating words. It is
expected that qualitative studies be conducted with extreme rigor because of the
potential for subjectivity that is inherent in this type of research. In addition to
addressing ethical issues, such as informed consent and use of data, qualitative
researchers are guided by the requirements for establishing trustworthiness of
the study. This is a more difficult task when dealing with words and people than
numbers and statistics. Lincoln and Guba (1985) proposed a different set of
criteria with unique terminology that is appropriate for evaluation of qualitative
research. These criteria are still considered to be a gold standard to establish
trustworthiness or rigor of a study (Houghton, Casey, Shaw, & Murphy, 2013).
Establishing Trustworthiness
Trustworthiness refers to the quality, the authenticity, and the truthfulness of
findings in qualitative research. It relates to the degree of trust, or confidence,
readers have in the results. Trustworthiness can be established by meeting four
criteria (Lincoln & Guba, 1985): credibility, transferability, dependability, and
confirmability. Box 14-3 provides a summary of strategies for meeting these
criteria. By maintaining an audit trail, researchers can demonstrate whether these
criteria are met. Auditability means that records maintained by the researcher
can be examined by others. For example, just like an auditor reviews financial
records to ensure ethical business practices are used, peer reviewers can evaluate
documents from qualitative studies to judge the trustworthiness of findings.
When another researcher can follow the audit trail, that researcher should arrive
at the same or similar conclusions. If contradictions about the conclusions exist,
then the trustworthiness of the study could be called into question.
Credibility
Credibility in qualitative research is akin to internal validity in quantitative
research. To meet the criterion of credibility, the research must be shown to be
authentic and truthful. The results should make sense and be believable. There
are many strategies to help establish and evaluate credibility. Researchers should
use well-established research methods and describe them with sufficient detail
so the study can be replicated. If a similar study can show similar results using
another method, credibility is supported.
Good interviewing skills help to establish credibility of the data. Shenton
(2004) suggested that specific questions be asked of participants to ensure that
KEY TERMS
trustworthiness:
The quality,
authenticity, and
truthfulness of
findings from
qualitative research
credibility: One
of four criteria
for establishing
a trustworthy
qualitative study;
refers to the truth
or believability of
findings
transferability:
One of four criteria
for a trustworthy
qualitative study
that relates to
whether findings
from one study can
be transferred to
a similar context;
application of
findings to a
different situation
dependability:
One of four criteria
for a trustworthy
qualitative study
that relates to
consistency in the
findings over time;
auditability; findings
are reflective of data
confirmability:
One of four criteria
for a trustworthy
qualitative study
that relates to the
rigorous attempts
to be objective and
the maintenance
of audit trails to
document the
research process;
findings can be
substantiated by
participants
392 CHAPTER 14 What Do the Qualitative Data Mean?