Interpretation and Method Empirical Research Methods and the Interpretive Turn

(Ann) #1

222 ANALYZING DATA


for grasping political processes, not on analyzing how these constructs themselves may be prod-
ucts of political processes. In other words, Collier’s work stops short of investigating how past
politics may have left their marks upon the ostensibly neutral concepts employed by political
researchers. These marks constitute, in Bourdieu’s language, an “intellectual unconscious em-
bedded in [the] analytical categories and tools” of political science, and exposing them is the task
of a reflexive political science.
A reflexive critique of the democratic peace, then, would aim to uncover the “intellectual
unconscious” embedded in the operational definitions of democracy and/or peace and in the
coding rules employed by the collectors of the Polity and COW data. Rather than pose the con-
ventional research questions—does the historical record support the democratic peace proposi-
tion, and does history contain the “seeds” of the modern democratic peace?—the first step in a
reflexive inquiry is to reorient the question toward the history of “democracy,” or “peace.” How
have past generations of political scientists understood and defined these analytical concepts,
how have their definitions of these concepts changed in time, and what was the politics of their
change? To what extent has historical change in the academic meaning of these political concepts
been shaped by historical change in international politics?
My critique (Oren 1995) focused on the concept of democracy. In the democratic peace litera-
ture, democracy is typically defined in terms of electoral process. For example, Russett and Oneal
define it as “a country where (1) most citizens can vote, (2) the government comes to power in a
free and fair election contested by two or more parties, and (3) the executive is either popularly
elected... or is held responsible to an elected legislature” (2001, 44). This definition is consistent
with, and builds upon, the analytic categories and coding rules employed by data-gathering projects
such as Polity. In the Polity data set, polities are coded on a scale that takes competitiveness and
fairness of electoral processes, as well as constraints on the freedom of executive action, as the
defining empirical features of democracy. A reflexive approach directs us to inquire whether the
understanding of democracy implicit in these coding rules is consistent with the ways in which
past generations of political scientists grasped this concept. And it directs us to wonder whether
these coding rules, and hence the data they order and classify, may have been shaped by the very
same history of international conflict that constitutes the empirical testing ground for the demo-
cratic peace proposition.
If the first step in a reflexive political analysis involves redirecting the investigation toward
disciplinary history, the second step is to select a set of past political scientists and texts to ana-
lyze. There is no general formula for making the selection—it rather depends on the research
question. Some substantive questions may call for a focus on nineteenth-century texts, whereas
other questions may be more effectively explored in the writings of more recent authors; some
questions may call for selecting past scholars who specialized in American institutions, while for
other questions it may be more appropriate to select past “area studies” specialists. For example,
if we seek to expose the “scientific unconscious” of contemporary research in African politics,
we should probably unearth the writings of past specialists in African colonial administration
and/or in issues of race. As a rule of thumb, it is often appropriate to select authors who, though
they may be forgotten today, enjoyed high professional standing in their lifetime, as attested by
indicators such as the honors their peers conferred upon them (presidency of the American Politi-
cal Science Association, for example), the professional institutions they directed, or favorable
reviews of their books in professional journals. But even this rule of thumb is just that, not an iron
rule, for some questions may be tackled more effectively by recovering voices from the margins
of the profession. For example, a critical reflexive analysis of current theorizing of gender may be
enriched by exploring the careers of the handful of women who earned doctorates in political
Free download pdf