Cara Rabe-Hemp and John C. Navarro
In the study of crime media and popular culture, researchers have a wide range of research methodologies at their disposal. Each methodology or standardized practice for producing knowledge involves an epistemological foundation and rules of evidence for making a claim, as well as a set of practices for generating evidence of the claim. The research methodology chosen is contingent upon the question being studied, as each methodology has strengths and weaknesses.
As the most stringent research design, experiments are unique because they are the only methodology able to establish causality. This is because experimental design’s major advantage is that researchers can control the environment, conditions, and variables that are being studied. However, experiments suffer from a major disadvantage as well: the precision and control utilized in experiments make it difficult to apply the findings to the real world, referred to as generalizability. This is especially poignant in crime media and popular culture studies where researchers are often interested in exploring how the criminal justice system, participants, and processes are socially constructed and how the mediated images impact our conceptualization of criminality and appropriate criminal justice system responses.
What is a “snowball”? For some, a snowball is a drink made of advocaat and lemonade; for others, a mix of heroin and cocaine injected; for yet others, a handful of packed snow commonly thrown at objects or people; for gamblers, it refers to a cash prize that accumulates over successive games; for social scientists, it is a form of sampling. There are other uses for the term in the stock market and further historical usages that refer to stealing things from washing lines or that are racist. Clearly then, different people in different contexts and different times will have used the term “snowball” to refer to various activities or processes. Problems like this—whereby a particular word or phrase may have various meanings or may be interpreted variously—are just one of the issues for which cognitive interviews can offer insights (and possible solutions).
Cognitive interviews can also help researchers designing surveys to identify problems with mistranslation of words, or near-translations that do not quite convey the intended meaning. They are also useful for ensuring that terms are understood in the same way by all sections of society, and that they can be used to assess the degree to which organizational structures are similar in different countries (not all jurisdictions have traffic police, for example). They can also assess conceptual equivalence. Among the issues explored here are the following:
• What cognitive interviews are
• The background to their development
• Why they might be used in cross-national crime and victimization surveys
• Some of the challenges associated with cross-national surveys
• Ways cognitive interviews can help with these challenges
• Different approaches to cognitive interviewing (and the advantages of each)
• How to undertake cognitive interviews
• A “real-world” example of a cognitive interviewing exercise
• Whether different probing styles make any difference to the quality of the data derived.