Friday, February 26, 2016

Getting to know the Force: Ideas and Culture

Discussion Questions

1. In chapter 6, Hansen describes the three dominant nineteenth and early twentieth century constructions of the ‘the Balkans’. These constructions have critical importance for the two discourses that we see today (i.e. The Balkan discourse and the Genocide discourse) Can you think of other examples in which the discourse surrounding a particular area/subject changed throughout history leading to a particular construction today?  

2. What are the differences between the three historical discourses that Hansen describes in terms of their spatial, temporal, and ethical identities? In what ways is the degree of “Otherness” different in each of these discourses?


3. Chapter 7 brings out how security discourse is shaped by different governments based on their national interests and foreign policy agendas and not on assessments of moral responsibilities. Do you agree? Can you give another example of a how the discourse of a war was shaped differently by different governments based on their respective national interests?


4. Hansen says that in order for a discourse to reach closure and stability, there are elements of “ambiguity, openness or blank spots” that have to be left in silence so as to maintain the stability of the discourse. Can you think of an example of a popular (stable) discourse that skipped the mention of critical instances that could have possibly changed how the discourse was formulated?


5. Hansen points out a number of problems with the humanitarian responsibility discourse. For instance, the dichotomy between “leaders” and “civilians” is problematic and it may fail to recognize the concept of “civilian agency.” According to Hansen, this discourse, among many things, is also a sort of response to media pressure. Do you think that media can influence how a discourse is shaped and recalled for years? Can you think of cases in which media reporting played a major role in forming its discourse?


6. According to the chapter, what explains the policy convergence - lift and strike - between a neorealist interpretation of the Balkan discourse and the Genocide discourse?


7. Would you agree that there is an orientalist approach in Rebecca West’s and Robert D. Kaplan’s texts and in their understandings of the Balkans? Please give a few examples to justify your position.


8. In chapter 9, Hansen writes on how the Bush Administration is criticized for staying inside the Balkan discourse by engaging in a “serious of calculated evasions”, calling the war against Bosnia “a blood feud” and “a complex, convoluted conflict that grows out of old-age animosities”. Can you think of a contemporary discourse in which a U.S. administration has used similar rhetoric? What is the foreign policy that has resulted so far from the discourse/issue you cited and is it any similar to the foreign policy generated by the U.S. during the Bosnian War; have identities been “re-articulated” during the process?

9. In what ways did the Balkan discourse differ from the Genocide discourse described in chapter 9 and why do you think this distinction is significant for understanding the West’s response to the Bosnian War? What are some of the foreign policy outcomes that were influenced by the “discursive variations” of each of the discourses? 


10. In searching for a way to understand the political impact of culture, political science has drawn from other fields like economics. How does Lisa Wedeen suggest political analysis should look to understand culture and political phenomena?

Saturday, February 20, 2016

The Power of the Force: Discourse Analysis

  1. Hansen points out that languages and the construction of identity is highly structured, but simultaneously inherently unstable. Why do you think this is the case?
  2. Does identity have a casual effect on the creation of policy? Does policy cause identity? Explain why or why not.
  3. What does Hansen mean by intertextuality, and how does she apply it to discourse analysis research with the three proposed models?
  4. Describe the different ways that, according to Hansen, the genres addressing foreign policy (policy texts, journalism, academic analysis, travel writing, and memoir) claim authority through constructing knowledge. 
  5. Is formulation of a proper narrative of identity in ethnographic research important?
  6. How do you weight certain facets of identity in research? Do you think they are equally important to your research outcome? 

Saturday, February 13, 2016

The Allure of the Dark Side: "Objectivity" and Science

1) Becker writes that one of the main differences between quantitative and qualitative methods is in how they collect and use data. Quantitative methods look more for key variables that explain or prove a concept, while quantitative methods collect highly detailed data in order to completely describe an event. This often leads to “thick” data sets that include even the smallest pieces of information. In your view, does more data clarify or cloud an objective?

2) In Becker’s The Epistemology of Qualitative Research, Herbert Blumer is cited as holding the belief that: all social scientists, implicitly or explicitly, attribute a point of view and interpretations to the people whose actions they analyze. What is Becker’s view on Blumer and how we should represent the viewpoint of those we analyze? Do you agree or disagree with his assertion?

3) According to Charmaz, what is the hallmark of grounded theory? What is the grounded researchers approach to their obtained data and how do they study meaning?

4) According to Katz’s “Ethnography’s Warrants,” what is a ‘normalizing’ view with regard to ethnographies warranted by deviant social reputations? Have you read any studies or seen any media in which a ‘normalizing’ view was expressed? Give an example.

5) Among the many shortcomings of the Failed States Index, the article also criticizes the FSI for its lack of practical utility and its inability to predict events like the Arab Spring. If the Failed States Index fails to accurately reflect the reality (just like other existing indexes like Democracy Index, Corruption-Perception Index, etc.) why do researchers often use these indicators in their studies? Do you think all quantitative analysis should be applicable in predicting future events?


6) Do you think that quantitative and ethnographic research have the same level of influence on policy? What are some real life examples of when quantitative or ethnographic research findings were used in policy discussions? 

Friday, February 5, 2016

Return to Dagobah: Interpretive Ethnography


“Man is an animal suspended in webs of significance that he himself has spun," "... and that analysis of [culture] to be therefore not an experimental science in search of law but an interpretive one in search of meaning.” (Max Weber cited in Geertz)


As participant observers we can learn the culture or subculture of the people we are studying. We can come to interpret the world in the same way that they do. (Hammersley and Atkinson, 1989, p. 7)

Discussion Question:

1.     Explain the difference between case study and ethnography?

2.     What is Culture for you? How do you explain or define culture? Explain if you consider cultural interpretation as science or not?

3.     How important is to have a prior knowledge of your area of research when you do fieldwork research?

4.     How different is Erving Goffman’s view of participant observation from Robert Emerson and Melvin Pollner’s in their document on ‘Constructing Participant / Observation Relations?’

5.     Ethical concerns are inevitable and therefore render participant / observation an invalid method for data collection. To what extent do you agree or disagree with this statement?

6.     What are the qualities of an Ethnographer?

7.     To what extent should a field researcher come close to those being studied?

8.     Why do advocates of interpretive approaches reject the three positivists' assumptions of dualist ontology, objectivist epistemology, and language as an accurate representation of objective reality?

9.  To what extent should ethical considerations guide the work of an ethnographer?

10.  Is ethnographic work merely a constructed reality of the ethnographer?












Friday, January 29, 2016

"Big Ideas are Destroying International Development"

Some of us may not go into academia, but instead may be interested in joining the ranks of USAID, State Department or a small start-up NGO. Many of these organizations focus on monitoring and evaluation, lessons learned, and “scaling-up” and replication. However, are these buzzwords reflecting the implementation of effective programs and policies?


As you read the article "Stop Trying to Save the World", think about the use of these buzzwords and the movement towards a focus on lessons learned, replication and scaling. Please review discussion questions below as you read the article to guide our conversation in class.


New Republic
Stop Trying To Save The World
November, 17, 2014
(You can skip the section of the article about NGO funding titled: “The last NGO I worked for had 150 employees and a budget of…”)

Discussion questions:
  1. As Professor Härdig pointed out in his previous blog post, not all research can or should be used for producing policy. Why do you agree or disagree with this statement as it relates to the article by Hobbes?

  2. Is there such a thing as an objectively existing reality that researchers can represent without internal biases or shaping it through interpretation? Or is reality an inescapable byproduct of our own interpretations?


  1. Can there be more than one scientific method?


  1. Should policy or program relevance determine a research agenda?


  1. What are your ontological and epistemological commitments?


  1. As a practitioner of international development, what lessons can be drawn from the article “Stop Trying to Save the World” as it relates to research methodologies and small-N case studies?


  1. What are some methodological issues highlighted by Hobbes’ articles and how can practitioners avoid those issues?


  1. In the case of deworming in Kenya and India, what independent variables and processes could have been used to better understand the dependent variables, and how?

  1. George and Bennett suggest that a “controlled comparison...is very difficult to achieve,” (pg. 151) and the other methodologies discussed attempt to get around strict comparison as much as possible. If this is true, then should practitioners scale-up or replicate interventions based on findings from non-controlled comparisons? If so, how?

Tuesday, January 20, 2015

Objectivity, Ontology, and Epistemology: The Policy Relevance of the Ivory Tower


In light of tonight’s class, and in anticipation of next, I would like you all to reflect on a few things. Can all research findings be ‘packaged’ as policy prescriptions? And policy prescription for whom and to what end? What happens to the coveted (and, perhaps, elusive) ‘objectivity’ when we add a dimension of normative policy prescription? If we forget for a moment that in-depth IR research (as opposed to real-time policy briefs) usually takes many years to complete and issue-specific policy recommendations are very sensitive to sudden events on the ground, there is also the fact that the social realm is incredibly complex and doesn’t always lend itself to clear-cut ‘right’ and ‘wrong’ paths in specific cases. Policymakers don’t necessarily have the same normative commitments as IR scholars and interpret 'national interest' according to another set of frames beyond what a scholar might ‘know’ from his research is the ‘right’ path. But also consider this: one of the most influential schools of thought in IR (and I mean ‘influential’ in the sense that policymakers claim to be informed by it, even when they don’t really know what it means) – Structural Realism – is an extreme abstraction from reality. In other words, some of the most theoretical of IR research has also been cited as the most influential.

So, clearly, there are different levels of ‘utility’ – it makes a difference if we’re talking about policy prescription in specific cases (i.e. ‘what do to do about Syria’) or interpreting the dynamics of the ‘state system.’ Usually, when we talk about ‘policy relevance,’ it seems we mean the former. Which brings me back to the question of policy prescription for whom and to what end? You can, of course, set up a general objective (e.g. the fall of Bashar al-Assad), and suggest measures specific actors, such as the US, could take that would achieve that end. But you may also have a more complex objective (e.g. the fall of Bashar al-Assad and the transitioning of Syria into a pluralist democracy), in which case you are likely to come up with a very different set of measures that would need to be taken. Of course, the actors that would have to take those measures may not at all be as interested in the same end objective, in which case your policy prescriptions will fall on very deaf ears. 

For instance, when the Syrian uprising was still an emerging non-violent movement and scholars pointed to the importance of maintaining the non-violent character of the movement (for, you see, research has very clearly shown that the most successful transitions from dictatorship to democracy have been through non-violent movements, whereas arming rebels usually results in protracted conflict followed by another not-so-desirable regime), whereas various political actors were calling for immediate support to rebels in the form of arms. As we know, the non-violent faction lost out and although we don’t have a very clear image yet, it is clear arms have come in from the outside and we have a protracted armed conflict. The point here isn't to go into a detailed account of the Syrian conflict, but to point out that a) the social realm is fluid and complex and any policy prescriptions are inherently normative, and b) that even when clear policy prescriptions can be extracted, policymakers make their decisions based on other factors (and have different normative commitments) than the answers provided them by social scientists.

Is, then, ‘objectivity’ something scholars should strive for and, if so, how can you make policy prescriptions while maintaining your objectivity? First, we need to establish how we use the terms ‘objective’ and ‘subjective’ in the philosophical sense. In common day use, we think about someone being ‘objective’ in the sense that they don’t have an ‘agenda,’ they are not involving personal biases. Conversely, someone who is ‘subjective’ is someone who has an ‘agenda,’ they are not ‘reigning in’ their personal biases. But this is a simplification of what we are talking about in the philosophical sense – what is at stake here is whether we assume that there are facts ‘out there’ that we, with our human brains, can ‘discover’ without any process of interpretation, or if the social realm is always in need of interpretation, that what we are, in fact, doing is co-producing facts through a process of interpretation of data. In other words, it is a question of whether we understand the world to consist of objects that speak for themselves or subjects that we have co-produced through interpretation.

This is a very important distinction, because our answer to this question determines what kind of knowledge-claims we believe we can validly make about the world. The article by Jonathan Grix, which is an attempt (fairly successful, I think) to explain terms like ontology and epistemology in plain language, should be read in the light of Patrick Thaddeus Jackson’s more complex breakdown of the same concepts. Remember that these are debates that happen (or should happen) within the scholarly community and it is important to think critically about any and all readings you do for this class (and any other class, for that matter). Ontology, in its simplest definition, regards what is out there for us to study – of what does the social realm consist? Grix explains this fairly straightforward understanding of ontology, but Jackson takes it further – our understanding of the nature of the world also has implications for how we as researchers are connected to it. If we understand the world as existing independently of our interpretation, then we as researchers are external to our objects of study. But if we understand the world as being socially constructed through interpretation, then we as researchers are internal to our subjects of study. Jackson illustrates this distinction by referring to ‘scientific’ and ‘philosophical’ ontology. Scientific ontology is simply a matter of what objects and ‘things’ are out there for us to study (e.g. states, IOs etc.), whereas philosophical ontology is a matter of how we are connected to the world we study. This is not a matter of being physically connected to the world we study – it is not about whether you study your home country or community – it is a matter of whether there is such a thing as an objectively existing reality that we as researchers can ‘represent’ without shaping it through our interpretation, or whether any reality out there is inescapably a product of our interpretation.

Returning then to the issue of ‘objectivity,’ claiming objectivity (facts exist independently of our interpretation) means employing what Jackson calls a ‘dualist ontology,’ whereby the researcher is understood as completely separate from the world s/he studies (mind-world dualism). What I often hear students say is that the world needs interpretation, that facts do not exist independently of our understanding of them, but we should ‘strive to be objective.’ It should be clear by now that, from a philosophical point of view, this is an untenable position, because being ‘objective’ means no interpretation is involved in producing the facts.

The first methodological framework, Comparative Case Studies (CCS), with which we will engage next week, is quite broadly accepted as ‘mainstream’ within IR research. As you will see in the discussions in the book, this framework is, at least partially, based on the notion that the social sciences can and should emulate the logic and techniques of the natural sciences and is, in many ways, not all that different from ‘quantitative’ methodological frameworks (though there are some significant differences). While I want you to be very critical of the tendency in the social sciences to import methods from other fields, because that makes it valid ‘science,’ I don’t mean to dismiss CCS altogether. But along with Jackson, I want to bring your attention to the sometimes dogmatic ways some scholars assert that there is one scientific method and anyone who doesn’t adhere to this particular method is doing something other than science. We will be engaging with two more methodological frameworks this semester – interpretive ethnography and discourse analysis – both of which would be condemned as heretics by the Social Science Elders if the Law of the Scientific Method was adopted in the social sciences.

As I've said many times, and again echoing Jackson, the most important aspect of any scientific research is internal consistency – in any methodological framework you employ, you have to have consistency between your original assumptions about the world and your connection to it as a researcher (scientific and philosophical ontology), how you know what you know about that world (epistemology), and your techniques of data collection and analysis (your methods). Together, your philosophical assumptions and (logically consistent) plan for data collection and analysis will inform your methodology – it is the knowledge-producing machine in which you stuff your data points and facts come out the other end. In short, in order to produce good social science, you shouldn’t strive to be ‘objective’ – you should strive to be logically consistent within your methodology.

I want you all to reflect on two things until next class: 1) Should policy relevance determine your research agenda; and 2) What are your ontological and epistemological commitments? Your understanding of social reality and your connection to it is expected to evolve over time, so don’t worry about being beholden to what you say in class for the duration of the course – I simply want you to think out loud about these issues. 

Sunday, January 18, 2015

The Point of Social Science Research


As you may have noted from the syllabus, this is not an exhaustive course of so-called qualitative methods and methodology. Over the coming months, we will be engaging with three major styles of research, namely small-n comparative case studies, interpretive ethnography, and relational analysis (even more specifically, discourse analysis). We will engage with major philosophical debates within the sciences through the readings and discussions in class, but I also want this class to give you an opportunity to gain some hands-on practice in both fieldwork and research design.

The point of teaching you research methods is to make you systematic and methodical investigators, as opposed to Op-Ed producers. The difference between a scientific study (and there are certainly those who disagree with me on this) and, say, a position paper, is the methodological framework, which is established before the study is undertaken. In other words, before embarking on your research, you have laid out for the world to see your ‘rules’ for your study. These rules tell your audience how you understand the reality you are investigating and what bars you set for making knowledge-claims – what kind of ‘evidence’ you will require of yourself to claim causality, for instance. I want to be very clear from the outset that there is and, indeed, should be diversity of methodologies in the social sciences, because different questions require different approaches. You cannot answer certain questions using a Comparative Case Study, and Interpretive Ethnography or Discourse Analysis are useless frameworks for other questions.

There is a tendency in the academic community to speak of ‘the scientific method,’ as if the same rules should apply to all studies, regardless of the research objectives and questions asked. This kind of dogmatism is thoroughly unhelpful in the quest for knowledge production in the social realm. Instead, whether or not something should be classified as ‘science’ must be judged on each study’s internal logic – whether it adheres to the rules of that particular methodology. If someone is employing a Comparative Case Study, then it’s validity must be evaluated based on the rules of CCS, not Interpretive Ethnography or Discourse Analysis. The same goes for the latter two as well, of course. Granted, even within each framework there are disagreements on the rules, but at least those debates can be fruitful, as opposed to a dogmatic approach that dismisses everything that isn’t founded on a logic born from the natural sciences as being ‘unscientific.’

Second, Graduate students (perhaps especially in policy-obsessed Washington, DC) are often of the view that the ‘usefulness’ of knowledge produced in the social sciences is determined by whether or not it results in policy. There are a number of things to consider here, not least the interjection that policy is not formulated based on ‘facts’ alone, which means that policymakers are very happy to ignore studies that don’t serve their interests. But another objection could be that knowledge production is an end in itself – learning about the social world may not always have immediate policy implications, but that doesn’t mean it’s not useful. Perhaps as a result of this eagerness to be policy relevant, when thinking about an appropriate issue to study, students often hone in on very contemporary events that are currently discussed by the media. But events still unfolding on the ground are not suitable for solid in-depth academic research, because in fluid, rapidly developing situations we are left doing a lot of guesswork, instead of systematic interpretation of data. It is also important to remember that science needs to be based in empirics, and that means using things that have actually happened to explain why and how it happened. That’s different from trying to predict what may happen in the future. All we can do with science – not just ‘qualitative,’ but ‘quantitative’ as well – is try to explain what has happened. We cannot make claims to predicting the future. You may want to use your findings to speculate on the future once you’re done, but that cannot be your research objective. In short, your research needs to explore an existing phenomenon and your research question cannot be about predicting the future.