Page 245 

Chapter Twenty One Qualitative data analysis

CHAPTER CONTENTS

Introduction 245
Understanding meaning in everyday life 246
Coding qualitative data 246
Predetermined coding 246
Coding and thematic analysis 246
Content analysis 247
Thematic analysis, verstehen and grounded theory 248
Interpretation and social context 249
The accuracy of qualitative data analysis 251
Summary 251
Self-assessment 252
True or false 252
Multiple choice 252

Introduction

Qualitative data are collected through techniques such as in-depth interviews, focus groups, participant observation and narratives spoken and written by the participants and researchers involved in the study. Qualitative data analysis refers to the processes by which researchers organize the information collected and analyse the meanings of what was said and done by the participants. In qualitative data analysis we bring our values, experiences and social understanding into analysing and constructing the meaning of what our respondents were telling us about their lives. At the same time, qualitative data analysis is prin-cipled; there are various explicit and shared strategies for summarizing and making sense of the data and checking the accuracy of our interpretation.

The aims of this chapter are to:

1. Describe the process of interpreting qualitative research data.
2. Describe the basic procedures involved in conducting content analysis, thematic analysis and semiotic analysis.
3. Discuss the comparative advantages and disadvantages of using different types of qualitative analyses.
4. Explain basic strategies for ensuring the accuracy of interpretations.
  Page 246 

Understanding meaning in everyday life

Understanding people involves discovering the contents of people’s minds – their beliefs, desires, intentions. There is nothing remarkable or supernatural being implied by this, simply that we infer mental contents by listening to and observing what people say and do, taking into account the social settings in which these actions occur.

For instance, one person says to another: ‘Would you like to come in for a coffee?’ What are the intentions of the speaker? Does he or she simply want to prepare the dark beverage and consume it in silence? Or should we look for ‘hidden’ or ‘latent’ meanings in order to understand the speaker’s true intentions? Consider these two everyday scenarios (Polgar & Swerissen 2000):

1. You have been given a lift by a work mate who had to go out of his way to drive you home. Although you are tired, it seems the right thing to offer the driver refreshments. However, your intention is to be polite and acknowledge the colleague’s effort; in fact you are hoping that the invitation will be refused. The ‘hidden message’ here is: ‘Thank you and goodbye!’ The worst-case outcome is that the colleague is too insensitive to read your intentions and stays around gossiping until midnight. Bad luck!
2. The British film ‘Brassed Off’ (1996) has a scene where a young woman is escorted home after a date by a young man. A dialogue was (approximately) as follows:
She: Come up for a cup of coffee.
He: I don’t drink coffee.
She: That’s alright; I don’t have any.

The above dialogue shows the nuances in the everyday use of language. Just as we sometimes misunderstand meanings and intentions in everyday life, we can also misinterpret the data produced by qualitative data collection. To avoid error we need to cross-check the accuracy of our interpretation.

Coding qualitative data

Qualitative data analysis frequently involves analysis of verbatim transcripts of dialogues and narratives. A common point of departure for analysing the transcript data is to develop a coding system. A coding system is to organize the data into specific classes or categories. There are two fundamental approaches to coding: predetermined and emerging with thematic analysis.

Predetermined coding

Predetermined coding uses predetermined categories to organize and analyse the transcripts.

For example, you might be conducting a survey to determine how clients experienced a rehabilitation programme at your workplace. Say that you conducted 20 in-depth interviews and produced a 100-page transcript representing what people said in these interviews. Considering your research aims, you might code the statements into three categories:

1. Satisfaction with the rehabilitation programme.
2. Dissatisfaction with the rehabilitation programme.
3. Neutral statements.

At the simplest level, analysing the first two categories would enable us to understand the reasons why the clients found the rehabilitation programmes to be satisfactory or unsatisfactory. This information could be useful for improving the programme. In most studies the coding system would be a good deal more elaborate.

Coding and thematic analysis

An alternative approach to using predetermined codes is to develop a coding system that identifies common themes as they emerge from the text. Different qualitative researchers advocate different approaches to coding but it typically involves the following steps. The researchers first study their materials, in this case transcripts, and develop a close familiarity with the material. During this process, all the concepts, themes and ideas are noted to form major categories. Often, the researcher will then attach a label and/or number to each category and record their positions in the transcript. Coding is an iterative process (we retrace our steps), with the researcher coding and recoding as the scheme develops. The researchers, having developed the codes and coded the trans-cripts, then attempt to interpret their meanings in the context in which they appeared. The reporting of this process typically involves ‘thick’ or detailed description of the categories and their context, with liberal use of examples from the original transcripts.

  Page 247 

Content analysis

Content analysis allows the quantification of units of meaning occurring in a text or a number of texts. Content analysis can be seen as a blending of quantitative and qualitative methods. The recognition and coding of meaning are qualitative, while the counting of the meaningful ‘chunks’ is quantitative. The ‘meaningful chunks’ can be words, sentences or paragraphs, that is, the units of language that were coded by the researchers from the narratives and dialogues.

For example, in an unpublished study one of the authors was interested in how leading newspapers were representing the use of stem cells in medical research. The following research questions were asked:

1. How extensive was the newspaper coverage of the medical use of stem cells?
2. What was the attitude of the newspapers (positive, negative or neutral) to the use of stem cells?

In relation to question 1, the data were collected by identifying relevant newspaper articles published on the topic and measuring the length of the columns. They were quantified by counting the number of articles published per month across the selected time interval. The data rele-vant to question 2 were obtained by identifying statements supportive or critical of using stem cells or simply ‘neutral’ descriptions of the nature and possible uses of stem cells. The column lengths for each of the three categories were measured and the percentages devoted to each were graphed across the months. Therefore, the content analysis provided evidence for the level of interest and changing attitudes of the media towards the use of stem cells. This evidence was relevant to understanding the cultural context in which government policy for using stem cells was being formulated.

The discussion of content analysis provides a good opportunity for raising the issue of computer-assisted data analysis. As the texts are often transcribed using personal computers the text is available in electronic form. This means that the text can be fed into a software package to assist with its analysis. For example, say that the data representing the contents of a hundred newspaper articles were transcribed into a software package. We could now introduce our codes and identify the segments of the whole text which use the relevant words/phrases/sentences. The segments can then be retrieved, examined or modified (cut and paste) on screen. Also, various frequency counts can be readily performed using software tools.

A detailed discussion for selecting and using computer packages is beyond the scope of the present book. Interested readers might find Liamputtong Rice & Ezzy (1999, pp 202–210) a useful introduction to selecting and using currently available software packages for expediting and improving qualitative data analysis in general (not only for content analysis). Liamputtong Rice & Ezzy have discussed the ambivalent attitude among qualitative researchers to computer-assisted data analysis. A key objection has been the distancing of the researcher from the creativity and surprising insights afforded by the more hands-on approaches. Another objection is that meanings of words and sentences sometimes do not follow dictionary definitions but rather have to be understood in the general context. The true meaning of certain subtle and ambiguous communications can be missed in crude and electronically conducted data analyses.

Content analysis is a technique that combines elements of both qualitative and quantitative approaches. We interpret the meaning of the text for developing our coding strategy for organizing or ‘chunking’ the text and then we use statistics to describe the quantities of text devoted to a specific point of view. Content analysis can be used to test hypotheses, for example hypotheses addressing media perspectives on embryonic stem cell research.

  Page 248 

Thematic analysis, verstehen and grounded theory

Counting and hypothesis testing is not the essence of the qualitative approach. What we are trying to do is to see things from the perspectives of our informants and to explain their actions from their points of view. The German word verstehen is often used in phenomenological research to express the notion of ‘putting ourselves in someone else’s shoes’ or attaining a strong empathy with their situation. Empathy with other people might seem quite simple, just something we do as human beings. It is worthwhile remembering, however, that sometimes we misunderstand how people feel or think, even when they are our close friends or family. In the same way, we might misunderstand the points of view of persons who are very different to us in age, gender, education, language and culture. Yet, it is essential to understand the points of views of the people to whom we offer health services. So how does ‘verstehen’ arise through qualitative health research?

First, as we described earlier, our data collection must use a technique (in-depth interviews, written materials, focus groups, etc.) which enables our respondents to express their point of view. Second, we can adopt a theoretical framework for explaining our understanding of the respondents’ experiences. The key point, in the context of grounded theory, is that our explan-ations or theories must emerge inductively from the information provided by our informants. The theory is constructed gradually as more evidence is provided by additional informants. Third, the data are often analysed by coding and thematic analysis as we outlined earlier in this chapter.

A theme is a grouping of ideas or meanings which emerge consistently in the text. The themes emerging from the data illuminate the experiences of the informants and enable us to understand their points of view (verstehen). Let us consider an example of thematic analysis.

In a study titled ‘The plight of rural parents caring for adult children with HIV’, Fred McGinn (1996) studied the experiences of parents caring for their adult children with acquired immuno-deficiency syndrome/human immuno-deficiency virus (AIDS/HIV). In-depth interviews were conducted with eight mothers and two fathers from rural families involved in this task. The interview transcripts were analysed using a thematic analysis/grounded theory approach (Miles & Huberman 1984).

McGinn extracted three major themes:

1. Physical and mental problems related to HIV/AIDS. Here the parents discussed their experiences of their children’s problems and the emotional consequences of physical decline and death, e.g:

‘He would fall over, so I would sit him in the wheelchair. And then from within a week in November he went from not being able to sit in the wheelchair to not getting out of bed. And he went from eating little bits of food along with taking a liquid nutrition to just liquid nutrition … and then he got to where he wouldn’t swallow the liquid nutrition and he subsisted on just water and juices and Pepsi … and then in the end he even refused them: he wouldn’t take anything … He just wasted away.’

2. Stigma associated with having AIDS. Because of the mode of transmission of AIDS and superstitious fears of contacting the condition, many of the parents found themselves socially isolated at such a very difficult time of their lives, e.g:

‘That Sunday, I never will forget. I asked him, ‘Do you want anybody to know?’ And I don’t remember if he said no, but his head … he almost shook it off. No way did he want anybody to know what the real problem was. But I want you to know that that was a terrible, stressful time. People who came, who normally would be support for me … weren’t. It was a real traumatic experience.’

3. Health care. This theme summarizes the difficulties of accessing necessary health services in rural settings. Even though there were serious deficiencies in health services, one mother reported:

‘As for the hospital, I couldn’t have asked for a better hospital. There may have been nurses who refused to work with him, I don’t know, but the nurses that did come in were great … They even hugged and kissed him goodbye whenever he got well and left. They didn’t act like they didn’t want to be around him and I appreciated that. I think that’s important.’

  Page 249 

These three themes enable us to understand and empathize with the parents of these very sick young people. Also, they were the bases for recommending improvements in rural health care which directly address the needs of AIDS sufferers and their families in non-metropolitan environments.

Also, we must note that McGinn’s paper reported the experiences of people in the mid-1990s, living in rural Canada. With improvements in the treatment and prevention of AIDS and a decrease in the stigma attached to the condition, the experiences of families caring for sufferers have improved. Because of differences and changes in practices and the cultural context, it is always important to note the time at and place in which interpretive research was carried out.

Interpretation and social context

As we have seen, qualitative data analysis is a systematic way of interpreting texts. There are many areas of study (e.g. history, politics, theology) where the interpretation of texts is an essential part of the research process. What these diverse disciplines have in common with qualitative health research is the recognition that the meaning of language and texts must be interpreted in a cultural context.

An example is hermeneutics, which is a method that was originally used to analyse the meaning of religious texts. Consider the meaning of the term ‘god’. When the Romans spoke of Augustus Caesar as a ‘god’, they were referring to him as a hero who was immortal in the history of Rome. The use of the term ‘god’ by a polytheistic is quite different to meanings in the context of contemporary Judaeo–Christian or Muslim traditions. The meaning of the term must be interpreted in the context of the religious tradition (polytheistic, monotheistic) and the position of the speaker (believer, non-believer).

An important issue in reading texts is that they might have implicit (in addition to explicit) meanings. Semiotics is a method of textual interpret-ation which seeks to uncover the hidden, omitted meanings implicit in a text. In order to do this, we must adopt a theoretical framework in terms of which we can ‘deconstruct’ a text. The theor-etical framework reflects our understanding of the culture within which the text was produced. You have probably read the book Animal Farm by George Orwell. There are several levels at which one can read this story; for example:

A fairy tale about the imaginary lives of farm animals where animals have human traits and concerns.
A morality tale in Aesop’s style about how power corrupts and leads to betrayal.
A critique of Stalinism and a retelling of the bloody history of the Bolshevik revolution and its social consequences in the Soviet Union.

In order to identify Orwell’s book as a political critique, one needs to understand the historical/cultural context in which the author worked and lived.

To illustrate these points, we will examine a letter to the editor in a Melbourne newspaper by a woman writer who was apparently concerned about the physical and mental health of young men:

They’re just asking for it.

Since the weather improved, it seems that young men all over the place are discarding their shirts and going about half-naked. I worry for them. Do they have any idea of what a provocative and inviting image they put across?

To my mind, they would be doing themselves a far greater service if they would just compromise a little and get dressed properly. It might not seem fair, and it might be less comfortable, but at least then there wouldn’t any longer be the danger of urge-driven women raping young men because of the confusing visual signals they so often put across.

(In Polgar & Swerissen 2000).

  Page 250 

Let us analyse the text consistent with a procedure outlined in Daly et al (1997). First, let us analyse the explicit content of the letter.

1. Tone. Serious and condescending as that used by authority figures such as teachers and magistrates; ‘… now, see here young man, this is for your own benefit …’ type of communication.
2. Language. Moralistic (e.g. ‘dressed properly’, ‘going about half-naked’) and calling for responsibility (‘compromising a little’). Also the language is alarmist, predicting that men non-compliant to a dress code will be assaulted.
3. The aim. The explicit aim of the letter is to warn young men of the dire consequences of dressing immodestly and thereby inviting attention by ‘urge-driven women’.
4. Repetition of ideas. The main idea seems to be that a scantily dressed man is sexually provocative to women. Another notion is that women are struggling to control powerful sexual urges. It is implied that men should accept responsibility for suppressing these urges in women. If men dress immodestly then they have to accept the consequences.
5. Themes. The first basic explicit theme is the importance of men taking responsibility in projecting a safe, chaste image. The second is the power and danger of women’s sexual urges which can explode into assault when provoked by scantily dressed males. An underlying theme which you might have detected is one of ‘blaming the victim’; if men are assaulted it is their fault, they should have been more careful.
6. Oppositional elements. If men ignore the letter writer’s message and move towards the choice of scanty dress then they are putting themselves at risk. That is, modest dress means safety while immodest dress means assault. Another dichotomy is gender: women are sexually powerful and dangerous; men are presented as naive victims lacking any defined sexuality. In different ways the overt themes emerging from the text are demeaning of both males and females.

You may have different views about how best to interpret the text. As Daly and her colleagues (1997, p. 183) noted: ‘Let us now make some basic semiotic moves across the data’. Let us interrogate the ‘data’ further using the six points suggested by Daly et al (1997).

Is the content of the letter preposterous? Are there scantily dressed male construction workers being dragged into alleys by out-of-control schoolgirls? Are there gangs of libidinous females cruising our streets with evil purposes on their minds? Preposterous! The incidence of assault by women is, to all intents and purposes, very low, regardless of how men choose to dress. Therefore, the letter is unsound or it may be a parody.
In order to understand the meaning of the letter, we play a language game as follows: read ‘male’ for ‘female’ in the text. The story now reads quite differently; in fact it resembles a more usual story told to women concerning their responsibility for ensuring that men don’t assault them.
One might propose that the latent agenda for the letter was to ridicule the notion that victims are in some way responsible for the violence of the perpetrator.
The apparent hero of the explicit story was the author, the caring woman dispensing advice to young men to keep themselves safe by dressing in a chaste fashion. In the implicit story the villains are people who blame women for contributing to violence simply by the clothes they wear.
What is missing from the original story? Or what was introduced? The writer introduced the notion of female sexuality as an urge that could transform at the slightest provocation into violence. If this notion is ludicrous for females, the question is, how can it be tenable for males? You might ask that if the true intention of the author was to denounce myths of male sexuality then why didn’t she say so directly? This is like asking why George Orwell wrote a fairy tale with talking farm animals rather than a direct denouncement of totalitarianism and Stalinist terror. It is a question of how we use language; we use metaphors, parables, hyperboles and so on for expressing ourselves in an interesting, colourful fashion. Semiotics is one of the ways for interpreting the meanings that might be hidden or camouflaged in the original narrative.
A basic principle for semiotic analysis is selecting a theoretical framework in terms of which we can deconstruct the original narrative and identify its hidden, repressed or mystifying elements. The key to the previous analysis was that the basic idea underpinning the argument (that immodestly dressed males are in danger of being assaulted by out-of-control women) was false and absurd. Our interpretation of the meaning is that the text is a parody of the victim-blaming discourses in patr-iarchal societies. By adopting a feminist theoretical framework we are in a position to identify the hidden meaning of the text and infer the intentions of the author.
  Page 251 
There is always the possibility that we have misinterpreted the text and misrepresented the intentions of the author. What if she was genuinely concerned about the welfare of young men? The fact of the matter is that there are no absolute guarantees. It might be that, regardless of his well-known interest in political affairs, George Orwell was simply intending to create a children’s story when he wrote Animal Farm.

In the next part of this chapter we will outline some strategies for ensuring validity and reliability for qualitative research.

The accuracy of qualitative data analysis

How can we be sure that the themes we identified in a text accurately reflect the actual views of the participants? Also, how do we know that similar themes would emerge from the reports of other people who had similar experiences to our sample?

There are a number of qualitative researchers who ensure that the collection and interpretation of their evidence are carried out in a methodologically rigorous fashion. The following represent some of the key methodological criteria for conducting qualitative research (Lincoln & Guba 1985):

1. Data saturation. This refers to ensuring that we have collected sufficient data from our respondents. Saturation occurs when the themes and ideas emerging from the text become repetitive and we are confident that the inclusion of new participants or further engagement with current participants will not lead to novel themes or interpretations.
2. Credibility. Checking if the interpretation of the evidence is judged as accurate by both the research participants and also independent clinicians or scholars. In other words, does your interpretation make sense and if not, why not?
3. Auditability. This refers to each of the steps of the research process being clearly described, so that an independent scholar can critique the research process from its beginning to the analysis and interpretation of the data. The auditor confirms or rejects the researcher’s methodology.
4. Triangulation. This strategy involves the use of multiple independent methods for collecting data and checking if the themes and interpret-ations emerging from these different methods are consistent and matching. For example, in order to evaluate client satisfaction with a health service you might use three different data collection strategies (Fig. 21.1). It is useful (but not essential) to use three different data collection methods. The researcher might, if appropriate, use both qualitative (e.g. in-depth interviews) and quantitative (e.g. structured questionnaires) methods for data collection. These are called ‘mixed’ designs (see also Chs 1 and 9).
image

Figure 21.1 Triangulation using different approaches to data collection.

As you can see, the methodological concerns in qualitative research are parallel to those of quantitative research (i.e. reliability and validity). However, because of the differences in the way the two types of research are conducted, the terminology for describing the methodological principles is somewhat different.

Summary

There are different approaches to analysing qualitative data depending on the theoretical framework and data collection strategies adopted by the researchers. However, as we saw in this chapter, there are several common aspects to qualitative data analysis:

‘Immersion’ in the data; reading and re-reading the texts to develop a sense of what it is that respondents are trying to say.
  Page 252 
Developing a coding system and identifying the themes emerging from the text.
Using these themes as a basis for insight, empathy (verstehen) with the experiences, emotions and thinking of the respondents.
Interpreting and theorizing the respondents’ experiences in the context of cultural or historical settings.
Ensuring the accuracy of the interpretations by cross-checking themes and explanations with other sources of data, other researchers’ interpret-ations of the data, and the respondents.

Self-assessment

Explain the meaning of the following terms:

auditability
coding
coding and thematic analysis
content analysis
credibility
data saturation
grounded theory
hermeneutics
predetermined coding categories
semiotics
theme
theoretical framework
triangulation
verstehen

True or false

1. Hermeneutics refers to understanding meanings in their cultural contexts.
2. Quantitative data analysis is a far more subject-ive process than qualitative analysis.
3. Qualitative data analysis is a systematic way of ‘reading’ another person’s mental states.
4. In the context of qualitative data analysis, the term ‘text’ refers to the transcripts of in-depth interviews, focus groups, etc.
5. Predetermined coding is based on categories of meaning emerging as the texts are analysed.
6. When coding and thematic analysis are carried out together, it is essential to maintain the first coding system chosen to avoid thematic confusion.
7. Content analysis often employs statistical analyses of the data.
8. A basic objection to computer-assisted coding and analysis is that this technique might obscure more subtle meanings communicated by the respondents.
9. ‘Verstehen’ is a German word referring to the precise dictionary definitions of the words used in a text.
10. A fundamental objective of qualitative data analysis is to enable the researcher to see health-related events from the perspectives of the respondents.
11. A theme is a specific idea which reflects the unique experiences of only one respondent.
12. Hermeneutics is a form of religious practice requiring withdrawal from everyday life.
13. Semiotics requires the adoption of a theoretical framework for identifying hidden meanings in a text.
14. The results of a qualitative study represent experiences which are useless unless they are true for all times and places.
15. ‘Auditability’ refers to the clarity of the methodology employed in conducting a qualitative research project.
16. ‘Data saturation’ addresses an issue analogous to external validity in quantitative research.
17. The results of quantitative and qualitative research cannot be compared with each other.
18. As there are no absolute guarantees for the truth of our interpretation of other people’s experiences, all qualitative research lacks credibility.
19. Qualitative analyses produce evidence relevant for constructing social theories, but have no relevance to evidence-based health care.
20. In conducting evidence-based health care, we should combine the results of qualitative and quantitative research to identify the best practice for our clients.

Multiple choice

1. Which of the following statements is not an aspect of ‘intepretivist’ approaches?
a Society exists as the result of meaningful social interactions.
b It is the actors themselves who are best able to define social situations.
c A society is defined by the sum of the total behaviours of individuals constituting a population.
  Page 253 
d Data collection requires a degree of empathy with the way in which people experience their social situation.
2. Themes are:
a the planning process used by the researcher
b organized around interview data
c the result of the research question
d ideas represented in a pattern.
3. A qualitative researcher could develop codes for interview data:
a after conducting all of the interviews
b before collecting data
c both before and during data collection
d all of the above.
4. Latent content of themes in qualitative data refers to:
a the hidden or underlying themes
b the second level of data collection
c what was not said directly in the data
d both a and c.
5. Which of the following statements is true in coding data?
a Words, concepts and themes are selected.
b The researcher must wait until all data are collected before establishing codes.
c Concepts are weighted as far more important than themes.
d The researcher must be trained in using a qualitative computer program.
6. In a qualitative study of public perceptions of people with mental illness, you intend to identify the social significance of being perceived as mentally ill. You are well aware that most of your respondents will attempt to appear caring and tolerant, even when they hold strong prejudices against people with mental illness. A useful approach for analysing the data in relation to the above question is called:
a grounded theory
b semiotic analysis
c content analysis
d typological categorization.
7. The term ‘grounded theory’ refers to:
a any sociological theory that is based on empirical evidence
b any theory, sociological or otherwise, that is based on empirical evidence
c a systematic way of formulating theories which are the sources for empirically testable hypotheses
d generating and testing interpretive theories during the course of data collection.
8. Generally, an interpretive theory aims to explain:
a the social causes of human action
b the experiences of people in the context of their cultural settings
c why people do what they do
d the factors which interact in a society for generating human personality.
9. The process of interpreting texts (such as the Bible) in the cultural contexts in which they were written is called:
a hermeneutics
b content analysis
c semiotics
d discourse analysis.
10. The term ‘data saturation’ as used in qualitative research is most closely related to what in quantitative research?
a Sample size.
b Validity of the evidence.
c Reliability of the evidence.
d ‘Scaling’ of the data (nominal, ordinal, etc.)
11. The term ‘triangulation’ as used in qualitative research is most closely related to what in quantitative research?
a Reliability.
b Validity.
c Hypothesis testing.
d Descriptive data analysis.
12. Which of the following is not a traditional approach to qualitative research?
a Ethnomethodology.
b Grounded theory.
c Phrenology.
d Phenomenology.
  Page 254