Page 21 

Chapter Two Research planning

CHAPTER CONTENTS

Introduction 21
Sources of research questions 21
The formulation of research questions 22
The justification of research questions 22
Formulation of research aims 23
Hypotheses in quantitative research 23
Research strategies 23
Survey research strategies 23
Experimental research strategies 24
Research planning: ethical considerations 24
Selection of research strategies: economic considerations 26
Steps in research planning 27
Summary 27
Self-assessment 27
True or false 27
Multiple choice 28

Introduction

Before the actual collection of information or data begins, researchers generally invest considerable time and effort in the planning of their investigations. The first step is to select and to justify the research problem. The second step is to transform the problem into clear researchable aims and research questions and, in the case of quantitative research, hypotheses are also usually specified. Research planning includes the selection of an appropriate research strategy for providing the required evidence to answer the research question. The selection of the appropriate research strategy may depend not only on the research questions being asked, but also on ethical issues and resource constraints that may define the scope and form of the investigation.

The specific aims of this chapter are to:

1. Discuss how research questions are selected and justified and derived from research aims.
2. Broadly outline research strategies available for specific types of investigations.
3. Discuss the ethical and economic constraints on the planning and implementation of research.

Sources of research questions

Advances in health research depend on the identification of questions and problems that promote the development of more powerful theories of health, illness and disability, and then devising more effective ways of assessing, treating and preventing health problems. This advancement depends very much on researchers asking the ‘right’ questions and identifying solvable problems and then applying sound investigation methods to these questions and problems.

  Page 22 

The formulation of research questions depends on the expertise of researchers who have a combination of theoretical knowledge and practical experience for identifying problems and asking the right questions. The professional background of researchers is an important consideration, as one’s educational background and practices will influence what are seen as theoretically and professionally interesting problems.

The formulation of even apparently simple research questions is often the culmination of intensive preliminary observations, spending long hours in the library reading through and critically analysing related research, discussing the issues and thinking through a range of issues.

The health care setting in which the researcher works may also have a strong influence on the formulation of research questions. For example, it is an important consideration if the researcher works in a laboratory, a hospital, a community clinic or in private practice. These settings will often influence how the patients’ problems are perceived, and how researchers define professionally relevant solutions to these problems.

In many areas of health care, including areas such as rehabilitation, community health and neurosciences, researchers sharing similar interests may join together in multidisciplinary research teams. Because of the broad range of expertise and perspectives, such teams may be in a position to formulate interesting research questions that can be simultaneously addressed from these different perspectives.

The formulation of research questions

The formulation of research questions is a creative act. It draws upon consideration of previous relevant work in the area under study. This work may be reviewed and the review may give rise to questions that have not been answered by previous work. A literature review is the usual way in which knowledge gaps are identified. The purpose of the review is to answer the questions ‘What do we know?’ and ‘What do we not know?’

Inspiration for research questions often stems from personal experience. Exposure to an issue or problems may raise questions suitable for a research study. Most health practitioners constantly pose questions like ‘What is the best and most effective method of treating this condition?’ and ‘How can we ensure that patients or clients get what they want from this service?’

The justification of research questions

When researchers call on public funds to conduct their studies, they must explain in what way their intended study will contribute to scientific knowledge and/or clinical practice. In ‘pure’ or ‘basic’ scientific research, a proposed investigation is justified in terms of its potential contribution to existing knowledge. In the context of ‘applied’ health research, the investigator may be required to demonstrate that the research will in some way contribute to the improved practice of health care, and benefit patients.

Before embarking on the design and conduct of a research project, the investigator must review previous work and publications relevant to the aims of the intended project. This process is essential, both for providing the appropriate background and context for the investigation, and for justifying the investigation in contributing to existing knowledge. It is a waste of money to duplicate very similar research (although deliberate replication of previous studies may be a legitimate activity if there are uncertainties about the validity of a previous study).

Literature searching may be carried out at appropriate research centres or libraries where scientific and professional journals are stored and, of course, by using the Internet. There are powerful web-based search methods that can simplify the search. The most widely used search tool for health research publications is probably PubMed, the web-based Public Medline (see http://www.ncbi.nlm.nih.gov/entrez/). Professional library staff can help you to locate the relevant literature. However, the critical evaluation of the literature depends on the application of research methods for the identification of controversies or ‘gaps’ in the available evidence.

  Page 23 

Formulation of research aims

Hypotheses in quantitative research

Quantitative research is normally structured so as to test a research hypothesis. Hypotheses are propositions about relationships between variables or differences between groups that are to be tested. Hypotheses may be concerned with relationships between observations or variables (for example, ‘Is there an association between level of exercise and annual health care expenditure?’) or differences between groups (for example, ‘Do patients treated under therapy x exhibit greater improvement than those treated under therapy y ?’). A variable is a property that varies, for example the room temperature, the ages of the patients, or their improvement on a clinical measurement scale.

Some quantitative research projects do not have a hypothesis to be tested in any formal sense. For example, if you are assessing the health needs of a local community, there need not be any specific expectation or hypothesis to be tested. The purpose of the research may be simply to describe accurately the characteristics of the study sample and target population. The goal is not to test a specific hypothesis. This does not mean the research is deficient; it just means it has a different objective from other types of quantitative research projects. So hypothesis testing is a characteristic of many, but not all, quantitative projects.

Qualitative research does not usually test hypotheses. It is concerned with understanding the personal meanings and interpretations of people concerning specified issues. However, most qualitative researchers work with specified research aims and questions to guide their investigation.

The formulation of adequate research aims generally involves a process during which the researcher gradually refines a broadly based issue into more specific operationally defined statements. This process must take into account the logical requirements of designs for information and data collection and ethical standards for conducting health research. In addition, the research aims must inform a realistic data collection procedure which can be supported by the resources available for researchers. We will examine these issues in the rest of this chapter.

Research strategies

Research planning also involves the selection or formulation of research strategies. Research strategies are established procedures for designing and executing research. The research strategies that are outlined in this book include experimental and quasi-experimental strategies, single case research, surveys and qualitative research. Before detailed discussion of the differences between these strategies is undertaken in the following sections, it is instructive to compare the basic structures of survey research and experimental research. As we shall see in subsequent sections, these are fundamentally different ways of conducting research.

Survey research strategies

The three essential steps involved in survey research strategies are shown in Figure 2.1. You will note in Figure 2.1 that the researcher defines the population of interest, selects the cases to be studied and then observes or studies them, generating the data. There is no intended active intervention in the situation by the researcher. Indeed, intervention that would change the phenomenon being studied is discouraged and avoided. In this type of research strategy there is a constant tension between the requirements for close and detailed observation (proximity to the phenomenon under study) and the possibility that the behaviour of the research participants under study may change because they are being studied. There are techniques for dealing with this problem, such as the use of unobtrusive measures and participant observation, which will be discussed in subsequent chapters.

image

Figure 2.1 Structure of a survey research strategy.

  Page 24 

Experimental research strategies

Experimental research strategies involve a sequence of steps, as illustrated in Figure 2.2. As with the survey research strategy, cases are selected for study from a defined population. However, these cases are then assigned (generally by chance or random method) to a treatment (intervention) or non-treatment (non-intervention) group, and then given the intervention or, in clinical contexts, the treatment. The term ‘treatment’ is used here in the sense that the subject or event is being systematically influenced or manipulated by the investigator; that is, in a broader sense than with medical or physical treatment. For this reason the broader term ‘intervention’ is often used in place of the term ‘treatment’. The intervention and non-intervention groups are then observed and compared. If everything went according to plan, any differences in the results for the intervention and non-intervention groups should be a result of the effects of the intervention. This type of design is often called a randomized controlled (sometimes clinical) trial or RCT. In some review systems such as the Cochrane Collaboration system, the RCT is considered to be the ‘best’ level of evidence to establish the effectiveness of an intervention.

image

Figure 2.2 Experimental research strategies.

Thus, there is quite a difference in the structure of experimental and survey (non-experimental) and qualitative research strategies. Cook & Campbell (1979) proposed a separate class of ‘quasi-experimental’ strategies (which are really just tightly structured non-experimental strategies) that we will also cover later in this book.

The decision of the investigator to adopt specific research strategies depends on the phenomenon being studied and the specific question type of research (causal or descriptive) being investigated.

Research planning: ethical considerations

In health research, where the health and lives of people participating in the study may be at stake, ethical considerations play a key role in research planning and implementation. For instance, consider the question of whether cigarette smoking has negative impacts on health. One way of investigating this question would be through experiments, which are generally considered to be the design best suited to establishing causal relationships. However, it would be ethically unacceptable to have a number of people randomly assigned to a group involved in long-term, heavy cigarette smoking as this would very likely damage their health. Clearly, to meet ethical criteria, evidence must come from studies in which investigators observe the effects of smoking in persons who have themselves chosen to smoke.

A research process is judged to be ethical by the extent to which it conforms to or complies with the set of standards or conventions in the context in which the research is to be carried out. In differ-ent countries, the various medical research councils have developed detailed statements concerning these standards. In the United Kingdom the Medical Research Council has a series of statements and publications available at its web-site (http://www.mrc.ac.uk), as does the Australian National Health and Medical Research Council on its web-site at http://www.nhmrc.gov.au. Canada has the statements by the Interagency Advisory Panel on Research Ethics (http://www.pre.ethics.gc.ca). In the United States there is a proliferation of bodies with research ethics guidelines, mostly based upon the 1979 work by the Belmont group. All of these guidelines draw upon the pioneering 1964 Helsinki declaration from the World Medical Association.

  Page 25 

Most health services and higher education institutions now have their own ethics committees to oversee health research involving humans and/or animals. Ethics committees, along with the researcher, are responsible for interpreting and enforcing ethical standards. It should be noted, however, that even when a given research proposal is judged to be ethical, it may not be seen as moral by specific individuals or groups in a community. A good example is animal experimentation when the research involves painful or stressful procedures such as surgery. According to the value systems of some persons and groups, such work may be considered to be intrinsically immoral. From this viewpoint, there may be no acceptable justification for inflicting suffering on animals, even when the results may be beneficial for humans. Others may argue that such procedures are morally justified, given that they are necessary for the advancement of the biological and medical sciences and provided that reasonable steps are taken to limit the suffering of the animals. There are no absolute solutions for such controversies as they involve human values, but discussing these issues in public may help to establish a degree of consensus in the community and guidance for the ethical decisions of researchers.

It is beyond the scope of this discussion to examine in full the ethics of health research, but the following issues are central to making decisions in these areas:

1. Benefits. Who is to benefit from the research? One likes to think that ‘humanity’, ‘the participants’, or ‘health science’ are going to be the beneficiaries of health research. A slightly more cynical analysis points to the investigators as having the most to gain, at least in the short term. After all, given a successful outcome for the research project, they stand to satisfy their curiosity, improve their career prospects or to raise their esteem before colleagues. In practice, benefits accruing to the investigator, the participants and health science have to be carefully weighed in relation to the conduct of any project. The protection of the rights and welfare of the participants is the primary consideration of research ethics.
2. Informed consent. Informed consent by the participants is a necessary condition for ethically acceptable research. This means that all the risks involved in the investigation must be explained to prospective participants, as well as the possible benefits, and they must decide about their participation or non-participation in an informed manner. Honest explanation of the procedures to the participant takes considerable skill, as disclosing the design of the study may influence the expectations and behaviour of the participants. Also, special care needs to be taken when the participants are in some way limited in their ability to understand the risks; for example, people who are intellectually disabled, or confused under the influence of drugs. Informed consent implies a freedom of choice: participants must feel confident that refusal to participate will not prejudice their subsequent clinical treatment.
3. Protection of participants. It is the investigator’s responsibility to minimise the chances of long-term deleterious effects to subjects. Dangers can arise from administering new interventions or treatments with unknown side effects, denying interventions of known effectiveness or using invasive assessment techniques. The welfare of laboratory animals must not be ignored. There are nowadays legally enforceable constraints in most jurisdictions on the conditions for using animals in research.
4. Minimizing discomfort. The investigator must also minimize even short-term pain, anxiety, discomfort or embarrassment involved in an investigation, especially if it is not part of routine therapeutic practice. This is an important issue, as some therapists and researchers take a mistakenly ‘proprietary’ view of their patients, imagining that they should put up with some discomfort for the good of medical science. In the past, patients in public wards of hospitals and long-term prisoners have been most vulnerable to questionable ethical practices.
5. Privacy. Health care research may involve collecting information that can lead to the embarrassment or stigmatization of the participants. The identity of participants must be protected; for instance, by ‘coding’ their real names so that they may not be identified even inadvertently. In qualitative research where the full text of comments may be reported, it is important that this text does not inadvertently identify people through the reporting of identifiable scenarios or names.
  Page 26 
6. Community values. Some research, such as that involving the assessment of sexual functioning or the investigation of human fetuses, calls for very sensitive planning. Anatomical research involving the use of human cadaver material must be planned to ensure respectful handling and disposal. Even if the investigator does not agree, the values and taboos of groups in the community must be taken into consideration when planning the investigation.
7. Conservation of resources. A fundamental value is that the time and effort of researchers and subjects and the resources of the community should not be wasted on a badly planned investigation. Of course, there can never be a guarantee that an investigation will produce clinically useful results. However, some poorly designed projects are doomed to failure even before the data collection begins, and lead to confusion and controversy in the professional literature. Therefore, the appropriate use of high-quality and sound research methods is not only useful for solving problems, but constitutes an ethical necessity. Many ethics committees also vet projects for scientific merit before the project is approved.

A responsible investigator is required to take into consideration ethical principles and to plan research projects accordingly so that no, or the minimum possible, harm is caused. Therefore, the health researcher must use considerable ingenuity in designing valid investigations, while maintaining ethical values. One of the roles of ethics committees is to guide investigators on complex issues, and to ensure that research is conducted in accordance with accepted community principles.

Selection of research strategies: economic considerations

Selection of appropriate research strategies can also be influenced by the resources available to investigators. Some projects involving the evalu-ation of the safety and effectiveness of new drugs, or the identification of risk factors in cardiac disease, have taken tens of millions of dollars to finance. Research planning takes into account economic issues, such as:

1. Availability of participants. Here the investigator has to consider if enough people can participate in the project under the required conditions. Attention has to be paid to issues such as the frequency of the disorder in the community, problems in identifying participants and their level of voluntary participation. As will be shown in Chapter 3, selection of participants is crucial for the validity of a study.
2. Availability of equipment. Some equipment is costly to acquire or to operate (for example, CT (computed tomography) scanners, biochemical assays, experimental drugs). Research planning should take these expenses into account.
3. Availability of expertise. Specialized assessment techniques and the administration of clinical treatments require professional expertise. If these are beyond the investigator’s competence or if the experimental design requires an unbiased, ‘blind’ therapist or assessor (see Ch. 5), there must be means for securing them.
4. Availability of time. Research projects have a tendency to take considerably longer than an inexperienced researcher might expect, due to the erratic and at times disastrous workings of Murphy’s law: ‘If anything can go wrong, it will’. Equipment breaks down and needs to be repaired, subjects ‘disappear’, collaborators might not deliver services promised. Research planning should take into account possible problems and how these might affect the time scale of investigations. This is a particularly important issue for postgraduate students.

The availability of resources strongly influences the scope of the research programme and also the research strategy selected by the investigator. A research project must be shown to be feasible from a cost viewpoint before it is initiated. It is only after the ethical constraints and economic resources have been evaluated that the researchers’ questions can be transformed into clearly defined hypotheses or aims.

It is important when conducting research that the identities of all supporting agencies and individuals are disclosed to the participants in order that their agreement to participate is fully informed.

  Page 27 

Steps in research planning

The following steps should be considered in quantitative research before actual data collection begins. The term ‘data’ refers to the set of observations recorded during an investigation.

1. Identification of the research problem.
2. Retrieval and critical evaluation of relevant literature for justifying and giving the context of the research problem.
3. Formulation of precise research aims and questions in the light of:
(a) the information to be collected
(b) the appropriate research strategies
(c) the ethical considerations required to protect participants and the community
(d) the projected cost of the project.
4. In addition, as to be discussed in this book, research planning takes into account:
(a) how the participants are to be selected
(b) the design of the investigation
(c) how the data are to be collected
(d) how the data are to be analysed.

The above points are written up in the form of a research protocol. This protocol is submitted to supervisors, colleagues or ethical committees, for scrutiny of methodological and ethical problems. It is only when the protocol is acceptable to all these parties that the actual data collection begins. It is often desirable to carry out a small-scale preliminary study, called a ‘pilot’. This is an economical way of identifying and eliminating potential problems in the large-scale investigation.

Summary

The planning of a research project requires the transformation of a vague question or problem into clearly stated aims or questions. To achieve this, the researcher should review the relevant literature and evaluate ethical considerations and economic constraints in conducting the investigation. Next, an appropriate research strategy needs to be selected. On the basis of the above, the researcher is in a position to state precisely the aims or hypotheses being investigated.

Before data collection begins, a protocol for the complete investigation is scrutinized by colleagues to correct methodological problems, or to prevent unethical research.

Self-assessment

Explain the meaning of the following terms:

ethics
informed consent
literature review
Murphy’s law
non-experimental study
pilot study
research strategy
variable

True or false

1. Scientific research always involves the testing of hypotheses.
2. A sample is a subset of the data.
3. The population being studied is defined after the sample has been selected.
4. A research protocol is a summary of the data obtained in an investigation.
5. A pilot is a small-scale research programme to demonstrate the feasibility of an investigation.
6. Human cadavers are not sentient beings, therefore their treatment falls outside the scope of medical ethics.
7. Planning quantitative research includes specifying the variables to be studied and how these are to be measured.
8. Abstract constructs, like ‘intelligence’ or ‘motiv-ation’, cannot have empirical referents.
9. A literature review is necessary for providing the appropriate background and rationale for an investigation.
10. Well-established data collection techniques are called research findings.
11. A non-experimental design involves the assignment of subjects to treatment groups.
12. Both experimental and non-experimental designs involve the drawing of an appropriate sample from the population being studied.
  Page 28 
13. An anthropologist studying how ethnic groups relate to illness would tend to adopt a quantitative research strategy.
14. The clear explanation of the risks involved in a research project is a necessary condition for obtaining informed consent from a subject.
15. The use of correct research methods does not constitute an ethical necessity.
16. A hypothesis is a proposition about the relationship existing between variables or prediction of differences between groups.
17. Some scientific research projects do not involve the testing of hypotheses.
18. Existing theories are the only appropriate sources for experimental hypotheses.
19. In a non-experimental study there is no need to pay attention to sampling.
20. Experimental designs involve the assignment of the sampled subjects into treatment groups.
21. Experimental designs are more appropriate than non-experimental designs for demonstrating causal relationships.
22. The subjects participating in medical research are generally the most likely beneficiaries of the project.
23. Informed consent of human subjects is necessary even when the investigation is not apparently embarrassing or dangerous.
24. It is unethical to study human sexual behaviour because people find it embarrassing to serve as subjects.
25. Medical researchers should expect that patients who receive free hospital treatment should participate in medical experiments.
26. The correct use of research methods in conducting an investigation is useful, but not an ethical necessity.
27. A well-designed, relevant research project will always be financed, regardless of the expense.
28. A variable is a property or attribute which varies from subject to subject.

Multiple choice

1. The aim of research planning is to:
a generate appropriate aims or clear-cut research hypotheses
b select an appropriate research strategy
c identify possible ethical or economic limitations in conducting the investigation
d a and b
e all of the above.
2. A ‘literature review’:
a is a list of research publications relevant to an investigation
b should discredit research findings which are inconsistent with the hypothesis
c should include only findings which directly support the hypothesis being investigated
d should be a critical review of findings relevant to an investigation.
3. Which of the following is common to both experimental and non-experimental research strategies?
a random assignment
b selection of cases to be studied
c experimental hypothesis
d participant observation
e field research.
4. Which of the following is unique to the experimental research strategy?
a random assignment
b selection of cases to be studied
c definition of population
d participant observation
e field research.
5. The availability of resources to conduct an investigation:
a is not the concern of a scientific researcher
b has an influence on the scope and design of the investigation
c is determined by Murphy’s law
d none of the above.
6. 32 degrees Centigrade is an example of:
a a variable
b the value of a variable
c a ratio
d a null hypothesis.
7. A variable is:
a a property which can take different values across different individuals
b a property which can take different values within an individual
c both a and b
d neither a nor b.
8. Which of the following ethical requirements is the most difficult to satisfy when conducting a placebo-controlled randomized clinical trial?
a Ensuring the privacy of the research participants.
b Obtaining informed consent from all research participants.
  Page 29 
c Protecting research participants from unnecessary risks.
d Providing the best available treatment for all research participants.
9. Which of the following represents the most explicitly formulated research aim?
a The aim of the present project was to investigate if health care workers in Gotham City were satisfied with their pay and career prospects.
b The aim of the present project was to investigate if emotionally disturbed persons living in Gotham City received adequate medical care.
c The aim of the present project was to identify the reasons why health professionals in Gotham City leave their professions, and turn to other types of employment.
d The aim of the present project was to identify the proportion of teenagers in Gotham City smoking more than 10 cigarettes a day.
10. A research protocol should make explicit:
a the justification for undertaking the research project
b the way in which the data are to be collected
c the empirical evidence provided by the investigation
d a and b.
11. Which of the following represents a non-researchable problem (in the context of the scientific method)?
a Is aspirin preferable to steroids in reducing the symptoms of arthritis?
b Does the use of alcohol result in greater levels of brain damage than the use of marijuana?
c Are painful experiments involving animals justified if they lead to benefits to patients?
d Do people coming from a low socioeconomic class receive poorer health care than people from a higher class?
  Page 30