Which of the following would a researcher be least likely to do when conducting a literature review?

Which of the following would a researcher be least likely to do when conducting a literature review?

CHRONOLOGICAL (by date): This is one of the most common ways, especially for topics that have been talked about for a long time and have changed over their history. Organise it in stages of how the topic has changed: the first definitions of it, then major time periods of change as researchers talked about it, then how it is thought about today.

BROAD-TO-SPECIFIC: Another approach is to start with a section on the general type of issue you're reviewing, then narrow down to increasingly specific issues in the literature until you reach the articles that are most specifically similar to your research question, thesis statement, hypothesis, or proposal. This can be a good way to introduce a lot of background and related facets of your topic when there is not much directly on your topic but you are tying together many related, broader articles.

MAJOR MODELS or MAJOR THEORIES: When there are multiple models or prominent theories, it is a good idea to outline the theories or models that are applied the most in your articles. That way you can group the articles you read by the theoretical framework that each prefers, to get a good overview of the prominent approaches to your concept.

PROMINENT AUTHORS: If a certain researcher started a field, and there are several famous people who developed it more, a good approach can be grouping the famous author/researchers and what each is known to have said about the topic. You can then organise other authors into groups by which famous authors' ideas they are following. With this organisation it can help to look at the citations your articles list in them, to see if there is one author that appears over and over.

CONTRASTING SCHOOLS OF THOUGHT: If you find a dominant argument comes up in your research, with researchers taking two sides and talking about how the other is wrong, you may want to group your literature review by those schools of thought and contrast the differences in their approaches and ideas.

Literature reviews determine what is known on a topic, how well this knowledge is established, and where future research might be directed. This page explains how to write literature reviews.

A literature review explores and evaluates the literature on a specific topic or question. It synthesises the contributions of the different authors, often to identify areas that need further exploration.

You may be required to write a literature review as a standalone document or part of a larger body of research, such as a thesis.

  • The point of a standalone literature review is to demonstrate that you have read widely in your field and you understand the main arguments.
  • As part of a thesis or research paper, the literature review defines your project by establishing how your work will extend or differ from previous work and what contribution it will make.

In the best literature reviews, the writer:

  • Has a clear understanding of key concepts within the topic.
  • Clarifies important definitions and terminology.
  • Covers the breadth of the specific topic.
  • Critically discusses the ideas in the literature and evaluates how authors present them.
  • Clearly indicates a research gap for future enquiry.

This video outlines a step by step approach to help you evaluate readings, organise ideas and write critically. It provides examples of how to connect, interpret and critique ideas to make sure your voice comes through strongly.

Practical examples of how to write a literature review.

Tips for research, reading and writing

  • How can I refine my topic?
  • How should I approach my research?
  • How can I read effectively?
  • How should I structure my literature review?
  • When should I start writing?

The most important thing to remember is that you are writing a review. That means you must move past describing what other authors have written by connecting, interpreting and critiquing their ideas and presenting your own analysis and interpretation.

Explore all resources

  • A guide to writing an effective proposal that effectively outlines the research you will undertake at a higher level of study.

  • This module will introduce you to the concept of critical thinking and provide strategies to help you think, read, take notes and write critically.

  • You’ve done the research, but how do you integrate it seamlessly into your academic writing?

Which of the following would a researcher be least likely to do when conducting a literature review?

Get tailored advice from an Academic Skills adviser by booking an individual appointment, or get quick advice from one of our Academic Writing Tutors in our online drop-in sessions.

Get one-on-one advice

1 German Cochrane Centre, Freiburg and Department of Nephrology, Charité, Berlin, Germany

Find articles by Regina Kunz

2 Centre for Reviews and Dissemination, York, UK

Find articles by Jos Kleijnen

3 German Cochrane Centre, Freiburg, Germany

Find articles by Gerd Antes

Systematic reviews and meta-analyses are a key element of evidence-based healthcare, yet they remain in some ways mysterious. Why did the authors select certain studies and reject others? What did they do to pool results? How did a bunch of insignificant findings suddenly become significant? This paper, along with a book1 that goes into more detail, demystifies these and other related intrigues.

A review earns the adjective systematic if it is based on a clearly formulated question, identifies relevant studies, appraises their quality and summarizes the evidence by use of explicit methodology. It is the explicit and systematic approach that distinguishes systematic reviews from traditional reviews and commentaries. Whenever we use the term review in this paper it will mean a systematic review. Reviews should never be done in any other way.

In this paper we provide a step-by-step explanation—there are just five steps—of the methods behind reviewing, and the quality elements inherent in each step (Box 1). For purposes of illustration we use a published review concerning the safety of public water fluoridation, but we must emphasize that our subject is review methodology, not fluoridation.

You are a public health professional in a locality that has public water fluoridation. For many years, your colleagues and you have believed that it improves dental health. Recently there has been pressure from various interest groups to consider the safety of this public health intervention because they fear that it is causing cancer. Public health decisions have been based on professional judgment and practical feasibility without explicit consideration of the scientific evidence. (This was yesterday; today the evidence is available in a York review2,3, identifiable on MEDLINE through the freely accessible PubMed clinical queries interface [http://www.ncbi.nlm.nib.gov/entrez/query/static/clinical.html], under ‘systematic reviews’.)

The research question may initially be stated as a query in free form but reviewers prefer to pose it in a structured and explicit way. The relations between various components of the question and the structure of the research design are shown in Figure 1. This paper focuses only on the question of safety related to the outcomes described below.

Box 1 The steps in a systematic review

  • Step 1: Framing questions for a review

    The problems to be addressed by the review should be specified in the form of clear, unambiguous and structured questions before beginning the review work. Once the review questions have been set, modifications to the protocol should be allowed only if alternative ways of defining the populations, interventions, outcomes or study designs become apparent

  • Step 2: Identifying relevant work

    The search for studies should be extensive. Multiple resources (both computerized and printed) should be searched without language restrictions. The study selection criteria should flow directly from the review questions and be specified a priori. Reasons for inclusion and exclusion should be recorded

  • Step 3: Assessing the quality of studies

    Study quality assessment is relevant to every step of a review. Question formulation (Step 1) and study selection criteria (Step 2) should describe the minimum acceptable level of design. Selected studies should be subjected to a more refined quality assessment by use of general critical appraisal guides and design-based quality checklists (Step 3). These detailed quality assessments will be used for exploring heterogeneity and informing decisions regarding suitability of meta-analysis (Step 4). In addition they help in assessing the strength of inferences and making recommendations for future research (Step 5)

  • Step 4: Summarizing the evidence

    Data synthesis consists of tabulation of study characteristics, quality and effects as well as use of statistical methods for exploring differences between studies and combining their effects (meta-analysis). Exploration of heterogeneity and its sources should be planned in advance (Step 3). If an overall meta-analysis cannot be done, subgroup meta-analysis may be feasible

  • Step 5: Interpreting the findings

    The issues highlighted in each of the four steps above should be met. The risk of publication bias and related biases should be explored. Exploration for heterogeneity should help determine whether the overall summary can be trusted, and, if not, the effects observed in high-quality studies should be used for generating inferences. Any recommendations should be graded by reference to the strengths and weaknesses of the evidence

Is it safe to provide population-wide drinking water fluoridation to prevent caries?

  • The populations—Populations receiving drinking water sourced through a public water supply

  • The interventions or exposures—Fluoridation of drinking water (natural or artificial) compared with non-fluoridated water

  • The outcomes—Cancer is the main outcome of interest for the debate in your health authority

  • The study designs—Comparative studies of any design examining the harmful outcomes in at least two population groups, one with fluoridated drinking water and the other without. Harmful outcomes can be rare and they may develop over a long time. There are considerable difficulties in designing and conducting safety studies to capture these outcomes, since a large number of people need to be observed over a long period. These circumstances demand observational, not randomized studies. With this background, systematic reviews on safety have to include evidence from studies with a range of designs.

To capture as many relevant citations as possible, a wide range of medical, environmental and scientific databases were searched to identify primary studies of the effects of water fluoridation. The electronic searches were supplemented by hand searching of Index Medicus and Excerpta Medica back to 1945. Furthermore, various internet engines were searched for web pages that might provide references. This effort resulted in 3246 citations from which relevant studies were selected for the review. Their potential relevance was examined, and 2511 citations were excluded as irrelevant. The full papers of the remaining 735 citations were assessed to select those primary studies in man that directly related to fluoride in drinking water supplies, comparing at least two groups. These criteria excluded 481 studies and left 254 in the review. They came from thirty countries, published in fourteen languages between 1939 and 2000. Of these studies 175 were relevant to the question of safety, of which 26 used cancer as an outcome.

Adequate study design as a marker of quality, is listed as an inclusion criterion in Box 1. This approach is most applicable when the main source of evidence is randomized studies. However, randomized studies are almost impossible to conduct at community level for a public health intervention such as water fluoridation. Thus, systematic reviews assessing the safety of such interventions have to include evidence from a broader range of study designs. Consideration of the type and amount of research likely to be available led to inclusion of comparative studies of any design. In this way, selected studies provided information about the harmful effects of exposure to fluoridated water compared with non-exposure.

After studies of an acceptable design have been selected, their in-depth assessment for the risk of various biases allows us to gauge the quality of the evidence in a more refined way. Biases either exaggerate or underestimate the ‘true’ effect of an exposure. The objective of the included studies was to compare groups exposed to fluoridated drinking water and those without such exposure for rates of undesirable outcomes, without bias. Safety studies should ascertain exposures and outcomes in such a way that the risk of misclassification is minimized. The exposure is likely to be more accurately ascertained if the study was prospective rather than retrospective and if it was started soon after water fluoridation rather than later. The outcomes of those developing cancer (and remaining free of cancer) are likely to be more accurately ascertained if the follow-up was long and if the assessment was blind to exposure status.

When examining how the effect of exposure on outcome was established, reviewers assessed whether the comparison groups were similar in all respects other than their exposure to fluoridated water. This is because the other differences may be related to the outcomes of interest independent of the drinking-water fluoridation, and this would bias the comparison. For example, if the people exposed to fluoridated water had other risk factors that made them more prone to have cancer, the apparent association between exposure and outcome might be explained by the more frequent occurrence of these factors among the exposed group. The technical word for such defects is confounding. In a randomized study, confounding factors are expected to be roughly equally distributed between groups. In observational studies their distribution may be unequal. Primary researchers can statistically adjust for these differences, when estimating the effect of exposure on outcomes, by use of multivariable modelling.

Put simply, use of a prospective design, robust ascertainment of exposure and outcomes, and control for confounding are the generic issues one would look for in quality assessment of studies on safety. Consequently, studies may range from satisfactorily meeting quality criteria, to having some deficiencies, to not meeting the criteria at all, and they can be assigned to one of three prespecified quality categories as shown in Table 1. A quality hierarchy can then be developed, based on the degree to which studies comply with the criteria. None of the studies on cancer were in the high-quality category, but this was because randomized studies were non-existent and control for confounding was not always ideal in the observational studies. There were 8 studies of moderate quality and 18 of low quality.

Description of quality assessment of studies on safety of public water fluoridation

Quality categoriesHighModerateLow
Prospective design Prospective Prospective Prospective or retrospective
Ascertainment of exposure Study began within 1 year of fluoridation Study began within 3 years of fluoridation Study began >3 years after fluoridation
Ascertainment of outcome Follow-up for at least 5 years and blind assessment Long follow-up and blind assessment Short follow-up and unblinded assessment
Control for confounding Adjustment for at least three confounding factors (or use of randomization) Adjustment for at least one confounding factor No adjustment for confounding factors

To summarize the evidence from studies of variable design and quality is not easy. The original review3 provides details of how the differences between study results were investigated and how they were summarized (with or without meta-analysis). This paper restricts itself to summarizing the findings narratively. The association between exposure to fluoridated water and cancer in general was examined in 26 studies. Of these, 10 examined all-cause cancer incidence or mortality, in 22 analyses. Of these, 11 analyses found a negative association (fewer cancers due to exposure), 9 found a positive one and 2 found no association. Only 2 studies reported statistically significant differences. Thus no clear association between water fluoridation and increased cancer incidence or mortality was apparent. Bone/joint and thyroid cancers were of particular concern because of fluoride uptake by these organs. Neither the 6 studies of osteosarcoma nor the 2 studies of thyroid cancer and water fluoridation revealed significant differences. Overall no association was detected between water fluoridation and mortality from any cancer. These findings were also borne out in the moderate-quality subgroup of studies.

In the fluoridation example, the focus was on the safety of a community-based public health intervention. The generally low quality of available studies means that the results must be interpreted with caution. However, the elaborate efforts in searching an unusually large number of databases provide some safeguard against missing relevant studies. Thus the evidence summarized in this review is likely to be as good as it will get in the foreseeable future. Cancer was the harmful outcome of most interest in this instance. No association was found between exposure to fluoridated water and specific cancers or all cancers. The interpretation of the results may be generally limited because of the low quality of studies, but the findings for the cancer outcomes are supported by the moderate-quality studies.

After having spent some time reading and understanding the review, you are impressed by the sheer amount of published work relevant to the question of safety. However, you are somewhat disappointed by the poor quality of the primary studies. Of course, examination of safety only makes sense in a context where the intervention has some beneficial effect. Benefit and harm have to be compared to provide the basis for decision making. On the issue of the beneficial effect of public water fluoridation, the review3 reassures you that the health authority was correct in judging that fluoridation of drinking water prevents caries. From the review you also discovered that dental fluorosis (mottled teeth) was related to concentration of fluoride. When the interest groups raise the issue of safety again, you will be able to declare that there is no evidence to link cancer with drinking-water fluoridation; however, you will have to come clean about the risk of dental fluorosis, which appears to be dose dependent, and you may want to measure the fluoride concentration in the water supply and share this information with the interest groups.

The ability to quantify the safety concerns of your population through a review, albeit from studies of moderate to low quality, allows your health authority, the politicians and the public to consider the balance between beneficial and harmful effects of water fluoridation. Those who see the prevention of caries as of primary importance will favour fluoridation. Others, worried about the disfigurement of mottled teeth, may prefer other means of fluoride administration or even occasional treatment for dental caries. Whatever the opinions on this matter, you are able to reassure all parties that there is no evidence that fluoridation of drinking water increases the risk of cancer.

With increasing focus on generating guidance and recommendations for practice through systematic reviews, healthcare professionals need to understand the principles of preparing such reviews. Here we have provided a brief step-by-step explanation of the principles. Our book1 describes them in detail.

Articles from Journal of the Royal Society of Medicine are provided here courtesy of Royal Society of Medicine Press