
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
- Publications
- Account settings
- My Bibliography
- Collections
- Citation manager

Save citation to file
Email citation, add to collections.
- Create a new collection
- Add to an existing collection
Add to My Bibliography
Your saved search, create a file for external citation management software, your rss feed.
- Search in PubMed
- Search in NLM Catalog
- Add to Search
An updated review of the scientific literature on the origin of SARS-CoV-2
Affiliation.
- 1 Universitat Rovira i Virgili, Laboratory of Toxicology and Environmental Health, School of Medicine, 43201, Reus, Catalonia, Spain. Electronic address: [email protected]
- PMID: 36037920
- PMCID: PMC9420317
- DOI: 10.1016/j.envres.2022.114131
More than two and a half years have already passed since the first case of COVID-19 was officially reported (December 2019), as well as more than two years since the WHO declared the current pandemic (March 2020). During these months, the advances on the knowledge of the COVID-19 and SARS-CoV-2, the coronavirus responsible of the infection, have been very significant. However, there are still some weak points on that knowledge, being the origin of SARS-CoV-2 one of the most notorious. One year ago, I published a review focused on what we knew and what we need to know about the origin of that coronavirus, a key point for the prevention of potential future pandemics of a similar nature. The analysis of the available publications until July 2021 did not allow drawing definitive conclusions on the origin of SARS-CoV-2. Given the great importance of that issue, the present review was aimed at updating the scientific information on that origin. Unfortunately, there have not been significant advances on that topic, remaining basically the same two hypotheses on it. One of them is the zoonotic origin of SARS-CoV-2, while the second one is the possible leak of this coronavirus from a laboratory. Most recent papers do not include observational or experimental studies, being discussions and positions on these two main hypotheses. Based on the information here reviewed, there is not yet a definitive and well demonstrated conclusion on the origin of SARS-CoV-2.
Keywords: COVID-19; Hosts; Laboratory leak; SARS-CoV-2; Zoonotic origin.
Copyright © 2022. Published by Elsevier Inc.
Conflict of interest statement
Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Similar articles
- Abstracts of Presentations at the Association of Clinical Scientists 143 rd Meeting Louisville, KY May 11-14,2022. [No authors listed] [No authors listed] Ann Clin Lab Sci. 2022 May;52(3):511-525. Ann Clin Lab Sci. 2022. PMID: 35777803 No abstract available.
- What we know and what we need to know about the origin of SARS-CoV-2. Domingo JL. Domingo JL. Environ Res. 2021 Sep;200:111785. doi: 10.1016/j.envres.2021.111785. Epub 2021 Jul 28. Environ Res. 2021. PMID: 34329631 Free PMC article.
- Tracing the origin of Severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2): A systematic review and narrative synthesis. Thakur N, Das S, Kumar S, Maurya VK, Dhama K, Paweska JT, Abdel-Moneim AS, Jain A, Tripathi AK, Puri B, Saxena SK. Thakur N, et al. J Med Virol. 2022 Dec;94(12):5766-5779. doi: 10.1002/jmv.28060. Epub 2022 Sep 7. J Med Virol. 2022. PMID: 35945190 Free PMC article.
- The SARS-CoV-2 origin dilemma: Zoonotic transfer or laboratory leak? Ruiz-Medina BE, Varela-Ramirez A, Kirken RA, Robles-Escajeda E. Ruiz-Medina BE, et al. Bioessays. 2022 Jan;44(1):e2100189. doi: 10.1002/bies.202100189. Epub 2021 Nov 22. Bioessays. 2022. PMID: 34812505 Free PMC article.
- Update of the current knowledge on genetics, evolution, immunopathogenesis, and transmission for coronavirus disease 19 (COVID-19). Tizaoui K, Zidi I, Lee KH, Ghayda RA, Hong SH, Li H, Smith L, Koyanagi A, Jacob L, Kronbichler A, Shin JI. Tizaoui K, et al. Int J Biol Sci. 2020 Sep 12;16(15):2906-2923. doi: 10.7150/ijbs.48812. eCollection 2020. Int J Biol Sci. 2020. PMID: 33061805 Free PMC article. Review.
- Updated analysis to reject the laboratory-engineering hypothesis of SARS-CoV-2. Wu F. Wu F. Environ Res. 2023 May 1;224:115481. doi: 10.1016/j.envres.2023.115481. Epub 2023 Feb 18. Environ Res. 2023. PMID: 36804316 Free PMC article.
- Scientific evidence on the origin of SARS-CoV-2. Núñez-Delgado A, Ahmed W, Romande JL, Dhama K, Domingo JL. Núñez-Delgado A, et al. Environ Res. 2023 Jan 1;216(Pt 2):114631. doi: 10.1016/j.envres.2022.114631. Epub 2022 Oct 19. Environ Res. 2023. PMID: 36272589 Free PMC article.
- Bhattacharya S., Tilak R., Bose C., Sinha S. Is the origin and emergence of SARS-CoV-2 ingenuous? J. Commun. Dis. 2021;53:232–235.
- Bloom J.D., Chan Y.A., Baric R.S., Bjorkman P.J., Cobey S., Deverman B.E., Fisman D.N., Gupta R., Iwasaki A., Lipsitch M., Medzhitov R., Neher R.A., Nielsen R., Patterson N., Stearns T., van Nimwegen E., Worobey M., Relman D.A. Investigate the origins of COVID-19. Science. 2021;372:694. - PMC - PubMed
- Borsetti A., Scarpa F., Maruotti A., Divino F., Ceccarelli G., Giovanetti M., Ciccozzi M. The unresolved question on COVID-19 virus origin: the three cards game? J. Med. Virol. 2022;94:1257–1260. - PubMed
- Cattaneo A.M. Reviewing findings on the polypeptide sequence of the SARS-CoV-2 S-protein to discuss the origins of the virus. Future Virol. 2022 doi: 10.2217/fvl-2021-0233. - DOI - PMC - PubMed
- Chakraborty C., Bhattacharya M., Nandi S.S., Mohapatra R.K., Dhama K., Agoramoorthy G. Appearance and re-appearance of zoonotic disease during the pandemic period: long-term monitoring and analysis of zoonosis is crucial to confirm the animal origin of SARS-CoV-2 and monkeypox virus. Vet. Q. 2022;42:119–124. - PMC - PubMed
Publication types
- Search in MeSH
LinkOut - more resources
Full text sources.
- Elsevier Science
- Europe PubMed Central
- Ovid Technologies, Inc.
- PubMed Central
- Genetic Alliance
- MedlinePlus Health Information
Miscellaneous
- NCI CPTAC Assay Portal
- Citation Manager
NCBI Literature Resources
MeSH PMC Bookshelf Disclaimer
The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.
- Published: 24 August 2016
Early Childhood Educators’ Well-Being: An Updated Review of the Literature
- Tamara Cumming 1
Early Childhood Education Journal volume 45 , pages 583–593 ( 2017 ) Cite this article
10k Accesses
89 Citations
2 Altmetric
Metrics details
Researchers are increasingly recognising the connections between early childhood educators’ well-being and their capacity for providing high quality education and care. The past five years have seen an intensification of research concerning early childhood educators’ well-being. However, fragmentation along conceptual, contextual and methodological lines makes it difficult to clearly identify the most effective focus for future research. The purpose of this article is to identify trends in, and implications of recent research concerned with educators’ well-being. Attention is given to ways recent studies address concerns raised in a review of earlier literature (Hall-Kenyon et al. in Early Child Educ J 42(3):153–162, 2014 , doi: 10.1007/s10643-013-0595-4 ), and what implications recent studies have for future research efforts concerned with educators’ well-being.
This is a preview of subscription content, access via your institution .
Access options
Buy single article.
Instant access to the full article PDF.
Price excludes VAT (USA) Tax calculation will be finalised during checkout.
Rent this article via DeepDyve.
As explained in the search procedures, crossover with the era of literature reviewed by Hall-Kenyon et al. ( 2014 ) was done deliberately. There is no duplication of studies reviewed between this current review and that of Hall-Kenyon et al.
It is possible that, despite searching numerous databases, there may be more studies concerned with educators’ well-being than have been covered in this review and in Hall-Kenyon et al.’s ( 2014 ). A search using the term ‘early childhood educators’ in journal articles published prior to 2012, or the inclusion of book chapters or dissertations could potentially expand the body of literature further.
Two articles by Rentzou reported on data from the same study, therefore I have counted one study only for this author.
Abu Taleb, T. F. (2013). Job satisfaction among Jordan’s kindergarten teachers: Effects of workplace conditions and demographic characteristics. Early Childhood Education Journal, 41 , 143–152. doi: 10.1007/s10643-012-0526-9 .
Article Google Scholar
Andrew, Y. (2015). What we feel and what we do: Emotional capital in early childhood work. Early Years: An International Research Journal, 35 (4), 351–365. doi: 10.1080/09575146.2015.1077206 .
Australian Children’s Services Education & Care Quality Authority. (2012). The National Quality Framework. http://acecqa.gov.au/national-quality-framework/introducing-the-national-quality-framework .
Boyd, M. (2013). I love my work but…”The professionalization of early childhood education. The Qualitative Report, 18 , 1–20. http://www.nova.edu.ssss/QR/QR18/boyd71.pdf .
Bullough, R. V., Jr. (2015). Teaming and teaching in ECE: Neoliberal reforms, teacher metaphors, and identity in Head Start. Journal of Research in Childhood Education, 29 , 410–417. doi: 10.1080/02568543.2015.1050563 .
Cassidy, D. J., Lower, J. K., Kintner-Duffy, V. L., Hegde, A. V., & Shim, J. (2011). The day-to-day reality of teacher turnover in preschool classrooms: An analysis of classroom context and teacher, director, and parent perspectives. Journal of Research in Childhood Education , 25 (1), 1–23. doi: 10.1080/02568543.2011.533118 .
Center for for the Study of Child Care Employment. (2014). Supportive environment quality underlying adult learning. www.irle.berkeley.edu/cscce/?s=Sequal .
Cheng, J.-N., & Chen, Y. (2011). The empirical study of the kindergarten teachers’ job satisfaction in Taiwan: Exploring the effect of the intrinsic demand, external reward, and organizational treatment. The Journal of Human Resource and Adult Learning, 7 (2), 127–132.
Google Scholar
Cheruvu, R., Souto-Manning, M., Lencl, T., & Chin-Calubaquib, M. (2015). Race, isolation, and exclusion: What early childhood teacher educators need to know about the experiences of pre-service teachers of color. Urban Review , 47 , 237–265. doi: 10.1077/s11256-014-0291-8 .
Cheuk, W. H., Wong, K. S., & Rosen, S. (2011). The effects of being spurned and self-esteem on depersonalization and coping preferences in kindergarten teachers: The case of Hong Kong. Social Psychology of Education, 14 (1), 57–73. doi: 10.1007/s11218-010-9138-7 .
Corr, L., Cook, K., LaMontagne, A. D., Waters, E., & Davis, E. (2015). Associations between Australian early childhood educators’ mental health and working conditions. Australasian Journal of Early Childhood, 40 (3), 69–78.
Corr, L., Davis, E., Cook, K., Waters, E., & LaMontagne, A. D. (2014). Fair relationships and policies to support family day care educators’ mental health: A qualitative study. BMC Public Health . doi: 10.1186/1471-2458-14-1214 .
Cumming, T. (2015). Early childhood educators’ experiences in their work environments: Shaping (im)possible ways of being an educator? Complicity: An International Journal of Complexity and Education, 12 (1), 52–66.
Curbow, B., Spratt, K., Ungaretti, A., McDonnell, K., & Breckler, S. (2000). Development of the child care worker job stress inventory. Early Childhood Research Quarterly, 15 , 515–536.
de Schipper, E. J., Riksen-Walraven, J. M., Geurts, S. A. E., & Derksen, J. J. L. (2008). General mood of professional caregivers in child care centers and the quality of caregiver-child interactions. Journal of Research in Personality, 42 , 515–526. doi: 10.1016/j.jrp.2007.07.009 .
Erdiller, Z. B., & Doğan, Ö. (2015). The examination of teacher stress among Turkish early childhood education teachers. Early Child Development and Care , 185 (4), 631–646. doi: 10.1080/03004430.2014.946502 .
Faulkner, M., Gerstenblatt, P., Lee, A., Vallejo, V., & Travis, D. (2014). Childcare providers: Work stress and personal well-being. Journal of Early Childhood Research . doi: 10.1177/1476718X14552871 .
Foucault, M. (1980). Power/knowledge . Brighton: Harvester.
Hall-Kenyon, K. M., Bullough, R. V., MacKay, K. L., & Marshall, E. E. (2014). Preschool teacher well-being: A review of the literature. Early Childhood Education Journal, 42 (3), 153–162. doi: 10.1007/s10643-013-0595-4 .
Hur, E., Jeon, L., & Buettner, C. K. (2016). Preschool teachers’ child-centred beliefs: Direct and indirect associations with work climate and job-related wellbeing. Child Youth Care Forum , 45 (3), 451–465. doi: 10.1007/s10566-015-9338-6 .
International Labour Organization. (2014). ILO Policy Guidelines on the promotion of decent work for early childhood education personnel . Geneva.
Jennings, P. A. (2015). Early childhood teachers’ well-being, mindfulness and self-compassion in relation to classroom quality and attitudes towards challenging students. Mindfulness, 6 , 732–743. doi: 10.1007/s12671-014-0312-4 .
Jeon, L., Buettner, C. K., & Hur, E. (2016). Preschool teachers’ professional background, process quality, and job attitudes: A person-centred approach. Early Education & Development , 27 (4), 551–571. doi: 10.1080/10409289.2016.1099354 .
Jorde-Bloom, P. (1988). Closing the gap: An analysis of teacher and administrator perceptions of organizational climate in the early childhood setting. Teaching and Teacher Education , 4 (2), 111–120.
Jovanovic, J. (2013). Retaining early childhood educators. Gender, Work and Organization, 20 (5), 528–544. doi: 10.1111/j.1468-0432.2012.00602.x .
Kilderry, A. (2015). The intensification of performativity in early childhood education. Journal of Curriculum Studies, 47 (5), 633–652. doi: 10.1080/00220272.2015.1052850 .
King, E. K., Johnson, A. V., Cassidy, D. J., Wang, Y. C., Lower, J. K., & Kintner-Duffy, V. L. (2015). Preschool teachers’ financial well-being and work time supports: Associations with children’s emotional expressions and behaviors in classrooms. Early Childhood Education Journal . doi: 10.1007/s10643-015-0744-z .
Kotaman, H. (2014). Turkish early childhood teachers’ emotional problems in early years of their professional lives. European Early Childhood Education Research Journal . doi: 10.1080/1350293X.2014.970849 .
Kusma, B., Groneberg, D. A., Nienhaus, A., & Mache, S. (2012). Determinants of day care teachers’ job satisfaction. Central European Journal of Public Health , 20 (3), 191–198.
Løvgren, M. (2016). Emotional exhaustion in day-care workers. European Early Childhood Education Research Journal, 24 (1), 157–167. doi: 10.1080/1350293X.2015.1120525 .
Nislin, M. A., Sajaniemi, N. K., Sims, M., Suhonen, E., Maldonado Montero, E. F., Hirvonen, A., et al. (2016). Pedagogical work, stress regulation and work-related well-being among early childhood professionals in integrated special day-care groups. European Journal of Special Needs Education, 31 (1), 27–43. doi: 10.1080/08856257.2015.1087127 .
Ota, C. L., Baumgartner, J. L., & Berghout Austin, A. M. (2013). Provider stress and children’s active engagement. Journal of Research in Childhood Education , 27 , 61–73. doi: 10.1080/02568543.2012.739588 .
Rentzou, K. (2012). Examination of work environment factors relating to burnout syndrome of early childhood educators in Greece. Child Care in Practice, 18 (2), 165–181. doi: 10.1080/13575279.2012.657609 .
Royer, N., & Moreau, C. (2015). A survey of Canadian early childhood educators’ psychological wellbeing at work. Early Childhood Education Journal , 44 (2), 135–146. doi: 10.1007/s10643-015-0696-3 .
Schreyer, I., & Krause, M. (2016). Pedagogical staff in children’s day care centres in Germany—Links between working conditions, job satisfaction, commitment and work-related stress. Early Years An International Research Journal . doi: 10.1080/09575146.2015.1115390 .
Wagner, S. L., Forer, B., Cepeda, I. L., Goelman, H., Maggi, S., D’Angiulli, A., et al. (2013). Perceived stress and Canadian early childcare educators. Child and Youth Care Forum, 42 , 53–70. doi: 10.1007/s10566-012-9187-5 .
Whitaker, R., Dearth-Wesley, T., & Gooze, R. A. (2015). Workplace stress and the quality of teacher-children relationships in Head Start. Early Childhood Research Quarterly, 30 , 57–69. doi: 10.1016/j.ecresq.2014.08.008 .
Whitebook, M., Howes, C., & Phillips, D. (1990). The national child care staffing study. Final report: Who Cares? Child care teachers and the quality of care in America . Washington, DC: Center for the Child Care Workforce.
Whitebook, M., & Ryan, S. (2011). Degrees in context: Asking the right questions about preparing skilled and effective teachers of young children . Rutgers, NJ: National Institute for Early Education Research.
Download references
Acknowledgments
The author wishes to thank Professor Jennifer Sumsion for her generous advice and feedback on drafts of this article, as well as the helpful suggestions of the anonymous reviewers.
Author information
Authors and affiliations.
Charles Sturt University, Suite 1.01, Quad 3, Bennelong Parkway, Sydney Olympic Park, Sydney, NSW, 2127, Australia
Tamara Cumming
You can also search for this author in PubMed Google Scholar
Corresponding author
Correspondence to Tamara Cumming .
Rights and permissions
Reprints and Permissions
About this article
Cite this article.
Cumming, T. Early Childhood Educators’ Well-Being: An Updated Review of the Literature. Early Childhood Educ J 45 , 583–593 (2017). https://doi.org/10.1007/s10643-016-0818-6
Download citation
Published : 24 August 2016
Issue Date : September 2017
DOI : https://doi.org/10.1007/s10643-016-0818-6
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Early childhood educators
- Early childhood teachers
- Childcare workers
Advertisement
Please note that Internet Explorer version 8.x is not supported as of January 1, 2016. Please refer to this support page for more information.
- Purchase PDF
Article preview
Introduction, section snippets, references (77), cited by (51), recommended articles (6).

Women and Birth
The nature of labour pain: an updated review of the literature.
The pain experience associated with labour is complex. Literature indicates psychosocial and environmental determinants of labour pain, and yet methods to support women usually target physiological attributes via pharmacological interventions.
To provide an update of our understanding of labour pain based on modern pain science. The review aims to help explain why women can experience labour pain so differently — why some cope well, whilst others experience great suffering. This understanding is pertinent to providing optimal support to women in labour.
A literature search was conducted in databases Medline, Cumulative Index to Nursing and Allied Health Literature and PsycINFO , using search terms labor/labour, childbirth , pain, experience and perception. Thirty-one papers were selected for inclusion.
Labour pain is a highly individual experience. It is a challenging, emotional and meaningful pain and is very different from other types of pain. Key determinants and influences of labour pain were identified and grouped into cognitive, social and environmental factors.
If a woman can sustain the belief that her pain is purposeful (i.e. her body working to birth her baby), if she interprets her pain as productive (i.e. taking her through a process to a desired goal) and the birthing environment is safe and supportive, it would be expected she would experience the pain as a non-threatening, transformative life event. Changing the conceptualisation of labour pain to a purposeful and productive pain may be one step to improving women’s experiences of it, and reducing their need for pain interventions.
The pain experience associated with labour is a complex phenomenon. It is often described as the most challenging and intense pain experience a woman may go through, and yet enormous variations in women’s perceptions of this pain exist. 1 Labour pain can be described as a paradoxical experience; one that is excruciating and yet desirable because of its positive outcome — the birth of a child. 2 Curiously, pain-free labours are not necessarily more satisfying to women 3 and many women desire to experience all the sensations of labour — including pain. 4
Labour pain has been defined as an “excellent model of acute pain”, 5 however unlike other acute pains that are usually associated with injury or pathology, labour pain is part of a normal physiological process. The pain associated with labour raises significant philosophical and theoretical questions due to its unique occurrence: Why is a normal physiological event, one that is essential to human existence, associated with such intense pain? From an evolutionary perspective labour may be painful in order to drive appropriate behaviour in the woman and others. That is, to capture the labouring woman’s attention and motivate her to seek help and safety. It is clear that there is still much to learn about the nature of labour pain.
In 2002 Nancy Lowe published ‘The Nature of Labor Pain’ 1 —a seminal literature review that was part of a broader project aiming to improve understandings of labour pain and its management (see Caton et al. 6 for more information). Lowe’s review summarised the literature regarding labour pain up until the year 2000, and interpreted this literature based on pain theories at the time. Over the past two decades shifts have occurred in both the characteristics of labouring women, the labour environment, and pain science. This present review aims to provide an update of our understanding of labour pain. It will capture and examine the literature since the start of the twenty-first century and aim to understand this literature in relation to the contemporary labouring woman and labour environment. Importantly, this literature will be evaluated in light of modern pain science.
This review aims to address the questions: What is the nature of labour pain? and What are the determinants and influences of labour pain? By the end of the review we hope to better understand why women can experience labour pain so differently. Why do some women cope well with labour pain, whilst others experience great suffering? These research questions have not been comprehensively addressed in the literature since Lowe’s 2002 review. And yet, this understanding is pertinent to providing optimal support to women going through such an experience.
Given the volume of literature on labour pain, this narrative review is intended to be illustrative as opposed to exhaustive. Studies will be selected for inclusion that contribute to better understanding the nature and influences of labour pain. In addition, we will raise a number of important related topics in order to put this review into context. These will include a description of ‘the contemporary labouring woman’, a summary of current pain theories, as well as important issues relating to assessing pain.
Over the last three decades, changes have occurred in the characteristics of the labouring woman, her labour environment and her pain management options. In 2015 the average age of a woman giving birth in Australia was 30.3 years, compared to 27.9 years in 1991.7, 8 A growing proportion of labouring women in both Australia and the United States (US) are aged 40 or older, are using assisted reproductive technology to assist with their conception, and have comorbidities such as obesity.8, 9, 10, 11
The management of women’s labours and births is also changing. The rate of spontaneous onset of labour in Australia has reduced to 56% and the rate of caesarean section has risen to 33%. 12 Similar trends are seen in the US with the caesarean rate at 32% of births. 11 Of mothers who experience labour, a large proportion receive analgesia: 85.7% for first-time mothers in Australia. 12 Women who do labour towards a vaginal birth are more likely to undergo continuous fetal monitoring 13 as well as induction or augmentation of their labours. 12
The contemporary labouring woman may now be able to access contemporary pain management options such as mobile epidurals, 14 intradermal water injections 15 and labour hypnosis. 16 She may also have more access to water during labour and birth 17 as well as alternatives to standard hospital care including continuity of care (group or case-load midwifery care) and team midwifery care. 18 In 2017 a Cochrane review reported the positive effects of continuous support during labour on women’s experience (including pain) and reduced use of analgesics. 19 At the same time, however, women’s labour and births are influenced by the medicalisation of labour, including hospital practices and the philosophies regarding management of labour and the birth environment. In an Australian study a critical analysis of hospital documents provided to women demonstrated how certain practices are framed as risky (use of water in labour) or safe (use of epidural analgesia during labour) depending on their acceptance by hospital culture, rather than their actual level of risk. 20 Low risk women giving birth in Australian private hospitals are more likely to receive obstetric interventions, such as an epidural or instrumental delivery, than low risk women in public hospitals.21, 22 Furthermore, a recent study in the US found that certain labour and delivery unit management cultures result in a higher rate of caesarean sections and complications, independent of women’s health. 23
The changing characteristics of the contemporary labouring women and her labour environment must be considered when attempting to understand her experience of labour pain and the determinants and influences of that experience.
The International Association for the Study of Pain (IASP) defines pain as “an unpleasant sensory and emotional experience associated with actual or potential tissue damage, or described in terms of such damage”. 24 This widely recognised and accepted definition has been applied by the clinical and research community dealing with many different occurrences of pain, including the pain associated with childbirth. However, labour pain may be a pain experience that is not adequately captured by this conceptualisation. The IASP definition describes tissue damage (actual or potential) as the main attributor to the pain experience, and implies that the function of pain is to indicate bodily tissue damage (actual or potential). Neither of these points may apply to the pain associated with a normal labour where normal tissue changes are occurring to work towards the birth of a baby, and the function of the pain experience may be to encourage appropriate survival-related behaviours in the woman. 25 The unique context of the pain of labour, as well as its complexities, suggest that the current definition of pain may not always be appropriate.
Whilst modern understandings of pain (described below) further make sense of the complexities and individuality of the human pain experience it seems that labour pain has not yet made the conceptual shift toward these new understandings. The previously dominant biophysiologic model that defined pain as a sensory message of peripheral tissue damage persists in both research and management of labour pain. That is, in research the focus remains on measuring the sensory component of a woman’s pain, and labour pain management continues to primarily focus on obliterating the sensory input by pharmacological means. Our attempt to better understand labour pain must be based upon up-to-date theories of pain science.
The neuromatrix theory, introduced by Ronald Melzack in the early twenty-first century, explains that pain is produced by a matrix of neural structures in the brain in response to actual or perceived tissue threat. 26 Multiple inputs feed into the central processing areas of the brain to produce the experience of pain, including affective-emotional, cognitive-evaluative and sensory-discriminative. The important recognition of multiple inputs (and therefore multiple dimensions) helps us better understand the enormous variations in individuals’ pain experiences associated with seemingly similar physiological situations, such as labour. It gives emphasis to the non-biological contributions to a pain experience. Pain is not simply driven by the state of the tissues and nociceptive input into the central nervous system. Rather, it emerges from a complex integration of affective, cognitive and sensory constituents, and only emerges when the brain determines that there is a threat to the self and that the individual should know about it. What one person’s brain classifies as a ‘threat’ may be different from another’s. 27
Using the neuromatrix theory of pain as a theoretical basis, specific determinants and influences of the experience of pain continue to emerge from the literature. Most notably is the recognition of the complex role of cortical processes, such as beliefs, expectations and past experiences, in the perception of pain. 28 This complex processing is influenced by the meaning of the pain 29 and by the social context in which it occurs. 30 It is further shaped by the individual’s emotional state 31 and other features of their state of mind such as their tendency to catastrophise 32 or their ability to accept the experience (psychological flexibility). 33 This modern understanding of pain provides a useful framework for better understanding the complexities of labour pain. It also assists in understanding and supporting alternate pain paradigms for labour pain such as ‘working with pain’ 34 and for describing labour pain as ‘functional discomfort’. 35 Finally, a better understanding of labour pain is warranted considering the emerging body of work demonstrating the interactions between pain and women’s hormonal physiology during labour, in particular beta-endorphins and oxytocin. 36
Pain is an entirely subjective experience. In order for an observer to ‘know’ a person’s pain, the person must communicate it. They must transform that inner experience into words to describe it, and/or display ‘pain behaviours’ that can be interpreted by an observer. 37 The interpretation of pain behaviours is heavily dependent on the social and cultural learnings and understandings of both the person in pain and the observer. In addition, the words used to describe a person’s pain may be subject to individual interpretation.
Pain measurement tools, such as a Visual Analogue Scale (VAS), Numeric Rating Scale and the McGill Pain Scale are validated tools for both clinical and research use, and are frequently used in labour settings. These types of measures are a convenient method of objectifying what is a subjective phenomenon, particularly in large cohorts. They are relatively simple and quick measures to complete, and may allow a caregiver to ascertain the effectiveness of a pain intervention, or a labouring woman who is in need of assistance.
However these tools “don’t actually measure ‘pain’ but attempt to access, quantify (VAS) or qualify (burning, stinging) certain ‘dimensions’ of pain expression”. 37 Each measurement tool attempts to convert what is a multidimensional and meaningful felt experience into a number on a scale. For particularly complex pain experiences such as labour, significant limitations have been recognised in their use due to the dynamic and, for many women, extreme nature of this pain experience. Women themselves have identified the potential inaccuracies of such pain assessment tools due to emotional and attentional influences during labour, and express annoyance at the disruption caused by such assessments.38, 39 Numerous studies have identified a ceiling effect and issues with the interpretation of the ‘worse pain imaginable’ anchor of such scales.38, 40 A study by Roberts et al. 39 reported the development and implementation of an alternative to measuring pain in labour: a ‘Coping with Labor Algorithm’ which may provide a suitable alternative to caregivers to ascertain whether a women needs assistance.
Ultimately, it would seem that the closest we can get to understanding the complexities of a woman’s experience of labour pain is to listen to her pain story — to her self-selected words to describe the pain experience as it occurred within the social and cultural context of her life. It is for this reason that qualitative studies will be of major focus in this review in helping us answer our research questions.
Search strategy, selection and evaluation
Extensive searches were undertaken within the electronic databases Medline, Cumulative Index to Nursing and Allied Health Literature (CINAHL) and PsycINFO. Search terms used included labor/labour, childbirth and pain. The additional search terms of ‘experience’ and ‘perception’ were used (with the ‘or’ Boolean operand) in order to narrow the search to the concept of interest (women’s experience/perception of labour pain). An iterative process was used within each individual database using
Pain attributed to normal tissue-based changes of physiological labour
Numerous studies have previously demonstrated the association between the mean intensity of labour pain and labour progression, where higher ratings of pain correlate with increasing cervical dilation, as well as uterine contraction intensity, frequency and duration (see Lowe 1 ). It is important to note, however, that enormous variability in women’s pain ratings continue to be evident. For example, a study of 81 labouring women at 3 cm dilation reported a range of pain scores between 21 and 100
Our understanding of the complexities of labour pain is expanding. The recognition of these complexities is important as we continue to evolve our strategies of supporting the contemporary labouring women through such experiences. All individuals involved in the care of labouring women – from policy makers to those supporting her during her labour – should understand the determinants and influences of labour pain. Although incredibly intense and challenging, it is very different in nature to
Acknowledgement
The authors would like to thank Stav Hillel, La Trobe University Senior Learning Advisor, for his assistance with database searches. No financial assistance was provided for this project.
It’s beyond water: stories of women’s experience of using water for labour and birth
Women birth, how caregivers manage pain and distress in second-stage labor, j midwifery women’s health, requests for cesarean deliveries: the politics of labor pain and pain relief in shanghai, china, soc sci med, journey to confidence: women’s experiences of pain in labour and relational continuity of care, anxiety sensitivity as a predictor of labor pain, pain in childbirth and postpartum recovery: the role of catastrophizing, the range of coping strategies women use to manage pain and anxiety prior to and during first experience of labour, japanese women’s experiences of pharmacological pain relief in new zealand, women’s expectations and experiences with labour pain in medical and midwifery models of birth in the united states, women’s experiences of labour pain and the role of the mind: an exploratory study, swedish women’s experience of childbirth 2 years after birth, childbirth experience according to a group of brazilian primiparas, comparison of induction of labour and expectant management in postterm pregnancy: a matched cohort study, the coping with labor algorithm: an alternate pain assessment tool for the laboring woman, assessment of pain associated with childbirth: women’s perspectives, preferences and solutions, functional discomfort and a shift in midwifery paradigm, psychological flexibility in adults with chronic pain: a study of acceptance, mindfulness, and values-based action in primary care, documenting risk: a comparison of policy and information pamphlets for using epidural or water in labour, implementing caseload midwifery: exploring the views of maternity managers in australia—a national cross-sectional survey, the nature and management of labor pain: executive summary, am j obstet gynecol, labour pain as a model of acute pain, women’s experience of pain during childbirth, the nature of labor pain, epidural versus non-epidural or no analgesia in labour, cochrane database syst rev, pain is the club: identity and membership in the natural childbirth community, qual sociol rev, australia’s mothers and babies 2010, australia’s mothers and babies—2015 in brief, assisted reproductive technology in australia and new zealand 2014, prepregnancy body mass index by maternal characteristics and state: data from the birth certificate, 2014, births: final data for 2015, australia’s mothers and babies 2014—in brief, fetal monitoring: creating a culture of safety with informed choice, j perinat educ, high dose versus low dose opioid epidural regimens for pain relief in labour, intracutaneous or subcutaneous sterile water injection for relieving pain in labour, hypnosis for pain management during labour and childbirth, immersion in water in labour and birth, continuous support for women during childbirth, rates of obstetric intervention among low-risk women giving birth in private and public hospitals in nsw: a population-based descriptive study, psychological impact of hypnosis for pregnancy and childbirth: a systematic review.
The use of hypnosis as a complementary therapy in the perinatal field is expanding, however, there is little research for its impact on perinatal mental health. Here, we review studies that evaluate the effect of hypnosis on women's mental health and subjective experiences.
A systematic review was conducted according to the PRISMA protocol for articles with experimental designs of hypnosis that measured their impact on several psychological variables, such as the presence of symptoms of anxiety, depression or fear of childbirth. Studies were evaluated according to the Critical Appraisal Skills Program Checklists (CASP), and analyzed for their designs and intervention themes.
Seven studies were included and six themes emerged: preparation for birth and unexpected events; change in the perception and experience of pain; pregnant body as a natural process; connection with the baby during pregnancy; development of inner resources; and progressive relaxation and guided imagery. Although results were partly mitigated, most studies found positive effects of hypnosis in alleviating anxiety, depression, and fear towards birth, empowering women with a higher sense of confidence and improving the overall emotional experience. Two studies also indicate encouraging outcomes in postnatal wellbeing.
While it is still argued as to what extent hypnosis has positive effects on physical aspects of labor, the empowerment and the increase in confidence associated with hypnosis seem to bring a significant contribution to a more positive subjective experience of pregnancy and childbirth, and on women's overall wellbeing in the perinatal period.
Women's sense of control during labour and birth with epidural analgesia: A qualitative descriptive study
Sense of control during childbirth is a critical issue concerning the association between high-quality maternity care and infant health. This study explored the facilitators of or barriers to a sense of control and the need for interventions to raise women's experience in childbirth.
The data came from 17 participants. Data collection was conducted in the childbirth room and within three days following childbirth, respectively. For tackling the research problems, participant observation and interviewing were applied. Thematic analysis was applied to the data analyzed.
Two themes were identified: (1) facilitators of or barriers to practice a sense of control and (2) Care needed for a sense of control. The effectiveness of a sense of control is related to energy refill, mental loading subsided, control over decisions, non-pharmacological usage, and support from the meaningful person. Care needed includes showing empathy, providing information, using complementary pain-relief strategies, and adjusting care by parturient conditions.
This study highlights the influencing factors and interventions relating to women's sense of control during childbirth with epidural analgesia. The findings suggest that many approaches, such as white noise, benefit women's sense of control after an epidural. Using non-pharmacological methods, such as a birth ball, should be appropriately regulated by situations to enhance women's sense of control. Through the assessment, education, attention to maternal needs, and recognizing the barriers to a sense of control, women will benefit from the interventions designed to improve their sense of control during childbirth.
Predictors associated with low-risk women's pre-labour intention for intrapartum pain relief: a cross-sectional study
Pregnant women have preferences about how they intend to manage labour pain. Unmet intentions can result in negative emotions and/or birth experiences.
To examine the antenatal level of intention for intrapartum pain relief and the factors that might predict this intention.
A cross-sectional online survey-based study.
414 healthy pregnant women in the Netherlands, predominantly receiving antenatal care from the community-based midwife who were recruited via maternity healthcare professionals and social media platforms.
The attitude towards intrapartum pain relief was measured with the Labour Pain Relief Attitude Questionnaire for pregnant women. Personality traits with the HEXACO-60 questionnaire, general psychological health with the Mental Health Inventory-5 and labour and birth anxiety with the Tilburg Pregnancy Distress Scale. Multiple linear regression was performed with the intention for pain relief as the dependant variable.
The obstetrician as birth companion ( p <.001), the perception that because of the impact of pregnancy on the woman's body, using pain relief during labour is self-evident ( p <.001), feeling convinced that pain relief contributes to self-confidence during labour ( p =.023), and fear of the forthcoming birth ( p =.003) predicted women were more likely to use pain relief. The midwife as birth companion ( p =.047) and considering the partner in requesting pain relief ( p =.045) predicted women were less likely to use pain relief.
Understanding the reasons predicting women's intention of pain management during labour, provides insight in low-risk women's supportive needs prior to labour and are worth paying attention to during the antenatal period.
Women's perceptions of counselling on pain assessment and management during labour in Finland: A cross-sectional survey
The challenge is to identify pain assessment counselling that are effective and reliable to the woman during labour while also supporting appropriate management of labour pain.
This study aimed to describe women's perceptions of their counselling on pain assessment and pain management during labour.
A descriptive, cross-sectional study.
The sample consisted of women who had given birth (n=204) at a university hospital in Finland; 250 parturients were recruited by convenience sampling.
Data were collected using a questionnaire (P-PAPM) between November 2018 and February 2019. The statistical significance of observed differences was analysed using the Chi-squared test and Fischer's exact test.
Eighty percent of women reported that they had received counselling on pharmacological treatments from midwives, but only 33 % received counselling on pain assessment. The non-pharmacological methods for alleviating labour pain most commonly taught by midwives were proper breathing techniques, cold/heat treatments, and trying different positions and movements. Women were less commonly counselled to try listening to music, thinking about pleasant and positive things, or concentrating their thoughts on something other than pain. The two most commonly used counselling methods were demonstrations and written material and least used Internet-based resources. The personal issue that midwives discussed most frequently during counselling was the women's individual hopes concerning pain management (91%), while the issue discussed least often was previous experiences of pain (58%). The participants’ experiences of fear, age, and education were significantly associated with aspects of counselling on pain assessment and management.
Women's counselling on pain assessment and management during labour varied widely. Therefore, to improve its quality, counselling should be routinely integrated into daily midwifery work. In particular, the counselling given on non-pharmacological pain relief methods during labour was inadequate. More varied counselling methods should be used in the future. Finally, the results indicate that midwives’ knowledge of counselling should be increased and they should be encouraged to routinely offer counselling on pain assessment and management for parturing women.
Effects of acupressure and shower applied in the delivery on the intensity of labor pain and postpartum comfort
Labour pain is a constantly increasing pain. This study thus aims to determine the effects of acupressure and shower on labour pain and postpartum comfort.
In this randomized controlled trial (RCT), the control group consisted of 40 pregnant women, while the experimental groups consisted of 80 pregnant women in total. The experimental groups received routine labour care and either acupressure or showers upon reaching three cervical dilations (4–5, 6–7 and 8–10 cm). The control group only received routine labour care. A maternal information form (MIF), the Visual Analog Scale (VAS) and the Postpartum Comfort Questionnaire (PPCQ) were used to collect data.
Pain was significantly reduced in both of the experimental groups, in contrast to the control group, in all periods of the study (p < 0.001). Postpartum comfort also significantly increased in the experimental groups compared to the control group (p < 0.05).
Acupressure and showering are effective in reducing labour pain and increasing postpartum comfort. Midwives and nurses can therefore apply them as inexpensive and easy to administer methods for labour pain relief.
Epidural use among women with spontaneous onset of labour – an observational study using data from a cluster-randomised controlled trial
To investigate whether the proportion of pregnant women who use epidural analgesia during birth differed between women registered at a maternity clinic randomised to Mindfetalness or to routine care.
An observational study including women born in Sweden with singleton pregnancies, with spontaneous onset of labour from 32 weeks’ gestation. Data used from a cluster-randomised controlled trial applying the intention-to-treat principle in 67 maternity clinics where women were randomised to Mindfetalness or to routine care. ClinicalTrials.gov (NCT02865759).
Midwives were instructed to distribute a leaflet about Mindfetalness to pregnant women at 25 weeks’ gestation. Mindfetalness is a self-assessment method for the woman to use to become familiar with the unborn baby's fetal movement pattern. When practising the method in third trimester, the women are instructed to daily lie down on their side, when the baby is awake, and focus on the movements’ intensity, character and frequency (but not to count each movement).
Of the 18 501 women with spontaneous onset of labour, 47 percent used epidural during birth. Epidural was used to a lower extent among women registered at a maternity clinic randomised to Mindfetalness than women in the routine-care group (46.2% versus 47.8%, RR 0.97, CI 0.94–1.00, p = 0.04). Epidural was more common among primiparous women, women younger than 35 years, those with educational levels below university, with BMI ≥25 and with a history of receiving psychiatric care or psychological treatment for mental illness.
Pregnant women who were informed about a self-assessment method, with the aim of becoming familiar with the unborn baby's fetal movement pattern, used epidural to a lower extent than women who were not informed about the method. Future studies are needed to investigate and understand the association between Mindfetalness and the reduced usage of epidural during birth.
Women with fear of childbirth might benefit from having a known midwife during labour
Having a known midwife at birth is valued by women across the world, however it is unusual for women with fear of childbirth to have access to this model of care. The aim of this study was to describe the prevalence and factors related to having access to a known midwife for women referred to counseling due to childbirth fear. We also wanted to explore if women’s levels of childbirth fear changed over time.
A pilot study of 70 women referred to counseling due to fear of birth in 3 Swedish hospitals, and where the counseling midwife, when possible, also assisted during labour and birth.
34% of the women actually had a known midwife during labour and birth. Women who had a known midwife had significantly more counseling visits, they viewed the continuity of care as more important, were more satisfied with the counseling and 29% reported that their fear disappeared. Fear of birth decreased significantly over time for all women irrespective of whether they were cared for in labour by a known midwife or not.
Although the women in the present study had limited access to a known midwife, the results indicate that having a known midwife whom the women met on several occasions made them more satisfied with the counseling and had a positive effect on their fear. Building a trustful midwife–woman relationship rather than counseling per se could be the key issue when it comes to fear of birth.
Awareness of Listeriosis and Methylmercury toxicity public health recommendations and diet during pregnancy
Awareness of Listeriosis and Methylmercury toxicity recommendations are associated with decreased intake of high-risk foods. Whether awareness of the recommendations affect dietary quality of pregnant women in Australian is unknown.
To evaluate awareness of Listeriosis and Methylmercury toxicity recommendations during pregnancy and its impact on dietary quality.
Pregnant women (n = 81) were recruited from antenatal clinics. Awareness of Listeriosis and Methylmercury toxicity recommendations and high-risk foods consumption were assessed via questionnaire at 10–23 weeks gestation. Diet quality was measured using the 2005 Healthy Eating Index using a validated food frequency questionnaire at 10–23 and 34–36 weeks gestation.
A higher proportion of women were aware of Methylmercury toxicity compared with Listeriosis recommendations (75.3 vs. 59.2%, p < 0.001). The proportion of women who decreased or avoided consumption of certain high-risk Listeriosis foods were higher in those who were aware compared with those who were unaware of Listeriosis recommendations [raw fish (96.0 vs 69.2%, p = 0.046), soft-serve ice cream (93.9 vs 58.3%, p = 0.004) and alfalfa/bean sprouts (68.7 vs 28.5%, p = 0.006)]. A large proportion of women (96.8%) met recommendations for limiting consumption of high Methylmercury fish. There was no difference in the change in dietary quality over pregnancy regardless of women’s awareness of the recommendations.
Awareness of Listeriosis and Methylmercury toxicity recommendations has little impact on dietary quality of pregnant women in this small study. Further research in a large representative population of pregnant women is needed to confirm our findings and to optimise dietary quality during pregnancy.
Joys and challenges of relationships in Scotland and New Zealand rural midwifery: A multicentre study
Globally there are challenges meeting the recruitment and retention needs for rural midwifery. Rural practice is not usually recognised as important and feelings of marginalisation amongst this workforce are apparent. Relationships are interwoven throughout midwifery and are particularly evident in rural settings. However, how these relationships are developed and sustained in rural areas is unclear.
To study the significance of relationships in rural midwifery and provide insights to inform midwifery education.
Multi-centre study using online surveys and discussion groups across New Zealand and Scotland. Descriptive and template analysis were used to organise, examine and analyse the qualitative data.
Rural midwives highlighted how relationships with health organisations, each other and women and their families were both a joy and a challenge. Social capital was a principal theme. Subthemes were (a) working relationships, (b) respectful communication, (c) partnerships, (d) interface tensions, (e) gift of time facilitates relationships.
To meet the challenges of rural practice the importance of relationship needs acknowledging. Relationships are created, built and sustained at a distance with others who have little appreciation of the rural context. Social capital for rural midwives is thus characterised by social trust, community solidarity, shared values and working together for mutual benefit. Rural communities generally exhibit high levels of social capital and this is key to sustainable rural midwifery practice.
Midwives, educationalists and researchers need to address the skills required for building social capital in rural midwifery practice. These skills are important in midwifery pre- and post-registration curricula.
Women׳s experiences of coping with pain during childbirth: A critical review of qualitative research
to identify and analyse qualitative literature exploring women׳s experiences of coping with pain during childbirth.
critical review of qualitative research.
ten studies were included, conducted in Australia, England, Finland, Iceland, Indonesia, Iran and Sweden. Eight of the studies employed a phenomenological perspective with the remaining two without a specific qualitative methodological perspective. Thematic analysis was used as the approach for synthesising the data in this review. Two main themes emerged as the most significant influences upon a woman׳s ability to cope with pain: (i) the importance of individualised, continuous support and (ii) an acceptance of pain during childbirth. This review found that women felt vulnerable during childbirth and valued the relationships they had with health professionals. Many of the women perceived childbirth pain as challenging, however, they described the inherent paradox for the need for pain to birth their child. This allowed them to embrace the pain subsequently enhancing their coping ability.
women׳s experience of coping with pain during childbirth is complex and multifaceted. Many women felt the need for effective support throughout childbirth and described the potential implications where this support failed to be provided. Feeling safe through the concept of continuous support was a key element of care to enhance the coping ability and avoid feelings of loneliness and fear. A positive outlook and acceptance of pain was acknowledged by many of the women, demonstrating the beneficial implications for coping ability. These findings were consistent despite the socio-economic, cultural and contextual differences observed within the studies suggesting that experiences of coping with pain during childbirth are universal.
the findings suggest there is a dissonance between what women want in order to enhance their ability to cope with pain and the reality of clinical practice. This review found women would like health professionals to maintain a continuous presence throughout childbirth and support a social model of care that promotes continuity of care and an increasing acceptance of pain as part of normal childbirth. It is suggested future research regarding the role of antenatal provision for instilling such a viewpoint in preparation of birth be undertaken to inform policy makers. The need for a shift in societal norms is also suggested to disseminate expectations and positive or negative views of what the role of pain during childbirth should be to empower women to cope with childbirth and embrace this transition to motherhood as part of a normal process.
Pain management during labor and vaginal birth
Neuraxial analgesia provides excellent pain relief in labor. Optimizing initiation and maintenance of neuraxial labor analgesia requires different strategies. Combined spinal-epidurals or dural puncture epidurals may offer advantages over traditional epidurals. Ultrasound is useful in certain patients. Maintenance of analgesia is best achieved with a background regimen (either programmed intermittent boluses or a continuous epidural infusion) supplemented with patient-controlled epidural analgesia and using dilute local anesthetics combined with opioids such as fentanyl. Nitrous oxide and systemic opioids are also used for pain relief. Nitrous oxide may improve satisfaction despite variable effects on pain. Systemic opioids can be administered by healthcare providers or using patient-controlled analgesia. Appropriate choice of drug should take into account the stage and progression of labor, local safety protocols, and maternal and fetal/neonatal side effects. Pain in labor is complex, and women should fully participate in the decision-making process before any one modality is selected.
Experiences of early labour management from perspectives of women, labour companions and health professionals: A systematic review of qualitative evidence
to examine evidence of women's, labour companions’ and health professionals’ experiences of management of early labour to consider how this could be enhanced to better reflect women's needs.
a systematic review of qualitative evidence.
women in early labour with term, low risk singleton pregnancies, not booked for a planned caesarean birth or post-dates induction of labour, their labour companions, and health professionals responsible for early labour care (e.g. midwives, nurse-midwives, obstetricians, family doctors). Studies from high and middle income country settings were considered.
21 publications were included from the UK, Ireland, Scandinavia, USA, Italy and New Zealand. Key findings included the impact of communication with health professionals (most usually midwives) on women's decision making; women wanting to be listened to by sympathetic midwives who could reassure that symptoms and signs of early labour were ‘normal’ and offer clear advice on what to do. Antenatal preparation which included realistic information on what to expect when labour commenced was important and appreciated by women and labour companions. Views of the optimal place for women to remain and allow early labour to progress differed and the perceived benefit of support and help offered by labour companions varied. Some were supportive and helped women to relax, while others were anxious and encouraged women to seek early admission to the planned place of birth. Web-based sources of information are increasingly used by women, with mixed views of the value of information accessed.
women, labour companions and health professionals find early labour difficult to manage well, with women unsure of how decisions about admission to their planned place of birth are taken. It is unclear why women are effectively left to manage this aspect of their labour with minimal guidance or support. Tailoring management to meet individual needs, with provision of effective communication could reassure women and facilitate timely admission from perspectives of women, their companions, midwives and other health professionals. Information on labour onset and progress, and approaches to pain management, should be shared with women's labour companions to enable them to feel more confident to better support women. Further research is needed of the impact of different models of care and increasing use of web-based information on women's approaches to self-management when labour commences.
PROSPERO 2014 CRD 42014009745
- Our Program Divisions
- Our Three Academies
- Government Affairs
- Statement on Diversity and Inclusion
- Our Study Process
- Conflict of Interest Policies and Procedures
- Project Comments and Information
- Read Our Expert Reports and Published Proceedings
- Explore PNAS, the Official Scientific Journal of NAS
- Access Transportation Research Board Publications
- Coronavirus Disease 2019 (COVID-19)
- Diversity, Equity, and Inclusion
- Economic Recovery
- Fellowships and Grants
- Publications by Division
- Division of Behavioral and Social Sciences and Education
- Division on Earth and Life Studies
- Division on Engineering and Physical Sciences
- Gulf Research Program
- Health and Medicine Division
- Policy and Global Affairs Division
- Transportation Research Board
- National Academy of Sciences
- National Academy of Engineering
- National Academy of Medicine
- Publications by Topic
- Agriculture
- Behavioral and Social Sciences
- Biography and Autobiography
- Biology and Life Sciences
- Computers and Information Technology
- Conflict and Security Issues
- Earth Sciences
- Energy and Energy Conservation
- Engineering and Technology
- Environment and Environmental Studies
- Food and Nutrition
- Health and Medicine
- Industry and Labor
- Math, Chemistry, and Physics
- Policy for Science and Technology
- Space and Aeronautics
- Surveys and Statistics
- Transportation and Infrastructure
- Searchable Collections
- New Releases
VIEW LARGER COVER
Gulf War and Health
Updated literature review of sarin.
The Gulf War in 1990-1991 was considered a brief and successful military operation, with few injuries or deaths of US troops. The war began in August 1990, and the last US ground troops returned home by June 1991. Although most Gulf War veterans resumed their normal activities, many soon began reporting a variety of nonexplained health problems that they attributed to their participation in the Gulf War, including chronic fatigue, muscle and joint pain, loss of concentration, forgetfulness, headache, and rash. Because of concerns about the veterans' health problems, the Department of Veterans Affairs (VA) requested that the Institute of Medicine (IOM) review the scientific and medical literature on the long-term adverse health effects of agents to which the Gulf War veterans may have been exposed. This report is a broad overview of the toxicology of sarin and cyclosarin. It assesses the biologic plausibility with respect to the compounds in question and health effects.
- Health and Medicine —Military and Veterans
- Conflict and Security Issues —Military and Defense Studies
Suggested Citation
Institute of Medicine. 2004. Gulf War and Health: Updated Literature Review of Sarin . Washington, DC: The National Academies Press. https://doi.org/10.17226/11064. Import this citation to: Bibtex EndNote Reference Manager
Publication Info
- Paperback: 978-0-309-09294-4
- Ebook: 978-0-309-16577-8
What is skim?
The Chapter Skim search tool presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter. You may select key terms to highlight them within pages of each chapter.
Copyright Information
The National Academies Press (NAP) has partnered with Copyright Clearance Center's Rightslink service to offer you a variety of options for reusing NAP content. Through Rightslink, you may request permission to reprint NAP content in another publication, course pack, secure website, or other media. Rightslink allows you to instantly obtain permission, pay related fees, and print a license directly from the NAP website. The complete terms and conditions of your reuse license can be found in the license agreement that will be made available to you during the online order process. To request permission through Rightslink you are required to create an account by filling out a simple online form. The following list describes license reuses offered by the National Academies Press (NAP) through Rightslink:
- Republish text, tables, figures, or images in print
- Post on a secure Intranet/Extranet website
- Use in a PowerPoint Presentation
- Distribute via CD-ROM
Click here to obtain permission for the above reuses. If you have questions or comments concerning the Rightslink service, please contact:
Rightslink Customer Care Tel (toll free): 877/622-5543 Tel: 978/777-9929 E-mail: [email protected] Web: http://www.rightslink.com
To request permission to distribute a PDF, please contact our Customer Service Department at 800-624-6242 for pricing.
To request permission to translate a book published by the National Academies Press or its imprint, the Joseph Henry Press, please click here to view more information.
What is a prepublication?

An uncorrected copy, or prepublication, is an uncorrected proof of the book. We publish prepublications to facilitate timely access to the committee's findings.
What happens when I pre-order?
The final version of this book has not been published yet. You can pre-order a copy of the book and we will send it to you when it becomes available. We will not charge you for the book until it ships. Pricing for a pre-ordered book is estimated and subject to change. All backorders will be released at the final established price. As a courtesy, if the price increases by more than $3.00 we will notify you. If the price decreases, we will simply charge the lower price. Applicable discounts will be extended.
Downloading and Using eBooks from NAP
What is an ebook.
An ebook is one of two file formats that are intended to be used with e-reader devices and apps such as Amazon Kindle or Apple iBooks.
Why is an eBook better than a PDF?
A PDF is a digital representation of the print book, so while it can be loaded into most e-reader programs, it doesn't allow for resizable text or advanced, interactive functionality. The eBook is optimized for e-reader devices and apps, which means that it offers a much better digital reading experience than a PDF, including resizable text and interactive features (when available).
Where do I get eBook files?
eBook files are now available for a large number of reports on the NAP.edu website. If an eBook is available, you'll see the option to purchase it on the book page.
View more FAQ's about Ebooks
Types of Publications
Consensus Study Report: Consensus Study Reports published by the National Academies of Sciences, Engineering, and Medicine document the evidence-based consensus on the study’s statement of task by an authoring committee of experts. Reports typically include findings, conclusions, and recommendations based on information gathered by the committee and the committee’s deliberations. Each report has been subjected to a rigorous and independent peer-review process and it represents the position of the National Academies on the statement of task.

Literature Reviews
What this handout is about.
This handout will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.
Introduction
OK. You’ve got to write a literature review. You dust off a novel and a book of poetry, settle down in your chair, and get ready to issue a “thumbs up” or “thumbs down” as you leaf through the pages. “Literature review” done. Right?
Wrong! The “literature” of a literature review refers to any collection of materials on a topic, not necessarily the great literary texts of the world. “Literature” could be anything from a set of government pamphlets on British colonial methods in Africa to scholarly articles on the treatment of a torn ACL. And a review does not necessarily mean that your reader wants you to give your personal opinion on whether or not you liked these sources.
What is a literature review, then?
A literature review discusses published information in a particular subject area, and sometimes information in a particular subject area within a certain time period.
A literature review can be just a simple summary of the sources, but it usually has an organizational pattern and combines both summary and synthesis. A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information. It might give a new interpretation of old material or combine new with old interpretations. Or it might trace the intellectual progression of the field, including major debates. And depending on the situation, the literature review may evaluate the sources and advise the reader on the most pertinent or relevant.
But how is a literature review different from an academic research paper?
The main focus of an academic research paper is to develop a new argument, and a research paper is likely to contain a literature review as one of its parts. In a research paper, you use the literature as a foundation and as support for a new insight that you contribute. The focus of a literature review, however, is to summarize and synthesize the arguments and ideas of others without adding new contributions.

Why do we write literature reviews?
Literature reviews provide you with a handy guide to a particular topic. If you have limited time to conduct research, literature reviews can give you an overview or act as a stepping stone. For professionals, they are useful reports that keep them up to date with what is current in the field. For scholars, the depth and breadth of the literature review emphasizes the credibility of the writer in his or her field. Literature reviews also provide a solid background for a research paper’s investigation. Comprehensive knowledge of the literature of the field is essential to most research papers.
Who writes these things, anyway?
Literature reviews are written occasionally in the humanities, but mostly in the sciences and social sciences; in experiment and lab reports, they constitute a section of the paper. Sometimes a literature review is written as a paper in itself.
Let’s get to it! What should I do before writing the literature review?
If your assignment is not very specific, seek clarification from your instructor:
- Roughly how many sources should you include?
- What types of sources (books, journal articles, websites)?
- Should you summarize, synthesize, or critique your sources by discussing a common theme or issue?
- Should you evaluate your sources?
- Should you provide subheadings and other background information, such as definitions and/or a history?
Find models
Look for other literature reviews in your area of interest or in the discipline and read them to get a sense of the types of themes you might want to look for in your own research or ways to organize your final review. You can simply put the word “review” in your search engine along with your other topic terms to find articles of this type on the Internet or in an electronic database. The bibliography or reference section of sources you’ve already read are also excellent entry points into your own research.
Narrow your topic
There are hundreds or even thousands of articles and books on most areas of study. The narrower your topic, the easier it will be to limit the number of sources you need to read in order to get a good survey of the material. Your instructor will probably not expect you to read everything that’s out there on the topic, but you’ll make your job easier if you first limit your scope.
Keep in mind that UNC Libraries have research guides and to databases relevant to many fields of study. You can reach out to the subject librarian for a consultation: https://library.unc.edu/support/consultations/ .
And don’t forget to tap into your professor’s (or other professors’) knowledge in the field. Ask your professor questions such as: “If you had to read only one book from the 90’s on topic X, what would it be?” Questions such as this help you to find and determine quickly the most seminal pieces in the field.
Consider whether your sources are current
Some disciplines require that you use information that is as current as possible. In the sciences, for instance, treatments for medical problems are constantly changing according to the latest studies. Information even two years old could be obsolete. However, if you are writing a review in the humanities, history, or social sciences, a survey of the history of the literature may be what is needed, because what is important is how perspectives have changed through the years or within a certain time period. Try sorting through some other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to consider what is currently of interest to scholars in this field and what is not.
Strategies for writing the literature review
Find a focus.
A literature review, like a term paper, is usually organized around ideas, not the sources themselves as an annotated bibliography would be organized. This means that you will not just simply list your sources and go into detail about each one of them, one at a time. No. As you read widely but selectively in your topic area, consider instead what themes or issues connect your sources together. Do they present one or different solutions? Is there an aspect of the field that is missing? How well do they present the material and do they portray it according to an appropriate theory? Do they reveal a trend in the field? A raging debate? Pick one of these themes to focus the organization of your review.
Convey it to your reader
A literature review may not have a traditional thesis statement (one that makes an argument), but you do need to tell readers what to expect. Try writing a simple statement that lets the reader know what is your main organizing principle. Here are a couple of examples:
The current trend in treatment for congestive heart failure combines surgery and medicine. More and more cultural studies scholars are accepting popular media as a subject worthy of academic consideration.
Consider organization
You’ve got a focus, and you’ve stated it clearly and directly. Now what is the most effective way of presenting the information? What are the most important topics, subtopics, etc., that your review needs to include? And in what order should you present them? Develop an organization for your review at both a global and local level:
First, cover the basic categories
Just like most academic papers, literature reviews also must contain at least three basic elements: an introduction or background information section; the body of the review containing the discussion of sources; and, finally, a conclusion and/or recommendations section to end the paper. The following provides a brief description of the content of each:
- Introduction: Gives a quick idea of the topic of the literature review, such as the central theme or organizational pattern.
- Body: Contains your discussion of sources and is organized either chronologically, thematically, or methodologically (see below for more information on each).
- Conclusions/Recommendations: Discuss what you have drawn from reviewing literature so far. Where might the discussion proceed?
Organizing the body
Once you have the basic categories in place, then you must consider how you will present the sources themselves within the body of your paper. Create an organizational method to focus this section even further.
To help you come up with an overall organizational framework for your review, consider the following scenario:
You’ve decided to focus your literature review on materials dealing with sperm whales. This is because you’ve just finished reading Moby Dick, and you wonder if that whale’s portrayal is really real. You start with some articles about the physiology of sperm whales in biology journals written in the 1980’s. But these articles refer to some British biological studies performed on whales in the early 18th century. So you check those out. Then you look up a book written in 1968 with information on how sperm whales have been portrayed in other forms of art, such as in Alaskan poetry, in French painting, or on whale bone, as the whale hunters in the late 19th century used to do. This makes you wonder about American whaling methods during the time portrayed in Moby Dick, so you find some academic articles published in the last five years on how accurately Herman Melville portrayed the whaling scene in his novel.
Now consider some typical ways of organizing the sources into a review:
- Chronological: If your review follows the chronological method, you could write about the materials above according to when they were published. For instance, first you would talk about the British biological studies of the 18th century, then about Moby Dick, published in 1851, then the book on sperm whales in other art (1968), and finally the biology articles (1980s) and the recent articles on American whaling of the 19th century. But there is relatively no continuity among subjects here. And notice that even though the sources on sperm whales in other art and on American whaling are written recently, they are about other subjects/objects that were created much earlier. Thus, the review loses its chronological focus.
- By publication: Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on biological studies of sperm whales if the progression revealed a change in dissection practices of the researchers who wrote and/or conducted the studies.
- By trend: A better way to organize the above sources chronologically is to examine the sources under another trend, such as the history of whaling. Then your review would have subsections according to eras within this period. For instance, the review might examine whaling from pre-1600-1699, 1700-1799, and 1800-1899. Under this method, you would combine the recent studies on American whaling in the 19th century with Moby Dick itself in the 1800-1899 category, even though the authors wrote a century apart.
- Thematic: Thematic reviews of literature are organized around a topic or issue, rather than the progression of time. However, progression of time may still be an important factor in a thematic review. For instance, the sperm whale review could focus on the development of the harpoon for whale hunting. While the study focuses on one topic, harpoon technology, it will still be organized chronologically. The only difference here between a “chronological” and a “thematic” approach is what is emphasized the most: the development of the harpoon or the harpoon technology.But more authentic thematic reviews tend to break away from chronological order. For instance, a thematic review of material on sperm whales might examine how they are portrayed as “evil” in cultural documents. The subsections might include how they are personified, how their proportions are exaggerated, and their behaviors misunderstood. A review organized in this manner would shift between time periods within each section according to the point made.
- Methodological: A methodological approach differs from the two above in that the focusing factor usually does not have to do with the content of the material. Instead, it focuses on the “methods” of the researcher or writer. For the sperm whale project, one methodological approach would be to look at cultural differences between the portrayal of whales in American, British, and French art work. Or the review might focus on the economic impact of whaling on a community. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed. Once you’ve decided on the organizational method for the body of the review, the sections you need to include in the paper should be easy to figure out. They should arise out of your organizational strategy. In other words, a chronological review would have subsections for each vital time period. A thematic review would have subtopics based upon factors that relate to the theme or issue.
Sometimes, though, you might need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. Put in only what is necessary. Here are a few other sections you might want to consider:
- Current Situation: Information necessary to understand the topic or focus of the literature review.
- History: The chronological progression of the field, the literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
- Methods and/or Standards: The criteria you used to select the sources in your literature review or the way in which you present your information. For instance, you might explain that your review includes only peer-reviewed articles and journals.
Questions for Further Research: What questions about the field has the review sparked? How will you further your research as a result of the review?
Begin composing
Once you’ve settled on a general pattern of organization, you’re ready to write each section. There are a few guidelines you should follow during the writing stage as well. Here is a sample paragraph from a literature review about sexism and language to illuminate the following discussion:
However, other studies have shown that even gender-neutral antecedents are more likely to produce masculine images than feminine ones (Gastil, 1990). Hamilton (1988) asked students to complete sentences that required them to fill in pronouns that agreed with gender-neutral antecedents such as “writer,” “pedestrian,” and “persons.” The students were asked to describe any image they had when writing the sentence. Hamilton found that people imagined 3.3 men to each woman in the masculine “generic” condition and 1.5 men per woman in the unbiased condition. Thus, while ambient sexism accounted for some of the masculine bias, sexist language amplified the effect. (Source: Erika Falk and Jordan Mills, “Why Sexist Language Affects Persuasion: The Role of Homophily, Intended Audience, and Offense,” Women and Language19:2).
Use evidence
In the example above, the writers refer to several other sources when making their point. A literature review in this sense is just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence to show that what you are saying is valid.
Be selective
Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the review’s focus, whether it is thematic, methodological, or chronological.
Use quotes sparingly
Falk and Mills do not use any direct quotes. That is because the survey nature of the literature review does not allow for in-depth discussion or detailed quotes from the text. Some short quotes here and there are okay, though, if you want to emphasize a point, or if what the author said just cannot be rewritten in your own words. Notice that Falk and Mills do quote certain terms that were coined by the author, not common knowledge, or taken directly from the study. But if you find yourself wanting to put in more quotes, check with your instructor.
Summarize and synthesize
Remember to summarize and synthesize your sources within each paragraph as well as throughout the review. The authors here recapitulate important features of Hamilton’s study, but then synthesize it by rephrasing the study’s significance and relating it to their own work.
Keep your own voice
While the literature review presents others’ ideas, your voice (the writer’s) should remain front and center. Notice that Falk and Mills weave references to other sources into their own text, but they still maintain their own voice by starting and ending the paragraph with their own ideas and their own words. The sources support what Falk and Mills are saying.
Use caution when paraphrasing
When paraphrasing a source that is not your own, be sure to represent the author’s information or opinions accurately and in your own words. In the preceding example, Falk and Mills either directly refer in the text to the author of their source, such as Hamilton, or they provide ample notation in the text when the ideas they are mentioning are not their own, for example, Gastil’s. For more information, please see our handout on plagiarism .
Revise, revise, revise
Draft in hand? Now you’re ready to revise. Spending a lot of time revising is a wise idea, because your main objective is to present the material, not the argument. So check over your review again to make sure it follows the assignment and/or your outline. Then, just as you would for most other academic forms of writing, rewrite or rework the language of your review so that you’ve presented your information in the most concise manner possible. Be sure to use terminology familiar to your audience; get rid of unnecessary jargon or slang. Finally, double check that you’ve documented your sources and formatted the review appropriately for your discipline. For tips on the revising and editing process, see our handout on revising drafts .
Works consulted
We consulted these works while writing this handout. This is not a comprehensive list of resources on the handout’s topic, and we encourage you to do your own research to find additional publications. Please do not use this list as a model for the format of your own reference list, as it may not match the citation style you are using. For guidance on formatting citations, please see the UNC Libraries citation tutorial . We revise these tips periodically and welcome feedback.
Anson, Chris M., and Robert A. Schwegler. 2010. The Longman Handbook for Writers and Readers , 6th ed. New York: Longman.
Jones, Robert, Patrick Bizzaro, and Cynthia Selfe. 1997. The Harcourt Brace Guide to Writing in the Disciplines . New York: Harcourt Brace.
Lamb, Sandra E. 1998. How to Write It: A Complete Guide to Everything You’ll Ever Write . Berkeley: Ten Speed Press.
Rosen, Leonard J., and Laurence Behrens. 2003. The Allyn & Bacon Handbook , 5th ed. New York: Longman.
Troyka, Lynn Quittman, and Doug Hesse. 2016. Simon and Schuster Handbook for Writers , 11th ed. London: Pearson.

Make a Gift
- - Google Chrome
Intended for healthcare professionals
- My email alerts
- BMA member login
- Username * Password * Forgot your log in details? Need to activate BMA Member Log In Log in via OpenAthens Log in via your institution

Search form
- Advanced search
- Search responses
- Search blogs
- When and how to update...
When and how to update systematic reviews: consensus and checklist
- Related content
Peer review
This article has a correction. please see:.
- Errata - September 06, 2016
- Paul Garner , professor 1 ,
- Sally Hopewell , associate professor 2 ,
- Jackie Chandler , methods coordinator 3 ,
- Harriet MacLehose , senior editor 3 ,
- Elie A Akl , professor 5 6 ,
- Joseph Beyene , associate professor 7 ,
- Stephanie Chang , director 8 ,
- Rachel Churchill , professor 9 ,
- Karin Dearness , managing editor 10 ,
- Gordon Guyatt , professor 4 ,
- Carol Lefebvre , information consultant 11 ,
- Beth Liles , methodologist 12 ,
- Rachel Marshall , editor 3 ,
- Laura Martínez García , researcher 13 ,
- Chris Mavergames , head 14 ,
- Mona Nasser , clinical lecturer in evidence based dentistry 15 ,
- Amir Qaseem , vice president and chair 16 17 ,
- Margaret Sampson , librarian 18 ,
- Karla Soares-Weiser , deputy editor in chief 3 ,
- Yemisi Takwoingi , senior research fellow in medical statistics 19 ,
- Lehana Thabane , director and professor 4 20 ,
- Marialena Trivella , statistician 21 ,
- Peter Tugwell , professor of medicine, epidemiology, and community medicine 22 ,
- Emma Welsh , managing editor 23 ,
- Ed C Wilson , senior research associate in health economics 24 ,
- Holger J Schünemann , professor 4 5
- 1 Cochrane Infectious Diseases Group, Department of Clinical Sciences, Liverpool School of Tropical Medicine, Liverpool L3 5QA, UK
- 2 Oxford Clinical Trials Research Unit, University of Oxford, Oxford, UK
- 3 Cochrane Editorial Unit, Cochrane Central Executive, London, UK
- 4 Department of Clinical Epidemiology and Biostatistics and Department of Medicine, McMaster University, Hamilton, ON, Canada
- 5 Cochrane GRADEing Methods Group, Ottawa, ON, Canada
- 6 Department of Internal Medicine, American University of Beirut, Beirut, Lebanon
- 7 Department of Mathematics and Statistics, McMaster University
- 8 Evidence-based Practice Center Program, Agency for Healthcare and Research Quality, Rockville, MD, USA
- 9 Centre for Reviews and Dissemination, University of York, York, UK
- 10 Cochrane Upper Gastrointestinal and Pancreatic Diseases Group, Hamilton, ON, Canada
- 11 Lefebvre Associates, Oxford, UK
- 12 Kaiser Permanente National Guideline Program, Portland, OR, USA
- 13 Iberoamerican Cochrane Centre, Barcelona, Spain
- 14 Cochrane Informatics and Knowledge Management, Cochrane Central Executive, Freiburg, Germany
- 15 Plymouth University Peninsula School of Dentistry, Plymouth, UK
- 16 Department of Clinical Policy, American College of Physicians, Philadelphia, PA, USA
- 17 Guidelines International Network, Pitlochry, UK
- 18 Children’s Hospital of Eastern Ontario, Ottawa, ON, Canada
- 19 Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- 20 Biostatistics Unit, Centre for Evaluation, McMaster University, Hamilton, ON, Canada
- 21 Centre for Statistics in Medicine, University of Oxford, Oxford, UK
- 22 University of Ottawa, Ottawa, ON, Canada
- 23 Cochrane Airways Group, Population Health Research Institute, St George’s, University of London, London, UK
- 24 Cambridge Centre for Health Services Research, University of Cambridge, Cambridge, UK
- Correspondence to: P Garner Paul.Garner{at}lstmed.ac.uk
- Accepted 26 May 2016
Updating of systematic reviews is generally more efficient than starting all over again when new evidence emerges, but to date there has been no clear guidance on how to do this. This guidance helps authors of systematic reviews, commissioners, and editors decide when to update a systematic review, and then how to go about updating the review.
Systematic reviews synthesise relevant research around a particular question. Preparing a systematic review is time and resource consuming, and provides a snapshot of knowledge at the time of incorporation of data from studies identified during the latest search. Newly identified studies can change the conclusion of a review. If they have not been included, this threatens the validity of the review, and, at worst, means the review could mislead. For patients and other healthcare consumers, this means that care and policy development might not be fully informed by the latest research; furthermore, researchers could be misled and carry out research in areas where no further research is actually needed. 1 Thus, there are clear benefits to updating reviews, rather than duplicating the entire process as new evidence emerges or new methods develop. Indeed, there is probably added value to updating a review, because this will include taking into account comments and criticisms, and adoption of new methods in an iterative process. 2 3 4 5 6
Cochrane has over 20 years of experience with preparing and updating systematic reviews, with the publication of over 6000 systematic reviews. However, Cochrane’s principle of keeping all reviews up to date has not been possible, and the organisation has had to adapt: from updating when new evidence becomes available, 7 to updating every two years, 8 to updating based on need and priority. 9 This experience has shown that it is not possible, sensible, or feasible to continually update all reviews all the time. Other groups, including guideline developers and journal editors, adopt updating principles (as applied, for example, by the Systematic Reviews journal; https://systematicreviewsjournal.biomedcentral.com/ ).
The panel for updating guidance for systematic reviews (PUGs) group met to draw together experiences and identify a common approach. The PUGs guidance can help individuals or academic teams working outside of a commissioning agency or Cochrane, who are considering writing a systematic review for a journal or to prepare for a research project. The guidance could also help these groups decide whether their effort is worthwhile.
Summary points
Updating systematic reviews is, in general, more efficient than starting afresh when new evidence emerges. The panel for updating guidance for systematic reviews (PUGs; comprising review authors, editors, statisticians, information specialists, related methodologists, and guideline developers) met to develop guidance for people considering updating systematic reviews. The panel proposed the following:
Decisions about whether and when to update a systematic review are judgments made for individual reviews at a particular time. These decisions can be made by agencies responsible for systematic review portfolios, journal editors with systematic review update services, or author teams considering embarking on an update of a review.
The decision needs to take into account whether the review addresses a current question, uses valid methods, and is well conducted; and whether there are new relevant methods, new studies, or new information on existing included studies. Given this information, the agency, editors, or authors need to judge whether the update will influence the review findings or credibility sufficiently to justify the effort in updating it.
Review authors and commissioners can use a decision framework and checklist to navigate and report these decisions with “update status” and rationale for this status. The panel noted that the incorporation of new synthesis methods (such as Grading of Recommendations Assessment, Development and Evaluation (GRADE)) is also often likely to improve the quality of the analysis and the clarity of the findings.
Given a decision to update, the process needs to start with an appraisal and revision of the background, question, inclusion criteria, and methods of the existing review.
Search strategies should be refined, taking into account changes in the question or inclusion criteria. An analysis of yield from the previous edition, in relation to databases searched, terms, and languages can make searches more specific and efficient.
In many instances, an update represents a new edition of the review, and authorship of the new version needs to follow criteria of the International Committee of Medical Journal Editors (ICMJE). New approaches to publishing licences could help new authors build on and re-use the previous edition while giving appropriate credit to the previous authors.
The panel also reflected on this guidance in the context of emerging technological advances in software, information retrieval, and electronic linkage and mining. With good synthesis and technology partnerships, these advances could revolutionise the efficiency of updating in the coming years.
Panel selection and procedures
An international panel of authors, editors, clinicians, statisticians, information specialists, other methodologists, and guideline developers was invited to a two day workshop at McMaster University, Hamilton, Canada, on 26-27 June 2014, organised by Cochrane. The organising committee selected the panel (web appendix 1). The organising committee invited participants, put forward the agenda, collected background materials and literature, and drafted the structure of the report.
The purpose of the workshop was to develop a common approach to updating systematic reviews, drawing on existing strategies, research, and experience of people working in this area. The selection of participants aimed on broad representation of different groups involved in producing systematic reviews (including authors, editors, statisticians, information specialists, and other methodologists), and those using the reviews (guideline developers and clinicians). Participants within these groups were selected on their expertise and experience in updating, in previous work developing methods to assess reviews, and because some were recognised for developing approaches within organisations to manage updating strategically. We sought to identify general approaches in this area, and not be specific to Cochrane; although inevitably most of the panel were somehow engaged in Cochrane.
The workshop structure followed a series of short presentations addressing key questions on whether, when, and how to update systematic reviews. The proceedings included the management of authorship and editorial decisions, and innovative and technological approaches. A series of small group discussions followed each question, deliberating content, and forming recommendations, as well as recognising uncertainties. Large group, round table discussions deliberated further these small group developments. Recommendations were presented to an invited forum of individuals with varying levels of expertise in systematic reviews from McMaster University (of over 40 people), widely known for its contributions to the field of research evidence synthesis. Their comments helped inform the emerging guidance.
The organising committee became the writing committee after the meeting. They developed the guidance arising from the meeting, developed the checklist and diagrams, added examples, and finalised the manuscript. The guidance was circulated to the larger group three times, with the PUGs panel providing extensive feedback. This feedback was all considered and carefully addressed by the writing committee. The writing committee provided the panel with the option of expressing any additional comments from the general or specific guidance in the report, and the option for registering their own view that might differ to the guidance formed and their view would be recorded in an annex. In the event, consensus was reached, and the annex was not required.
Definition of update
The PUGs panel defined an update of a systematic review as a new edition of a published systematic review with changes that can include new data, new methods, or new analyses to the previous edition. This expands on a previous definition of a systematic review update. 10 An update asks a similar question with regard to the participants, intervention, comparisons, and outcomes (PICO) and has similar objectives; thus it has similar inclusion criteria. These inclusion criteria can be modified in the light of developments within the topic area with new interventions, new standards, and new approaches. Updates will include a new search for potentially relevant studies and incorporate any eligible studies or data; and adjust the findings and conclusions as appropriate. Box 1 provides some examples.
Box 1: Examples of what factors might change in an updated systematic review
A systematic review of steroid treatment in tuberculosis meningitis used GRADE methods and split the composite outcome in the original review of death plus disability into its two components. This improved the clarity of the reviews findings in relation to the effects and the importance of the effects of steroids on death and on disability. 11
A systematic review of dihydroartemisinin-piperaquine (DHAP) for treating malaria was updated with much more detailed analysis of the adverse effect data from the existing trials as a result of questions raised by the European Medicines Agency. Because the original review included other comparisons, the update required extracting only the DHAP comparisons from the original review, and a modification of the title and the PICO. 12
A systematic review of atorvastatin was updated with simple uncontrolled studies. 13 This update allowed comparisons with trials and strengthened the review findings. 14
Which systematic reviews should be updated and when?
Any group maintaining a portfolio of systematic reviews as part of their normative work, such as guidelines panels or Cochrane review groups, will need to prioritise which reviews to update. Box 2 presents the approaches used by the Agency for HealthCare Research and Quality (AHRQ) and Cochrane to prioritise which systematic reviews to update and when. Clearly, the responsibility for deciding which systematic reviews should be updated and when they will be updated will vary: it may be centrally organised and resourced, as with the AHRQ scientific resource centre (box 2). In Cochrane, the decision making process is decentralised to the Cochrane Review Group editorial team, with different approaches applied, often informally.
Box 2: Examples of how different organisations decide on updating systematic reviews
Agency for healthcare research and quality (us).
The AHRQ uses a needs based approach; updating systematic reviews depends on an assessment of several criteria:
Stakeholder impact
Interest from stakeholder partners (such as consumers, funders, guideline developers, clinical societies, James Lind Alliance)
Use and uptake (for example, frequency of citations and downloads)
Citation in scientific literature including clinical practice guidelines
Currency and need for update
New research is available
Review conclusions are probably dated
Update decision
Based on the above criteria, the decision is made to either update, archive, or continue surveillance.
Of over 50 Cochrane editorial teams, most but not all have some systems for updating, although this process can be informal and loosely applied. Most editorial teams draw on some or all of the following criteria:
Strategic importance
Is the topic a priority area (for example, in current debates or considered by guidelines groups)?
Is there important new information available?
Practicalities in organising the update that many groups take into account
Size of the task (size and quality of the review, and how many new studies or analyses are needed)
Availability and willingness of the author team
Impact of update
New research impact on findings and credibility
Consider whether new methods will improve review quality
Priority to update, postpone update, class review as no longer requiring an update
The PUGs panel recommended an individualised approach to updating, which used the procedures summarised in figure 1 ⇓ . The figure provides a status category, and some options for classifying reviews into each of these categories, and builds on a previous decision tool and earlier work developing an updating classification system. 15 16 We provide a narrative for each step.
Fig 1 Decision framework to assess systematic reviews for updating, with standard terms to report such decisions
- Download figure
- Open in new tab
- Download powerpoint
Step 1: assess currency
Does the published review still address a current question.
An update is only worthwhile if the question is topical for decision making for practice, policy, or research priorities (fig 1 ⇑ ). For agencies, people responsible for managing a portfolio of systematic reviews, there is a need to use both formal and informal horizon scanning. This type of scanning helps identify questions with currency, and can help identify those reviews that should be updated. The process could include monitoring policy debates around the review, media outlets, scientific (and professional) publications, and linking with guideline developers.
Has the review had good access or use?
Metrics for citations, article access and downloads, and sharing via social or traditional media can be used as proxy or indicators for currency and relevance of the review. Reviews that are widely cited and used could be important to update should the need arise. Comparable reviews that are never cited or rarely downloaded, for example, could indicate that they are not addressing a question that is valued, and might not be worth updating.
In most cases, updated reviews are most useful to stakeholders when there is new information or methods that result in a change in findings. However, there are some circumstances in which an up to date search for information is important for retaining the credibility of the review, regardless of whether the main findings would change or not. For example, key stakeholders would dismiss a review if a study is carried out in a relevant geographical setting but is not included; if a large, high profile study that might not change the findings is not included; or if an up to date search is required for a guideline to achieve credibility. Box 3 provides such examples. If the review does not answer a current question, the intervention has been superseded, then a decision can be made not to update and no further intelligence gathering is required (fig 1 ⇑ ).
Box 3: Examples of a systematic review’s currency
The public is interested in vitamin C for preventing the common cold: the Cochrane review includes over 29 trials with either no or small effects, concluding good evidence of no important effects. 17 Assessment: still a current question for the public.
Low osmolarity oral rehydration salt (ORS) solution versus standard solution for acute diarrhoea in children: the 2001 Cochrane review 18 led the World Health Organization to recommend ORS solution formula worldwide to follow the new ORS solution formula 19 and this has now been accepted globally. Assessment: no longer a current question.
Routine prophylactic antibiotics with caesarean section: the Cochrane review reports clear evidence of maternal benefit from placebo controlled trials but no information on the effects on the baby. 20 Assessment: this is a current question.
A systematic review published in the Lancet examined the effects of artemisinin based combination treatments compared with monotherapy for treating malaria and showed clear benefit. 21 Assessment: this established the treatment globally and is no longer a current question and no update is required.
A Cochrane review of amalgam restorations for dental caries 22 is unlikely to be updated because the use of dental amalgam is declining, and the question is not seen as being important by many dental specialists. Assessment: no longer a current question.
Did the review use valid methods and was it well conducted?
If the question is current and clearly defined, the systematic review needs to have used valid methods and be well conducted. If the review has vague inclusion criteria, poorly articulated outcomes, or inappropriate methods, then updating should not proceed. If the question is current, and the review has been cited or used, then it might be appropriate to simply start with a new protocol. The appraisal should take into account the methods in use when the review was done.
Step 2: identify relevant new methods, studies, and other information
Are there any new relevant methods.
If the question is current, but the review was done some years ago, the quality of the review might not meet current day standards. Methods have advanced quickly, and data extraction and understanding of the review process have become more sophisticated. For example:
Methods for assessing risk of bias of randomised trials, 23 diagnostic test accuracy (QUADAS-2), 24 and observational studies (ROBINS-1). 25
Application of summary of findings, evidence profiles, and related GRADE methods has meant the characteristics of the intervention, characteristics of the participants, and risk of bias are more thoroughly and systematically documented. 26 27
Integration of other study designs containing evidence, such economic evaluation and qualitative research. 28
There are other incremental improvements in a wide range of statistical and methodological areas, for example, in describing and taking into account cluster randomised trials. 29 AMSTAR can assess the overall quality of a systematic review, 30 and the ROBIS tool can provide a more detailed assessment of the potential for bias. 31
Are there any new studies or other information?
If an authoring or commissioning team wants to ensure that a particular review is up to date, there is a need for routine surveillance for new studies that are potentially relevant to the review, by searching and trial register inspection at regular intervals. This process has several approaches, including:
Formal surveillance searching 32
Updating the full search strategies in the original review and running the searches
Tracking studies in clinical trial and other registers
Using literature appraisal services 33
Using a defined abbreviated search strategy for the update 34
Checking studies included in related systematic reviews. 35
How often this surveillance is done, and which approaches to use, depend on the circumstances and the topic. Some topics move quickly, and the definition of “regular intervals” will vary according to the field and according to the state of evidence in the field. For example, early in the life of a new intervention, there might be a plethora of studies, and surveillance would be needed more frequently.
Step 3: assess the effect of updating the review
Will the adoption of new methods change the findings or credibility.
Editors, referees, or experts in the topic area or methodologists can provide an informed view of whether a review can be substantially improved by application of current methodological expectations and new methods (fig 1 ⇑ ). For example, a Cochrane review of iron supplementation in malaria concluded that there was “no significant difference between iron and placebo detected.” 36 An update of the review included a GRADE assessment of the certainty of the evidence, and was able to conclude with a high degree of certainty that iron does not cause an excess of clinical malaria because the upper relative risk confidence intervals of harm was 1.0 with high certainty of evidence. 37
Will the new studies, information, or data change the findings or credibility?
The assessment of new data contained in new studies and how these data might change the review is often used to determine whether an update should go ahead, and the speed with which the update should be conducted. The appraisal of these new data can be carried out in different ways. Initially, methods focused on statistical approaches to predict an overturning of the current review findings in terms of the primary or desired outcome (table 1 ⇓ ). Although this aspect is important, additional studies can add important information to a review, which is more than just changing the primary outcome to a more accurate and reliable estimate. Box 4 gives examples.
Formal prediction tools: how potentially relevant new studies can affect review conclusions
- View inline
Box 4: Examples of new information other than new trials being important
The iconic Cochrane review of steroids in preterm labour was thought to provide evidence of benefit in infants, and this question no longer required new trials. However, a new large trial published in the Lancet in 2015 showed that in low and middle income countries, strategies to promote the uptake of neonatal steroids increased neonatal mortality and suspected maternal infection. 49 This information needs to somehow be incorporated into the review to maintain its credibility.
A Cochrane review of community deworming in developing countries indicates that in recent studies, there is little or no effect. 50 The inclusion of a large trial of two million children confirmed that there was no effect on mortality. Although the incorporation of the trial in the review did not change the review’s conclusions, the trial’s absence would have affected the credibility of the review, so it was therefore updated.
A new paper reporting long term follow-up data on anthracycline chemotherapy as part of cancer treatment was published. Although the effects from the outcomes remained essentially unchanged, apart from this longer follow-up, the paper also included information about the performance bias in the original trial, shifting the risk of bias for several outcomes from “unknown” to “high” in the Cochrane review. 51
Reviews with a high level of certainty in the results (that is, when the GRADE assessment for the body of evidence is high) are less likely to change even with the addition of new studies, information, or data, by definition. GRADE can help guide priorities in whether to update, but it is still important to assess new studies that might meet the inclusion criteria. New studies can show unexpected effects (eg, attenuation of efficacy) or provide new information about the effects seen in different circumstances (eg, groups of patients or locations).
Other tools are specifically designed to help decision making in updating. For example, the Ottawa 39 and RAND 45 methods focus on identification of new evidence, the statistical predication tool 15 calculates the probability of new evidence changing the review conclusion, and the value of information analysis approach 52 calculates the expected health gain (table 1 ⇑ ). As yet, there has been limited external validation of these tools to determine which approach would be most effective and when.
If potentially relevant studies are identified that have not previously been assessed for inclusion, authors or those managing the updating process need to assess whether including them might affect the conclusions of the review. They need to examine the weight and certainty of the new evidence to help determine whether an update is needed and how urgent that update is. The updating team can assess this informally by judging whether new studies or data are likely to substantively affect the review, for example, by altering the certainty in an existing comparison, or by generating new comparisons and analyses in the existing review.
New information can also include fresh follow-up data on existing included studies, or information on how the studies were carried out. These should be assessed in terms of whether they might change the review findings or improve its credibility (fig 1 ⇑ ). Indeed, if any study has been retracted, it is important the authors assess the reasons for its retraction. In the case of data fabrication, the study needs to be removed from the analysis and this recorded. A decision needs to be made as to whether other studies by the same author should be removed from the review and other related reviews. An investigation should also be initiated following guidelines from the Committee on Publication Ethics (COPE). Additional published and unpublished data can become available from a wide range of sources—including study investigators, regulatory agencies and industry—and are important to consider.
Preparing for an update
Refresh background, objectives, inclusion criteria, and methods
Before including new studies in the review, authors need to revisit the background, objectives, inclusion criteria, and methods of the current review. In Cochrane, this is referred to as the protocol, and editors are part of this process. The update could range from simply endorsing the current question and inclusion criteria, through to full rewriting of the question, inclusion criteria and methods, and republishing the protocol. As a field progresses with larger and better quality trials rigorously testing the questions posed, it may be appropriate to exclude weaker study designs (such as quasi-randomised comparisons or very small trials) from the update (table 2 ⇓ ). The PUGs panel recommended that a protocol refresh will require the authors to use the latest accepted methods of synthesis, even if this means repeating data extraction for all studies.
New authors and authorship
Updated systematic reviews are new publications with new citations. An authorship team publishing an update in a scientific or medical journal is likely to manage the new edition of a review in the same way as with any other publication, and follow the ICMJE authorship criteria. 56 If the previous author or author team steps down, then they should be acknowledged in the new version. However, some might perceive that their efforts in the first version warrant continued authorship, which may be valid. The management of authorship between versions can sometimes be complicated. At worst, it delays new authors completing an update and leads to long authorship lists of people from previous versions who probably do not meet ICMJE authorship criteria. One approach with updates including new authors is to have an opt-in policy for the existing authors: they can opt in to the new edition, provided that they make clear their contribution, and this is then agreed with the entire author team.
Although they are new publications, updates will generally include content from the published version. Changing licensing rights around systematic reviews to allow new authors of future updates to remix, tweak, or build on the contributions of the original authors of the published version (similar to the rights available via a Creative Commons licence; https://creativecommons.org ) could be a more sustainable and simpler approach. This approach would allow systematic reviews to continue to evolve and build on the work of a range of authors over time, and for contributors to be given credit for contributions to this previous work.
Efficient searching
In performing an update, a search based on the search conducted for the original review is required. The updated search strategy will need to take into account changes in the review question or inclusion criteria, for example, and might be further adjusted based on knowledge of running the original search strategy. The search strategy for an update need not replicate the original search strategy, but could be refined, for example, based on an analysis of the yield of the original search. These new search approaches are currently undergoing formal empirical evaluation, but they may well provide much more efficient search strategies in the future. Some examples of these possible new methods for review updates are described in web appendix 2.
In reporting the search process for the update, investigators must ensure transparency for any previous versions and the current update, and use an adapted flow diagram based on PRISMA reporting (preferred reporting items for systematic reviews and meta-analyses). 57 The search processes and strategies for the update must be adequately reported such that they could be replicated.
Systematic reviews published for the first time in peer reviewed journals are by definition peer reviewed, but practice for updates remains variable, because an update might have few changes (such as an updated search but no new studies found and therefore included) or many changes (such as revise methods and inclusion of several new studies leading to revised conclusions). Therefore, and to use peer reviewers’ time most effectively, editors need to consider when to peer review an update and the type of peer reviewer most useful for a particular update (for example, topic specialist, methodologist). The decision to use peer review, and the number and expertise of the peer reviewers could depend on the nature of the update and the extent of any changes to the systematic review as part of an editor assessment. A change in the date of the search only (where no new studies were identified) would not require peer review (except, arguably, peer review of the search), but the addition of studies that lead to a change in conclusions or significant changes to the methods would require peer review. The nature of the peer review could be described within the published article.
Reporting changes
Authors should provide a clear description of the changes in approach or methods between different editions of a review. Also, authors need to report the differences in findings between the original and updated edition to help users decide how to use the new edition. The approach or format used to present the differences in findings might vary with the target user group. 58 Publishers need to ensure that all previous versions of the review remain publically accessible.
Updates can range from small adjustments to reviews being completely rewritten, and the PUGs panel spent some time debating whether the term “new edition” would be a better description than “update.” However, the word “update” is now in common parlance and changing the term, the panel judged, could cause confusion. However, the debate does illustrate that an update could represent a review that asks a similar question but has been completely revised.
Technology and innovation
The updating of systematic review is generally done manually and is time consuming. There are opportunities to make better use of technology to streamline the updating process and improve efficiency (table 3 ⇓ ). Some of these tools already exist and are in development or in early use, and some are commercially available or freely available. The AHRQ’s evidence based practice centre team has recently published tools for searching and screening, and will provide an assessment of the use, reliability, and availability of these tools. 63
Technological innovations to improve the efficiency of updating systematic reviews
Other developments, such as targeted updates that are performed rapidly and focus on updating only key components of a review, could provide different approaches to updating in the future and are being piloted and evaluated. 64 With implementation of these various innovations, the longer term goal is for “living” systematic reviews, which identify and incorporate information rapidly as it evolves over time. 60
Concluding remarks
Updating systematic reviews, rather than addressing the same question with a fresh protocol, is generally more efficient and allows incremental improvement over time. Mechanical rules appear unworkable, but there is no clear unified approach on when to update, and how implement this. This PUGs panel of authors, editors, statisticians, information specialists, other methodologists, and guideline developers brought together current thinking and experience in this area to provide guidance.
Decisions about whether and when to update a systematic review are judgments made at a point in time. They depend on the currency of the question asked, the need for updating to maintain credibility, the availability of new evidence, and whether new research or new methods will affect the findings.
Whether the review uses current methodological standards is important in deciding if the update will influence the review findings, quality, reliability, or credibility sufficiently to justify the effort in updating it. Those updating systematic reviews to author clinical practice guidelines might consider the influence of new study results in potentially overturning the conclusions of an existing review. Yet, even in cases where new study findings do not change the primary outcome measure, new studies can carry important information about subgroup effects, duration of treatment effects, and other relevant clinical information, enhancing the currency and breadth of review results.
An update requires appraisal and revision of the background, question, inclusion criteria, and methods of the existing review and the existing certainty in the evidence. In particular, methods might need to be updated, and search strategies reconsidered. Authors of updates need to consider inputs to the current edition, and follow ICMJE criteria regarding authorship. 56
The PUGs panel proposed a decision framework (fig 1 ⇑ ), with terms and categories for reporting the decisions made for updating procedures for adoption by Cochrane and other stakeholders. This framework includes journals publishing systematic review updates and independent authors considering updates of existing published reviews. The panel developed a checklist to help judgements about when and how to update.
The current emphasis of authors, guideline developers, Cochrane, and consequently this guidance has been on effects reviews. The checklists and guidance here still applies to other types of systematic reviews, such as those on diagnostic test accuracy, and this guidance will need adapting. Accumulative experience and methods development in reviews other than those of effects are likely to help refine guidance in the future.
This guidance could help groups identify and prioritise reviews for updating and hence use their finite resources to greatest effect. Software innovation and new management systems are being developed and in early use to help streamline review updates in the coming years.
Contributors: HJS initiated the workshop. JC, SH, PG, HM, and HJS organised the materials and the agenda. SH wrote up the proceedings. PG wrote the paper from the proceedings and coordinated the development of the final guidance; JC, SH, HM, and HJS were active in the finalising of the guidance. All PUGs authors contributed to three rounds of manuscript revision.
Funding: Attendance at this meeting, for those attendees not directly employed by Cochrane, was not funded by Cochrane beyond the reimbursement of out of pocket expenses for those attendees for whom this was appropriate. Expenses were not reimbursed for US federal government attendees, in line with US government policy. Statements in the manuscript should not be construed as endorsement by the US Agency for Healthcare Research and Quality or the US Department of Health and Human Services.
Competing interests: All participants have a direct or indirect interest in systematic reviews and updating as part of their job or academic career. Most participants contribute to Cochrane, whose mission includes a commitment to the updating of its systematic review portfolio. JC, HM, RM, CM, KS-W, and MT are, or were at that time, employed by the Cochrane Central Executive.
Provenance and peer review: Not commissioned; externally peer reviewed.
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 3.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/3.0/ .
- ↵ Shekelle PG, Ortiz E, Rhodes S, et al. Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA 2001 ; 286 : 1461 - 7 . doi:10.1001/jama.286.12.1461 pmid:11572738 . OpenUrl CrossRef PubMed Web of Science
- ↵ Claxton K, Cohen JT, Neumann PJ. When is evidence sufficient? Health Aff (Millwood) 2005 ; 24 : 93 - 101 . doi:10.1377/hlthaff.24.1.93 pmid:15647219 . OpenUrl Abstract / FREE Full Text
- ↵ Fenwick E, Claxton K, Sculpher M, et al. Improving the efficiency and relevance of health technology assessment: the role of decision analytic modelling. Paper 179. Centre for Health Economics, University of York, 2000 .
- ↵ Sculpher M, Claxton K. Establishing the cost-effectiveness of new pharmaceuticals under conditions of uncertainty—when is there sufficient evidence? Value Health 2005 ; 8 : 433 - 46 . doi:10.1111/j.1524-4733.2005.00033.x pmid:16091019 . OpenUrl CrossRef PubMed Web of Science
- ↵ Sculpher M, Drummond M, Buxton M. The iterative use of economic evaluation as part of the process of health technology assessment. J Health Serv Res Policy 1997 ; 2 : 26 - 30 . pmid:10180650 . OpenUrl Abstract / FREE Full Text
- ↵ Wilson E, Abrams K. From evidence based economics to economics based evidence: using systematic review to inform the design of future research. In: Shemilt I, Mugford M, Vale L, et al, eds. Evidence based economics. Blackwell Publishing, 2010 doi:10.1002/9781444320398.ch12 .
- ↵ Chalmers I, Enkin M, Keirse MJ. Preparing and updating systematic reviews of randomized controlled trials of health care. Milbank Q 1993 ; 71 : 411 - 37 . doi:10.2307/3350409 pmid:8413069 . OpenUrl CrossRef PubMed Web of Science
- ↵ Higgins J, Green S, Scholten R. Chapter 3. Maintaining reviews: updates, amendments and feedback: Version 5.1.0 (updated March 2011). Cochrane Collaboration, 2011 .
- ↵ Cochrane. Editorial and publishing policy resource. http://community.cochrane.org/editorial-and-publishing-policy-resource . 2016.
- ↵ Moher D, Tsertsvadze A. Systematic reviews: when is an update an update? Lancet 2006 ; 367 : 881 - 3 . doi:10.1016/S0140-6736(06)68358-X pmid:16546523 . OpenUrl CrossRef PubMed Web of Science
- ↵ Prasad K, Singh MB, Ryan H. Corticosteroids for managing tuberculous meningitis. Cochrane Database Syst Rev 2016 ; 4 : CD002244 . pmid:27121755 . OpenUrl PubMed
- ↵ Zani B, Gathu M, Donegan S, Olliaro PL, Sinclair D. Dihydroartemisinin-piperaquine for treating uncomplicated Plasmodium falciparum malaria. Cochrane Database Syst Rev 2014 ; 1 : CD010927 . pmid:24443033 . OpenUrl CrossRef PubMed
- ↵ Adams SP, Tsang M, Wright JM. Lipid lowering efficacy of atorvastatin. Cochrane Database Syst Rev 2012 ; 12 : CD008226 . pmid:23235655 . OpenUrl PubMed
- ↵ Higgins J. Convincing evidence from controlled and uncontrolled studies on the lipid-lowering effect of a statin. Cochrane Database Syst Rev 2012 ; 12 : ED000049 . pmid:23361645 . OpenUrl PubMed
- ↵ Takwoingi Y, Hopewell S, Tovey D, Sutton AJ. A multicomponent decision tool for prioritising the updating of systematic reviews. BMJ 2013 ; 347 : f7191 . doi:10.1136/bmj.f7191 pmid:24336453 . OpenUrl FREE Full Text
- ↵ MacLehose H, Hilton J, Tovey D, et al. The Cochrane Library: revolution or evolution? Shaping the future of Cochrane content. Background paper for The Cochrane Collaboration’s Strategic Session Paris, France, 18 April 2012. http://editorial-unit.cochrane.org/sites/editorial-unit.cochrane.org/files/uploads/2012-CC-strategic-session_full-report.pdf .
- ↵ Hemilä H, Chalker E. Vitamin C for preventing and treating the common cold. Cochrane Database Syst Rev 2013 ;( 1 ): CD000980 . pmid:23440782 .
- ↵ Hahn S, Kim S, Garner P. Reduced osmolarity oral rehydration solution for treating dehydration caused by acute diarrhoea in children. Cochrane Database Syst Rev 2002 ;( 1 ): CD002847 . pmid:11869639 .
- ↵ World Health Organization (WHO). Reduced osmolarity oral rehydration salts (ORS) formulation. A report from a meeting of Experts jointly organized by UNICEF and WHO. New York: Child and Adolescent Health and Development, 18 July 2001 http://apps.who.int/iris/bitstream/10665/67322/1/WHO_FCH_CAH_01.22.pdf .
- ↵ Smaill FM, Grivell RM. Antibiotic prophylaxis versus no prophylaxis for preventing infection after cesarean section. Cochrane Database Syst Rev 2014 ;( 10 ): CD007482 . pmid:25350672 .
- ↵ Adjuik M, Babiker A, Garner P, Olliaro P, Taylor W, White N. International Artemisinin Study Group. Artesunate combinations for treatment of malaria: meta-analysis. Lancet 2004 ; 363 : 9 - 17 . doi:10.1016/S0140-6736(03)15162-8 pmid:14723987 . OpenUrl CrossRef PubMed Web of Science
- ↵ Agnihotry A, Fedorowicz Z, Nasser M. Adhesively bonded versus non-bonded amalgam restorations for dental caries. Cochrane Database Syst Rev 2016 ; 3 : CD007517 . pmid:26954446 . OpenUrl PubMed
- ↵ Higgins JP, Altman DG, Gøtzsche PC, et al. Cochrane Bias Methods Group Cochrane Statistical Methods Group. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011 ; 343 : d5928 . doi:10.1136/bmj.d5928 pmid:22008217 . OpenUrl FREE Full Text
- ↵ Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2 Group. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011 ; 155 : 529 - 36 . doi:10.7326/0003-4819-155-8-201110180-00009 pmid:22007046 . OpenUrl CrossRef PubMed Web of Science
- ↵ Sterne JAC, Higgins JPT, Reeves BC; on behalf of the development group for ROBINS-I. A tool for assessing risk of bias in non-randomized studies of interventions, version 7. March 2016. www.riskofbias.info .
- ↵ Guyatt GH, Oxman AD, Vist GE, et al. GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008 ; 336 : 924 - 6 . doi:10.1136/bmj.39489.470347.AD pmid:18436948 . OpenUrl FREE Full Text
- ↵ Schünemann HJ. Interpreting GRADE’s levels of certainty or quality of the evidence: GRADE for statisticians, considering review information size or less emphasis on imprecision? J Clin Epidemiol 2016 ; 75 : 6 - 15 . doi:10.1016/j.jclinepi.2016.03.018 pmid:27063205 . OpenUrl CrossRef PubMed
- ↵ Gough D. Qualitative and mixed methods in systematic reviews. Syst Rev 2015 ; 4 : 181 . doi:10.1186/s13643-015-0151-y pmid:26670769 . OpenUrl CrossRef PubMed
- ↵ Richardson M, Garner P, Donegan S. Cluster randomised trials in Cochrane reviews: evaluation of methodological and reporting practice. PLoS One 2016 ; 11 : e0151818 . doi:10.1371/journal.pone.0151818 pmid:26982697 . OpenUrl CrossRef PubMed
- ↵ Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007 ; 7 : 10 . doi:10.1186/1471-2288-7-10 pmid:17302989 . OpenUrl CrossRef PubMed
- ↵ Whiting P, Savović J, Higgins JP, et al. ROBIS group. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol 2016 ; 69 : 225 - 34 . doi:10.1016/j.jclinepi.2015.06.005 pmid:26092286 . OpenUrl CrossRef PubMed
- ↵ Sampson M, Shojania KG, McGowan J, et al. Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol 2008 ; 61 : 755 - 62 . doi:10.1016/j.jclinepi.2007.10.003 pmid:18586179 . OpenUrl CrossRef PubMed Web of Science
- ↵ Hemens BJ, Haynes RB. McMaster Premium LiteratUre Service (PLUS) performed well for identifying new studies for updated Cochrane reviews. J Clin Epidemiol 2012 ; 65 : 62 - 72.e1 . doi:10.1016/j.jclinepi.2011.02.010 pmid:21856121 . OpenUrl CrossRef PubMed
- ↵ Sagliocca L, De Masi S, Ferrigno L, Mele A, Traversa G. A pragmatic strategy for the review of clinical evidence. J Eval Clin Pract 2013 ; 19 : 689 - 96 . doi:10.1111/jep.12020 pmid:23317014 . OpenUrl CrossRef PubMed
- ↵ Rada G, Peña J, Capurro D, et al. How to create a matrix of evidence in Epistemonikos. Abstracts of the 22nd Cochrane Colloquium; Evidence-informed public health: opportunities and challenges; Hyderabad, India. Cochrane Database Syst Rev 2014 ; suppl 1 : 132 .
- ↵ Okebe JU, Yahav D, Shbita R, Paul M. Oral iron supplements for children in malaria-endemic areas. Cochrane Database Syst Rev 2011 ;( 10 ): CD006589 . pmid:21975754 .
- ↵ Neuberger A, Okebe J, Yahav D, Paul M. Oral iron supplements for children in malaria-endemic areas. Cochrane Database Syst Rev 2016 ; 2 : CD006589 . pmid:26921618 . OpenUrl PubMed
- Balshem H, Helfand M, Schünemann HJ, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011 ; 64 : 401 - 6 . doi:10.1016/j.jclinepi.2010.07.015 pmid:21208779 . OpenUrl CrossRef PubMed Web of Science
- ↵ Chung M, Newberry SJ, Ansari MT, et al. Two methods provide similar signals for the need to update systematic reviews. J Clin Epidemiol 2012 ; 65 : 660 - 8 . doi:10.1016/j.jclinepi.2011.12.004 pmid:22464414 . OpenUrl CrossRef PubMed
- Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med 2007 ; 147 : 224 - 33 . doi:10.7326/0003-4819-147-4-200708210-00179 pmid:17638714 . OpenUrl CrossRef PubMed Web of Science
- Shojania K, Sampson M, Ansari M, et al. Updating systematic reviews; AHRQ technical reviews; report no 07-0087. Agency for Healthcare Research and Quality, 2007 .
- Pattanittum P, Laopaiboon M, Moher D, Lumbiganon P, Ngamjarus C. A comparison of statistical methods for identifying out-of-date systematic reviews. PLoS One 2012 ; 7 : e48894 . doi:10.1371/journal.pone.0048894 pmid:23185281 . OpenUrl CrossRef PubMed
- Shekelle PG, Motala A, Johnsen B, Newberry SJ. Assessment of a method to detect signals for updating systematic reviews. Syst Rev 2014 ; 3 : 13 . doi:10.1186/2046-4053-3-13 pmid:24529068 . OpenUrl CrossRef PubMed
- Shekelle PG, Newberry SJ, Wu H, et al. Identifying signals for updating systematic reviews: a comparison of two methods; report no 11-EHC042-EF. Agency for Healthcare Research and Quality, 2011 .
- ↵ Shekelle P, Newberry S, Maglione M, et al. Assessment of the need to update comparative effectiveness reviews: report of an initial rapid program assessment (2005-2009). Agency for Healthcare Research and Quality, 2009 .
- Tovey D, Marshall R, Bazian, Hopewell S, Rader T. Fit for purpose: centralised updating support for high-priority Cochrane Reviews; National Institute for Health Research Cochrane-National Health Service Engagement Award Scheme, July 2011. https://editorial-unit.cochrane.org/sites/editorial-unit.cochrane.org/files/uploads/10_4000_01%20Fit%20for%20purpose%20-%20centralised%20updating%20support%20for%20high%20priority%20Cochrane%20Reviews%20FINAL%20REPORT.pdf .
- Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 1999 ; 18 : 341 - 64 . doi:10.1016/S0167-6296(98)00039-3 pmid:10537899 . OpenUrl CrossRef PubMed Web of Science
- Wilson EC. A practical guide to value of information analysis. Pharmacoeconomics 2015 ; 33 : 105 - 21 . doi:10.1007/s40273-014-0219-x pmid:25336432 . OpenUrl CrossRef PubMed
- ↵ Althabe F, Belizán JM, McClure EM, et al. A population-based, multifaceted strategy to implement antenatal corticosteroid treatment versus standard care for the reduction of neonatal mortality due to preterm birth in low-income and middle-income countries: the ACT cluster-randomised trial. Lancet 2015 ; 385 : 629 - 39 . doi:10.1016/S0140-6736(14)61651-2 pmid:25458726 . OpenUrl CrossRef PubMed
- ↵ Taylor-Robinson D, Maayan N, Soares-Weiser K, et al. Deworming drugs for soil-transmitted intestinal worms in children: effects on nutritional indicators, haemoglobin and school performance. Cochrane Database Syst Rev 2012 ;( 11 ): CD000371 .
- ↵ van Dalen EC, van der Pal HJ, Kremer LC. Different dosage schedules for reducing cardiotoxicity in people with cancer receiving anthracycline chemotherapy. Cochrane Database Syst Rev 2016 ; 3 : CD005008 . pmid:26938118 . OpenUrl PubMed
- ↵ Wilson E. on behalf of the Cochrane Priority Setting and Campbell & Cochrane Economics Methods Groups. Which study when? Proof of concept of a proposed automated tool to help decision which reviews to update first. Cochrane Database Syst Rev 2014 ; suppl 2 : 29 - 31 .
- Rosenbaum SE, Glenton C, Nylund HK, Oxman AD. User testing and stakeholder feedback contributed to the development of understandable and useful Summary of Findings tables for Cochrane reviews. J Clin Epidemiol 2010 ; 63 : 607 - 19 . doi:10.1016/j.jclinepi.2009.12.013 pmid:20434023 . OpenUrl CrossRef PubMed
- Rosenbaum SE, Glenton C, Oxman AD. Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol 2010 ; 63 : 620 - 6 . doi:10.1016/j.jclinepi.2009.12.014 pmid:20434024 . OpenUrl CrossRef PubMed Web of Science
- Vandvik PO, Santesso N, Akl EA, et al. Formatting modifications in GRADE evidence profiles improved guideline panelists comprehension and accessibility to information. A randomized trial. J Clin Epidemiol 2012 ; 65 : 748 - 55 . doi:10.1016/j.jclinepi.2011.11.013 pmid:22564503 . OpenUrl CrossRef PubMed
- ↵ International Committee of Medical Journal Editors (ICMJE). Defining the role of authors and contributors. 2016. www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html .
- ↵ Stovold E, Beecher D, Foxlee R, Noel-Storr A. Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram. Syst Rev 2014 ; 3 : 54 . doi:10.1186/2046-4053-3-54 pmid:24886533 . OpenUrl CrossRef PubMed
- ↵ Newberry SJ, Shekelle PG, Vaiana M, et al. Reporting the findings of updated systematic reviews of comparative effectiveness: how do users want to view new information? report no 13-EHC093-EF. Agency for Healthcare Research and Quality, 2013 .
- Marshall IJ, Kuiper J, Wallace BC. Automating risk of bias assessment for clinical trials BCB’14. Proceedings of the 5th ACM conference on Bioinformatics, computational biology, and health informatics. 2014:88-95. http://thirdworld.nl/automating-risk-of-bias-assessment-for-clinical-trials .
- ↵ Elliott JH, Turner T, Clavisi O, et al. Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS Med 2014 ; 11 : e1001603 . doi:10.1371/journal.pmed.1001603 pmid:24558353 . OpenUrl CrossRef PubMed
- Elliott J, Sim I, Thomas J, et al. #CochraneTech: technology and the future of systematic reviews. Cochrane Database Syst Rev 2014 ;( 9 ): ED000091 . pmid:25288182 .
- Cochrane. Project transform: the Cochrane Collaboration. 2016. http://community.cochrane.org/tools/project-coordination-and-support/transform .
- ↵ Paynter R, Bañez L, Berlinerm E, et al. EPC methods: an exploration of the use of text-mining software in systematic reviews. Research white paper. AHRQ publication 16-EHC023-EF. Agency for Healthcare Research and Quality, April 2016. https://www.effectivehealthcare.ahrq.gov/search-for-guides-reviews-and-reports/?pageaction=displayproduct&productID=2214 .
- ↵ Soares-Weiser K, Marshall R, Bergman H, et al. Updating Cochrane Reviews: results of the first pilot of a focused update. Cochrane Database Syst Rev 2014 ; suppl 1 : 31 - 3 .
- My Accounts
Conduct a literature review
What is a literature review.
A literature review is a summary of the published work in a field of study. This can be a section of a larger paper or article, or can be the focus of an entire paper. Literature reviews show that you have examined the breadth of knowledge and can justify your thesis or research questions. They are also valuable tools for other researchers who need to find a summary of that field of knowledge.
Unlike an annotated bibliography, which is a list of sources with short descriptions, a literature review synthesizes sources into a summary that has a thesis or statement of purpose—stated or implied—at its core.
How do I write a literature review?
Step 1: define your research scope.
- What is the specific research question that your literature review helps to define?
- Are there a maximum or minimum number of sources that your review should include?
Ask us if you have questions about refining your topic, search methods, writing tips, or citation management.
Step 2: Identify the literature
Start by searching broadly. Literature for your review will typically be acquired through scholarly books, journal articles, and/or dissertations. Develop an understanding of what is out there, what terms are accurate and helpful, etc., and keep track of all of it with citation management tools . If you need help figuring out key terms and where to search, ask us .
Use citation searching to track how scholars interact with, and build upon, previous research:
- Mine the references cited section of each relevant source for additional key sources
- Use Google Scholar or Scopus to find other sources that have cited a particular work
Step 3: Critically analyze the literature
Key to your literature review is a critical analysis of the literature collected around your topic. The analysis will explore relationships, major themes, and any critical gaps in the research expressed in the work. Read and summarize each source with an eye toward analyzing authority, currency, coverage, methodology, and relationship to other works. The University of Toronto's Writing Center provides a comprehensive list of questions you can use to analyze your sources.
Step 4: Categorize your resources
Divide the available resources that pertain to your research into categories reflecting their roles in addressing your research question. Possible ways to categorize resources include organization by:
- methodology
- theoretical/philosophical approach
Regardless of the division, each category should be accompanied by thorough discussions and explanations of strengths and weaknesses, value to the overall survey, and comparisons with similar sources. You may have enough resources when:
- You've used multiple databases and other resources (web portals, repositories, etc.) to get a variety of perspectives on the research topic.
- The same citations are showing up in a variety of databases.
Additional resources
Undergraduate student resources.
- Literature Review Handout (University of North Carolina at Chapel Hill)
- Learn how to write a review of literature (University of Wisconsin-Madison)
Graduate student and faculty resources
- Information Research Strategies (University of Arizona)
- Literature Reviews: An Overview for Graduate Students (NC State University)
- Oliver, P. (2012). Succeeding with Your Literature Review: A Handbook for Students [ebook]
- Machi, L. A. & McEvoy, B. T. (2016). The Literature Review: Six Steps to Success
Graustein, J. S. (2012). How to Write an Exceptional Thesis or Dissertation: A Step-by-Step Guide from Proposal to Successful Defense [ebook]
Thomas, R. M. & Brubaker, D. L. (2008). Theses and Dissertations: A Guide to Planning, Research, and Writing

IMAGES
VIDEO
COMMENTS
Although a large amount of data in the current literature on the effects of weight loss prior to bariatric surgery are inconsistent for many outcome
Universitat Rovira i Virgili, Laboratory of Toxicology and Environmental Health, School of Medicine, 43201, Reus, Catalonia, Spain. Electronic
also identified some specific problems with the body of literature that they reviewed: the small number of data-driven, peer-reviewed research
Mass customization: literature review and research directions. International Journal of Production Economics, 72 (1), 1–13), and identify research gaps to be
Aim. To provide an update of our understanding of labour pain based on modern pain science. The review aims to help explain why women can experience labour
This paper updates the literature review on homophobia revisiting society's assumptions about homosexuals. Changes are discussed in the context of
Institute of Medicine. 2004. Gulf War and Health: Updated Literature Review of Sarin. Washington, DC: The National Academies Press. https://doi.org/10.17226/
The main focus of an academic research paper is to develop a new argument, and a research paper is likely to contain a literature review as one of its parts
Citation in scientific literature including clinical practice guidelines. Currency and need for update. New research is available. Review
This can be a section of a larger paper or article, or can be the focus of an entire paper. Literature reviews show that you have examined the breadth of