Skip to main content

Main menu

  • Home
  • Current issue
  • Early View
  • Archive
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • COVID-19 submission information
    • Institutional open access agreements
    • Peer reviewer login
  • Alerts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • Early View
  • Archive
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • COVID-19 submission information
    • Institutional open access agreements
    • Peer reviewer login
  • Alerts
  • Subscriptions

European Respiratory Society clinical practice guidelines: methodological guidance

Blin Nagavci, Thomy Tonia, Nicolas Roche, Celine Genton, Valerie Vaccaro, Marc Humbert, Christopher Brightling, Carlos Robalo Cordeiro, Andrew Bush
ERJ Open Research 2022 8: 00655-2021; DOI: 10.1183/23120541.00655-2021
Blin Nagavci
1European Respiratory Society, Lausanne, Switzerland
2Institute for Evidence in Medicine, Medical Center – University of Freiburg, Freiburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: blin.nagavci@ersnet.org
Thomy Tonia
1European Respiratory Society, Lausanne, Switzerland
3Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicolas Roche
1European Respiratory Society, Lausanne, Switzerland
4Dept of Pulmonology, Cochin Hospital, Assistance Publique – Hôpitaux de Paris (AP-HP) Centre, Université de Paris, Paris, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Celine Genton
1European Respiratory Society, Lausanne, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Valerie Vaccaro
1European Respiratory Society, Lausanne, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marc Humbert
1European Respiratory Society, Lausanne, Switzerland
5Université Paris–Saclay, INSERM, AP-HP, Service de Pneumologie et Soins Intensifs Respiratoires, Hôpital Bicêtre, Le Kremlin Bicêtre, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Marc Humbert
Christopher Brightling
1European Respiratory Society, Lausanne, Switzerland
6Dept of Respiratory Sciences, University of Leicester, Leicester, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carlos Robalo Cordeiro
1European Respiratory Society, Lausanne, Switzerland
7Dept of Pneumology, Coimbra University Hospital, Coimbra, Portugal
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew Bush
1European Respiratory Society, Lausanne, Switzerland
8Dept of Paediatric Respiratory Medicine, Imperial Centre for Paediatrics and Child Health, National Heart and Lung Institute, Imperial College and Royal Brompton Hospital, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • PDF
Loading

Abstract

ERS has published official methodological guidance for clinical practice guidelines. ERS recommends this to ensure that state-of-the-art guidelines are developed. https://bit.ly/3xP5SSr

As one of the leading respiratory organisations, the European Respiratory Society (ERS) brings together physicians, healthcare professionals, scientists and other experts working in respiratory medicine. One of their roles is to provide guidance on clinical practice by developing high-quality clinical practice guidelines (CPGs). This is achieved by establishing specific task forces through an annual call for applications (except for short documents, for which applications can be submitted at any time [1]), and a rigorous selection and peer review process. Once approved, task force members, supported by ERS methodologists, work together for 2 years to develop CPGs using rigorous methodology, which, on satisfactory completion, are then adopted by ERS as official documents.

CPGs are documents that contain recommendations for clinical practice, aiming to provide physicians, healthcare practitioners and patients with information and strategies for making decisions on important areas for specific clinical conditions [2]. Having in mind the indispensable role that they play in clinical practice and their potential impact on patients’ health, it is of outmost importance that they contain evidence-based recommendations and are developed using state-of-the art methodology. Furthermore, task forces involved in guideline development should encompass all required areas of expertise by including clinical experts, allied healthcare professionals, early career investigators and patient representatives, and they should mirror the diversity of the society by being international, and age- and gender-balanced.

To facilitate this, ERS has developed the “ERS Handbook for Clinical Practice Guidelines”, which is the society's methodological guidance for developing evidence-based CPGs. It specifies in detail the roles and duties of all task force members, as well as all the steps that need to be followed during the development of the guideline, including management of any potential conflicts of interest. In this editorial, we give an overview of this guidance, highlighting the main methodological steps described therein.

Methodology of ERS CPGs

ERS CPGs are based on systematic literature reviews, assessment of the quality of the evidence using Grading of Recommendations, Assessment, Development and Evaluations (GRADE) and a transparent process of decision making using the Evidence to Decision (EtD) frameworks. The methodology for developing ERS CPGs is divided into 12 methodological steps, which should be followed carefully by the task forces.

Defining the research questions

Defining the research questions represents one of the most important steps of CPG development. The questions should be clinically important and phrased clearly, using the Population, Intervention, Comparator and Outcomes (PICO) format, as required by GRADE [3]. PICO questions can be supplemented by narrative questions, which are not answered using the GRADE approach, but are based on systematic literature searches and EtDs, and can lead to recommendations [4].

Rating the importance of patient-relevant outcomes

As part of the GRADE process, panellists (task force members with voting rights) should decide on the importance of patient-relevant outcomes for each PICO question. There are three levels of importance: “critical”, “important but not critical” and “of limited importance” [3], and only outcomes rated as critical or important will be considered in the CPG for clinical decision making.

Defining the inclusion criteria

For each research question, inclusion and exclusion criteria for the studies to be included should be defined in detail. This will help the information specialist design the search strategies, determine which studies to include in the review, and keep the process transparent and consistent for any possible replication of results or CPG update in the future.

Literature search

The literature search is a systematic and organised search for published and unpublished studies in electronic databases, which should be well documented and updated yearly. ERS requires, as a minimum, that MEDLINE should be systematically searched, with additional databases to be decided depending on the topic.

Screening and selection of studies

Screening and selection is a two-phase process (title/abstract and full-text screening) for selection of relevant studies [5] with clear documentation of the procedure using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram for increased transparency and consistency [6]. This can be performed with online screening tools. The two main bodies of evidence (BoE) to be considered in the CPG are randomised clinical trials (RCTs) and nonrandomised studies of intervention [5]. Depending on the topic and type of questions, one would be considered as the main BoE for making recommendations (preferably RCTs) while the other will have a supplementary role. Real-life evidence could also be considered as supplementary evidence [7].

Extracting the data from the primary studies

Data should be extracted in systematic way, using piloted data sheets, in order to avoid loss of information, and make sure that the studies are comparable and that results are presented consistently throughout the document.

Risk of bias assessment

An assessment of the risk of bias should be performed for included studies belonging to the main BoE. For different types of studies, different tools can be used to assess the risk of bias; for example, the Cochrane Risk-of-Bias Tool for Randomized Trials or its revised version [8, 9], the Newcastle–Ottawa Scale [10], ROBINS-I [11], QUADAS-2 [12], or the QUIPS tool [13].

Data analysis/synthesis

Data synthesis is the process of analysing the data from all included studies in order to reach valid conclusions and make clinical practice recommendations. This can be performed using the quantitative approach (with meta-analyses, if appropriate) or with the narrative/descriptive approach (without meta-analyses). When interpreting results from primary studies or from conducted meta-analyses, task forces should take into account not only the point estimates or p-values but all aspects of the results, including effect measures and their confidence intervals, statistical significance, clinical significance, and the quality of evidence.

Rating the quality of evidence

ERS mandates using the GRADE approach for rating the evidence in order to determine the extent to which our confidence in an estimate of the effect is adequate to support a particular recommendation [14]. The quality of evidence for the main BoE is rated for each outcome, followed by rating of the overall quality of evidence across all outcomes (e.g. ranked as very low, low, moderate or high). This should be stated for each recommendation made.

Making recommendations using GRADE EtD frameworks

The purpose of EtD is to structure the discussion and the decision making process in order for task forces to consider important aspects and contexts of the interventions, and to provide a summary of the evidence and the rationale of recommendations to the readers [15, 16]. One EtD should be compiled for each research question (PICO or narrative). Task forces can make recommendations for or against an intervention, or in some cases, a recommendation will not be possible. The decision for or against a certain intervention should take into consideration the balance between desirable and undesirable outcomes, quality of evidence, values, balance of effects, resources required, impact on health equity, acceptability, and feasibility. Recommendations must be actionable, stated concisely using an active voice, and should contain the population, the intervention, the recommendation strength and the quality of evidence [14].

Writing the manuscript

The main document of an ERS CPG should not contain more than 8000 words (excluding tables, figures and references) but supplementary material can be added without any word limit [17]. The manuscript should contain a brief introduction focusing on positioning the questions addressed in the context of clinical care, and a methods section containing all relevant information such as the scope and purpose, panel information, conflict of interest management, literature searches, main inclusion criteria, data analyses, etc. The results should be presented for each question separately using a pre-defined format, which can be found in the handbook. The discussion should be kept short, and used for presenting a summary of results, similarities and differences with other CPGs, and strengths and limitations of the CPG.

Manuscript finalisation and submission

After the manuscript has been drafted, it needs to be reviewed in detail by the appointed ERS in-house methodologist (from a methodological point of view) and by all co-authors (from a clinical point of view). After finalisation, the manuscript should be sent to ERS for an overall preliminary check. Only then it can be submitted for publication to the European Respiratory Journal (ERJ), which is the first journal to be considered. The manuscript will undergo an external peer-review process and the (possible) publication is an editorial decision of the ERJ. Once approved for publication, the ERS staff submits the final version to the ERS Executive Committee for endorsement, which is required in order for the CPG to be published as an official ERS document. The manuscript and all deliberations of the task force must remain confidential until acceptance for publication.

Conclusions

ERS Handbook for Clinical Practice Guidelines is the society's official methodological guidance for developing CPGs. It integrates ERS values for diversity in task force composition, and determines roles and duties of each task force member. It empowers patients by making sure their voice is actively heard in every step of the process. ERS recommends this handbook to all its members when drawing up proposals for new ERS CPGs and throughout the entire CPG development process, to ensure that state-of-the-art documents are developed.

ERS Handbook for Clinical Practice Guidelines is freely available at www.ersnet.org/science-and-research/development-programme/ers-clinical-practice-guidelines-statements-and-technical-standards/.

Footnotes

  • Provenance: Submitted article, peer reviewed.

  • Conflict of interest: B. Nagavci is a methodologist for the European Respiratory Society.

  • Conflict of interest: T. Tonia is a methodologist for the European Respiratory Society.

  • Conflict of interest: N. Roche has nothing to disclose.

  • Conflict of interest: C. Genton is an employee of the European Respiratory Society.

  • Conflict of interest: V. Vaccaro is an employee of the European Respiratory Society.

  • Conflict of interest: M. Humbert has nothing to disclose.

  • Conflict of interest: C. Brightling reports receiving grants or contracts from GSK, AZ, BI, Novartis, Sanofi, Chiesi, Roche, Genentech, Merck, Mologic and 4DPharma, outside the submitted work; and consulting fees from GSK, AZ, BI, Novartis, Sanofi, Chiesi, Roche, Genentech, Merck, Mologic and 4DPharma paid to his institution, outside the submitted work. He is the Science Council Chair of the European Respiratory Society.

  • Conflict of interest: C. Robalo Cordeiro reports receiving consulting fees from AstraZeneca, Boehringer Ingelheim, GSK and Roche, outside the submitted work; payment or honoraria for lectures, presentations, speaker bureaus, manuscript writing or educational events from AstraZeneca, Boehringer Ingelheim and GSK, outside the submitted work; and participation on data safety monitoring or advisory boards for AstraZeneca, Boehringer Ingelheim, GSK and Roche, outside the submitted work.

  • Conflict of interest: A. Bush has nothing to disclose.

  • Received November 22, 2021.
  • Accepted November 23, 2021.
  • Copyright ©The authors 2022
http://creativecommons.org/licenses/by-nc/4.0/

This version is distributed under the terms of the Creative Commons Attribution Non-Commercial Licence 4.0. For commercial reproduction rights and permissions contact permissions{at}ersnet.org

References

  1. ↵
    1. Roche N,
    2. Tonia T,
    3. Miravitlles M, et al.
    Expanding the spectrum of European Respiratory Society official scientific documents: short documents complement clinical practice guidelines, statements and technical standards. Eur Respir J 2020; 55: 2001030. doi:10.1183/13993003.01030-2020
    OpenUrlAbstract/FREE Full Text
  2. ↵
    1. Institute of Medicine Committee to Advise the Public Health Service on Clinical Practice Guidelines
    . Clinical Practice Guidelines: Directions for a New Program. Washington, National Academies Press (US), 1990.
  3. ↵
    1. Guyatt GH,
    2. Oxman AD,
    3. Kunz R, et al.
    GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011; 64: 395–400. doi:10.1016/j.jclinepi.2010.09.012
    OpenUrlCrossRefPubMed
  4. ↵
    1. Miravitlles M,
    2. Tonia T,
    3. Rigau D, et al.
    New era for European Respiratory Society clinical practice guidelines: joining efficiency and high methodological standards. Eur Respir J 2018; 51: 1800221. doi:10.1183/13993003.00221-2018
    OpenUrlAbstract/FREE Full Text
  5. ↵
    1. Higgins JP,
    2. Thomas J,
    3. Chandler J, et al.
    Cochrane Handbook for Systematic Reviews of Interventions version 6.2. www.training.cochrane.org/handbook. Date last updated: February 2021. Date last accessed: October 2021.
  6. ↵
    1. Moher D,
    2. Liberati A,
    3. Tetzlaff J, et al.
    Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009; 6: e1000097. doi:10.1371/journal.pmed.1000097
    OpenUrlCrossRefPubMed
  7. ↵
    1. Fally M,
    2. Nagavci B,
    3. Tonia T, et al.
    Real-life evidence in ERS clinical practice guidelines: from foes to friends. Eur Respir J 2021; 58: 2101718. doi:10.1183/13993003.01718-2021
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. Higgins JP,
    2. Altman DG,
    3. Gøtzsche PC, et al.
    The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011; 343: d5928. doi:10.1136/bmj.d5928
    OpenUrlFREE Full Text
  9. ↵
    1. Sterne JAC,
    2. Savović J,
    3. Page MJ, et al.
    RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019; 366: l4898. doi:10.1136/bmj.l4898
    OpenUrlFREE Full Text
  10. ↵
    1. Wells GA,
    2. Shea B,
    3. O'Connell D, et al.
    The Newcastle–Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Date last accessed: October 2021.
  11. ↵
    1. Sterne JA,
    2. Hernán MA,
    3. Reeves BC, et al.
    ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016; 355: i4919. doi:10.1136/bmj.i4919
    OpenUrlFREE Full Text
  12. ↵
    1. Whiting PF,
    2. Rutjes AW,
    3. Westwood ME, et al.
    QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011; 155: 529–536. doi:10.7326/0003-4819-155-8-201110180-00009
    OpenUrlCrossRefPubMed
  13. ↵
    1. Hayden JA,
    2. van der Windt DA,
    3. Cartwright JL, et al.
    Assessing bias in studies of prognostic factors. Ann Intern Med 2013; 158: 280–286. doi:10.7326/0003-4819-158-4-201302190-00009
    OpenUrlCrossRefPubMed
  14. ↵
    1. Schünemann H,
    2. Brożek J,
    3. Guyatt G, et al.
    GRADE handbook for grading quality of evidence and strength of recommendations. www.guidelinedevelopment.org/handbook. Date last updated: October 2013. Date last accessed: July 2021.
  15. ↵
    1. Alonso-Coello P,
    2. Oxman AD,
    3. Moberg J, et al.
    GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 2: Clinical practice guidelines. BMJ 2016; 353: i2089. doi:10.1136/bmj.i2089
    OpenUrlFREE Full Text
  16. ↵
    1. Alonso-Coello P,
    2. Schünemann HJ,
    3. Moberg J, et al.
    GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction. BMJ 2016; 353: i2016. doi:10.1136/bmj.i2016
    OpenUrlFREE Full Text
  17. ↵
    1. European Respiratory Journal
    . Instructions for authors. https://erj.ersjournals.com/authors/instructions. Date last updated: April 2021. Date last accessed: October 2021.
PreviousNext
Back to top
Vol 8 Issue 1 Table of Contents
ERJ Open Research: 8 (1)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
European Respiratory Society clinical practice guidelines: methodological guidance
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
European Respiratory Society clinical practice guidelines: methodological guidance
Blin Nagavci, Thomy Tonia, Nicolas Roche, Celine Genton, Valerie Vaccaro, Marc Humbert, Christopher Brightling, Carlos Robalo Cordeiro, Andrew Bush
ERJ Open Research Jan 2022, 8 (1) 00655-2021; DOI: 10.1183/23120541.00655-2021

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
European Respiratory Society clinical practice guidelines: methodological guidance
Blin Nagavci, Thomy Tonia, Nicolas Roche, Celine Genton, Valerie Vaccaro, Marc Humbert, Christopher Brightling, Carlos Robalo Cordeiro, Andrew Bush
ERJ Open Research Jan 2022, 8 (1) 00655-2021; DOI: 10.1183/23120541.00655-2021
Reddit logo Technorati logo Twitter logo Connotea logo Facebook logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Methodology of ERS CPGs
    • Conclusions
    • Footnotes
    • References
  • Info & Metrics
  • PDF
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

  • Pneumonia in exacerbations of COPD
  • There can be smoke without fire
Show more Editorial

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About ERJ Open Research

  • Editorial board
  • Journal information
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Online ISSN: 2312-0541

Copyright © 2023 by the European Respiratory Society