Chapter 4: Formulating PICO Questions

About

  • This ACIP GRADE handbook provides guidance to the ACIP workgroups on how to use the GRADE approach for assessing the certainty of evidence.

Summary

Guidelines help answer questions about clinical, communication, organizational or policy interventions, in the hope of improving health care or health policy.1 It is therefore helpful to structure a guideline in terms of answerable questions with relevant outcomes. Research questions that are too broad may necessitate extra resources to conduct the review, leading to heterogenous results that may be difficult to interpret. However, a broad question may produce a holistic summary based on a larger body of evidence and more generalizable findings. In contrast, narrow questions may require less resources but could lead to a smaller body of evidence with less generalizable findings. Depending on the scope of the review, authors should decide if it is more beneficial to lump things together resulting in a broader PICO question or if it is more useful to split comparisons and create narrow PICO questions.2 To define the scope of the review, research priorities should be identified, and stakeholders should be engaged. The scope of the review may focus on a setting in which a vaccine is introduced where there was no vaccine previously or in a setting where a new vaccine is being compared to an existing vaccine. The scope may also be focused on new or updated recommendations for existing vaccines based on a changing epidemiology and/or the populations affected. For more information about developing a PICO question for a systematic review, refer to https://training.cochrane.org/handbook/current/chapter-02.2

The GRADE approach can be used to answer various questions that lead to actionable recommendations.3 Research questions can be categorized as either background or foreground questions.1 Background questions provide context and frame the need for the guideline, while foreground questions directly inform recommendations. Therefore, background questions can provide information on the prevalence or burden of a problem that help formulate foreground questions. Foreground questions provide insight on harms and benefits of the intervention of interest while also considering factors like acceptability and feasibility. Good questions target topics with controversy or doubt surrounding the answer, help pave the way for future research and positively impact patient care, costs and quality of life.

Research questions act as the starting point for formulating recommendations; they help inform inclusion and exclusion criteria for included studies, shape search strategies, inform the type of data to be extracted and guide the wording for recommendations.3 Research questions may also inform the type of data synthesis used in a review. In order to create strong research questions that shape an evidence review, questions should be developed and presented using the PICO (population/intervention/comparator/outcome) framework.1 The population component of the question describes the target population for the intervention. The intervention includes the treatment, test, policy or exposure being evaluated in the review. The comparator specifies the alternatives to the intervention being recommended in the guideline. Typically, a placebo is not used as a comparison in a recommendation (even though it may serve as a comparison in the systematic review of the literature), as "placebo" would not be a sensible option to recommend. Instead, the comparisons could look at existing alternatives, standard practice and no intervention (e.g., no vaccine in the situation when no vaccine has been previously available). Outcomes consider the potential benefits and harms of the intervention and should be patient centered. Table 1 provides two examples of well-formulated PICO questions.

Table 1. Examples of PICO Questions

Policy question Example 1: Should pre-exposure vaccination with the rVSVΔG-ZEBOV-GP vaccine be recommended for adults 18 years of age or older in the U.S. population who are at potential occupational risk of exposure to Ebola virus (species Zaire ebolavirus) for prevention of Ebola virus infection (ACIP Grading for Ebola Vaccine | CDC, 2021)? Example 2: Should persons vaccinated with a MenB primary series who remain at increased risk for serogroup B meningococcal disease receive a MenB booster dose (ACIP Grading for Serogroup B Meningococcal (MenB) Vaccines for Persons at Increased Risk for Serogroup B Meningococcal Disease | CDC, 2020)?
Population Adults aged 18 years or older in the United States who are at potential risk of exposure to EBOV because they are:
  • Persons who are responding to an outbreak of EVD
  • Persons who work as healthcare personnel (HCP) at federally designated Ebola Treatment Centers in the United States
  • Persons who work as laboratorians or other staff at biosafety-level 4 facilities in the United States
Persons aged ≥10 years who have previously completed a MenB-FHbp or MenB-4C primary series who remain at increased risk for serogroup B meningococcal disease because of:
  • Persistent complement component deficiencies, complement inhibitor use, functional or anatomic asplenia, or routine exposure to isolates of Neisseria meningitidis as a microbiologist, or
  • An outbreak of serogroup B meningococcal disease
Intervention Pre-exposure intramuscular immunization with a single licensed dose of the rVSVΔG-ZEBOV-GP vaccine MenB-FHbp or MenB-4C booster dose
Comparison No vaccine No MenB-FHbp or MenB-4C booster dose
Outcomes
  • Development of Ebola-related symptomatic illness
  • Ebola-related mortality
  • Vaccine-related joint pain or swelling (arthritis or arthralgia)
  • Vaccine-related adverse pregnancy outcomes for women inadvertently vaccinated while pregnant and women who become pregnant within in 2 months of vaccination
  • Transmissibility of rVSVΔG-ZEBOV-GP to humans or animals: Surrogate assessed with viral dissemination/shedding of the rVSVΔG-ZEBOV-GP vaccine virus
  • Serious adverse events related to the vaccination
  • Incidence and severity of oral or skin lesions
  • Interaction or cross-reactivity with monoclonal antibody-based therapeutics or other VSV-backboned vaccines
  • Serogroup B meningococcal disease
  • Short-term immunogenicity of booster dose
  • Persistence of immune response to booster dose
  • Immune interference due to co-administration of booster dose with other vaccines
  • Serious adverse events from booster dose

When developing PICO questions for guidelines, the setting in which the recommendations will be applied is often taken into consideration in addition to elements specified in the PICO approach. Moreover, the identification of subgroups within the population part of the PICO question allows for guideline panels to create recommendations targeting specific subpopulations. In the case of multiple comparators within a PICO question, guideline authors may need to clarify if the intervention is recommended over all the comparators equally or if there is a hierarchy. Additionally, PICO questions for guidelines may have a more comprehensive list of outcomes compared to a systematic review since they need to consider harms and how the implementation of an intervention may impact different populations. When listing outcomes for a PICO question informing a guideline document, the importance of the outcomes should be rated before the evidence review begins.

  1. World Health O. WHO handbook for guideline development. World Health Organization; 2014:167.
  2. Thomas J, Kneale D, McKenzie J, Brennan S, Bhaumik S. Chapter 2: Determining the scope of the review and the questions it will address. In: Higgins J, Thomas J, Chandler J, et al, eds. Cochrane Handbook for Systematic Reviews of Interventions version 63 (updated February 2022). Cochrane; 2022. www.training.cochrane.org/handbook.
  3. Guyatt GH, Oxman AD, Kunz R, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011/04// 2011;64(4):395-400. doi:10.1016/j.jclinepi.2010.09.012