Resident Track

Miscellaneous

Critical Review of Manuscripts

Moderator(s)

• 

  Susan Galandiuk, MD (she/her/hers)

  Division Director
  University of Louisville
  University of Louisville
  Louisville, KY, US

  All of the relevant financial relationships listed below have been mitigated.
  Abbvie: Clinical Trial Investigator (Ongoing), Grant/Research Support (Ongoing); American Society of Colon & Rectal Surgeons: Independent Contractor (Ongoing); Takeda Pharmaceuticals: Clinical Trial Investigator (Ongoing), Grant/Research Support (Ongoing)

There is no fee, but registration is required.
CME Credit: 1.5
Self-Assessment Credit: 1.5
Contact Hours: 1.5

The peer review process is central to the continued advancement of scientific knowledge. A critical review of scientific manuscripts helps to ensure that the most reliable evidence is disseminated within the surgical community. The volume of new material, the complexity of trial design, and the limitations of peer review before publication are challenges to this process, for which post-publication peer review by readers of the scientific literature is necessary. While the practicing surgeon relies on the editorial process to largely separate the “wheat from the chaff”, (s)he also requires solid critical appraisal skills to ensure that evidence from published studies is trustworthy as well as being wisely applied to the proper patient care scenarios. While the editor asks, “Does this manuscript add significant knowledge to the literature?” the reader asks, “Does this manuscript add new information that warrants a change to my practice?” There are three generic types of surgical trials: exploratory trials to assess utility, explanatory trials to assess efficacy, and pragmatic trials to assess effectiveness. Methodologies include observational studies (cohort or case-control), administrative database/ large dataset studies, randomized controlled trials (RCT), structured reviews, and meta-analyses, and again for the second year, new to the discussion in the symposium - qualitative research studies. Each methodology has a role defined by its strengths and limitations. Traditionally, observational studies are viewed as presenting evidence of the least evidentiary strength. Yet, there are many instances where an observational study is the best and perhaps the only investigatory approach that is practical, especially if a disease entity or outcome is rare. Observational studies may provide relatively strong evidence when there is a large treatment effect, or when confounding factors would bias the results in opposition to the observed effect. They may also be subject to significant bias, and thus their methodology and results must be carefully examined. Large non-randomized observational studies based on administrative databases/large datasets have become very popular due to the ease of data abstraction. They have the advantage of reporting on large populations and identifying trends in treatment, outcomes, and rare complications. However, data collection may be incomplete or inconsistent and the data may lack the granularity to conclude to answer key questions. The RCT design is least likely to be affected by bias and is the only methodology that can identify cause and effect. Sound knowledge of study design is needed to evaluate the many variations in structure and primary outcomes (i.e. inferiority, non-inferiority). While no study is completely void of bias it is important to determine whether bias is responsible for a significant portion of the observed effect as there is wide variation in the quality of RCTs. The sheer volume of primary literature has increased the importance of secondary analysis or literature summaries. A systematic review of the literature may be combined with a meta-analysis to give the best estimate of the effect. Although pooling the results of multiple trials increases precision by narrowing confidence intervals, a secondary analysis of poorly designed RCTs may result in a misleading conclusion. Thus, the reviewer must be familiar with the common limitations of secondary analysis and the range of conclusions that can be drawn. This symposium is aimed at three groups: present and prospective reviewers for Diseases of the Colon & Rectum (DC&R), practicing surgeons who want to increase their critical appraisal skills, and authors who wish to improve their writing skills. It is designed to be hands-on. Through an interactive symposium, we will explore the most common study methodologies, and identify appropriate questions for each method, while identifying the advantages, the disadvantages, and the common mistakes in study conduct, reporting, and conclusions. We will also explore essential resources for additional learning in this area. Previously published representative papers from the five common methodologies will be identified in advance from DC&R. Three weeks prior to the symposium, the manuscripts of these five papers will be distributed to each symposium participant who will have the chance to read and critique them as if they were primary reviewers. At the symposium, each participant will be assigned to a small group led by an editorial board member from DC&R. Following an introduction of the manuscript by the faculty, the editorial board members will facilitate a working discussion and critique of each manuscript within the small groups. Board members will have access to the original editorial comments and the changes that were requested by the editors prior to publication to enhance the discussion as well as to questions for discussion provided by the speakers. The benefit to attendees will be maximized with the appropriate preparation time prior to the symposium.

Presentations:

• 8:30 AM – 8:35 AM PT

  Introduction
  

  Faculty: Susan Galandiuk, MD (she/her/hers) – University of Louisville
• 8:35 AM – 8:44 AM PT

  Observational Studies
  

  Faculty: Daniel L. Feingold, MD, FASCRS, FACS – Rutgers Robert Wood Johnson Medical School
• 8:44 AM – 8:52 AM PT

  Table Group Discussions -Observational Studies
• 8:52 AM – 9:01 AM PT

  Administrative Database Studies
  

  Faculty: Julia R. Berian, MD, MS (she/her/hers) – University of Wisconsin
• 9:01 AM – 9:09 AM PT

  Table Group Discussion - Administrative Database Studies
• 9:09 AM – 9:18 AM PT

  Qualitative Research
  

  Faculty: Srinivas Joga Ivatury, MD MHA – University of Texas at Austin
• 9:18 AM – 9:26 AM PT

  Table Group Discussions - Qualitative Research
• 9:26 AM – 9:35 AM PT

  Randomized Controlled Trials
  

  Faculty: Marylise Boutros, MD (she/her/hers) – Cleveland Clinic Florida
• 9:35 AM – 9:43 AM PT

  Table Group Discussions - Randomized Controlled Trials
• 9:43 AM – 9:52 AM PT

  Systematic Reviews & Meta-analyses
  

  Faculty: Carrie Peterson, MD, MS (she/her/hers) – Medical College of Wisconsin
• 9:52 AM – 10:00 AM PT

  Table Group Discussion - Systematic Reviews & Meta-analyses