Skip to content
COVID-19 / SPECIALTY RESEARCH

Research MethodologyIn perspective.

The key COVID-19 findings in research methodology, distilled into a clear, readable brief. The evidence is here whenever you want to go deeper.

INSIDE THIS MONITOR
53cited sources
11available findings

Study findings updated

AI-assisted evidence summary. For general information. These findings are not individual medical advice or a clinician endorsement.

THE SHORT VERSION

What’s worth knowing.

The key findings, what they mean, and the context that matters.

THE HEADLINE TAKEAWAY78% (1,591 results)

Most reviewed Omicron vaccine results had serious bias concerns

In a living systematic review of observational Omicron vaccine-effectiveness studies, 78% (1,591 results) were judged at serious risk of bias; confounding was the principal concern.

The appraisal covered 79 studies, over 53 million individuals and 2,032 vaccine-effectiveness estimates; 18% (361 results) were at moderate risk. These percentages concern study credibility, not the amount of vaccine effectiveness.

See the evidence

Results from observational studies of Omicron vaccine effectiveness judged to be at serious risk of bias; the principal concern was confounding

78% (1,591 results)

Kazi, Fatema et al.. Implications for future pandemics from a living systematic review and critical evaluation of observational studies of the effectiveness of COVID-19 vaccination against the Omicron variant.. Vaccine. 2026.

Added

Scale of the evidence base critically appraised for Omicron vaccine effectiveness

79 studies; over 53 million individuals; 2,032 vaccine-effectiveness estimates

Kazi, Fatema et al.. Implications for future pandemics from a living systematic review and critical evaluation of observational studies of the effectiveness of COVID-19 vaccination against the Omicron variant.. Vaccine. 2026.

Added

Results from observational studies of Omicron vaccine effectiveness judged to be at moderate risk of bias

18% (361 results)

Kazi, Fatema et al.. Implications for future pandemics from a living systematic review and critical evaluation of observational studies of the effectiveness of COVID-19 vaccination against the Omicron variant.. Vaccine. 2026.

Added

02

Early COVID-19 studies commonly had bias concerns

67%

A systematic assessment found that 67% of early COVID-19 studies had high or unclear risk of bias.

High and unclear ratings were combined, so 67% does not mean every study was judged high risk. Relative to earlier studies, the assessment reports that quality improved substantially from 2021 onward.

See the evidence

of early COVID-19 studies showed high or unclear risk of bias

67%

Zdravkovic M, Berger-Estilita J, Gmeiner S, et al. Quality of published COVID-19 research: a systematic assessment. BMJ Open. 2021;11(6):e048507.

03

Protocols were preregistered in 23% of COVID-19 randomized trials

23%

A systematic review and meta-epidemiological study reported preregistered protocols for 23% of COVID-19 randomized controlled trials.

The denominator was COVID-19 randomized controlled trials. This is a trial-transparency measure, not a treatment-effect or safety result.

See the evidence

Protocol Registration

23%
RCTs with pre-registered protocols

Jung RG, Di Santo P, Bhalla K, et al. Methodological rigor in COVID-19 clinical research: a systematic review and meta-epidemiological study. BMJ Open. 2021;11(4):e049335.

04

Most vagus nerve stimulation trials had high bias risk

83%

A systematic review of vagus nerve stimulation for hospitalized COVID-19 patients found 83% of included randomized controlled trials at high risk of bias.

The evidence base comprised 6 randomized controlled trials and 221 patients; 17% were judged low risk. This appraisal does not establish treatment benefit or harm.

See the evidence

Proportion of VNS for COVID-19 RCTs with high risk of bias

83%

Balan, Adrian et al.. Efficacy and Safety of Vagus Nerve Stimulation for Hospitalized COVID-19 Patients: A Systematic Review and Methodological Evaluation of Randomized Controlled Trials.. Medicina (Kaunas, Lithuania). 2026.

Total evidence base for VNS in COVID-19

6 RCTs, 221 patients

Balan, Adrian et al.. Efficacy and Safety of Vagus Nerve Stimulation for Hospitalized COVID-19 Patients: A Systematic Review and Methodological Evaluation of Randomized Controlled Trials.. Medicina (Kaunas, Lithuania). 2026.

Proportion of VNS for COVID-19 RCTs with low risk of bias (1 of 6)

17%

Balan, Adrian et al.. Efficacy and Safety of Vagus Nerve Stimulation for Hospitalized COVID-19 Patients: A Systematic Review and Methodological Evaluation of Randomized Controlled Trials.. Medicina (Kaunas, Lithuania). 2026.

05

Retention after fraud screening varied across survey times

After fraud screening, the survey retained 17% (798/4663) of responses at Time 1 and 49% (629/1281) at Time 2.

This was one international, community-engaged web-based survey of adults living with Long COVID. Retention percentages do not by themselves establish the screening method's accuracy.

See the evidence

Responses retained after fraud screening in one international web-based survey of adults living with Long COVID

17% (798/4663) at Time 1; 49% (629/1281) at Time 2

McDuff, Kiera et al.. Battling the Bots and Defending Against Fraudulent Responses in an International Community-Engaged Web-Based Survey With People Living With Long COVID: Methodological Study.. Journal of medical Internet research. 2026.

Added

06

Peer review was much faster for COVID science

6 days

Median peer-review time for COVID science was 6 days, compared with 100+ days before the pandemic.

This is a publishing-process comparison. It does not establish whether faster review changed study validity, retraction risk or patient outcomes.

See the evidence

Peer Review Speed

6 days
Median (vs. 100+ days pre-pandemic)

Else H. How a torrent of COVID science changed research publishing - in seven charts. Nature. 2020;588(7839):553.

Study-specific findings. Different populations, treatments and follow-up periods can produce different results.

THE RESEARCH, AS IT ARRIVES

Latest studies.

The newest findings added to this collection.
The learning from each, already distilled.

  1. STUDY 01Findings added
    TL;DR

    Most reviewed Omicron vaccine results had serious bias concerns

    78% (1,591 results)

    In a living systematic review of observational Omicron vaccine-effectiveness studies, 78% (1,591 results) were judged at serious risk of bias; confounding was the principal concern.

    The appraisal covered 79 studies, over 53 million individuals and 2,032 vaccine-effectiveness estimates; 18% (361 results) were at moderate risk. These percentages concern study credibility, not the amount of vaccine effectiveness.

    Study details & original results

    Kazi, Fatema et al.. Implications for future pandemics from a living systematic review and critical evaluation of observational studies of the effectiveness of COVID-19 vaccination against the Omicron variant.. Vaccine. 2026.

    Results from observational studies of Omicron vaccine effectiveness judged to be at serious risk of bias; the principal concern was confounding

    78% (1,591 results)

    Scale of the evidence base critically appraised for Omicron vaccine effectiveness

    79 studies; over 53 million individuals; 2,032 vaccine-effectiveness estimates

    Results from observational studies of Omicron vaccine effectiveness judged to be at moderate risk of bias

    18% (361 results)

    Citation in Research Methodology
  2. STUDY 02Findings added
    TL;DR

    Retention after fraud screening varied across survey times

    After fraud screening, the survey retained 17% (798/4663) of responses at Time 1 and 49% (629/1281) at Time 2.

    This was one international, community-engaged web-based survey of adults living with Long COVID. Retention percentages do not by themselves establish the screening method's accuracy.

    Study details & original results

    McDuff, Kiera et al.. Battling the Bots and Defending Against Fraudulent Responses in an International Community-Engaged Web-Based Survey With People Living With Long COVID: Methodological Study.. Journal of medical Internet research. 2026.

    Responses retained after fraud screening in one international web-based survey of adults living with Long COVID

    17% (798/4663) at Time 1; 49% (629/1281) at Time 2

    Citation in Research Methodology
2 of 2 study updates

Dates show when findings were added here, not when papers were published. Study populations and comparisons differ.

WHEN YOU WANT TO GO DEEPER
See all 11 findingsOriginal results, comparisons and study details.
7 of 7 source groupsFindings stay together with their study.
SOURCE 533 findings

Kazi, Fatema et al.. Implications for future pandemics from a living systematic review and critical evaluation of observational studies of the effectiveness of COVID-19 vaccination against the Omicron variant.. Vaccine. 2026.

Results from observational studies of Omicron vaccine effectiveness judged to be at serious risk of bias; the principal concern was confounding

Added
78% (1,591 results)Source [53]

Results from observational studies of Omicron vaccine effectiveness judged to be at moderate risk of bias

Added
18% (361 results)Source [53]
All 3 findings from this source

Scale of the evidence base critically appraised for Omicron vaccine effectiveness

Added
79 studies; over 53 million individuals; 2,032 vaccine-effectiveness estimatesSource [53]
SOURCE 521 finding

McDuff, Kiera et al.. Battling the Bots and Defending Against Fraudulent Responses in an International Community-Engaged Web-Based Survey With People Living With Long COVID: Methodological Study.. Journal of medical Internet research. 2026.

Responses retained after fraud screening in one international web-based survey of adults living with Long COVID

Added
17% (798/4663) at Time 1; 49% (629/1281) at Time 2Source [52]
SOURCE 031 finding

Jung RG, Di Santo P, Bhalla K, et al. Methodological rigor in COVID-19 clinical research: a systematic review and meta-epidemiological study. BMJ Open. 2021;11(4):e049335.

Protocol Registration

23%RCTs with pre-registered protocolsSource [3]
SOURCE 041 finding

Guyatt GH, Oxman AD, Vist GE, et al; GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-926.

High Certainty Evidence

8%GRADE 'high' rating proportionSource [4]
SOURCE 513 findings

Balan, Adrian et al.. Efficacy and Safety of Vagus Nerve Stimulation for Hospitalized COVID-19 Patients: A Systematic Review and Methodological Evaluation of Randomized Controlled Trials.. Medicina (Kaunas, Lithuania). 2026.

Proportion of VNS for COVID-19 RCTs with high risk of bias

Total evidence base for VNS in COVID-19

6 RCTs, 221 patientsSource [51]
All 3 findings from this source

Proportion of VNS for COVID-19 RCTs with low risk of bias (1 of 6)

Browse the 53 original sourcesThe complete bibliography behind this monitor.
  1. [1]

    Soltani P, Patini R. Retracted COVID-19 articles: a side-effect of the hot race to publication. Scientometrics. 2020;125(1):819-822.

    Open original source in a new tab
  2. [2]

    Else H. How a torrent of COVID science changed research publishing - in seven charts. Nature. 2020;588(7839):553.

    Open original source in a new tab
  3. [3]

    Jung RG, Di Santo P, Bhalla K, et al. Methodological rigor in COVID-19 clinical research: a systematic review and meta-epidemiological study. BMJ Open. 2021;11(4):e049335.

    Open original source in a new tab
  4. [4]

    Guyatt GH, Oxman AD, Vist GE, et al; GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924-926.

    Open original source in a new tab
  5. [5]

    Zdravkovic M, Berger-Estilita J, Gmeiner S, et al. Quality of published COVID-19 research: a systematic assessment. BMJ Open. 2021;11(6):e048507.

    Open original source in a new tab
  6. [6]

    Raynaud M, Zhang H, Louis K, et al. COVID-19-related medical research: a meta-research and critical appraisal. BMC Med Res Methodol. 2021;21:1.

    Open original source in a new tab
  7. [7]

    RECOVERY Collaborative Group. Dexamethasone in Hospitalized Patients with Covid-19. N Engl J Med. 2021;384(8):693-704.

    Open original source in a new tab
  8. [8]

    WHO Solidarity Trial Consortium. Remdesivir and three other drugs for hospitalised patients with COVID-19: final results of the WHO Solidarity randomised trial and updated meta-analyses. Lancet. 2022;399(10339):1941-1953.

    Open original source in a new tab
  9. [9]

    REMAP-CAP Investigators. Interleukin-6 Receptor Antagonists in Critically Ill Patients with Covid-19. N Engl J Med. 2021;384(16):1491-1502.

    Open original source in a new tab
  10. [10]

    Ioannidis JPA. The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses. Milbank Q. 2016;94(3):485-514.

    Open original source in a new tab
  11. [11]

    Ioannidis JPA. Coronavirus disease 2019: The harms of exaggerated information and non-evidence-based measures. Eur J Clin Invest. 2020;50(4):e13222.

    Open original source in a new tab
  12. [12]

    Greenhalgh T, Knight M, A'Court C, et al. Management of post-acute covid-19 in primary care. BMJ. 2020;370:m3026.

    Open original source in a new tab
  13. [13]

    Greenhalgh T, Jimenez JL, Prather KA, et al. Ten scientific reasons in support of airborne transmission of SARS-CoV-2. Lancet. 2021;397(10285):1603-1605.

    Open original source in a new tab
  14. [14]

    Glasziou PP, Sanders S, Hoffmann T. Waste in covid-19 research. BMJ. 2020;369:m1847.

    Open original source in a new tab
  15. [15]

    Boutron I, Chaimani A, Meerpohl JJ, et al. The COVID-NMA Project: Building an Evidence Ecosystem for the COVID-19 Pandemic. Ann Intern Med. 2020;173(12):1015-1017.

    Open original source in a new tab
  16. [16]

    Siemieniuk RA, Bartoszko JJ, Ge L, et al. Drug treatments for covid-19: living systematic review and network meta-analysis. BMJ. 2020;370:m2980.

    Open original source in a new tab
  17. [17]

    Wynants L, Van Calster B, Collins GS, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369:m1328.

    Open original source in a new tab
  18. [18]

    Sterne JAC, Savovic J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898.

    Open original source in a new tab
  19. [19]

    Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.

    Open original source in a new tab
  20. [20]

    Schulz KF, Altman DG, Moher D; CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.

    Open original source in a new tab
  21. [21]

    von Elm E, Altman DG, Egger M, et al; STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement. Ann Intern Med. 2007;147(8):573-577.

    Open original source in a new tab
  22. [22]

    London AJ, Kimmelman J. Against pandemic research exceptionalism. Science. 2020;368(6490):476-477.

    Open original source in a new tab
  23. [23]

    Bramstedt KA. The carnage of substandard research during the COVID-19 pandemic: a call for quality. J Med Ethics. 2020;46(12):803-807.

    Open original source in a new tab
  24. [24]

    Soriano JB, Murthy S, Marshall JC, et al. A clinical case definition of post-COVID-19 condition by a Delphi consensus. Lancet Infect Dis. 2022;22(4):e102-e107.

    Open original source in a new tab
  25. [25]

    Chen C, Haupert SR, Zimmermann L, et al. Global Prevalence of Post COVID-19 Condition or Long COVID: A Meta-Analysis and Systematic Review. J Infect Dis. 2022;226(9):1593-1607.

    Open original source in a new tab
  26. [26]

    Davis HE, Assaf GS, McCorkell L, et al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. EClinicalMedicine. 2021;38:101019.

    Open original source in a new tab
  27. [27]

    Al-Aly Z, Xie Y, Bowe B. High-dimensional characterization of post-acute sequelae of COVID-19. Nature. 2021;594(7862):259-264.

    Open original source in a new tab
  28. [28]

    RECOVERY Collaborative Group. Effect of Hydroxychloroquine in Hospitalized Patients with Covid-19. N Engl J Med. 2020;383(21):2030-2040.

    Open original source in a new tab
  29. [29]

    RECOVERY Collaborative Group. Tocilizumab in patients admitted to hospital with COVID-19 (RECOVERY). Lancet. 2021;397(10285):1637-1645.

    Open original source in a new tab
  30. [30]

    ACTIV-4a Investigators. Therapeutic Anticoagulation with Heparin in Noncritically Ill Patients with Covid-19. N Engl J Med. 2021;385(9):790-802.

    Open original source in a new tab
  31. [31]

    Polack FP, Thomas SJ, Kitchin N, et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N Engl J Med. 2020;383(27):2603-2615.

    Open original source in a new tab
  32. [32]

    Baden LR, El Sahly HM, Essink B, et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med. 2021;384(5):403-416.

    Open original source in a new tab
  33. [33]

    Lopez Bernal J, Andrews N, Gower C, et al. Effectiveness of Covid-19 Vaccines against the B.1.617.2 (Delta) Variant. N Engl J Med. 2021;385(7):585-594.

    Open original source in a new tab
  34. [34]

    Andrews N, Stowe J, Kirsebom F, et al. Covid-19 Vaccine Effectiveness against the Omicron (B.1.1.529) Variant. N Engl J Med. 2022;386(16):1532-1546.

    Open original source in a new tab
  35. [35]

    World Health Organization. COVID-19 Clinical management: living guidance. WHO/2019-nCoV/clinical/2023.1.

    Original source link unavailable
  36. [36]

    National Institutes of Health. COVID-19 Treatment Guidelines Panel. Available at: covid19treatmentguidelines.nih.gov.

    Original source link unavailable
  37. [37]

    Infectious Diseases Society of America. COVID-19 Guidelines. Available at: idsociety.org/covid-19.

    Original source link unavailable
  38. [38]

    Siemieniuk RA, Bartoszko JJ, Diaz Martinez JP, et al. Antibody and cellular therapies for treatment of covid-19: a living systematic review and network meta-analysis. BMJ. 2021;374:n2231.

    Open original source in a new tab
  39. [39]

    Cochrane Library. COVID-19 resources and special collections. Available at: cochranelibrary.com/covid-19.

    Original source link unavailable
  40. [40]

    PROSPERO. International prospective register of systematic reviews. CRD, University of York.

    Original source link unavailable
  41. [41]

    COVID-NMA Initiative. Living network meta-analysis. Available at: covid-nma.com.

    Original source link unavailable
  42. [42]

    MAGIC Evidence Ecosystem Foundation. COVID-19 living guidelines. Available at: magicevidence.org.

    Original source link unavailable
  43. [43]

    Living Evidence Network. Guidance for living systematic reviews. Cochrane Methods.

    Original source link unavailable
  44. [44]

    Ioannidis JPA, Axfors C, Contopoulos-Ioannidis DG. Population-level COVID-19 mortality risk for non-elderly individuals. Environ Res. 2020;188:109890.

    Open original source in a new tab
  45. [45]

    Greenhalgh T, Koh GCH, Car J. Covid-19: a remote assessment in primary care. BMJ. 2020;368:m1182.

    Open original source in a new tab
  46. [46]

    Retraction Watch Database. COVID-19 retractions. Available at: retractionwatch.com.

    Original source link unavailable
  47. [47]

    European Medicines Agency. COVID-19 treatments and vaccines authorization and safety updates.

    Original source link unavailable
  48. [48]

    FDA. Emergency Use Authorizations for COVID-19 therapeutics and vaccines.

    Original source link unavailable
  49. [49]

    Stable Evidence Collaboration. Living mapping and living systematic review of Covid-19 studies. covid-nma.com.

    Original source link unavailable
  50. [50]

    Living Evidence Network. Guidance for producing living systematic reviews. Cochrane Methods.

    Open original source in a new tab
  51. [51]

    Balan, Adrian et al.. Efficacy and Safety of Vagus Nerve Stimulation for Hospitalized COVID-19 Patients: A Systematic Review and Methodological Evaluation of Randomized Controlled Trials.. Medicina (Kaunas, Lithuania). 2026.

    Open original source in a new tab
  52. [52]

    McDuff, Kiera et al.. Battling the Bots and Defending Against Fraudulent Responses in an International Community-Engaged Web-Based Survey With People Living With Long COVID: Methodological Study.. Journal of medical Internet research. 2026.

    Open original source in a new tab
  53. [53]

    Kazi, Fatema et al.. Implications for future pandemics from a living systematic review and critical evaluation of observational studies of the effectiveness of COVID-19 vaccination against the Omicron variant.. Vaccine. 2026.

    Open original source in a new tab
ABOUT THIS MONITOR

Understanding includes the limits.

This is an AI-assisted evidence summary, not a clinician endorsement. Read each original paper for its complete methods, population and limitations. Different studies can ask different questions and report different kinds of results.

Dates marked “added” describe when a finding entered this monitor, not when the study was published or clinically reviewed. Personal health and treatment decisions belong in a conversation with a qualified clinician.

KEEP YOUR QUESTIONS CLOSE

A little more understanding.
Wherever you are.

Explore the ModernDoc app