Loading...
Comparison of AI-assisted and human-generated plain language summaries for Cochrane reviews: protocol for a randomized trial (HIET-1)
Devane, Declan Pope, Johanna Byrne, Paula Forde, Evan Woloshin, Steven Culloty, Eileen Dahly, Darren Hess Elgersma, Ingeborg Munthe-Kaas, Heather Judge, Conor
Devane, Declan
Pope, Johanna
Byrne, Paula
Forde, Evan
Woloshin, Steven
Culloty, Eileen
Dahly, Darren
Hess Elgersma, Ingeborg
Munthe-Kaas, Heather
Judge, Conor
Files
Citations
Altmetric:
Publication Date
2025-07-01
Type
journal article
Downloads
Citation
Devane, Declan, Pope, Johanna, Byrne, Paula, Forde, Evan, Woloshin, Steven, Culloty, Eileen, Dahly, Darren, Elgersma, Ingeborg Hess, Munthe-Kaas, Heather, Judge, Conor, O'Donnell, Martin, Krewer, Finn, Galvin, Sandra, Burke, Nikita, Tierney, Theresa, Saif-Ur-Rahman, K. M., Conway, Tom, Thomas, James. (2025). Comparison of AI-assisted and human-generated plain language summaries for Cochrane reviews: protocol for a randomized trial (HIET-1). Journal of Clinical Epidemiology, 185. https://doi.org/10.1016/j.jclinepi.2025.111894
Abstract
Plain language summaries (PLSs) of systematic reviews present complex health evidence in accessible language. Advances in artificial intelligence (AI), particularly large language models, may enhance the generation of PLSs. This protocol describes a randomized, parallel-group, two-armed, noninferiority trial comparing AI-assisted vs human-generated PLSs. Adults aged 18 years or older, proficient in English, will be recruited online via an audience recruitment platform. Participants are randomly assigned (1:1 ratio) to (1) the intervention group: three AI-assisted PLSs based on recent Cochrane reviews; or (2) the control group: three human-generated Cochrane PLSs. The primary outcome is comprehension (aligned with QUEST's Understanding dimension), assessed via a 10-item multiple-choice questionnaire for each summary, structured according to Cochrane PLS template sections. Secondary outcomes are readability, quality of information, safety considerations, and perceived trustworthiness. This study aims to provide insights into integrating AI technologies in health communication. Its findings will inform future practices in disseminating evidence-based health information to the public.
Publisher
Elsevier
Publisher DOI
Rights
CC BY