Evaluation of a Vaccine Chatbot on HPV Vaccine Confidence and Hesitancy

Официальное название

Evaluation of a Vaccine Chatbot on HPV Vaccine Confidence and Hesitancy: a Randomized Controlled Trial and Implementation Science Study

Обзор

The goal of this clinical trial is to learn if a chatbot powered by artificial intelligence works to improve HPV vaccination among females aged 15 to 45 in China. A randomized controlled trial and implementation science study will be conducted targeting females as participants. The main questions it aims to answer are: 1. Does the vaccine chatbot influence women's confidence, literacy, hesitancy, and uptake of the HPV vaccine. 2. What are the public acceptance of chatbot and the facilitators and barriers to its implementation in a real-world setting. Researchers will compare a group of women who use the chatbot with a group who do not use it to see if the chatbot is effective at helping women feel confident and willing to get vaccinated against HPV. Participants will: 1. Be recruited and randomly allocated into one of two groups. One group will be invited to use the HPV vaccine chatbot and the other group will not get access to the vaccine chatbot until the end of the trial. 2. Complete a questionnaire survey on their confidence, literacy, and hesitancy on the HPV vaccine. 3. Have their vaccination status checked at the end of trial.

Подробное описание

A randomized controlled trial with 2 arms will be conducted to evaluate the effectiveness of an LLM-powered chatbot on improving HPV vaccination among females aged 15 to 45, followed by a pragmatic implementation science study to assess the public acceptance of chatbot and to identify the facilitators and barriers to its implementation in a real-world setting.

The sample size is calculated based on the primary outcome of the HPV vaccination uptake among females aged 15 to 45 in China. This uptake is around 10% according to the China CDC estimation, and we assume that it can increase to 15% following the intervention. With a significance level (α) of 0.05 and 80% power (1-β=0.8), a sample size of at least 683 per group is needed to detect a 5% absolute difference in vaccination rate (from an assumed baseline rate of 10% to 15% post-intervention). The sample size is inflated to 900 per group to account for potential loss to follow-up and to ensure adequate power for a multi-center design.

Participant recruitment will be conducted using a multistage sampling approach across eastern, central, and western China. In each of three provinces, one urban area and one or two rural area will be selected. Participants meeting the inclusion criteria will be invited to participate and provide informed consent. For those aged 15 to 17, both parental or legal guardian consent and adolescent assent will be obtained. A randomization method will be employed to ensure balanced allocation across two groups, and the randomization sequence will be generated by an independent statistician to ensure a 1:1 allocation ratio. Participants and on-site intervention staff cannot be blinded; personnel responsible for blinded outcome assessment and statistical analysis will remain unaware of allocation.

Participants in the intervention group will be invited to use the HPV vaccine chatbot as well as a routine HPV educational pamphlet . The chatbot powered by a large language model (LLM), offers a scalable, accessible, and interactive platform around the HPV vaccine information. At the recruitment site, participants will access the chatbot through WeChat or a web browser and will be asked to use it for around five minutes. A WeChat group will be established, and the chatbot access link will be sent at one week, half a month, one month, one and half month, two months following the enrollment. The control group will not get access to the vaccine chatbot until the end of the trial and will receive standard care by a routine educational pamphlet about HPV infection and vaccination. Following the intervention, all participants will complete a questionnaire survey on their confidence, literacy, and hesitancy on the HPV vaccine. And their vaccination status will be obtained from official vaccination records at the end of trial.

The intention-to-treat (ITT) analysis will be used to evaluate the effectiveness of the intervention. Between-group comparisons will use t-tests for continuous variables and chi-square tests for categorical variables. HPV vaccine uptake as the primary outcome will be analyzed using log-binomial regression with study center included as a fixed effect and prespecified covariates included for adjustment. Risk ratios and adjusted absolute risk differences with 95% confidence intervals will be reported. If the log-binomial model does not converge, modified Poisson regression with robust sandwich variance estimation will be used. Timing of vaccination will be evaluated using Kaplan-Meier survival curves and log-rank tests, with Cox proportional hazards models to estimate intervention effects on time-to-vaccination. Binary secondary outcomes such as vaccine hesitancy and perceived disease risk will be analyzed using log-binomial or modified Poisson regression, consistent with the primary-outcome analysis; and continuous secondary outcomes such as vaccine confidence and literacy will be analyzed using linear regression models that account for study-center effects and adjust for prespecified baseline covariates. Prespecified subgroup analyses will assess heterogeneity of intervention effects across populations stratified by baseline characteristics. In addition, a per-protocol analysis will be conducted on the primary outcome, and within the intervention group, the effect of intervention intensity measured by chatbot engagement levels on primary outcome will also be evaluated.

Вмешательства

• Поведенческое LLM-Powered HPV Vaccine Chatbot
  A vaccine chatbot delivered via WeChat or a web browser, designed to provide information and health education about the HPV vaccine. The chatbot is powered by large language models and is trained on an expert-validated knowledge base derived from authoritative sources such as the WHO and China CDC to ensure accuracy. The knowledge base is validated by experts. The chatbot engages users in interactive, conversational dialogue to answer questions and address concerns regarding HPV and HPV vaccines

Первичные конечные точки

• HPV Vaccine Uptake [Срок оценки: Three months after participant randomization allocation]

Вторичные конечные точки (7)

• HPV Vaccine Hesitancy [Срок оценки: The same day after the intervention]
• HPV Vaccine Confidence [Срок оценки: The same day after the intervention]
• HPV Vaccine Literacy [Срок оценки: The same day after the intervention]
• Timing of HPV Vaccination [Срок оценки: Within three months after participant randomization allocation]
• Perceived Risk of HPV-Related Disease [Срок оценки: The same day after the intervention]
• Chatbot Usability [Срок оценки: The same day after the intervention]
• Cost of interventions [Срок оценки: Within three months after participant randomization allocation]

Критерии участия

Критерии включения

• Female, aged 15 to 45 years, inclusive.
• Not previously vaccinated against HPV.
• Reports no contraindications to HPV vaccination.
• Has no mental, visual, or reading impairments that would preclude cooperation with study activities.
• Is willing and able to provide informed consent.

Критерии исключения

• Male.
• Age under 15 or over 45 years.
• Has a history of prior HPV vaccination.
• Has a known contraindication to HPV vaccination.
• Unable to comply with study procedures.
• Is unwilling or unable to provide informed consent.

Критерии приведены из реестра в оригинале (на английском). Окончательную оценку соответствия проводит исследовательский центр.

Здоровые добровольцы: Да

Дизайн исследования

Распределение

Рандомизированное

Модель

Параллельные группы

Маскирование

Простое слепое

Основная цель

Организация здравоохранения

Центры проведения

Список центров уточняется — проверьте первичный протокол.

Публикации

• Weeks R, Sangha P, Cooper L, Sedoc J, White S, Gretz S, Toledo A, Lahav D, Hartner AM, Martin NM, Lee JH, Slonim N, Bar-Zeev N. Usability and Credibility of a COVID-19 Vaccine Chatbot for Young Adults and Health Workers in the United States: Formative Mixed Methods Study. JMIR Hum Factors. 2023 Jan 30;10:e40533. doi: 10.2196/40533. PMID 36409300
• Weeks R, Cooper L, Sangha P, Sedoc J, White S, Toledo A, Gretz S, Lahav D, Martin N, Michel A, Lee JH, Slonim N, Bar-Zeev N. Chatbot-Delivered COVID-19 Vaccine Communication Message Preferences of Young Adults and Public Health Workers in Urban American Communities: Qualitative Study. J Med Internet Res. 2022 Jul 6;24(7):e38418. doi: 10.2196/38418. PMID 35737898
• Kobayashi T, Nishina Y, Tomoi H, Harada K, Tanaka K, Matsumoto E, Horimukai K, Ishihara J, Sasaki S, Inaba K, Seguchi K, Takahashi H, Salinas JL, Yamada Y. Corowa-kun: A messenger app chatbot delivers COVID-19 vaccine information, Japan 2021. Vaccine. 2022 Jul 30;40(32):4654-4662. doi: 10.1016/j.vaccine.2022.06.007. Epub 2022 Jun 8. PMID 35750541
• Almalki M, Azeez F. Health Chatbots for Fighting COVID-19: a Scoping Review. Acta Inform Med. 2020 Dec;28(4):241-247. doi: 10.5455/aim.2020.28.241-247. PMID 33627924
• Wilson L, Marasoiu M. The Development and Use of Chatbots in Public Health: Scoping Review. JMIR Hum Factors. 2022 Oct 5;9(4):e35882. doi: 10.2196/35882. PMID 36197708
• Luk TT, Lui JHT, Wang MP. Efficacy, Usability, and Acceptability of a Chatbot for Promoting COVID-19 Vaccination in Unvaccinated or Booster-Hesitant Young Adults: Pre-Post Pilot Study. J Med Internet Res. 2022 Oct 4;24(10):e39063. doi: 10.2196/39063. PMID 36179132
• Si M, Su X, Jiang Y, Wang W, Zhang X, Gu X, Ma L, Li J, Zhang S, Ren Z, Liu Y, Qiao Y. An Internet-Based Education Program for Human Papillomavirus Vaccination Among Female College Students in Mainland China: Application of the Information-Motivation-Behavioral Skills Model in a Cluster Randomized Trial. J Med Internet Res. 2022 Sep 30;24(9):e37848. doi: 10.2196/37848. PMID 36178723
• Si M, Su X, Jiang Y, Wang W, Zhang X, Gu X, Ma L, Li J, Zhang S, Ren Z, Liu Y, Qiao Y. Effect of an IMB Model-Based Education on the Acceptability of HPV Vaccination Among College Girls in Mainland China: A Cluster RCT. Cancer Control. 2022 Jan-Dec;29:10732748211070719. doi: 10.1177/10732748211070719. PMID 35088609

Идентификаторы

NCT: NCT07200570 · Fudan-HPV LLM chatbot

Первоисточники (государственные реестры)

• ClinicalTrials.gov (NIH, США)

Открыть это исследование на ClinicalTrials.gov ↗