Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination
For patients and families
In plain language
An automatic summary of structured registry data. It is an orientation aid, not a substitute for the official protocol or a physician assessment.
- What is being studied
- This is an observational study: the protocol does not assign a study treatment.
- Who it may be relevant to
- Registry conditions: AI (Artificial Intelligence). Basic parameters: 18 years — 60 years · All.
- What needs checking
- Age, condition and sex are only basic indicators. Prior treatment, laboratory values and other mandatory requirements appear in the eligibility criteria below.
- Where it takes place
- China
- Next step
- Save the trial, show it to the treating physician, and confirm current recruitment with the study center. Costs, documents and travel →
Unsure about the terms? Read our patient guide →
Official title
Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination: An Empirical Analysis Based on the "Answering-Generating" Closed Loop and Transformation of Competency Assessment
Overview
This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. The entire study adheres to the principles of single-blinding, randomization, and standardization to ensure scientific rigor and reproducibility. The single-blind design is implemented during the "standardized testing" phase, where the system intersperses AI-generated items with those authored by human experts. Participants remain blinded to the source of each item (AI-generated vs. human-authored) throughout the testing and scoring processes, thereby ensuring the objectivity of the evaluation results.
Primary outcome measures
- Comparative Analysis of Item Accuracy [Time frame: Baseline]
Eligibility criteria
Inclusion criteria
- 1.Professional Status: Medical students currently enrolled in a Standardized Residency Training (SRT) program.
2.Educational Background: Holders of a Bachelor of Medicine degree or higher, with foundational clinical knowledge.
3.Informed Consent: Voluntarily participate in the study and provide written informed consent.
4.Technical Competency: Proficient in using digital platforms to complete assessments and scoring.
Exclusion criteria
- 1.Conflict of Interest: Individuals involved in the AI model training, prompt engineering, or the creation of the human-authored question bank for this study.
2.Inability to Complete: Presence of visual/auditory impairments or severe illness that precludes completion of the assessment within the specified time.
3.Investigator's Discretion: Any other condition that, in the opinion of the investigator, renders the participant unsuitable for the study.
Criteria are shown verbatim from the registry (in English). Final eligibility is always assessed by the study center.
Healthy volunteers: Yes
Study design
- Observational model
- Other
Study locations
China · 1 center
- Guangdong Provincial People's Hospital — Guangzhou
Identifiers
NCT: NCT07505862 · KY2025-1298-02