NCT07107880 · Stanford University
Use of Artificial Intelligence to Assess Trainee Communication Compared to Human Assessment
What this study is about
This study will evaluate whether a web-based artificial intelligence platform (AI) (Clinical Mind AI \[CMAI\] Stanford, CA), can assess communication skills in anesthesiology trainees, including residents and fellows, in the setting of disclosing medical errors.
View original scientific description
This study will evaluate whether a web-based artificial intelligence platform (AI) (Clinical Mind AI \[CMAI\] Stanford, CA), can assess communication skills in anesthesiology trainees, including residents and fellows, in the setting of disclosing medical errors. All participants will participate in an AI-generated simulation by using the platform remotely, and CMAI will assess trainee performance immediately after the simulation.
Interventions
OTHER
Communication Assessment through AI and Human
Participants will remotely engage in an AI-generated simulation that presents an voice-based conversation with a simulated parent of a pediatric patient. The scenario involves discussing a clinical scenario concerning their child. Following the simulation, the participant's communication skills will be assessed using an artificial intelligence (AI) system trained to evaluate the key aspects of communication using standardized rating scales. In addition, two human evaluators will assess the participant's communication skills using the same rating scales.
Primary outcome measures
Reliability of AI Conversational Performance Assessment
Time frame: Immediately after the simulation
The primary outcome is to evaluate the reliability of the Clinical Mind AI (CMAI) platform in accurately assessing the communication skills of medical education trainees during a simulated interaction. To measure this outcome, the CMAI will use the Breaking Bad News Assessment Schedule (BBAS), a validated tool assessing participant's communication skills in five domains: 1) Setting the scene, 2) Breaking the news, 3) Eliciting concerns, 4) Informative giving, and 5) Empathy and Support. It includes 17 items, each with sub questions, rated on a 5-point Likert scale from (1-5), where score meanings may vary by each question. The scoring will be guided by Breaking Bad News Rubric, which outlines performance criteria for each item on the BBAS. In addition, two trained human evaluators will independently asses the participant's communication skills using the same BBAS tool and rubric. Lastly, both CMAI and human scores will be compared to determine the reliability of the CMAI platform.
Who can participate
This study lists these criteria on ClinicalTrials.gov. A study coordinator reviews eligibility during screening — this page does not determine whether you qualify.
Inclusion criteria
- Participant's must be 18 years of age or older
- Graduate medical trainess such as residents and fellows at all levels of training excluding PGY1 trainees at Department of Anesthesiology, Perioperative, and Pain Medicine at Stanford University
- Able to speak and understand English
- Willing and able to provide consent to participate in research
- Able to participate in Artificial Intelligence communication simulation
Exclusion criteria
- Non-English speaker
- unable to provide consent to participate in research
- individual with no access to the necessary technology (internet, computer/smart device) required for participating in the digital, voice-based interaction with the AI platform
Where
- Palo Alto, California
Related conditions & keywords
Frequently asked questions
What is a clinical trial?
A clinical trial is a research study that tests new medical treatments, drugs, devices, or procedures to determine their safety and effectiveness. Trials are carefully designed and monitored to protect participants while advancing medical knowledge.
Is it safe to participate?
Clinical trials follow strict safety guidelines and ethical standards. Trials must be reviewed and approved, and participants are closely monitored by medical professionals throughout the study. You can withdraw at any time if you choose.
Will I be compensated?
Many clinical trials offer compensation for your time, travel expenses, and inconvenience. The specific compensation varies by study and will be discussed during the screening process. All study-related medical care is typically provided at no cost to participants.
Will I receive a placebo instead of treatment?
When effective treatment exists, participants typically receive either the standard treatment plus the study intervention, or the standard treatment plus placebo. You would not be denied effective care. Placebos are primarily used when no proven treatment is available, or in addition to standard care. Your trial consent form will clearly explain what treatments you may receive.
Can I leave a trial if I change my mind?
Absolutely. Participation in clinical trials is completely voluntary. You have the right to withdraw from the study at any time, for any reason, without penalty or loss of benefits to which you are otherwise entitled.
How long does a clinical trial last?
Trial duration varies widely depending on the study design and purpose. Some trials last just a few weeks, while others may continue for months or years. The study coordinator will provide specific timeline information during your screening call.
Data: ClinicalTrials.gov · synced Apr 24, 2026 · Source of record for eligibility and locations