Implementation of Problem-Solving Treatment in Community Health Centers (PST-Aid)

BEHAVIORAL

Problem Solving Treatment as usual (PST as usual)

PST is a skills-based intervention that teaches clients a 7-step approach in which they 1) select a specific problem and define it in concrete terms,2) select a goal that is feasible to reach before next session, 3) brainstorm various ways to accomplish the goal, 4) evaluate pros and cons of each solution, including the likelihood they can actually implement it, 5) select the best solution, 6) create a plan to implement the solution, and 7) evaluate the plan afterward to ascertain the effectiveness of the solution. Practitioners teach and illustrate the PST process to clients at each session and encourage clients to implement action plans developed using the PST process. Clients are also encouraged to practice the PST process with additional problems between sessions, in order to gain mastery over the PST skills, enhance behavioral activation and as a result improve their belief in their ability to solve problems on their own (self efficacy).

BEHAVIORAL

Problem Solving Treatment Aid (PST-Aid)

PST-Aid is an internet-based tool to support the delivery of PST. PST-Aid incorporates decision support for the practitioner as well as client and provides PST treatment support functions (i.e., scaffolding), including patient problem lists and session worksheets. PST-Aid was designed to be used during remote sessions, such that practitioners and clients can interact throughout the session while collaboratively viewing and editing worksheets on their own browsers.This system was developed into a prototype that was piloted and found to be acceptable and with adequate usability.

Change in Implementation Strategy Usability Scale (ISUS) score

Time frame: Baseline, 3 months, 6 months

Usability will be evaluated with clinician report on the 10-item Implementation Strategy Usability Scale (ISUS), which is based closely on the well-validated System Usability Scale. Ratings are on a 1 to 5 scale and yield a total score from 0 to 100. Half the items are reverse scored; higher total scores reflect greater usability. The ISUS has good inter-item consistency (a = .83) and sensitivity. Research has also demonstrated that the original version of the ISUS (the SUS) functions similarly-and yields similar scores-for adults and youth as young as 11 years.

Change in Participant Responsiveness Scale (PRS) score

Time frame: Baseline, 3 months, 6 months

Clinicians will complete the Participant Responsiveness Scale (PRS), an adapted version of the 12-item Patient Responsiveness Scale tailored to be developmentally appropriate for children aged 8 and above as well as adults. The PRS measures two factors, Participation and Enthusiasm. The original Patient Responsiveness Scale has demonstrated strong reliability (a = .86) and construct validity.

Change in Intervention Appropriateness Measure (IAM) score

Time frame: Baseline, 3 months, 6 months

Clinicians will complete the Intervention Appropriateness Measure (IAM) is a rigorously developed, pragmatic instrument with strong good internal consistency (a = .87) and test-retest reliability (a = .87).

Adoption over time

Time frame: Baseline, 7 months post-initial training in the intervention, and end of the individual's study participation period, assessed as the study withdrawal date or 24 months post-training, whichever is first

Adoption is operationalized as whether or not the clinician completes at least 1 PST session with 3 or more cases at any point during study participation.

Reach over time

Time frame: Baseline, 7 months post-initial training in the intervention, and end of the individual's study participation period, assessed as the study withdrawal date or 24 months post-training, whichever is first

Reach will be calculated as the percentage of clinicians caseloads of patients with a depressive disorder receiving PST.

Change in Patient Health Questionnaire (PHQ-9) score

Time frame: Baseline, 4 weeks, 9 weeks

The Patient Health Questionnaire is one of the most used short depression measures. The PHQ features 9 items on a four-point scale (0=not at all, 1=several days, 2=more than half the days, 3=nearly every day), with cutpoints for 5, 10, 15, and 20 representing mild, moderate, moderately severe, and severe levels of depressive symptoms. Four original validation studies were conducted on nearly 10,000 patients, and there have been multiple meta-analyses. Scores have been found valid, with sensitivity of 88% and specificity of 88% for a cut point of 10 has been found for Major Depressive Disorders.

Client Satisfaction Questionnaire-16

Time frame: 9 weeks

This measure will ask 3 items from the Client Satisfaction Questionnaire-16: Did treatment meet your needs? Are you satisfied with treatment services? Would you use the same treatment again if needed?

Change in Quality of Life in Neurological Disorders Social Relations scale (Neuro-QOL) score

Time frame: Baseline, 4 weeks, 9 weeks

The Quality of Life in Neurological Disorders Satisfaction with Social Roles scale (Neuro-QOL) is a widely used 8-item measure of functioning in usual social roles, activities, and responsibilities. Factor analyses and Item Response Theory analyses have ensured broad information parameters without differential item functioning by demographics. Scale scores have been validated and normed on thousands of participants in the US general and clinical inpatient and outpatient settings, presenting with a variety of problem areas. Scores provide a T score with a mean of 50 and standard deviation of 10, aligned with a variety of norming samples. An example item stem is: In the past 7 days I am able to do all of my regular family activities. Response options are on a scale of 1 to 5 (1=never, 2-rarely, 3=sometimes, 4=often, 5=always).

Initial fidelity (PST Fidelity Scale)

Time frame: Expert clinicians review audiotapes of therapy sessions or mock interview for each clinician participant over a six-month period of time prior to certification in the intervention

Fidelity will be measured using the PST Adherence and Competency Scale (PST Fidelity Scale). The PST Fidelity Scale includes seven items assessing the seven key problem-solving steps rated on a 5 point scale (0=very poor, 5=very good), an average score of 3 or greater indicates a satisfactory performance.Internal consistency is good, with Cronbach alpha ranging from .83 to .89. A Principal Components Analysis found all factors loaded on a common factor accounting for 76.6% of the variance.Interrater reliability has been found to be high (r=.822-.918), with 86% of two-rater comparisons within one point of each other. Initial fidelity will be defined as the hours of training until fidelity-based certification is reached, measured by trainer PST Fidelity Scale ratings of session recordings or mock interviews.

Sustained fidelity

Time frame: Expert clinicians review audiotapes of therapy sessions or mock interview for each clinician participant over a six-month period of time after initial training

Sustained fidelity will be rated via observer coding of recordings of one randomly selected session (or mock interview) per client using the PST Fidelity Scale (i.e., fidelity tool)

What is a clinical trial?

A clinical trial is a research study that tests new medical treatments, drugs, devices, or procedures to determine their safety and effectiveness. Trials are carefully designed and monitored to protect participants while advancing medical knowledge.

Is it safe to participate?

Clinical trials follow strict safety guidelines and ethical standards. Trials must be reviewed and approved, and participants are closely monitored by medical professionals throughout the study. You can withdraw at any time if you choose.

Will I be compensated?

Many clinical trials offer compensation for your time, travel expenses, and inconvenience. The specific compensation varies by study and will be discussed during the screening process. All study-related medical care is typically provided at no cost to participants.

Will I receive a placebo instead of treatment?

When effective treatment exists, participants typically receive either the standard treatment plus the study intervention, or the standard treatment plus placebo. You would not be denied effective care. Placebos are primarily used when no proven treatment is available, or in addition to standard care. Your trial consent form will clearly explain what treatments you may receive.

Can I leave a trial if I change my mind?

Absolutely. Participation in clinical trials is completely voluntary. You have the right to withdraw from the study at any time, for any reason, without penalty or loss of benefits to which you are otherwise entitled.

How long does a clinical trial last?

Trial duration varies widely depending on the study design and purpose. Some trials last just a few weeks, while others may continue for months or years. The study coordinator will provide specific timeline information during your screening call.