Sign Up For Newsletter

Blueprints For Healthy Youth Development logo

Parent-Child Interaction Therapy

A program designed for children and their parents that focuses on decreasing child behavior problems, increasing positive parent behaviors, and improving the quality of the parent-child relationship.

Program Outcomes

  • Antisocial-aggressive Behavior
  • Child Maltreatment
  • Conduct Problems
  • Externalizing
  • Internalizing
  • Mental Health - Other

Program Type

  • Parent Training

Program Setting

  • Social Services

Continuum of Intervention

  • Indicated Prevention
  • Selective Prevention

Age

  • Early Childhood (3-4) - Preschool
  • Late Childhood (5-11) - K/Elementary

Gender

  • Both

Race/Ethnicity

  • All

Endorsements

Blueprints: Promising
SAMHSA : 3.1-3.9

Program Information Contact

PCIT International
P.O. Box 1591
High Springs, FL 32655
Email: pcit.international@gmail.com
www.pcit.org

Program Developer/Owner

Sheila Eyberg, Ph.D.
University of Florida


Brief Description of the Program

Parent-Child Interaction Therapy is an intervention for children (ages 2-12 years) and their parents or caregivers that focuses on decreasing externalized child behavior problems (e.g., defiance, aggression), increasing positive parent behaviors, and improving the quality of the parent-child relationship. It teaches parents traditional play-therapy skills to improve parent-child interactions and problem-solving skills to manage new problem behaviors. Parents are taught and practice communication skills and behavior management with their children in a playroom while coached by therapists. The activities and coaching by a therapist enhance the relationship between parent and child and help parents implement non-coercive discipline strategies. The length of treatment can vary, but the standard treatment consists of 12 one-half hour weekly sessions, with a one-hour booster session one month after treatment ends. 

Outcomes

  • Both a standard 12-session treatment and an abbreviated 5-session treatment similarly reduced posttest measures of behavior problems among preschool children with oppositional defiant disorder (Study 1: Nixon et al., 2003, 2004).
  • A treatment group of Puerto Rican children ages 4-6 with diagnosed ADHD and significant behavior problems showed significantly greater improvement than the control group on posttest measures relating to hyperactivity, aggression, disruptive behavior, and positive parental practices (Study 2: Matos et al., 2009).
  • The percent of children classified as having oppositional defiant disorder dropped from 91% to 22% in treatment subjects who completed the training, while the percent dropped from 100% to 57% in treatment subjects who did not complete the training (Study 3: Boggs et al., 2004).
  • Study 4 (Leung et al., 2008) demonstrated that Chinese parents and children in Hong Kong benefitted from the program.
  • A package of Parent-Child Interaction Therapy combined with a self-motivational orientation significantly reduced the incidence of recidivism among a sample of parents referred to child welfare for child abuse (Study 5: Chaffin et al., 2004; Study 6: Chaffin et al., 2011).

Significant Risk and Protective Factors:

  • Significant decreases at posttest for child-related parenting stress and significant increases in parenting practices which included monitoring and supervision, involvement, and discipline (Study 2: Matos et al., 2009).
  • Parents benefited from the treatment in developing a stronger sense of competence and control in their child rearing (Study 1: Nixon et al., 2003).

Study 7 (McCabe & Yeh 2009; McCabe et al., 2012)

Compared to treatment as usual, families that received the GANA intervention demonstrated significantly improved:

  • Disruptive behaviors (at posttest and long-term follow-up)
  • Parent-child interactions (at posttest)
  • Child externalizing problems (at posttest and long-term follow-up)
  • Symptoms of ADHD, oppositional defiant disorder, and conduct disorder (at posttest and long-term follow-up)

Risk and Protective Factors

  • Positive parenting behaviors (at posttest)
  • Parent stress (at posttest)
  • Parent locus of control (at long-term follow-up)

Compared to treatment as usual, families that received standard PCIT intervention demonstrated significantly improved:

  • Externalizing problems (at posttest)

Risk and Protective Factors

  • Parent stress (at posttest)

Brief Evaluation Methodology

Study 1

Nixon et al. (2003, 2004) randomly assigned 63 families to three groups: 1) the standard program, 2) the abbreviated program, and 3) a waitlist control group. Nixon et al. (2003) reported assessments at baseline, posttest, and 6-month follow-up. Nixon et al. (2004) included additional follow-up assessments done at 1 year and 2 years after the intervention. However, long-term results compared changes for the standard treatment group and for the abbreviated treatment group (no comparisons to a control group were possible).

Study 2

Matos et al. (2009) used a randomized control design involving a sample of 32 Puerto Rican families with children 4-6 years old with an ADHD diagnosis of the combined or hyperactive-impulsive type. The pretreatment assessment was followed by the intervention and then a posttest at about 3.5 months after baseline. A follow-up occurred 3.5 months after the posttest.

Study 3

Boggs et al. (2004) conducted a quasi-experimental study of 61 families who had been referred to a psychology clinic for treatment of child disruptive behavior problems.

Study 4

Leung et al. (2008) used a quasi-experimental design involving 130 families with children ages 2-8. Subjects were referred to the program by hospitals, social service agencies, schools, and parents themselves because of concerns about the behavior of children. Assessments occurred at baseline and post intervention.

Study 5

Chaffin et al. (2004) used a randomized control design with 110 parents referred to the study upon entering the child welfare system for a new confirmed physical child abuse report. Assessments included self-report questionnaires, observational coding of parent-child interactions, and administrative data from the state child welfare database, and data were collected at baseline and at posttest (after the 6-month treatment).

Study 6

Chaffin et al. (2011) conducted a randomized control design with 192 parents of children (2.5 to 12 years of age) that had been referred by a child welfare agency for neglect and/or physical abuse. Many were mandated to participate in the treatment by child welfare services. Outcome measures included self-report questionnaires, observation coding of parent-child interactions, and administrative data collected from the state child welfare database. Database matching occurred from baseline up to 3.5 years later.

Study 7

McCabe & Yeh (2009) and McCabe et al. (2012) tested the standard program and a version of the program adapted for Mexican American children using a randomized controlled trial. Families with Mexican American children ages 3-7 were randomly assigned to receive the standard program (n = 19), the version modified for Mexican American children (called Guiando a Ninos Activos or GANA, n = 21), or treatment as usual (n = 18). Several measures of child behavior problems and parenting were assessed at baseline, posttest, and long-term follow up (average of 15.9 months post-treatment).

Study 1

Nixon, R. D. V., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent-Child Interaction Therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71(2), 251-260.


Study 2

Matos, M., Bauermeister, J. J., & Bernal, G. (2009). Parent-Child Interaction Therapy for Puerto Rican preschool children with ADHD and behavior problems: A pilot efficacy study. Family Process, 48(2), 232-252.


Study 6

Chaffin, M., Funderburk, B., Bard, D., Valle, L. A., & Gurwitch, R. (2011). A combined motivation and Parent-Child Interaction Therapy package reduces child welfare recidivism in a randomized dismantling field trial. Journal of Consulting and Clinical Psychology, 79(1), 84-95.


Risk Factors

Individual: Early initiation of antisocial behavior

Family: Neglectful parenting*, Parent aggravation*, Parent stress*, Poor family management*, Psychological aggression/discipline*, Violent discipline*

Protective Factors

Family: Attachment to parents, Nonviolent Discipline*, Opportunities for prosocial involvement with parents, Rewards for prosocial involvement with parents


* Risk/Protective Factor was significantly impacted by the program

Race/Ethnicity/Gender Details

Diverse samples have been included in evaluation studies, including heavy concentrations of both Caucasian and African Americans. One study included Puerto Rican families. Cross-national generality has been demonstrated in a Chinese sample. A version of the program created for Mexican American children has also shown positive effects.

PCIT Master Trainers are certified by PCIT International to provide expert training and consultation in the official empirically supported version of PCIT for the treatment of parents and young children with disruptive behavior disorders and for parents at-risk for or requiring rehabilitation of physically abusive parenting and their child. You may contact PCIT International (pcit.international@gmail.com) for assistance in enrolling in a training course conducted at the training facility or for scheduling on-site training for therapists at your agency or practice by a certified Master Trainer within your region. PCIT Master Trainers provide training and consultation in the official version of PCIT, leading to certification as a therapist by PCIT International, the authorized organization for research and training in the empirically supported PCIT protocol.

Initial training for therapists runs from $3,000-4,000 per participant, depending upon the size of the group. It is recommended that at least two therapists from an agency be trained together. It is also suggested that a supervisor or administrator be trained. Each therapist will receive weekly consultation from the purveyor for the first year at a cost of $1,000 per therapist for the year.

Training Certification Process

Sites can choose to build local capacity to train and monitor fidelity. A train-the-trainer approach is available in a one-day training for $750.

Program Benefits (per individual): $1,159
Program Costs (per individual): $2,104
Net Present Value (Benefits minus Costs, per individual): ($945)
Measured Risk (odds of a positive Net Present Value): 27%

Source: Washington State Institute for Public Policy
All benefit-cost ratios are the most recent estimates published by The Washington State Institute for Public Policy for Blueprint programs implemented in Washington State. These ratios are based on a) meta-analysis estimates of effect size and b) monetized benefits and calculated costs for programs as delivered in the State of Washington. Caution is recommended in applying these estimates of the benefit-cost ratio to any other state or local area. They are provided as an illustration of the benefit-cost ratio found in one specific state. When feasible, local costs and monetized benefits should be used to calculate expected local benefit-cost ratios. The formula for this calculation can be found on the WSIPP website.

Start-Up Costs

Initial Training and Technical Assistance

Initial training for therapists runs from $3,000-4,000 per participant, depending upon the size of the group. It is recommended that at least two therapists from an agency be trained together. It is also suggested that a supervisor or administrator be trained.

Curriculum and Materials

Programs need to purchase toys - other curriculum costs are detailed below.

Licensing

Certification costs $200 per organization.

Other Start-Up Costs

When PCIT is delivered in the office, the model often requires modification of space, with the addition of a one-way mirror to adjacent rooms, sound equipment and toys at an estimated cost of $1,000 to $1,500.

Intervention Implementation Costs

Ongoing Curriculum and Materials

An Eyberg Child Behavior Inventory is administered weekly to each parent at a cost of $40 for 25 forms.

Staffing

Qualifications: Implementation cost is mainly comprised of salaries for therapists and supervisors. Both are expected to be licensed Master's level therapists.

Ratios: Therapists see 15-25 PCIT cases per week.

Time to Deliver Intervention: Families receive therapy for an average of 14-16 weeks per family.

Other Implementation Costs

Administrative costs including costs associated with maintaining an office for the program.

Implementation Support and Fidelity Monitoring Costs

Ongoing Training and Technical Assistance

Each therapist will receive weekly consultation from the purveyor for the first year at a cost of $1,000 per therapist for the year. In addition to the consultation provided to each therapist in his/her first year, the purveyor also offers additional training at $1,500 per participant. Sites can also choose to build local capacity to train and monitor fidelity. A train-the-trainer approach is available in a one-day training for $750.

Fidelity Monitoring and Evaluation

Fidelity tools are included in the certification and can be copied.

Ongoing License Fees

None.

Other Implementation Support and Fidelity Monitoring Costs

No information is available

Other Cost Considerations

No information is available

Year One Cost Example

Training for four therapists administrator @ $4,000 each travel $21,000.00
Space and Equipment $1,500.00
Certification @ $200 per organization $200.00
Therapist consultation from purveyor in Year 1 @ $1,000/therapist x 4 $4,000.00
Salary @ $60,000 per therapist x 4 $240,000.00
Fringe @ 30% $72,000.00
Total One Year Cost $338,700.00

If each therapist has a caseload of 20 for an average of 15 weeks per family, 280 families could be served in the first year at a cost of $1,210 per family.

Funding Overview

As a form of therapy, PCIT is commonly funded by Medicaid. Some interested communities struggle to find a source for start-up funds. The child welfare block grant funds (Title IV-B) as well as the Community Mental Health Services block grant are both potential sources of support for start-up and for services and populations not covered by Medicaid. In addition, because Parent Child Interaction Therapy requires fairly significant start-up funding and once established can be supported with a relatively stable funding source (Medicaid), debt financing could be considered for start-up costs.

Funding Strategies

Improving the Use of Existing Public Funds

Studies document that PCIT reduces conduct disorder in children and improves the quality of parenting and parent-child interactions. State child welfare agencies that support implementation of PCIT may do so as part of a strategy to prevent costly out-of-home placements, and/or to help support children in successfully transitioning home from out of out-of-home placements. State dollars saved on out-of-home placements and reentries into the system can be redirected toward expanding and sustaining the intervention.

Allocating State or Local General Funds

State funds are needed to provide the required Medicaid state match. In addition, some state agencies have provided grant funds to cover start-up costs for PCIT.

Maximizing Federal Funds

Entitlements: Medicaid is the primary funder of PCIT. It is billed as mental health therapy, either individual or family. Recipients must be Medicaid eligible. Medicaid managed care organizations can use administrative dollars and/or reinvestment funds to support start-up and fidelity monitoring.

Formula Funds: Formula funds could potentially be used for start-up costs associated with PCIT. Because the intervention is generally targeted to children with behavioral health challenges and their parents/ caretakers, behavioral health or child welfare funding streams are likely most relevant.

  • The Community Mental Health Services Block Grant (MHSBG) can fund a variety of mental health promotion and intervention activities and is a potential source of support for Parent Child Interaction Therapy programs.
  • Title IV-B, Parts 1 & 2 provides fairly flexible funding to state child welfare agencies for child welfare services including prevention and family preservation activities.

Discretionary Grants: Relevant discretionary grants are administered by the Substance Abuse and Mental Health Services Administration (SAMHSA) or the Children's Bureau within the Department of Health and Human Services.

Foundation Grants and Public-Private Partnerships

Foundations should be considered as a source of start-up funding. Developing a public-private partnership with foundations and corporate partners could enable a locality to leverage the private investment to help support start-up costs and ongoing quality monitoring efforts that may not be fully covered with Medicaid support.

Debt Financing

Because Parent Child Interaction Therapy requires fairly significant start-up funding and once established can be supported with a fairly stable funding source (Medicaid), debt financing could be considered for start-up costs. Social Impact Bonds, or Program-Related Investments from Foundations, can be considered for start-up expenses, with repayment being made from a portion of the Medicaid payment generated from delivery of the service.

Data Sources

All information comes from the responses to a questionnaire submitted by the developer of the program, Sheila Eyberg, PhD., to the Annie E. Casey Foundation.

Program Developer/Owner

Sheila Eyberg, Ph.D.University of FloridaDept. of Clinical and Health PsychologyGainesville, FL 32610USA352-273-6145352-273-6156eyberg@phhp.ufl.edu www.pcit.org

Program Outcomes

  • Antisocial-aggressive Behavior
  • Child Maltreatment
  • Conduct Problems
  • Externalizing
  • Internalizing
  • Mental Health - Other

Program Specifics

Program Type

  • Parent Training

Program Setting

  • Social Services

Continuum of Intervention

  • Indicated Prevention
  • Selective Prevention

Program Goals

A program designed for children and their parents that focuses on decreasing child behavior problems, increasing positive parent behaviors, and improving the quality of the parent-child relationship.

Population Demographics

The program is designed for caregivers and their young children (2 to 7 years old) who are experiencing social, behavioral, and/or emotional difficulties.

Target Population

Age

  • Early Childhood (3-4) - Preschool
  • Late Childhood (5-11) - K/Elementary

Gender

  • Both

Race/Ethnicity

  • All

Race/Ethnicity/Gender Details

Diverse samples have been included in evaluation studies, including heavy concentrations of both Caucasian and African Americans. One study included Puerto Rican families. Cross-national generality has been demonstrated in a Chinese sample. A version of the program created for Mexican American children has also shown positive effects.

Other Risk and Protective Factors

Risk Factors: Parental depression, parental substance abuse, high levels of family problems, general distress, co-occurring domestic violence, marital problems and broad psychosocial difficulties.

Protective Factors: Improving parent-child communication, increasing parental affection and children's self-esteem.

Risk/Protective Factor Domain

  • Individual
  • Family

Risk/Protective Factors

Risk Factors

Individual: Early initiation of antisocial behavior

Family: Neglectful parenting*, Parent aggravation*, Parent stress*, Poor family management*, Psychological aggression/discipline*, Violent discipline*

Protective Factors

Family: Attachment to parents, Nonviolent Discipline*, Opportunities for prosocial involvement with parents, Rewards for prosocial involvement with parents


*Risk/Protective Factor was significantly impacted by the program

Brief Description of the Program

Parent-Child Interaction Therapy is an intervention for children (ages 2-12 years) and their parents or caregivers that focuses on decreasing externalized child behavior problems (e.g., defiance, aggression), increasing positive parent behaviors, and improving the quality of the parent-child relationship. It teaches parents traditional play-therapy skills to improve parent-child interactions and problem-solving skills to manage new problem behaviors. Parents are taught and practice communication skills and behavior management with their children in a playroom while coached by therapists. The activities and coaching by a therapist enhance the relationship between parent and child and help parents implement non-coercive discipline strategies. The length of treatment can vary, but the standard treatment consists of 12 one-half hour weekly sessions, with a one-hour booster session one month after treatment ends. 

Description of the Program

Parent-Child Interaction Therapy (PCIT) is an intervention for children (ages 2-12 years) and their parents or caregivers that focuses on decreasing externalized child behavior problems (e.g., defiance, aggression), increasing positive parent behaviors, and improving the quality of the parent-child relationship. It teaches parents traditional play-therapy skills to improve parent-child interactions and problem-solving skills to manage new problem behaviors. Parents are taught and practice communication skills and behavior management with their children in a playroom while coached by therapists. Most parenting programs for abusive parents treat parents separately from their children and use an instructive approach, but PCIT treats parents with their children. Skills are behaviorally defined, directly coached, and practiced in parent-child sessions. Parents are shown directly how to implement specific behavioral skills with their children. Therapists observe parent-child interactions through a one-way mirror and coach the parent using a radio earphone. Live coaching and monitoring of skill acquisition are cornerstones of PCIT.

The PCIT intervention is composed of three phases. The first phase consists of orientation sessions focused on increasing parent motivation for active participation. Following the motivational enhancement orientation module, parents begin a course of approximately 12 PCIT sessions that consists of two more phases. In the child-direct interaction phase, parents allow their child to lead the play activity while they describe, imitate, and praise the child's appropriate behavior and ignore inappropriate behavior. In the parent-directed interaction phase, parents direct children's activity by using clear, positively stated direct commands and consistent consequences for their children's behavior (praise or time-outs). The goal is to enhance relationships while improving compliance.

Theoretical Rationale

The PCIT intervention is one of several derived from Hanf's original two-phase operant model for modifying maladaptive parent-child interactions and disrupting the escalating coercive cycles.These interactions and cycles produce a developmental trajectory for child behavior problems and, in some cases, for parental abuse. By disrupting the coercive cycles and improving the quality of parent-child interactions, parents act more appropriately and children learn appropriate behavior from parents.

The approach incorporates both the parent and the child (and other involved family members) in the intervention activities. The interventions combine elements of family systems, learning theory, and traditional play therapy. The therapist takes an extremely active and directive role in the process.

Theoretical Orientation

  • Skill Oriented
  • Attachment - Bonding
  • Social Learning

Brief Evaluation Methodology

Study 1

Nixon et al. (2003, 2004) randomly assigned 63 families to three groups: 1) the standard program, 2) the abbreviated program, and 3) a waitlist control group. Nixon et al. (2003) reported assessments at baseline, posttest, and 6-month follow-up. Nixon et al. (2004) included additional follow-up assessments done at 1 year and 2 years after the intervention. However, long-term results compared changes for the standard treatment group and for the abbreviated treatment group (no comparisons to a control group were possible).

Study 2

Matos et al. (2009) used a randomized control design involving a sample of 32 Puerto Rican families with children 4-6 years old with an ADHD diagnosis of the combined or hyperactive-impulsive type. The pretreatment assessment was followed by the intervention and then a posttest at about 3.5 months after baseline. A follow-up occurred 3.5 months after the posttest.

Study 3

Boggs et al. (2004) conducted a quasi-experimental study of 61 families who had been referred to a psychology clinic for treatment of child disruptive behavior problems.

Study 4

Leung et al. (2008) used a quasi-experimental design involving 130 families with children ages 2-8. Subjects were referred to the program by hospitals, social service agencies, schools, and parents themselves because of concerns about the behavior of children. Assessments occurred at baseline and post intervention.

Study 5

Chaffin et al. (2004) used a randomized control design with 110 parents referred to the study upon entering the child welfare system for a new confirmed physical child abuse report. Assessments included self-report questionnaires, observational coding of parent-child interactions, and administrative data from the state child welfare database, and data were collected at baseline and at posttest (after the 6-month treatment).

Study 6

Chaffin et al. (2011) conducted a randomized control design with 192 parents of children (2.5 to 12 years of age) that had been referred by a child welfare agency for neglect and/or physical abuse. Many were mandated to participate in the treatment by child welfare services. Outcome measures included self-report questionnaires, observation coding of parent-child interactions, and administrative data collected from the state child welfare database. Database matching occurred from baseline up to 3.5 years later.

Study 7

McCabe & Yeh (2009) and McCabe et al. (2012) tested the standard program and a version of the program adapted for Mexican American children using a randomized controlled trial. Families with Mexican American children ages 3-7 were randomly assigned to receive the standard program (n = 19), the version modified for Mexican American children (called Guiando a Ninos Activos or GANA, n = 21), or treatment as usual (n = 18). Several measures of child behavior problems and parenting were assessed at baseline, posttest, and long-term follow up (average of 15.9 months post-treatment).

Outcomes (Brief, over all studies)

Benefits came from a standard 12-session treatment and an abbreviated 5-session treatment (Study 1: Nixon et al., 2003, 2004), from implementation for preschool children (3-5) - Study 2 (Matos et al., 2009) -  and older children (8-11; for example, Study 4: Leung et al., 2008), and from versions without and with special self-motivation orientation sessions. It should be noted that the Child Abuse outcome reported in Study 6 (Chaffin et al., 2011) has only been certified when PCIT is offered with the Motivational Component.

In Study 3 (Boggs et al., 2004), parents who completed the Parent-Child Interaction Therapy reported significantly lower levels of behavioral problems among their children than parents who dropped out of the program. The effects lasted 10 to 30 months after baseline and gave evidence of sustained effects.

In Study 7, McCabe & Yeh (2009) and McCabe et al. (2012) found that GANA (a version of PCIT designed for Mexican American children), compared to treatment as usual, produced significantly better improvement in disruptive behaviors, parent-child interactions, child symptoms of ADHD, oppositional defiant disorder, and conduct disorder, positive parenting behaviors, and parent stress at posttest. GANA also had long-term effects on disruptive behavior intensity, child externalizing problems, ADHD symptoms, and parent locus of control. Standard PCIT, compared to treatment as usual, produced significantly better improvement in externalizing problems and parent stress at posttest. Standard PCIT did not produce significant improvements, relative to treatment as usual, at long-term follow up.

Outcomes

  • Both a standard 12-session treatment and an abbreviated 5-session treatment similarly reduced posttest measures of behavior problems among preschool children with oppositional defiant disorder (Study 1: Nixon et al., 2003, 2004).
  • A treatment group of Puerto Rican children ages 4-6 with diagnosed ADHD and significant behavior problems showed significantly greater improvement than the control group on posttest measures relating to hyperactivity, aggression, disruptive behavior, and positive parental practices (Study 2: Matos et al., 2009).
  • The percent of children classified as having oppositional defiant disorder dropped from 91% to 22% in treatment subjects who completed the training, while the percent dropped from 100% to 57% in treatment subjects who did not complete the training (Study 3: Boggs et al., 2004).
  • Study 4 (Leung et al., 2008) demonstrated that Chinese parents and children in Hong Kong benefitted from the program.
  • A package of Parent-Child Interaction Therapy combined with a self-motivational orientation significantly reduced the incidence of recidivism among a sample of parents referred to child welfare for child abuse (Study 5: Chaffin et al., 2004; Study 6: Chaffin et al., 2011).

Significant Risk and Protective Factors:

  • Significant decreases at posttest for child-related parenting stress and significant increases in parenting practices which included monitoring and supervision, involvement, and discipline (Study 2: Matos et al., 2009).
  • Parents benefited from the treatment in developing a stronger sense of competence and control in their child rearing (Study 1: Nixon et al., 2003).

Study 7 (McCabe & Yeh 2009; McCabe et al., 2012)

Compared to treatment as usual, families that received the GANA intervention demonstrated significantly improved:

  • Disruptive behaviors (at posttest and long-term follow-up)
  • Parent-child interactions (at posttest)
  • Child externalizing problems (at posttest and long-term follow-up)
  • Symptoms of ADHD, oppositional defiant disorder, and conduct disorder (at posttest and long-term follow-up)

Risk and Protective Factors

  • Positive parenting behaviors (at posttest)
  • Parent stress (at posttest)
  • Parent locus of control (at long-term follow-up)

Compared to treatment as usual, families that received standard PCIT intervention demonstrated significantly improved:

  • Externalizing problems (at posttest)

Risk and Protective Factors

  • Parent stress (at posttest)

Mediating Effects

Changes in parent attitudes and behaviors may be seen as mediating between the program and child behavior outcomes. Mediating effects thus showed in the influence of the program on the Parenting Stress Index, Parent Sense of Competence, (Nixon et al., 2003, 2004), Parent Locus of Control (Boggs et al., 2004), and observational measures of parent-child interaction (Nixon et al., 2003, 2004; Leung et al., 2008). Similarly, parent attitude and behaviors may be seen as mediating between the program and child abuse recidivism. Mediating effects thus showed in the influence of the program on Parent Readiness to Change and parent-child interaction observation scores (Chaffin et al., 2011).

One study performed a full mediation analysis (Chaffin et al., 2004) but found weak results. Only one of nine mediating variables examined, negative parent-child interaction, responded significantly to the program. In turn, controlling for negative parent behavior in the survival model then reduced the effect of the PCIT treatment on child abuse recidivism to insignificance.

Effect Size

The main studies reported effect sizes only for the difference between the standard and abbreviated treatments at follow-up rather than between the treatment and the control groups. These effect sizes have little value in evaluating the treatment, particularly given findings that the two treatments seldom differ significantly. The values of Cohen's d varied widely from -.23 to .53 in Nixon et al. (2003) and values of Hedges' g, a variation on Cohen's d suited for small samples, varied from -.68 to .56 in Nixon et al. (2004).

Three other studies reported generally large effects sizes for the treatment group relative to the control group. Matos et al. (2009) reported an average effect size of 1.57, and Leung et al. (2008) reported effect sizes ranging from .97 to 1.57. Boggs et al. (2004) reported effects sizes separately for their sample of completers and dropouts, and found more varied results. For completers, d ranged from .58 (medium) to 1.69 (large); for dropouts, d ranged from .12 (weak) to .58 (medium).

McCabe et al. (2012) reported medium to large effect sizes (d = .52 - .81) on long-term outcomes for a version of the program created for Mexican American children (GANA).

Generalizability

The program showed cross-cultural generality. Positive results emerged in samples from the United States (Chaffin et al., 2004, 2011; Boggs et al., 2004), Australia (Nixon et al., 2003, 2004), Puerto Rico (Matos et al., 2009), and Hong Kong (Leung et al., 2008). The samples in the studies came from families with major child disruptive behavior or child abuse and tended to have lower socioeconomic status than the general population. Additionally, an adapted version of the program (GANA) showed similar positive results for Mexican American children.

Potential Limitations

Study 1- Study 4 suffered from the following limitations:

  • Tests for differential attrition were incomplete (Study 1: Nixon et al., 2003).
  • Study 2 (Matos et al., 2009), Study 3 (Boggs et al., 2004) and Study 4 (Leung et al., 2008) used measures based on self-reports of parents who participated in the program and might be biased toward reporting improved behavior in the children.
  • Study 4 (Leung et al., 2008) was a quasi-experimental study that found numerous baseline differences between the groups.

Study 7 - McCabe & Yeh (2009); McCabe et al. (2012):

  • Incomplete tests for baseline equivalence
  • Incomplete tests for differential attrition
  • Pilot study and relatively small sample
  • Effects only on non-independent measures

Notes

PCIT for child abuse has been certified only with the addition of the motivational component.

Endorsements

Blueprints: Promising
SAMHSA : 3.1-3.9

Program Information Contact

PCIT International
P.O. Box 1591
High Springs, FL 32655
Email: pcit.international@gmail.com
www.pcit.org

References

Study 1

Certified Nixon, R. D. V., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent-Child Interaction Therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71(2), 251-260.

Nixon, R. D. V., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2004). Parent-Child Interaction Therapy: One- and two-year follow-up of standard and abbreviated treatments for oppositional preschoolers. Journal of Abnormal Child Psychology, 32(3), 263-271.

Study 2

Certified Matos, M., Bauermeister, J. J., & Bernal, G. (2009). Parent-Child Interaction Therapy for Puerto Rican preschool children with ADHD and behavior problems: A pilot efficacy study. Family Process, 48(2), 232-252.

Study 3

Boggs, S. R., Eyberg, S. M., Edwards, D. L., Rayfield, A., Jacobs, J., Bagner, D., & Hood, K. K. (2004). Outcomes of Parent-Child Interaction Therapy: A comparison of treatment completers and study dropouts one to three years later. Child & Family Behavior Therapy, 26(4), 1-22.

Study 4

Leung, C., Tsang, S., Heung, K., & Yiu, I. (2008). Effectiveness of Parent-Child Interaction Therapy (PCIT) among Chinese families. Research on Social Work Practice, 19(3), 304-313.

Study 5

Chaffin, M., Silovsky, J. F., Funderburk, B., Valle, L. A., Brestan, E. V., Balachova, T., . . . Bonner, B. L. (2004). Parent-Child Interaction Therapy with physically abusive parents: Efficacy for reducing future abuse reports. Journal of Consulting and Clinical Psychology, 72(3), 500-510.

Study 6

Certified Chaffin, M., Funderburk, B., Bard, D., Valle, L. A., & Gurwitch, R. (2011). A combined motivation and Parent-Child Interaction Therapy package reduces child welfare recidivism in a randomized dismantling field trial. Journal of Consulting and Clinical Psychology, 79(1), 84-95.

Study 7

McCabe, K., & Yeh, M. (2009). Parent-Child Interaction Therapy for Mexican Americans: A randomized clinical trial. Journal of Clinical Child and Adolescent Psychology, 38(5), 753-759. doi:10.1080/15374410903103544

McCabe, K., Yeh, M., Lau, A., & Argote, C. B. (2012). Parent-Child Interaction Therapy for Mexican Americans: Results of a pilot randomized clinical trial at follow-up. Behavior Therapy43(3), 606-618. doi:10.1016/j.beth.2011.11.001

Study 1

Evaluation Methodology

Design: The two papers used a randomized control design in which sampled children with behavior problems (called the clinical sample) were randomly assigned to treatment or control groups. The design included an additional sample of children without behavioral difficulties (called the non-problem sample). This sample obviously differed from the clinical sample at baseline but was not used to test the efficacy of the treatment. The goal was to see if treatment groups reached the levels of the non-problem sample at posttest and follow-up.

Recruitment of treatment subjects came from responses to announcements of a free treatment program for preschool-aged children exhibiting behavioral difficulties. To be included, the child needed to be diagnosed for oppositional defiant disorder, have had symptoms for 6 months, and score in the clinical range on the Eyberg Child Behavior Inventory. Past traumatic experiences, severe physical or mental deficits, or current use of medication disqualified potential subjects. Of 71 families volunteering to participate, 54 were used in the analysis.

The study assigned subject families to three groups: 1) the standard PCIT, 2) the abbreviated PCIT, and 3) a waitlist control group. The standard PCIT group began with 22 families and 5 (23%) dropped out. The abbreviated PCIT group began with 23 families and 3 (13%) dropped out. The waitlist control group began with 18 families and 1 (6%) dropped out. The three conditions thus ended up with final sample sizes of 17, 20, and 17, a total sample size of 54, and a total attrition rate of 14%. It is not clear if the investigators attempted to follow up the dropouts and if the study met the intent-to-treat criterion.

The other sample of non-problem families had 21 volunteers recruited from newspaper advertisements. They needed to meet the opposite inclusion criteria: no diagnosis of the child as having oppositional defiant disorder, no parent reports of having trouble managing their child's behavior, scores on the Eyberg Child Behavior Inventory in the normal range.

In the first paper (Nixon et al., 2003), assessments occurred at baseline, posttest, and 6-month follow-up. Normally, PCIT lasts until the parent has mastered the skills and the child no longer meets the criteria for oppositional defiant disorder, but this study used a set number of sessions to compare the standard and abbreviated forms of the program. The standard program treatment consisted of 12 1-2 hour weekly sessions; the abbreviated program treatment consisted of 5 face-to-face sessions with five 30-minute phone consultations and access to videotaped instruction. Both treatments included a 1-hour booster session that occurred one month after treatment.

In the second paper (Nixon et al., 2004), additional follow-up assessments were done at 1 year and 2 years after the intervention. At the 1-year follow-up, 53 of 54 families completed the assessment and at the 2-year follow-up, 52 of 54 families completed the assessment. The 1-year assessment included parent report and observational data, but the 2-year assessment included parent reports only - done by phone and mail-back questionnaire. Further, the 2-year assessment contained substantial missing data: Only 10 of 16 in the standard treatment group returned questionnaires.

None of the follow-up assessments allowed for a control-group comparison because waitlist subjects entered the therapy after posttest.

Sample Characteristics: For the clinical group, the children had an average age of 4 and were mostly male. Mothers and fathers of these children were on average age 34, nearly all were Caucasian, and most were married. The parents averaged 12 years or less of education. The children in the non-problem sample were mostly male and 4 years old on average. Their parents on average had some technical or college education.

Measures: The DSM-IV was used to diagnose baseline oppositional defiant disorder among the clinical sample children. Other measures came in four forms: 1) parent reports on children, 2) parent self-report, 3) investigator observations of parent-child interactions, and 4) classification of scores into clinical categories.

Parent Report of Child Behavior. Mothers' perceptions of children's behavior came from established instruments: the Eyberg Child Behavior Inventory, the externalizing subscale of the Child Behavior Checklist, and the Home Situations Questionnaire - Modified.

Parenting Attitudes and Discipline Methods.

  • Parenting Stress Index, a measure of frustration and low fulfillment (reliability established in other studies).
  • Parent Sense of Competence Index, a measure of self-esteem and efficacy in the parenting role (test-retest reliability ranging from .46 to .82).
  • Parent Locus of Control, a measure of the degree to which parents feel they can influence their child's behavior (alpha = .92).
  • Parenting Scale, a measure of dysfunctional discipline practices such as laxness, over-reactivity, and verbosity (alpha = .82)

Independent Assessment of Child and Parent Behavior. Investigators videotaped a set of structured interactions between the parent and child and coded behaviors using the Dyadic Parent-Interaction Coding Systems - II. The codes measured parental praise, criticisms, and commands and child compliance and deviant behavior. An undergraduate student performed the coding after going through 40 hours of training. The coder was blind to the group membership and ratings were checked by the study leader. Test-retest reliability was .91.

Clinical Classification. Measures from mother's reports of child behavior and observations were used to 1) classify children as normal or clinical, 2) assess movement from clinical to normal, and 3) identify significant improvement (such as a 30% change in an outcome).

Analysis: For comparison of the three groups in the clinical sample, the outcomes were examined with ANCOVAs and baseline measures as covariates. Planned contrasts involved standard treatment versus waitlist control, abbreviated treatment versus waitlist control, and standard treatment versus abbreviated treatment. The text first reported unadjusted significance tests but later reported results with Bonferroni adjustments for non-independence of the outcomes.

The 1-year follow-up performed an intent-to-treat analysis by estimating missing data with the method of carrying the last observation forward. It also examined a subsample of those who completed all sessions.

Outcomes

Implementation Fidelity: Sessions were videotaped and 20% were coded for treatment adherence. Average therapist accuracy was 99%. Outside clinical psychologists rated the proficiency of the therapists as, on average, 7.24 and 7.71 on a scale ranging from 0 (poor) to 10 (excellent).

Baseline Equivalence: A series of ANOVAs on parent-report and observation data for the three clinical conditions did not reveal any difference on the baseline variables.

The clinical sample was equivalent to the non-problem sample on all demographic variables except maternal education, with the clinical sample having lower levels than the non-problem sample. However, mother's education had no relationship with any of the outcome measures. The clinical sample appropriately differed from the non-problem sample on the outcomes.

Differential Attrition: The authors say only that "Completers and noncompleters did not differ on any demographic or pretreatment variables."

Nixon et al., 2003: Posttest and 6-Month Follow-Up

Posttest: Results for the clinical sample for the continuous and classification measures were supplemented by results for the non-problem sample.

Continuous Measures. Tests of the program effects included five parent-report measures, four parent behavior measures, and five independent observations - a total of 14 outcome measures. The standard treatment did significantly better than the waitlist control group on 10 of the 14 outcomes, and the abbreviated treatment did better than the waitlist control group on 9 of the 14 outcomes. The significant effects occurred for each of the different types of measures (parent reports, parent behaviors, and observations). However, additional tests qualified these positive findings. The authors reported results that adjusted for the non-independence of the 14 outcomes. Using a Bonferroni standard of p = .05/14, they found significant benefits of the standard treatment for only 3 of 14 outcomes and significant benefits of the abbreviated treatment for only 3 of 14 outcomes.

Comparing the standard to the abbreviated treatment revealed no significant differences. Additional tests examined whether or not the outcome means at follow-up for the two groups differed by more than one standard deviation. These tests largely confirmed the equivalence of the two types of treatment.

Classification Measures. Tests for nine clinical classification measures largely confirmed the benefits of the standard treatment but less so for the abbreviated treatment. The standard treatment did significantly better than the waitlist control on seven of nine measures, and the abbreviated treatment did significantly better than the waitlist control group on three of nine measures. The standard treatment did significantly better than the abbreviated treatment on one outcome.

Comparisons to Non-Problem Group. The standard treatment and abbreviated treatment groups, although improved relative to the control group, continued to report significantly more behavior problems on most outcome measures than the non-problem group.

6-Month Follow-Up: Treatment of the waitlist group after the posttest prevented comparison of the control and treatment groups during the follow-up period. Comparisons of the standard and abbreviated treatment on measures of clinical classification showed, much like at posttest, no differences. The lack of main effects for time indicated that both groups maintained gains from posttest to follow-up.

Nixon et al., 2004: 1-year and 2-Year Follow-Up

1-Year Follow-Up: Results compared changes from baseline to the 1-year follow-up for the standard treatment group and for the abbreviated treatment group (no comparisons to a control group were possible). The tables presented results for both an intent-to-treat sample with imputed missing data and a completer sample of subjects who attended all sessions. However, the results differed little for the two samples.

For the continuous measures, the standard treatment group showed significant improvement on eight of nine measures, while the abbreviated treatment group showed significant improvement on six of nine measures. The trend over time did not differ significantly for the two groups. The measures failing to change significantly for one or both of the treatment groups included observational counts of mother criticisms, child compliance, and child deviance.

For the classification measures, the two groups showed similar percentages of families making significant change for the better, but the standard treatment tended to show somewhat more change than the abbreviated treatment.

2-Year Follow-Up: Because of new measures used in the phone and mail-back questionnaires at the 2-year follow-up, the tables do not examine changes over time. Also, response rates for the questionnaire were low. That said, the results indicated no differences between the standard and abbreviated treatment groups after 2 years.

Study 2

Evaluation Methodology

Design : The study used a randomized control design. A sample of 32 families was selected from children referred to the program by preschool centers and from parents responding to newspaper, TV, or radio ads. The sample was specialized. According to the inclusion criteria, the children must have had the following characteristics:

  • 4-6 years old and attending a preschool program,
  • hyperactivity and behavior problems, as reported by parents,
  • an ADHD diagnosis of the combined or hyperactive-impulsive type,
  • an IQ equal to or greater than 80,
  • no significant developmental difficulty,
  • a Puerto Rican mother who lived with them,
  • not receiving stimulant or psychotropic medication,
  • parental agreement of no other form of therapy.

Other inclusion criteria for parents included the absence of domestic violence, mental retardation, severe major depression, substance abuse, and psychopathology. Further, the sample excluded children with ADHD of the inattentive type because it typically begins at later ages and presents lower risk for problem behavior.

Of the 128 children referred to the study, 89 were excluded, leaving 39 who fit the criteria. Of these, 7 did not show up or agree to participate and 32 were randomized to the PCIT (n = 20) or waitlist (n = 12) conditions.

For the intervention, a therapist met individually with each family in a weekly 90-minute session. Since the therapy ended when parents demonstrated mastery of the program skills, some families attended more sessions than others. Control group members were contacted monthly by phone but received no treatment.

The pretreatment assessment was followed by the intervention and then a posttest done about 3.5 months after baseline. A follow-up occurred 3.5 months after the posttest. Given the use of a waitlist control group that received the opportunity to participate in the therapy after the posttest, the study could not make follow-up comparisons of the treatment and control groups.

All subjects completed the posttest and were included in the analysis. As appropriate for intent-to-treat analysis, the one PCIT subject who did not complete the treatment was included in the analysis. However, the data contained missing values for 3% of the sample at posttest and 9% at follow-up.

Measures: The numerous measures have accepted reliability for Puerto Rican samples or demonstrated reliability from other studies.

  • The Disruptive Behavior Scale for Children included numerous ADHD items rated by a clinician.
  • The Hyperactivity and Aggression Subscales of the Behavioral Assessment System for Children-Parent Rating Scale provided parental ratings of children's behavior.
  • The Peabody Picture Vocabulary Test was used as an indicator of intelligence.
  • The NIMH Diagnostic Interview Schedule for Children IV - Parent Version focused on the presence among children of ADHD, anxiety disorders, and depression as rated by clinicians.
  • The Children's Global Assessment Scale yielded clinician ratings of impairment in adaptive functioning.
  • The Eyberg Child Behavior Inventory came from a 36-item parent report on the frequency and number of conduct problem behaviors.
  • The Family Experiences Inventory measured stressful experiences reported by the mother.
  • The Parent Practices Inventory measured parental monitoring, supervision, involvement, and discipline.
  • The Beck Depression Inventory measured depression among parents.
  • The Treatment Evaluation Scale measured parent satisfaction with treatment.
  • The Therapy Attitude Inventory measured the impact of the training on dealing with children.

Analysis: The analysis compared the intervention and control groups with ANCOVA and baseline scores treated as covariates. An alpha level of .0125 was used, with the .05 level "divided by the number of secondary outcomes (4)."

Values were imputed for the 3% missing data at posttest and 9% missing data at follow-up. The imputation was justified by a statement that "There was no identifiable pattern for the small percentage of missing data" and "no significant differences in participation of evaluation sessions as a function of treatment condition."

Outcomes

Implementation Fidelity: The investigators evaluated the content of each parent-child interaction therapy session with a checklist of therapist's actions and met weekly with therapists to review past sessions and plan future sessions. All treatment sessions were videotaped and analysis of a 20% random sample showed an integrity rate of 98%.

Baseline Equivalence: At baseline, children in the treatment and waitlist group did not differ significantly on gender, IQ, parent's sociodemographic characteristics, family structure, or the numerous outcome measures.

Differential Attrition: All subjects were included in the analysis. The small percentages missing data at posttest and follow-up were included with imputed values.

Posttest: The treatment group demonstrated significantly better outcomes on all six of the primary measures (relating to hyperactivity, aggression, and problems of the child) and on three of the four secondary measures (relating to parent and family outcomes).

To further illustrate the clinical significance of the effects, the percentage of children who moved out of the dysfunctional range on the six primary measures ranged between 50-75% in the intervention group and between 0-25% in the control group.

Long-Term: Comparisons could not be made with the waitlist control group, which had started the treatment by the time of the follow-up assessment. Alternatively, the analyses showed no significant differences between the intervention group means at the posttest and follow-up for the primary and secondary outcomes. Thus, the improvements appeared to be sustained in absolute terms.

Mediating Effects

None reported.

Effect Size

Effect sizes for the primary measures were large, averaging 1.57.

Generalizability

The sample was narrowly defined to have a specific type of ADHD but also have no major developmental delays, parental problems, or other therapy. The results show applicability of the program to Spanish-speaking Puerto Rican children.

Limitations

  • The follow-up assessment occurred only 3.5 months after intervention and did not have a control group comparison.
  • The key outcome measures came from parent reports. Those parents participating in the treatment may be biased toward finding improvement in their child's behavior.

Study 3

Evaluation Methodology

Design: The data came from a quasi-experimental study of 61 families who, in the initial study, had been referred to a psychology clinic for treatment of child disruptive behavior problems. The children were diagnosed as having oppositional defiant disorder and often comorbid conditions of conduct disorder and ADHD. The sample included children taking medication, as long as the medication dose would not change during the study. The sample excluded children with mental or physical disabilities or with parents having an IQ below 70. Families were randomly assigned to an intervention or a 4-month waitlist control group.

Dropouts from the original study are crucial for this follow-up study. Of the 33 families in the intervention group, 14 dropped out before completing the training. Of the 28 families in the control group, 17 dropped out while on the waitlist or while in treatment. For this study, all 61 families, both dropouts and completers, were contacted and 46 (75%) agreed to participate and returned questionnaires - 23 completers and 23 dropouts. The 75% willing to participate came equally from those completing and not completing the original treatment, allowing sufficient cases for comparisons of those receiving full treatment to those receiving partial treatment.

The follow-up assessment occurred on average 19.59 months after the pretest of the original study. Since some families started the program earlier than others, the time between the pretest and follow-up assessments varied from 10 to 30 months. The original study appeared to last 4 months, so the follow-up period ranged from 6 months to 26 months. Most but not all subjects were tested at least a year after the end of the intervention.

Sample Characteristics: The 46 children in the follow-up sample were mostly boys (78%), Caucasian (74%), and African American (15%). The mean age at original enrollment was 4 years, 11 months, but at the time of the follow-up they had reached an average of 6 years, 7 months.

Measures: The measures all came from the responses of parents, either over the phone or by mail-back questionnaire. The measures replicated those used in the original study.

The DSM-III-R Structured Interview for Disruptive Behavior Disorders was administered to the child's mother by telephone, but the researchers diagnosed the presence of the disorder. Studies have reported high levels of inter-rater agreement on this instrument. It is not clear if those who diagnosed the disorder were blind to group membership.

The Eyberg Child Behavior Inventory included 1) an Intensity Scale for the frequency of disruptive behavior and 2) a Problem Scale for parental tolerance of the child's behavior. These scales have been shown to have high reliability.

The Parenting Stress Index had a parent domain with items focusing on stress in the parent role and a child domain with items focusing on child behaviors that make it hard to develop a relationship. Other studies have reported high reliability for the index and domain subscales.

The Parent Locus of Control Scale focused on the parenting role and parent-child interactions. An alpha reliability of .81 has been reported for the scale.

The Therapy Attitude Inventory was designed to assess parent satisfaction with participation in parent training, family therapy, or parent-child therapy. The scale has been shown to have high reliability and correlate with changes in outcome measures.

Analysis: Analysis was intent-to-treat. Estimates of group-by-time interactions came from repeated-measures ANOVAs with controls for baseline values of the outcomes.

Outcomes

Implementation Fidelity: Since this follow-up study did not perform the intervention, implementation fidelity was not an issue.

Baseline Equivalence and Differential Attrition: For this study, the effectiveness of the randomization in the original study has less relevance than the difference between the completers and dropouts in this follow-up study. The quasi-experimental design made it crucial to demonstrate no differences at baseline between the completers and dropouts who agreed to participate in the follow-up.

Chi-square and t-test comparisons of the pretreatment characteristics of the completers and dropouts showed no significant differences on sociodemographics of parents and children, presence of conduct disorder, presence of ADHD, use of medication, child IQ, and child symptoms. Among the five outcome variables, one differed significantly - the Parenting Stress Index (child domain) was higher in the dropout group than the completer group.

Appropriately, the only significant difference was in the number of treatment sessions attended, with completers attending nearly four times as many as dropouts.

However, the dropout sample appears to have higher scores on the problem behaviors. With the small sample size of 46, some fairly large differences did not reach significance. For example, 30% of the completers were from single parent families compared to 57% of the dropouts. And 13% of the completers had comorbid conduct disorder compared to 30% of the dropouts. Thus, the dropout group had greater risks than the completer group.

Long-term: F tests for the group-by-time interactions were significant for four of five outcome measures. The completers improved significantly more from baseline than the dropouts on all four measures of child behavior but not on the Parent Locus of Control Scale.

The results also showed significantly different changes in the percentage of children meeting diagnostic criteria for oppositional defiant disorder, ADHD, and conduct disorder. For example, at baseline, 21 of 23 in the intervention group and 23 of 23 in the control group were classified as having oppositional defiant disorder. At follow-up, 5 of 23 (22%) in the intervention group and 13 of 23 (57%) in the control group were so classified.

Dose-Response: The design of the study in which dropouts participated in fewer sessions than completers is similar to a dose-response model, but the study did not specifically examine the influence of sessions attended on the outcomes. Rather it compared all completers and all dropouts as separate groups.

Mediating Effects

The Parent Locus of Control Scale may be seen as mediating between the program and child behavior outcomes, but it did not show significant differences between the conditions.

Effect Size

The study calculated Cohen's d values for the change from baseline to follow-up within the completer group and within the dropout group. For completers, d ranged from .58 (medium) to 1.69 (large); for dropouts, d ranged from .12 (weak) to .52 (medium).

Generalizability

The findings apply to families with children ages 4-5 who have serious behavioral problems. No other information is provided on the socioeconomic characteristics or geographical location of the subjects.

Limitations

  • The quasi-experimental design requires the assumption that the subjects in the completer and dropout groups who were assessed at the follow-up were equivalent at baseline. Baseline comparisons showed few differences in observed characteristics and suggest equivalence, but the likelihood of differences in unmeasured characteristics remains and limits internal validity.
  • The measures came largely from the mothers, who might have been influenced in their response by participation in the study. Measures based on diagnoses made from responses of the parents might also be biased. No other measures such as from teachers were available to validate the results reported by parents.

Study 4

Evaluation Methodology

Design: The study used a quasi-experimental design. Subjects were referred to the program by hospitals, social service agencies, schools, and parents themselves because of concerns about the behavior of children. The children, limited to ages 2 to 8, had to meet certain unspecified inclusion criteria, probably those applied in other studies. All these subjects were assigned to the intervention. The control group was recruited separately from the intervention group and during a period from up to 12 months later. They came from referrals for parent training from preschools and primary schools and therefore appear to differ from the intervention group.

The intervention group had 53 dyads and the control group had 77 dyads. The intervention group underwent 1-hour sessions each week and ended when parents had mastered the skills and child behavior fell within normal limits. Assessments occurred at baseline, post intervention, and 6-month follow-up. The comparisons group completed baseline and posttest assessments but, having been designated as waiting for intervention, did not complete a follow-up assessment.

The sample experienced modest attrition by posttest. Of the 130 participations, 110 had complete data at the posttest. In the intervention group, 48 of 53 (89%) subjects completed the posttest, while in the control group, 62 of 77 (81%) subjects completed the posttest. Incomplete data in the intervention group resulted from program dropouts, who cited personal, health, or family problems as reasons for attrition. Incomplete data for the control group came from inability of investigators to find or contact the subjects. A note that seven of the intervention group subjects dropped out before completing the treatment but had nonetheless participated in the posttest indicates that the design satisfied the intent-to-treat criterion.

Attrition reached higher levels by the follow-up assessment. Data was obtained on 34 of the 54 (63%) subjects in the intervention group.

Measures: Along with sociodemographic information about parents and children, the study obtained data on several outcome measures. Most of the measures came from parent self-reports rather than unbiased observers and might be subject to misreporting. Observational measures coded by the investigators provided a check on the self-report but were done only for the intervention group and again might be biased toward finding a program effect.

Parent Report Measures. The Eyberg Child Behavior Inventory included 1) an Intensity Scale for the frequency of disruptive behavior and 2) a Problem Scale for parental tolerance of the child's behavior. The Chinese versions of these scales had reliabilities above .7 for the intervention and comparison groups. Cutoff scores of 131 for the Intensity Scale and 15 for the Problem Scale indicated serious behavioral problems.

The Parenting Stress Index has 36 items that measure three factors: parental distress, parent-child dysfunctional interaction, and difficult child. A total score from the three scales can also be calculated. With one exception, reliabilities exceeded .7.

Observational Measures. The Dyadic Parent-Child Interaction Coding System - II was used to code observed parent-child interactions at a clinical setting. The codes measured six behaviors: questions, criticisms, commands, descriptions, reflections, and praise. These measures were available only for the intervention group. At the time of the observations, investigators also asked parents about the frequency of corporal punishment during the previous month.

Analysis: ANCOVAs included controls for gender and baseline outcomes, many of which differed significantly across groups.

Outcomes

Fidelity Implementation: Social workers with 56 hours of training and 200 hours of supervision served as therapists for the parent-child interaction.

Baseline Equivalence: Likely due to the non-random assignment of subjects, the study failed to establish baseline equivalence. The treatment and control groups differed significantly at baseline on gender, the Eyberg Intensity Scale, the Eyberg Problem Scale, the Parenting Stress Index, the Parenting Stress index parent-child dysfunctional interaction measure, and the Parenting Stress Index difficult child measure.

Differential Attrition: Participants with complete and incomplete data did not differ significantly on baseline child behavior, parenting stress, or sociodemographic characteristics. In comparing dropouts across conditions, only one significant difference emerged: Those with incomplete data in the intervention group had higher baseline scores on the Parenting Stress Index than those with incomplete data in the control group.

A check on attrition imputed values for participants with incomplete data by assuming no change (i.e., substituting the baseline score for the missing posttest score). The results replicated those reported below for the sub-sample with complete data.

Posttest: The results showed significantly lower posttest scores for the intervention on six key outcomes: the Eyberg Intensity Scale, the Eyberg Problem Scale, the Parenting Stress Index total score, and all three Parenting Stress Index subscales. Effect sizes ranged from .97 to 1.59. To illustrate, among the intervention families with Eyberg scores above the cutoff for serious behavioral problems, 71% had scores below the cutoffs at posttest. Among the control families with scores above the cutoffs, 16% had scores below the cutoffs at posttest.

Long-term: Because of the waitlist control group, the follow-up examined maintenance of change among the intervention group rather than maintenance of differences between the intervention and control groups. Consistent with but not proof of sustained effects, the results showed a significant drop in the posttest and follow-up scores from baseline and no significant difference between the posttest and follow-up scores.

Mediating Effects

The analyses examined program effects on the observational measures of parent-child interaction. However, the measures were available only for the intervention group and allowed for no comparisons with the control group at either posttest or follow-up. The scores showed significant improvements from baseline to both posttest and follow-up. Similarly, a measure of the use of corporal punishment declined significantly from baseline to posttest and follow-up.

Effect Size

Reported values on Cohen's d (between .97 and 1.57) indicated large effect sizes.

Generalizability

The positive results for a Chinese sample of Hong Kong residents confirmed results for western nations and indicate the cross-cultural generality of the program. The program was modified in some ways to fit the Chinese culture, but the basic therapeutic philosophy remained.

Limitations

  • The quasi-experimental design meant the intervention group likely included more highly motivated subjects with interest in the program than the control group. The differences in recruitment resulted in numerous baseline differences between the groups.
  • The waitlist design prevented comparisons between the intervention and control groups from posttest to follow-up.
  • Imputed missing data at posttest relied on the overly simple assumption that no change occurred from baseline to posttest for the dropouts (i.e., baseline scores were substituted for missing posttest scores).

Study 5

Evaluation Methodology

Design: The study used a randomized control design. Abusive parents and their abused child were referred to the study upon entering the child welfare system for a new confirmed physical abuse report. Referred parents were accepted into the study if they met the following conditions: 1) the parent (including step-parent or other caregivers) and child could participate (no legal termination of parental rights had been initiated), 2) the abusive parent had an IQ of at least 70, 3) the child was between 4 and 12 years old, 4) the parent did not have a designation as a sexual abuse perpetrator, and 5) the parent provided voluntary consent to participate.

Of 300 dyads referred, 112 (37%) met the inclusion criteria and were enrolled as participants. Most of those not included declined to participate or could not be located. Data from the child welfare agency showed no difference between those enrolled and not enrolled on gender, age, race/ethnicity, family structure, or kinship ties between parent and child. However, two subjects were dropped when it became apparent that the parents could not understand or answer the assessment questions. The final sample size thus equaled 110.

Subjects were assigned to one of three conditions:

  1. PCIT. The treatment included two components: a six-session orientation group to increase parent motivation for active participation (needed because many participants are coerced into attending) plus the 12-session parent-child interaction therapy. The intervention occurred in a clinic setting.
  2. Enhanced PCIT. In addition to the standard treatment, subjects received services targeting depression, substance abuse, and domestic violence; the services were commonly provided by staff and designed to meet the particular needs of the parent.
  3. Standard Community Group. A community-based non-profit agency offered a parent training program that provided information on improving skills such as listening, discipline, stress management, and anger control. The sessions covered the same topics and lasted the same length of time as PCIT but did not involve interaction with children.

Assessment occurred at baseline and at posttest, after the 6-month treatment. The final outcome of repeated abuse incidents came from a database search after the end of treatment.

Following the intent-to-treat principle, investigators attempted to obtain 6-month posttest data on dropouts. About 25% of early dropouts and nearly all completers provided the psychometric posttest data, but an unreported number of subjects were missing posttest data. Although it is not possible to compute the attrition rate, it appears to be non-trivial. For posttest data, the researchers used multiple imputation methods. For follow-up, figures on re-reports of child abuse from a central database could be measured independent of the involvement of the subjects and contained no missing data (n = 110).

Sample Characteristics: The parents were largely female (65%) and had a mean age of 32 years. About 34% were married at baseline, 52% were white, 40% were African American, and 27% had some college or a college degree. Over 62% were characterized as living below the poverty line, and 64% received some form of public assistance.

Subjects on average were referred for two prior child welfare physical abuse reports and two child welfare neglect reports. IQ scores ranged from 70 to 114 with a mean of 95. About one-third had symptoms of a lifetime alcohol or drug disorder. Antisocial personality disorder (16%) and depression (22%) were common.

Measures: Data came from three sources: 1) self-report questionnaires, 2) observational coding of parent-child interactions, and 3) administrative data from the state child welfare database. Questionnaire data was obtained at baseline, after the six-session orientation program, and after the 12-session parenting program. Observation coding occurred at the same three times. Database matching occurred for a median follow-up time of 850 days.

The Child Abuse Potential Inventory used a 160-item questionnaire and four subscales to estimate risk for committing child abuse (alpha reliability ranged from .79 to .94 for the four subscales).

The Behavioral Assessment for Children used parent and, if possible, teacher reports to measure adaptive as well as problematic behaviors of children. It had temporal stability and internal consistency scores ranging from the mid .70s to the low .90s.

The Dyadic Parent-Child Interaction Coding System - II was used to code observed parent-child interactions during structured tasks. The coding scheme corresponded to the goals of the parent-child interaction therapy and therefore served as a measure of skills learned in the program. The correlation between the study scores with scores given by off-site coders was .94 for negative behaviors and .84 for positive behaviors.

The Abuse Dimensions Inventory rates the severity of sexual and/or physical abuse on the basis of written child welfare investigation information and/or an interview with the child welfare worker. The mean interrelated reliability was .76.

The Child Neglect Index was coded based on a review of written child welfare investigation information and/or an interview with the child welfare worker.

The Beck Depression Inventory is a 21-item self-report measure (alpha = .90).

The follow-up measure of re-reports came from checks of the central state child welfare database. The checks made certain to find matches on multiple criteria and avoid duplication.

Analysis: The study used survival analysis to model the timing to the first instance of abuse contained in the child welfare database. The study lacked details on the dates for which the subjects were followed but noted a median follow-up period of 850 days. The analysis did not control for exposure to child abuse, as a later study did (Study 6). Not measuring survival for the period in which the parent had access to the child might exaggerate the influence of the program (those most prone to abuse their children would be most likely to lose parental rights and show unusually long survival). However, the bias should work similarly across all groups.

Outcomes

Implementation Fidelity: Supervisors observed parent-child sessions and completed adherence checklists. Average protocol adherence reached 93%.

Measures of individual treatment services obtained by parents demonstrated expected differences between the PCIT and enhanced PCIT groups. Information on the number of referrals and the sessions attended (outside the parenting program) came from study organizers. Missing data were imputed on sessions attended for less than 10% of the cases. Group comparisons showed, as expected, that subjects in the enhanced PCIT condition received significantly more outside services and attended more outside sessions than the other groups. The mean number of additional service sessions was 9.3 for the enhanced condition and 1.9 for the other two groups. About 79% of the enhanced group received outside services compared to 32% in PCIT and 20% in the control. Investigators made sure that outside therapists did not counsel parents in parent skills that were obviously inconsistent with PCIT skills.

Baseline Equivalence: No significant baseline differences existed for measures of abuse, family characteristics, child characteristics, parent sociodemographic characteristics, lifetime drug use, alcohol symptoms, depression, or antisocial personality symptoms.

Differential Attrition: The PCIT and enhanced PCIT conditions had better retention than the community control condition. A three-category measure identified subjects who dropped out during the orientation, subjects who completed the orientation but less than half the core parenting program, and subjects who completed the orientation and most of the core parenting program. Controls for the categorical attrition pattern and the attrition pattern by condition did not significantly influence survival. This finding indicates that differential attrition did not bias the results.

Long-term: Re-reports of child abuse occurred for 19% of the PCIT condition, 36% of the enhanced PCIT condition, and 49% of the community group. Consistent with the percentages, the PCIT condition had significantly better survival than the control condition (p = .02). The enhanced PCIT group did worse than the PCIT group but not significantly so (p = .13). The enhanced PCIT did better than the control group in timing to recidivism but again not significantly so.

The results held across gender and race/ethnic groups and across younger as well as older children.

Mediating Effects

Table 1 reported posttest results for nine mediating psychometric instruments. The measures included items on parent reports of internalizing and externalizing behavior of children, the Child Abuse Potential Inventory scale and its four subscales, and observational measure of positive and negative parenting behaviors.

Improvements over time differed significantly between the treatments (both PCIT and enhanced PCIT) and the control group on only one of the outcomes - negative parent behavior. Controlling for negative parent behavior in the survival model then reduced the effect of the PCIT program treatment on recidivism to insignificance. This result provided evidence of mediation, but results for eight other outcomes were not supportive.

Effect Size

Given the focus of the survival analysis on length of time to recidivism, no effect sizes were reported.

Generalizability

The sample and results came from a single child welfare agency in an unknown location.

Limitations

The study had a strong randomized design and evidence of baseline equivalence and similar attrition across groups. Problems included:

  • The measure of recidivism based on official records likely underestimated the true extent of parental abuse.
  • Group comparisons were biased by differences in risk exposure.
  • Only weak evidence emerged for the influence of the posited mediating mechanisms.

Study 6

Evaluation Methodology

Design: The study used a randomized control design. Subject parents were referred to the program by a child welfare agency for neglect and/or physical abuse. The agency was located in the inner city and contracted with the state system to operate a parenting program. The parents had to have a child ages 2.5 to 12 who would be permitted to participate in the parent-child interaction therapy. Many were mandated to participate in the treatment by child welfare services. Parents were excluded if they had an IQ below 65 or previously received the treatment. Enrollment occurred between January 2004 and August 2006.

The analysis sample included 153 parents. Recruitment began with 291 parents approached to participate in the study, but 42 declined, 38 were not eligible, and 19 failed to complete the pretest. The remaining 192 (66%) were randomized, but 21 lost parental rights and were removed, 11 refused services, and 7 dropped out. The remaining 153 biological parents, step-parents, or primary caregivers comprised the analysis sample and an attrition rate of 20% of those randomized. No attrition occurred among the 153 parents over the remainder of the program. Efforts to follow all subjects meet the intent-to-treat criterion.

Randomization occurred in two steps, first for the orientation conditions and then for the therapy conditions. The first randomization assigned 192 parents to either a self-motivation orientation condition or a usual orientation condition. The self-motivation orientation involved meetings without the children and included activities to highlight the benefits of the program; the usual orientation was primarily informational and educational.

The second randomization assigned the 153 parents remaining after the orientation to a parent-child interaction condition or a service-as-usual condition. The parent-child interaction condition followed program guidelines to promote positive interaction between both parent and child; the service-as-usual sessions provided information to the parent on child development, reasonable expectations, compassionate parenting, and the value of empathy.

The sequential randomization thus defined four conditions: 1) self-motivation orientation and parent-child interaction therapy; 2) usual orientation and parent-child interaction therapy; 3) self-motivation orientation and service-as-usual; and 4) usual orientation and service-as-usual (i.e., control). The design allowed for the analysis to disentangle the benefits of the orientation from the benefits of the therapy.

The program included six orientation sessions and 12 parenting sessions. Assessments occurred at baseline, after the six-session orientation, and after the 12 sessions of the parenting program. The length of the intervention varied across subjects, making it difficult to pinpoint a specific end, but the median time from baseline to collection of post-treatment data was 247 days. The period of follow-up differed as well, but the median was 2.5 years.

Sample Characteristics: Participants were 75% women with a mean age of 29. By race/ethnicity, 60% were white, 19% African American, 9% Native American, 7% Hispanic, and 6% other. The sample was disadvantaged: 75% had income below the official poverty level, and 65% were not married.

Measures: Data came from three sources: 1) self-report questionnaires, 2) observation coding of parent-child interactions, and 3) administrative data from the state child welfare database. Questionnaire data was obtained at baseline, after the six-session orientation program, and after the 12-session parenting program. Observation coding occurred at the same three times. Database matching occurred from baseline up to 3.5 years later.

The Readiness for Parenting Change Scale measured motivation for participating in a child welfare parenting program and attitudes toward being mandated to attend the program (alpha reliability = .84). This scale served as a measure of responsiveness to the orientation.

The Dyadic Parent-Child Interaction Coding System - II was used to code observed parent-child interactions during structured tasks. The coding scheme corresponded to the goals of the parent-child interaction therapy and therefore served as a measure of skills learning in the program. Coder training required at least 90% correct with standard video stimulus sets.

The Child Abuse Potential Inventory used a 160-item questionnaire to estimate risk for committing child abuse (alpha reliability = .92).

The Child Welfare Database was used for the key measure of recidivism. Investigators checked the central state database of all child welfare reports, allegations, dispositions, and placements for incidents involving the subjects. The checks made certain to find matches on multiple criteria and avoid duplication. The placement information was also used to determine periods of time when children were removed from the parent.

Analysis: Event-history or hazard models were used to estimate the time from baseline to an incident of child abuse recidivism. However, comparisons across conditions in the models would be biased by differences in the time parents spent living with their child. Those parents who have high potential for abuse might have low recidivism because the child was not allowed to live at home with them. The analysis used two approaches to deal with this potential bias, both of which gave much the same results. First, the models examined the hazard for abuse relative to the interval during which the parent was at risk of abuse (i.e., living or spending unsupervised time with the child). Second, the models used imputed data for the period of not living or spending time with the child. The authors devoted an extended discussion to these relatively uncommon procedures.

The hazard or event history models included covariates (age, prior referrals, and number of children in the home). Because all subjects entered baseline with an abuse history, a control for the baseline outcome was unnecessary.

Outcomes

Implementation Fidelity: The self-motivation orientation sessions and the parent-child interaction sessions were monitored with checklists. To quote, "All therapists were able to maintain reasonable fidelity." Mean attendance at the six-session orientation was 5.2, and mean attendance at the 12-session parenting treatment was 10.1.

Baseline Equivalence: Comparisons of the self-motivation orientation group and the usual orientation group showed no significant baseline differences on sociodemographic characteristics, prior welfare referrals, number of children in out-of-home placement, the Child Abuse Potential Inventory, the Readiness for Parental Change scale, or the Dyadic Parent-Child Interaction codes. Comparisons of the parent-child interaction and service-as-usual groups also did not show any significant differences on the same set of variables.

Differential Attrition: Of 192 parents starting, 153 remained for the analysis. The main source of attrition was loss of access to children, which prevented assignment to the parent-child interaction condition. The investigators stated that attrition rates and reasons for attrition did not differ significantly across the conditions. However, they did not formally examine differences in baseline characteristics among completers and dropouts.

Long-term: The long-term results focused on newly reported incidents of child abuse available from the administrative data. The raw percentages show clear evidence of the program benefits:

  • The combined self-motivation orientation and parent-child interaction condition had a recidivism rate of 29%.
  • The parent-child interaction only condition had a recidivism rate of 47%
  • The self-motivation orientation condition had a recidivism rate of 34%.
  • The control condition a rate of 41%.

However, these figures do not control for exposure to the risk of recidivism (i.e., having children at home). Results from the event history models that are based on the observed risk intervals and the imputed data correct for this bias. With the corrections, significantly longer periods without abuse were found for the combined self-motivation orientation and parent-child interaction condition relative to all three of the other conditions. The results indicated that the combined treatments were needed for effective reduction of recidivism and that neither the self-motivation orientation nor the parent-child interaction alone had much benefit.

Further, the combined condition was significantly more effective in reducing the risk of recidivism when children were present in the home for long periods. It most helped when children were at home at the start of the study or returned soon after the start.

Mediating Effects

The study demonstrated that the intervention produced intended changes in parents that could lead to lower child abuse recidivism. For the self-motivation orientation, evidence showed that the condition produced significantly greater scores on Parent Readiness to Change than the usual orientation condition. For the PCIT treatment, checks used the Dyadic Parent-Child Interaction codes. The parent-child interaction condition produced fewer negative interactions and more positive interactions with children than the service-as-usual condition.

Effect Sizes

No effect sizes were presented, but the hazard coefficients show the probability of abuse recidivism. An indication of strength comes from the following: The probability of recidivism for the self-motivation orientation plus parent-child interaction conditions was only .11 of that for the usual orientation plus parent-child interaction condition (or 89% lower), was only .10 of that for the for self-motivation orientation only (or 90% lower), and was only .20 for the control (80% lower). It appears that neither the self-motivation orientation nor the parent-child interaction alone had much benefit.

Generalizability

The sample, which included subjects with a record of often severe maltreatment of their children, came from a single child welfare agency in an unknown location.

Limitations

The study had a strong randomized design and evidence of baseline equivalence and similar attrition across groups. Problems included:

  • The measure of recidivism based on official records likely underestimated the true extent of parental abuse.
  • The differential attrition analysis was incomplete.
  • Group comparisons are biased by differences in risk exposure, and methods to correct for the problem are not well developed.

Study 7

These articles compare standard PCIT and a version adapted specifically for Mexican American children (called Guiando a Ninos Activos or GANA) to a treatment as usual control condition. GANA was designed to maintain the core elements of PCIT while adapting them to be more culturally relevant for Mexican American families. Effects of both treatment conditions compared to the control condition are reported below.

Evaluation Methodology

Design:

Recruitment: Families were recruited from a community mental health clinic. Families were eligible if the parent identified their child as being Mexican American and between the ages of 3 and 7, if the child received a score above the clinical cut point on the Intensity Scale of disruptive behaviors from the Eyberg Child Behavior Inventory, and if neither the parent nor the child was participating in any other psychosocial treatment simultaneously. Possibly eligible families were screened by telephone. Of 103 families screened, 32 did not meet inclusion criteria, 11 declined, and 2 could not participate for logistical reasons. The remaining 58 families enrolled in the study.

Assignment: Eligible families were randomly assigned to either the GANA condition (PCIT adapted for Mexican American children, n = 21), the PCIT condition (n = 19), or a treatment as usual condition (TAU condition, n = 18).

Assessments/Attrition: Assessments occurred at baseline, posttest (immediately after treatment), and at long-term follow up. The long-term follow up occurred, on average, 15.9 months (SD = 4.25) post-treatment, with a range of 6-24 months. Of the 58 families that completed the baseline measures, 54 completed the posttest (93%), and 48 completed the long-term follow-up (83%).

Sample: The primary caregivers were mostly female (92%), although male caregivers participated in at least one session 40% of the time. Female caregivers were, on average, 32.2 years old; male caregivers were, on average, 35 years old. Overall, 51% of mothers and fathers reported high school education or less and yearly average income was $23,271. The children's average age was 52.8 months. The sample included more male children (71%) than female children.

Measures: The authors stated that assessors and families were blind to condition. Parents completed seven outcome measures at pretest, posttest, and long-term follow-up. There were also seven observational measures that were assessed at pretest and posttest. Note that many of these parent-reported measures overlap in child externalizing and disruptive behavior content.

Outcomes:

  • Two subscales from the 36-item Eyberg Child Behavior Inventory (ECBI): the Intensity Scale measuring frequency of disruptive behaviors and the Problems Scale measuring total behavior problems. This measure was administered during the initial screening call, posttest, and long-term follow up.
  • The Externalizing Problems scale from the Child Behavior Checklist (CBCL), which was administered at pretest, posttest, and long-term follow-up.
  • The Early Childhood Inventory, which assesses symptoms of ADHD, oppositional defiant disorder, and conduct disorder. This measure was administered at pretest, posttest, and long-term follow-up.
  • The Parent Child Dysfunctional Interactions Scale from the Parenting Stress Index, administered at pretest, posttest, and long-term follow-up.

Risk and Protective Factors:

  • The Dyadic Parent Child Interaction Coding System (DPICS), which is an observational behavioral measure of the quality of parent and child interactions. This measure was administered at pretest and posttest.
  • The Parenting Practices Scale, which assesses positive parenting behaviors and was administered at pretest and posttest.
  • The Parenting Distress Scale and the Parent Child Dysfunctional Interactions Scale from the Parenting Stress Index, which was administered at pretest, posttest, and long-term follow-up.
  • The Parental Locus of Control Scale (PLOC) of child behaviors, which was administered at pretest and long-term follow-up.

All measures demonstrated adequate reliability (alphas above .70, kappa coefficients above .59).

Analysis: Treatment effects at posttest were assessed using single-degree of freedom contrasts, comparing the treatment conditions with one another and the treatment as usual condition. Baseline outcome controls were used in analyses to determine pretest-posttest treatment gains.

Intent-to-Treat: Data were analyzed following an intent-to-treat approach.

Outcomes

Implementation Fidelity: Sessions were video-taped and coded for fidelity. Both treatment conditions scored well on the inclusion of items from the treatment manual (77% in GANA, 82% in PCIT). A random subset of 25% of videos were coded by both coders and their agreement was 85%. The authors reported that 76% of families (n=44) attended five or more sessions and 57% of families completed all sessions.

Baseline Equivalence: There were no significant differences at baseline on eight demographic measures. It is unclear whether the conditions differed on outcome measures at baseline.

Differential Attrition: Only four of 58 families did not complete posttest measures. However, formal tests for differential attrition were not conducted at posttest. The authors stated that the three conditions did not differ on rates of attrition, but it appears the reported rates are for those who dropped out of the intervention condition rather than completing measures at posttest. Attrition at long-term follow up did not significantly differ by condition.

Posttest: The GANA intervention condition produced significantly more improvement than TAU on all seven of the parent-reported outcomes: disruptive behaviors, total problem behaviors, symptoms of ADHD, oppositional defiant disorder, and conduct disorder, externalizing problems, and parent-child dysfunctional interactions. The standard PCIT treatment condition also produced significant improvements, relative to TAU, for one of seven behavioral outcomes, externalizing problems. In no instances did the GANA and PCIT conditions significantly differ from one another, on either parent-reported or observational measures of outcomes. Posttest effect sizes were reported within condition (pre-post) rather than between treatment and TAU conditions.

For risk and protective factors, the GANA intervention condition showed significantly greater improvement than TAU for parenting practices, parent distress, difficult child, and total parent stress. The standard PCIT also showed greater improvement in parent stress, compared to TAU.  According to Table 3, GANA and PCIT families also showed significant improvement, relative to TAU families, on several observational measures of parenting skills.  

Long-Term: Six to 24 months post-treatment, GANA, relative to TAU, produced significantly greater improvements on five of eight parent-reported outcomes: disruptive behaviors (d = .81), CBCL internalizing problems (d = .56), externalizing problems (d = .65), and total problems scales (d = .63), symptoms of ADHD (d = .52) and for the risk and protective factor of parent control of child behaviors (d = 1.24). GANA outperformed PCIT on the CBCL internalizing subscale (d = .31). PCIT and TAU did not significantly differ on any outcomes at long-term follow-up.

Contact

Blueprints for Healthy Youth Development
University of Colorado Boulder
Institute of Behavioral Science
UCB 483, Boulder, CO 80309

Email: blueprints@colorado.edu

Sign up for Newsletter

If you are interested in staying connected with the work conducted by Blueprints, please share your email to receive quarterly updates.

Blueprints for Healthy Youth Development is
currently funded by Arnold Ventures (formerly the Laura and John Arnold Foundation) and historically has received funding from the Annie E. Casey Foundation and the Office of Juvenile Justice and Delinquency Prevention.