Army New Parent Support Program Implementation of Evidence-based Curriculum Project

ARMY NEW PARENT SUPPORT PROGRAM IMPLEMENTATION OF EVIDENCE-BASED CURRICULUM PROJECT

Sponsoring Institution

National Institute of Food and Agriculture

Project Status

TERMINATED

Funding Source

OTHER GRANTS

Reporting Frequency

Annual

Accession No.

1014403

Grant No.

2017-48792-27334

Project No.

PENW-2017-08668

Proposal No.

2017-08668

Multistate No.

(N/A)

Program Code

FF-L

Project Start Date

Sep 1, 2017

Project End Date

Aug 31, 2020

Grant Year

2018

Project Director
Perkins, D. F.

Recipient Organization
PENNSYLVANIA STATE UNIVERSITY
408 Old Main
UNIVERSITY PARK,PA 16802-1505

Performing Department
Agricultural Economics, Sociol

Non Technical Summary
The Clearinghouse for Military Family Readiness will be: (1) employing marketing and evidence-informed strategies to increase rates of NPSP program completion; (2) providing training to home visitors on two evidence-based curricula; and (3) increasing documentation and assessment to inform curricula and parenting behavior changes. This project is designed to increase NPSP programming effectiveness and promote child development by supporting parents to develop skills and knowledge to deal with the everyday demands of parenthood.

Animal Health Component

Research Effort Categories

Basic

(N/A)

Applied

100%

Developmental

(N/A)

Classification

Knowledge Area (KA)	Subject of Investigation (SOI)	Field of Science (FOS)	Percent
802	6020	3070	100%

Knowledge Area
802 - Human Development and Family Well-Being;

Subject Of Investigation
6020 - The family and its members;

Field Of Science
3070 - Psychology;

Keywords

Goals / Objectives
The Army NPSP Evaluation Phase III (NPSP EIII) seeks to provide families with a helping hand in the everyday demands of parenthood.Priority 1. Facilitate the implementation of evidence-based curricula within Army NPSP home visits.Priority 2. Provide information in home visit effectiveness through an implementation evaluation.Priority 3. Increase NPSP visibility and family recruitment through innovative marketing and outreach.Army NPSP EIII will target families at installations from pregnancy up to age three providing evidence-based curricula on home visits and an implementation evaluation. In addition, we will embark on a three-phase marketing effort designed to increase NPSP visibility, recruitment, and retention.

Project Methods
An effectiveness-implementation design will simultaneously test the implementation and intervention related outcomes of the programs. During the course of the study, families will complete questionnaires, observations, and direct assessments. Home visitors will document their implementation of the program along with associated outcomes. In addition to fidelity tracking, measures will be completed at three main time points throughout the evaluation, baseline (visits 1-3), 3-4 months following baseline, and 6-7 months following baseline. Client IDs will be matched to the Army Central Registry data at 12-months post-baseline to capture substantiated cases of abuse.

Progress 09/01/19 to 08/31/20

Outputs
Target Audience:The target audience involves New Parent Support Program home visitors and the Army parents of newborns. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?Army NPSP staff have been offered a number of trainings ranging from four to 21 CEUs. · 17 staff were trained in Parents as Teachers with another 12 scheduled to be trained in July; · 16 staff were trained in evaluation measures including the ASQ-3 and PICCOLO; · 12 staff were trained in Take Root Home Visitation; and · 12 staff were trained in a curriculum cross-over training. How have the results been disseminated to communities of interest?Kaye, M. P. & Perkins, D.F.Kaye, M. P. & Perkins, D.F. (2019, September). Army FAP Projects: Understanding recidivism, the effects of FAP programs, and evidence-informed practices and the Army New Parent Support Program EIII. Oral presentation at the Army Family Advocacy Program Manager Training, San Antonio, TX. What do you plan to do during the next reporting period to accomplish the goals?During the next reporting period we plan to complete staff training in each of the two evidence-informed curricula, as well as the curriculum selection tool. We will complete two-preliminary implementation reports, one on each of the evidence informed curricula and will provide continued evaluation updates and reports to partners.

Impacts
What was accomplished under these goals? T This project has three overarching priorities, listed below, with the following accomplishments: Priority 1. Three hundred eighty-five new families consented to participate in the project. Priority 2. This project has provided evidence-informed curricula training to NPSP staff at 10 Army installations. In addition, monthly support calls support the staff at each site in the implementation of the curriculum. Efforts are underway to train the staff in a second curriculum and a curriculum selection training and tool has been developed. Priority 3. Analysis of initial findings suggest improved retention and client outcomes for families receiving evidence-informed curricula as compared to service as usual families. Updates are disseminated to partners on a quarterly basis.

Publications

Type: Other Status: Published Year Published: 2020 Citation: Kaye, M. P., Ferarra, A., & Erby-Abram, G., Perkins D.F. (2020). Army NPSP EIII Curriculum Cross-Over Training: Working with and Selecting from two Curricula. University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Other Status: Published Year Published: 2020 Citation: Kaye, M. P., & Ferrara, A. M., Perkins, D. F. (January, 2020). Army NPSP EIII Quarterly Update (2 pages). University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Other Status: Published Year Published: 2019 Citation: Kaye, M. P., & Perkins, D. F. (2019). Army New Parent Support Program Evaluation III: Project Overview and Initial Findings. (6 pages). University Park, PA: Clearinghouse for Military Family Readiness at Penn State.

Progress 09/01/17 to 08/31/20

Outputs
Target Audience:Target audiences include two overarching groups: Army staff, including IMCOM leadership, Family Advocacy Program Managers (FAPMs), and New Parent Support Program (NPSP) staff, along with Army families eligible for NPSP services. Army families eligible for services are Army service members, spouses, or dependents expecting or with a child aged birth to three years of age at risk of child maltreatment. During this reporting period, these families were ethnically diverse (less than 50% white), with most (over 80%) experiencing risk factors of low social support, over half experiencing relocation or deployment, and over one-quarter experiencing economic hardship. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?Army NPSP staff have been offered a number of trainings ranging from four to 21 CEUs. · 17 staff were trained in Parents as Teachers with another 12 scheduled to be trained in July; · 16 staff were trained in evaluation measures including the ASQ-3 and PICCOLO; · 12 staff were trained in Take Root Home Visitation; and · 12 staff were trained in a curriculum cross-over training. How have the results been disseminated to communities of interest?Kaye, M. P. & Perkins, D.F.Kaye, M. P. & Perkins, D.F. (2019, September). Army FAP Projects: Understanding recidivism, the effects of FAP programs, and evidence-informed practices and the Army New Parent Support Program EIII. Oral presentation at the Army Family Advocacy Program Manager Training, San Antonio, TX. What do you plan to do during the next reporting period to accomplish the goals? Nothing Reported

Impacts
What was accomplished under these goals? This project has three overarching priorities, listed below, with the following accomplishments: Priority 1. Three hundred eighty-five new families consented to participate in the project. Priority 2. This project has provided evidence-informed curricula training to NPSP staff at 10 Army installations. In addition, monthly support calls support the staff at each site in the implementation of the curriculum. Efforts are underway to train the staff in a second curriculum and a curriculum selection training and tool has been developed. Priority 3. Analysis of initial findings suggest improved retention and client outcomes for families receiving evidence-informed curricula as compared to service as usual families. Updates are disseminated to partners on a quarterly basis.

Publications

Type: Other Status: Published Year Published: 2019 Citation: Kaye, M. P., & Perkins, D. F. (2019). Army New Parent Support Program Evaluation III: Project Overview and Initial Findings. (6 pages). University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Other Status: Published Year Published: 2019 Citation: Kaye, M. P., Ferrara, A. M., Abram-Erby, G., Gerel, A., Ganon, S., & Perkins, D. F. (September, 2019). Army NPSP EIII Quarterly Update (2 pages). University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Other Status: Published Year Published: 2019 Citation: Kaye, M. P., & Erby-Abram, G. (2019). Incorporating Take Root Home Visitation into the Army NPSP EIII Program Evaluation. University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Other Status: Published Year Published: 2020 Citation: Kaye, M. P., & Ferrara, A. M., Perkins, D. F. (January, 2020). Army NPSP EIII Quarterly Update (2 pages). University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Other Status: Published Year Published: 2020 Citation: Kaye, M. P., Ferarra, A., & Erby-Abram, G., Perkins D.F. (2020). Army NPSP EIII Curriculum Cross-Over Training: Working with and Selecting from two Curricula. University Park, PA: Clearinghouse for Military Family Readiness at Penn State.
Type: Journal Articles Status: Awaiting Publication Year Published: 2020 Citation: Kaye, M. P., Saathoff-Wells, T., Ferrara, A. M., Morgan, N., & Perkins, D. (in press). Exploratory Structural Equation Modeling analysis and validity of the Family Needs Screener. Journal of Interpersonal Violence. https://doi.org/10.1177/0886260519888517

Progress 09/01/18 to 08/31/19

Outputs
Target Audience:There are two primary audiences for this work (1) New Parent Support Program and (2) Army parents with newborns. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?Training were conducted with NPSP staff at five Army installations relatd to Parents as Teacher Curriculum. In addition, another five army installatios NPSP staff were trained on Take Root Home Visitor curriculum. How have the results been disseminated to communities of interest?The ongoing work is being shared in the form a monthly newsletter to staff and a monthly parenting tip sheet. What do you plan to do during the next reporting period to accomplish the goals?For the FAP-M guide, We are currently in the process of developing newly identified content and revising old content to better meet the needs identified by FAPMs. Over the next year, we plan to complete revisions and updates to the FAP Guide to Prevention Programming and develop it into an online format. This included updating content, developing new content, and developing linked resources. Key features of this online manual will include keyword searches along with preview lists of pages that contain the keyword. There will be a preview of all topics in the table of contents, and pages can easily be downloaded into a pdf format and saved as a desktop guide or printed. For the Army NPSP EIII Project, we will continue work on priorities 2 and 3. For priority 2, we will continue to provide ongoing support of the home visitors use of the curricula (e.g., support calls, newsletters, infographics) and training in each curriculum. The five installations currently implementing Parents as Teachers will also be receiving training in Take Root Home Visitation. Implementation outcomes will continue to be collected. For priority 3, we will continue to collect data from families and home visitors on the impact of services on family outcomes. An interim report will be completed detailing the implementation and outcome findings for the first year of curriculum implementation.

Impacts
What was accomplished under these goals? The FAP Research and Prevention/CSS Phase 2 project has two overarching priorities: (1) to provide information in the effectiveness of child maltreatment and intimate partner violence case treatments for Army Medical command; (2) to develop evidence-informed information for the prevention of child maltreatment and intimate partner abuse that support program accountability requirements for Army Installation Management Command (IMCOM). Over the past year, final reports for Priority 1 were completed. With regard to Priority 2, specific recommendations were presented to Army IMCOM for the revision and redevelopment of the FAP Guide to Prevention Programming. In particular, we identified key content areas, developed a table of contents and received feedback from a selection of FAPMs regarding content coverage, and identified installation best practices and delivery strategies. The Army NPSP EIII Project has three overarching priorities: (1) to increase NPSP visibility and family recruitment through innovative marketing; (2) to facilitate the implementation of evidence-informed curricula within Army NPSP home visits; (3) to provide valuable information in the effectiveness of the programing through an implementation evaluation. Over the past year, we have completed priority 1 to create and coordinate the roll-out of a dynamic marketing effort designed to increase NPSP visibility and recruitment. Four products were developed including two videos, one targeting parents and one targeting professionals who may refer families, a webpage with information about Army NPSP, and sippy cups with the website which have been distributed to participating installations. In addition, the first step of priority two was been completed. Home visitors from the 10 participating installations have been trained in one of two evidence-informed curricula. Thirty home visitors at five installations have been trained in and are delivering Parents as Teachers (PAT). Twenty-five home visitors at five installations have been trained in and are delivering Take Root Home Visitation (TRHV). Ongoing support of the curricula is being delivered to each installation in the form of monthly to bi-monthly support calls (to date, n = 12), a monthly newsletter, and quarterly infographic depicting family participation and outcomes. Nearly 250 other instances of support regarding implementation have also been provided in the form of emails, phone calls, in-person meetings, and zoom calls. Priority three is currently underway. Sixty-two home visitors at the 10 participating installations have been trained to use the on-line evaluation portal developed for this project. These home visitors have provided information for nearly 800 families, over 475 in the control/treatment as usual condition and over 300 receiving PAT. The implementation of TRHV has just begun and as new families begin NPSP services, they are entered into the program evaluation. Data collection focuses on the feasibility of training and delivery of the curricula with fidelity, quality, and impact on families. Home visitors have documented about 3,300 visits. Approximately 625 (78%) families have completed outcome measures at baseline; 440 (66%) three months following baseline; 300 (65%) six months following baseline; and 170 (67%) at program completion.

Publications

Progress 09/01/17 to 08/31/18

Outputs
Target Audience:The target audience is NPSP providers who work with Army Families through NPSP. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest?We have been working with Army NPSP headquarter staff to determine the roll out marketing materials as well as trainings schedules. What do you plan to do during the next reporting period to accomplish the goals?Priority 1, Goal 1. Coordinate and create marketing efforts. The Clearinghouse worked with Army partners to coordinate and create a dynamic marketing effort designed to increase NPSP visibility and recruitment. This three-phase effort included: (1) a planning phase with a working group of ACS, FAP, and NPSP partners focused on brand positioning/messaging and the establishment of print/web/digital messaging; (2) a design and development phase for the creation of products and preliminary training of NPSP staff in the use of the products; and (3) the pushout of all products in a structured campaign format. The products have been developed and are in the final stages of refinement. Currently all that remains of this goal is to train NPSP staff in the use of the products and the pushout of all products. Priority 2, Goal 1. Conduct an evaluability assessment to determine site selection. In collaboration with a working group of prevention-focused OSD-FAP and Service POCS, the Clearinghouse will conduct an evaluability assessment to identify installations where the roll-out of the programs will occur. This goal has been completed; 10 installations have committed to participate. Train Army NPSP home visitors for the use of evidence-informed programing and curricula. The Clearinghouse will initiate this work with (1) the facilitation of Parents as Teachers trainings for participating installations and (2) the creation of an appropriate online training format best suited to DoD capabilities, Services' priorities, and tools that are user-friendly and meet the requirements to address the needs of the various adult learners for training in Take Root! Home Visitation. The first sets of Parents as Teachers and evaluation trainings have been scheduled. At the completion of this goal, NPSP staff from five installations will be trained in and deliver evidence-informed programming. The home visitors at the other five installations will be receiving the evaluation trainings during the same time frame and will serve as the control group for 9-months before being training in Take Root! Home Visitation. After one year of program delivery, each set of home visitors will be trained in the opposing program; thus at the completion of the project the participating home visitors will be trained in two evidence-informed programs. Priority 2, Goal 3. Provide ongoing support of the curricula to increase quality implementation. The Clearinghouse will create an ongoing infrastructure of implementation support to assist the installation Army NPSP with continuous quality improvement. This support infrastructure will include the development of a training platform providing virtual online trainings covering a variety of topics related to increasing fidelity and quality delivery evidence-informed programs/curricula. Priority 2, Goal 4. Develop a protocol for the use of evidence-informed programs and curricula to increase quality implementation. The Clearinghouse will then create a protocol for the Army NPSP home visitors for the use of the evidence-informed programs and curricula. The process may also include additional alterations as a result of information received during the implementation evaluation. This will include a web platform to assist Army NPSP home visitors in the selection and documentation of curricula. The evaluation system for the documentation of curricula is in refinement. Priority 3, Goal 1. Develop the evaluation design. Evaluation questions and methods to assess the issues of greatest concern to Army and OSD partners will be identified to develop a feasible, ethical, and accurate evaluation plan, while using time and resources as efficiently as possible. Important considerations will include choosing indicators that meaningfully address evaluation questions while limiting the scope and selection of information that gives priority to the most valid sources and promotes the collection of reliable and systematic information. The evaluation design and methods have been identified and developed. Currently the development of an evaluation capture system is underway and in the final stages of refinement. Evaluation trainings are being scheduled with the five control installations and have been scheduled with the Parents as Teachers installations. Priority 3, Goal 2. Conduct program evaluation, analyze data, and summarize results in a briefing document. The program evaluation will be conducted. Data will be collected and analyzed to answer questions of feasibility of training and delivery of programs with fidelity, quality, value, and impact (i.e., significance) on families. A brief will be written that includes actionable information and recommendations and may inform the protocol for use of evidence-informed programs (Priority 1, Goal 2). Priority 3, Goal 3. Develop an on-line toolbox to support home visitors in curricula selection and documentation. A web platform will be developed to assist Army NPSP home visitors in curriculum selection, documentation, and assessment. The development of an on-line documentation system is in the final stages of refinement. 

Impacts
What was accomplished under these goals? -The marketing products have been developed and are in the final stages of refinement. Currently all that remains of this goal is to train NPSP staff in the use of the products and the pushout of all products. -Sites have been selected for participation and 10 installations have committed to participate. -The first sets of Parents as Teachers and evaluation trainings have been scheduled. At the completion of this goal, NPSP staff from five installations will be trained in and deliver evidence-informed programming. The home visitors at the other five installations will be receiving the evaluation trainings during the same time frame and will serve as the control group for 9-months before being training in Take Root! Home Visitation. After one year of program delivery, each set of home visitors will be trained in the opposing program; thus at the completion of the project the participating home visitors will be trained in two evidence-informed programs. -The evaluation design and methods have been identified and developed. Currently the development of an evaluation capture system is underway and in the final stages of refinement. -Evaluation trainings are being scheduled with the five control installations and have been scheduled with the Parents as Teachers installations. 

Publications

Type: Journal Articles Status: Published Year Published: 2018 Citation: Kaye, M. P., Faber, A., Davenport, K., & Perkins, D. F. (2018). Common components of evidence-informed home visitation programs for the prevention of child maltreatment. Children and Youth Services Review, 90(C), 94-105. DOI: 10.1016/j.childyouth.2018.05.009
Type: Other Status: Published Year Published: 2017 Citation: Kaye, M. P., Davenport, K. E., Faber, A., Schulte, J., & Perkins, D. F. (2017). New Parent Support Program Engagement III: Marketing, Implementation, and Outcome Evaluation Plan. (34 pages) University Park, PA: Clearinghouse for Military Family Readiness at Penn State.