Progress 09/01/23 to 08/31/24
Outputs Target Audience:This project reaches five key audiences: 1. High school aged youth participate in our FAME program with 15 plus hours of learning in ag tech and science communication and an end-of-program showcase. 2. Undergraduate students serve as mentors for youth throughout all phases of their program. Staff and undergraduate students were trained in youth leadership, positive youth development, science communication, and documentary ethics by project youth development professionals and science communication experts. 3. Scientists and food systems experts, supported by project staff, prepare their research stories in accessible ways for the youth audiences they will be working with. Finally, youth will work in partnership with science storytelling and tech experts to successfully complete their media stories. 4. A broader public audience including parents, youth participants, peers and other community members are invited to the science story showcase to view the youth science films and be present for a Q&A with youth and scientist experts. 5. Informal Education Professionals, 4-H Youth Development professionals, Higher Education STEM learning and STEM retention professionals. Changes/Problems:Our project team is proud to have completed a successful year of programming and outreach bringing together local youth and our university community together. For the pilot year, a change was made in the geographical location of the cooperating high school for recruitment to the 4-H FAME Ag Tech Program. Due to transportation logistics, a high school near campus was selected that had the demographics to draw students from underrepresented groups, as well as the student and teacher interest, which met our project goals. One problem that we are revisiting in year two is our program evaluation plan. The way our current IRB protocol is written complicated data collection from our youth participants. Currently, as it is structured, our SERC evaluation team uses an online system to generate auto emails sending guardians consent paperwork, and program surveys. In addition to glitches in the system's functionality, we found that guardians were not responsive to the unknown sender, which is not a surprise given the current number of Phishing emails the average person receives each day . It was also hard for the project team to directly work with families to help facilitate data collection due to fear of coercion by the evaluation team. Because of this, we had to overburden families with multiple texts and emails about our program evaluation and research needs which were often confusing and could have come off as intimidating. We also ended up with a lower response rate than ideal. We are working with the SERC evaluation team to update the IRB to allow the project team working with the youth participants to integrate research consents into the program registration process and to deliver our program evaluation survey to youth directly in paper form surveys. What opportunities for training and professional development has the project provided? Project staff, our youth development, and our science storytelling undergraduate student mentors participated in the Rutgers Protection of Minors Training and 4-H Positive Youth Development training. Rutgers Protection of Minors Training included a criminal background check, and a short webinar focused on Rutgers youth protection policies and youth safety. The 4-H training hosted by project team member Marissa Staffen, included a review of the 4-H Thriving Model, youth ages and stages, classroom management and offered multiple handouts on positive youth development. Mentors were also guided by project team member Dena Seidel in science communication techniques and story editing software. They were guided by Dr. Morin in science learning topics and youth engagement. Our youth participants completed 15 plus hours of programming geared towards increasing their skills and knowledge in Agriculture Technologies, Food Systems and science communications. How have the results been disseminated to communities of interest?The project team hosted a first science story showcase for youth and their families at the Highland Park High School. The event included 6 short science films, a Q&A session and an awards ceremony for youth participants and science and storytelling mentors. A university-based website has been developed showcasing the youth science films. Each semester, films from the new cohorts will be added. Project team leaders presented at the Environmental Storytelling series in Syracuse, New York, in September of 2024, to share the developed storytelling model with students from a variety of majors at both Syracuse University and the SUNY College of Environmental Science and Forestry (SUNY ESF). The event was organized jointly by SUNY ESF's Writing, Rhetoric, and Communications Program, and Syracuse University's Engaged Humanities Network. The organizers of the event were inspired by the methodology and story products coming from Rutgers' storytelling model. Alongside Dena Seidel presenting the model, Rutgers graduate students presented their experiences being interviewed by FAME high school students as they created their story titled "Traditional Roots," which explored the cultural and scientific uses of ginger. They spoke about their experiences working with these students, and how they were able to grasp the information and immerse themselves in the field of Plant Biology, while also sharing the information that they learned with others through their story. What do you plan to do during the next reporting period to accomplish the goals?The evaluation team at Carleton College's Science Education Resource Center (SERC) was invited to support the program through evaluation of project activities and their impact on things like students' science identity, sense of belonging, and other factors that can shape student engagement with and eventual pursuit of STEM studies and careers. The annual report provides the results of data collected via exit tickets and a student pre-/post-program survey during the Spring 2024 pilot implementation of the program, along with associated evaluation learning and recommendations for ensuing program activities. The project evaluation team at SERC provided formative data on program delivery program impact related to our youth learning outcomes. During our first cohort implementation of the program, program staff members distributed a link to the exit ticket and invited students to share their responses at the end of each program session. For the pilot implementation, participants were split into two groups: one typically meeting on Mondays, the other on Tuesdays. The same content was presented to each group during their sequential program sessions, albeit sometimes with slight adaptations based on the success of the first presentation. A daily "exit ticket" was developed to give students an opportunity to indicate how engaged they were in each day's program activities as illustrated in Figure 1. Participants were also asked to identify one thing they learned during each session. Data from these exit tickets was synthesized and will be used to reflect on the impact of individual activities. The project team is using this data to consider modifying specific activities for the next cohort. In addition, to evaluate the program's progress along and impact on project goals, SERC evaluators drew from validated measures commonly used in STEM education research (e.g., Learning Activation Lab, 2022;Cole, S., 2012; and Reninger, 2009) to design a pre-/post- student survey. Portions of the THRIVE Youth Development scale, selected in collaboration with FAME project team members, were also included to assess alignment of the program implementation with the principles underlying FAMEs 4H youth programming, and the extent to which the program successfully established a climate conducive to positive youth development. Those included the "Caring Adults," "Challenging Growth," and "Youth" subscales. Together the resulting surveys explore things like student science identity and engagement, influences on their interests and decision making, and intent to pursue higher STEM education and/or careers. Additionally, bespoke items were developed collaboratively with FAME project team members to assess the impact of program curriculum on science knowledge.? In addition, the project team including project PIs, senior personal, and undergraduate mentors met for a cohort 1 debrief. Notes on what worked well and didn't were collected and will also be considered then planning for the next cohort. From these data sources, some of the major considerations for improvement to better meet our program goals include. ? Build more programing time for each cohort; ? Focus on more Ag teach activities during each session; ? Consider more options for transportation to get youth to campus; and ? Update IRB protocol to better streamline collection of consent and program evaluation
Impacts What was accomplished under these goals?
In a review of our logic model, the project team was successful in reaching many of the intended short-term and medium-term outcomes and are well on our way to realizing our intended long-term outcomes. Through our program evaluation surveys, we have been able to document a growth in knowledge of ag technologies and science communication skills for our youth participants. With our initial showcase, our project team observed our community participants showing an interest in learning more about the agriculture technologies shared in the youth films during the very interactive Q&A session. We do not have tools developed or data collected yet to measure the impact on our undergraduate mentors and scientists. Tools are being developed and will be implemented to measure impact on these audiences during our year 2-3 of outreach. 1.) Our short-term outcomes included: 1.1. Youth: increased comfort and belonging within a science community, increased comfort with scientists, increased knowledge of food systems sciences and agriculture technologies to address food systems challenges; increased awareness of careers in Ag Tech; 1.2 Undergraduate mentors: increased skills in science communication, mentoring, and professional science video story experiences; 1.3 Public: increased knowledge of Ag tech as solutions; positively impact image of STEM and scientists, engineers; and 1.4 Experts: increased science communication experience. 2. Our medium-term outcomes included: 2.1) 4-H programs: Increased science communication skills with different platforms & programming; 2.2) Public: Increased relatability to STEM & scientists; 2.3) For our scientists, engineers and food systems experts: increased engagement with students; and 2.4) For science communicators: Access to raw film footage of AgTech for future projects. 3.) Our Long-Term outcomes include: 3.1) Youth: pursue additional education for careers in agricultural technology with increased confidence in agriculture technologies to address food systems challenges; 3.2) 4-H community: Expand number of FAME ag tech youth programs; 3.3) Public: Empower broader communities with the knowledge to address food insecurity through agricultural technologies; 3.4) Experts: participate in and support new science communication activities
Publications
- Type:
Other Journal Articles
Status:
Awaiting Publication
Year Published:
2024
Citation:
Seidel, D.K., M. Steffan, L. Abdullah, X. Morin. Engaging Underrepresented Youth in STEM Learning through Collaborative Video Storytelling.Journal of Extension.
|