Progress 02/01/21 to 01/27/25
Outputs Target Audience:The Agricultural Literacy Certification Program (ALCP) was designed for various educators and volunteers, aiming to increase agricultural literacy and career awareness among K-12 students. The target audience includes: K-12 educators (who do not have a degree in agricultural education) Volunteer educators, such as 4-H leaders Early-career AITC (Agriculture in the Classroom) staff or other agricultural education staff Pre-service teachers These individuals are the focus of ALCP because many Americans lack a basic understanding of agriculture despite the nation's agricultural abundance. Additionally, while AITC programs reach a substantial number of students and teachers, a large population of students and educators still needs to be reached. The ALCP addresses the limitations of face-to-face training and provides greater access to professional development. The program also seeks to support state AITC programs, many of which have limited staff and resources. The ALCP aims to increase participants': Agricultural knowledge Appreciation for agriculture Understanding of how to use the National Agricultural Literacy Outcomes (NALOs) Understanding of their agricultural literacy knowledge gaps Willingness to participate in local agricultural literacy efforts and assess student agricultural literacy Ability to include agriculture as a context for academic content, improve teaching approaches, and highlight agricultural careers. The program focuses on improving agricultural literacy among educators so that they can teach agricultural concepts to their students. In 2024, the research team enrolled participants in three separate sessions: 1) Pilot, 2) Sponsored Rollout, and the 3) National Rollout. Pilot participants (N = 50) were required to apply for participation. Pilot course promotion and advertising was conducted from January to February 2024. Pilot enrollment was conducted from March-April 2024. Wereceived 3,600+ applications, including some international requests for participation in the pilot session. We selecteda diverse group of K-12 educators (n = 33) who were currently employed at a US public school, volunteer educators (n = 7), andearly-career AITC staff members (n = 10). The pilot course lasted from May 20 through June 1, 2024. Participants were expected to complete eight learning modules (approximately 12 hours of instructional time) and a capstone. The capstone project required participants to 1) present a lesson plan to an audience of their choosing and submit a personal reflection highlighting skills and content and/or instruction they used, OR 2) Share on social media about what they learned and what they planned to do in the future with resources from the program; referencing skills/content/instruction they learned and their plans to reach future audiences. The research team monitored the pilot, which was evaluated by Dr. Katie Stofer, University of Florida, per the grant award (June 2024). Dr. Stofer's evaluation included survey creation and data collection, qualitative and quantitative analysis, data analysis, and a report submitted to the PI and the course instructional designer. The team reviewed and implemented the recommendations. Pilot participants received grant-reward incentives (participant support costs) in these amounts: 1) K-12 educators, a $300 Amazon Gift Card via Tango Rewards and a $100 NAITC e-store resource gift card, 2) volunteers, a $100 Amazon Gift Card via Tango Rewards, 3) AITC staff did not receive any incentives for pilot course participation. Sponsored Rollout participants (N = 408) were recruited in September 2024 via social media, email listservs, the National Agriculture in the Classroom Conference (SLC, UT), and the application list from the pilot. The USDA-NIFA PDAL-sponsored rollout ran from August1 through September 1, 2024. Award incentives of a $100 Amazon Gift Card via Tango Rewards and a $100 NAITC e-store resource gift card were distributed to educators who completed the course by September 1. There were 279 completers of the Sponsored Rollout by the session deadline. The research team further evaluated the course for additional improvements, including content and modular review by scientific and content experts to improve information accuracy. National Rollout participants (N = 1,025) were recruited when the course moved into the open course format on October 1, 2024. A course fee of $20 per participant was instituted to provide sustainable management and updating of the course modules. The National Center for Agricultural Literacy at Utah State University took over the operation of ALCP on the starting date. Because there were remaining funds available in the PDAL grant to support participant support costs, and because we did not achieve the goal of providing incentives for 500 US educators (per the grant proposal), the PI distributed $100 Amazon Gift Cards via Tango Rewards to 150 educators and $100 NAITC e-store resource gift cards to 129 educatorswho completed the course before December 1, 2024. Notably, 313 participants completed the course, showing that over half were not incentivized. This USDA-NIFA grant incentivized 509 participants for completion of the ALCP course. Between May 20 and November 27, 2024, 1,354 educators enrolled in the course, and over 978 completed course requirements. Changes/Problems:As detailed in the reports, several changes and adjustments occurred during the Agricultural Literacy Certification Program (ALCP) grant. These changes primarily relate to the timeline, staffing, and course development process. Timeline Adjustments The most significant change was a shift in the project's timeline.The original plan was adjusted, causing the project to be about one year behind schedule for the course development. The Activity Completion Dates for the Plan of Work were updated in September 2021 due to when funding was allocated and the co-PIs' workloads. Despite these delays, the project's objectives, funding, and methodology remained unchanged. Ultimately, the project was completed successfully within the grant funding timeline. Staffing Some staff funding was reallocated to support the challenging work of obtaining video and graphics for the online course. The reports show slight changes in the Full-Time Equivalent (FTE) allocation for staff roles over the years, but the overall staffing levels remained consistent. Movement of Funds from Participant Support Costs to Program Development In 2024, our sub-awardee, the National Agriculture in the Classroom, who hires and manages the instructional designer who develops the course, notified us they needed additional funding to complete the changes and updates necessary post-pilot. They requested an additional $10,000 be paid to their sub-award in 2024 to complete video segments, course assessments, and interactive instruction. The PI sought and obtained USDA-NIFA approval to move $10,000 from participant support costs to course development. The funding was allocated to the sub-award and paid to the instructional designer. The course was completed with the pilot-evaluation-recommended changes before the October 1 National Rollout of the course began. Course Development Developing the web interface and course content required more effort and funding than initially anticipated. Formatting the course and building the user interface proved particularly challenging. However, technical support was outstanding, and the resulting course was deemed high quality and accessible to all users. Pilot Program The pilot program was initially planned for 2023 and moved to spring 2024. Other Changes The ALCP was presented at the National Agriculture in the Classroom Conference in June 2024.? What opportunities for training and professional development has the project provided?The course can be a training and professional development opportunity for K-14 educators, volunteers, and nonprofit and government staff. The research team has received numerous requests for the addition of a "student-version" of the course to be developed. The course content outline has been shown below to highlight the specific content areas. Course Details The course begins with a homepage that details critical information for completing the course, requires the Judd-Murray Agricultural Literacy Instrument I Assessment (Pre-test), and a participant introduction to a collaborating cohort of educators. Module 1: Meeting Human Needs 1.1 What is Agriculture? 1.2 Agriculture in Your Life 1.3 Natural Resources 1.4 Producers and Consumers Module 2: Teaching About Agriculture 2.1 Why Incorporate Agriculture into Your Curriculum? 2.2 How Agriculture Fits with Educational Content Areas 2.3 Assessing Agricultural Literacy Module 3: Agricultural Development 3.1 The Emergence of Agriculture 3.2 History of US Agriculture 3.3 Agriculture in a Global Economy Module 4: Food Systems 4.1 Elements of the Food System 4.2 Types of Food Systems 4.3 Conventional and Organic Food 4.4 Global and Local Food 4.5 Food Security and Hunger Module 5: Food and Human Health 5.1 Nutritional Guidelines 5.2 Food Processing and Preservation 5.3 Food Labeling and Marketing 5.4 Food Safety Module 6: Plant Production 6.1 The Nature of Plants 6.2 Soil Science 6.3 Types of Crops 6.4 Crop Production Practices 6.5 Grain, Oilseed, and Pulse Production 6.6 Fruit, Tree Nut, and Vegetable Production 6.7 Cotton Production Module 7: Animal Production 7.1 Understanding Animals 7.2 Types of Livestock 7.3 Livestock Production Practices 7.4 Cattle Production 7.5 Poultry Production 7.6 Swine Production 7.7 Aquaculture Module 8: The Future of Agriculture 8.1 Feeding a Growing Population 8.2 Consumer Trends 8.3 Different Perspectives Completion Steps Judd-Murray Agricultural Literacy Assessment Instrument II, Post-test Capstone Certificate of Completion, to be printed by the participant How have the results been disseminated to communities of interest?Judd-Murray, R., & Spielmaker, D. M. (2024, June 26-27). Mission Possible: Agricultural Literacy Certification [Presentation]. 2024 National Agriculture in the Classroom Conference, Salt Lake City, Utah, USA. Role & Impact: I co-presented the one-hour presentation. Seventy educators from national and global organizations were instructed, recruited, and advised on registering for and utilizing the course to improve their programs. The research team is actively analyzing significant data that can be disseminated for publication and workshop presentation. Utah State University contacted us about producing a media press release regarding the course. The PI showcased the course and provided an interview, but no publication has been completed. The National Agriculture in the Classroom has advertised the course on its social media and quarterly newsletter. The National Center for Agricultural Literacy also advertised the course on its social media feeds and email listserv. The PI is very interested in assisting USDA-NIFA marketing in showcasing the course through the NIFA projects newsletter and PubAg. What do you plan to do during the next reporting period to accomplish the goals?
Nothing Reported
Impacts What was accomplished under these goals?
In Phase 1 (2021-2022), the research team assembled a 15-member panel. The Delphi study was a critical part of the ALCP's curriculum development, designed to determine the content of the 10-12 online modules. Fifteen agricultural literacy, education, and online learning experts participated in four rounds of communication and collaboration via Zoom, using electronic platforms to rank and comment on content. The committee reached a consensus on critical components to be included in the modules, guiding content curation and identifying areas of pedagogy to integrate. Most members were paid for their participation with grant funds. The study's findings directly informed the development of the educational modules and the learning management system. In Phase 2 (2022-2024), we completed the development of an intensive 8-moduleresearch-based online course to improve agricultural literacy. The specific features of the course and the website it is housed in include: WordPress. WordPress provides infrastructure for content management, user permissions, and the backend database. LMS plugin. The course's foundation is a WordPress LMS plugin (e.g., LearnDash) with customized underlying code tailored to our needs. Sleek and simple website interface. The website's main purpose is to get people to either login or purchase access to the course. This means providing clear navigation and prominent indicators of what learners can expect and why that's something they want (the "what's in it for me" principle). Secure domain and hosting.The site will be served over SSL. Accessible and usable. The site will be compliant with Section 508 requirements and WCAG AA standards. Additionally, all users will have an equally positive experience regardless of browser, screen size, operating system, or internet speed. Course purchase ($20). Course purchases are made using a standard payment processor. Participants can check out with a credit card or a discount code. Additionally, since the course is for K-12 educators, it is easy for participants to download their purchase receipt and submit it for reimbursement. School districts can purchase access for "groups" of educators. Strong course alignment. The assessments lead to learner outcomes, and the content/activities will help participants complete the assessments. Smart completion tracking. For data purposes, participants can see what they've done and still need to do. Drip content. Participants progress through the course specifically based on what they've already completed. Interactive and useful learning activities. Additionally, assessments can ideally be "graded" automatically. Community-building. Activities and spaces help build community among the learners. For example, a text--or video-based forum or shared workspace where they upload things like lesson plans and get feedback from others. Pre- and post-test. At the beginning and end of the ALCP, participants take the NALO assessments as a pre-test and a post-test. The NCAL team uses these to determine learning progress and knowledge gaps. Completion survey.Upon completion of the ALCP course modules, participants complete a survey with questions about their knowledge, attitudes, and perceptions concerning agricultural literacy, the course effectiveness, their self-efficacy regarding the use of agriculture as a content providing context for academic subjects, and their future plans for including more agricultural instruction in their academic content areas. Completion badges or certificates. After submitting their course survey, each participant will receive a digital certification or badge from Badgr. Unlimited lifetime content access. Every educator, volunteer, or program staff member who completes the course, regardless of which phase or beyond the grant funding period, will maintain access to the curriculum, content, and modules to maintain their commitment to agricultural literacy and share it with their students. Output Numbers Between May 20, 2024 and November 27, 2024: 1,354 educators enrolled in the course 978 completed the course requirements and achieved their digital certification The USDA-NIFA grant provided participant support costs (incentives) for 509 participants of the ALCP course. Over 6,100 hours of instruction have taken place A 76% completion rate within a 60-day-start to end session Educators who have completed the course have the potential to influence 15,300 K-12 students Participants were highly satisfied with the course, course navigation, and individual course objectives. Means were no more than 2 on a 5-point Likert scale (1 = Strongly Agree to 5 = Strongly Disagree); participants had a mean score of 1.45 out of 5 (SD = .71) on the question of whether they would be likely to recommend the course. 75% of participants chose to analyze a lesson plan for their capstone Agricultural Literacy Increase in Participants Not all the course data has been analyzed or prepared for publication and dissemination. However, these are some of the analyzed data. Participants in the pilot overall had a fair amount of knowledge when they started the course but still improved from pre- to post-test(paired samples T-test, t =-5.025, p <.001, two-sided) by a mean of 1.45 points (SD =1.82) out of 15 (10%). Differences in the pre-post change between formal vs volunteer educators were not statistically significant (F = .329, p = .25, two-sided). The largest score increase was a five-point change for a single participant. The pre-and post-tests presented 15 questions from the JMALI NALO assessments ( Judd-Murray, R., Warnick, B. K., Coster, D. C., & Longhurst, M. L. (2024). Development and validation of a high school agricultural literacy assessment. Advancements in Agricultural Development,5(3), 91-104. https://doi.org/10.37433/aad.v5i3.407). In evaluating the National Rollout participants, pre-test scores (M = 12, SD = 1.71) indicated that most (54%) enrollees began with practical and applicable agricultural proficiency. Post-test scores (M = 13, SD = 1.10) indicated participants gained some understanding throughout the course, with less variation among responses. Most participants gained 1.5 points (SD = 1.94) from pre-to post-test. Questions most frequently missed on both tests were related to technology use in agriculture. While becoming agriculturally literate will take more than one intervention, these results indicate the ALC course is moving participants toward an increased proficiency in agriculture. Participant Testimonials of the ALCP Course: Let me say, as someone who teaches specifically ag (grades 3-5 exploratoryagriculture teacher, but also a past middle and high school teacher as well as an agriculturemuseum employee), that this is one of the greatest courses I have seen for educating someone in ag literacy. I have recommended it to so many people around me as a great way to become more in tune with the world of agriculture!--Georgia Teacher "I wasn't planning to do it so quickly, but I enjoyed it. It was kind of like getting into a good book that you just don't really put down until all of a sudden, it's like, "Wow, I finished." It was funny at dinner yesterday. During our conversation, three different facts came up from the course. Pretty soon, the rest of my family will be ag literate too!"--Wisconsin Teacher
Publications
|
Progress 02/01/21 to 01/31/22
Outputs Target Audience:
Nothing Reported
Changes/Problems:In September, 2021, the co-PIs updated the Activity Completion Dates for the Plan of Work for the ALCP. These dates will not affect the objectives, funding or any of the methodology. The dates were changed dueto when the funding wasallocated and when the work could begin based on the co-PI's current workload. The changes are shown below: Table 1. Plan of Work for the ALCP Key Personnel Project Milestones Activity Completion Dates Performance Targets Phase 1: Development and Pilot Testing R. Judd-Murray & D. Spielmaker Determine the Delphi study panel members September 2021- January 2022 Minimum of three iterations Panel consensus on module content R. Judd-Murray & Amelia Content creation and module development (i.e., audio, visual, video creation, resource integration) January 2022 - August 2022 8-10 modules encompassing these potential topics (e.g., What is agricultural literacy (so what?)? What are the NALOs? Exploring the NALO themes; Agricultural literacy instruction; Evaluating agricultural literacy; Completing the capstone project) Educator/Graduate Student TBD Assisting Dr. Judd-Murray in content creation and module development (i.e., audio, visual, video creation, resource integration) January 2022 - August 2022 8-10 modules encompassing these potential topics (e.g., What is agricultural literacy? What are the NALOs? Exploring the NALO themes; Agricultural literacy instruction; Evaluating agricultural literacy; Completing the capstone project) D. Spielmaker Web interface integration management & digital badging development March 2022 - January 2023 Online framework established and prepared for content inclusion Instructional Designer Web interface development (i.e., course enrollment, content addition, payment/access codes, ADA compliance) October 2021-Jan 2023 Online framework established and prepared for content inclusion, student enrollment,participant payments, and badging implementation R. Judd-Murray & D. Spielmaker Pilot-project promotion & Paid-for advertising Jan 2023-February 2023 Use of Google and Facebook paid-for advertisements Participants enroll in ALCP Stakeholders express support for ALCP R. Judd-Murray & D. Spielmaker Project enrollment Participants begin course March 2023-April 2023 Notifications: May 1, 2023 June 1, 2023 Enroll at least 30 educators, 10 volunteer educators, and 10 new AITC staff members Educator/Graduate Student TBD (Amelia/Michelle) Participants begin course June 1, 2023- August 30, 2023 Maintain student contact Answer questions Monitor course progression Monitor course assessments K. Stofer Evaluation: Survey creation & begin data collection June 2023-Aug 30, 2023 Formative and summative evaluation tools completed Evaluations uploaded to Qualtrics survey tool Data collected from all course participants (Qualitative: open-ended survey questions, student reflection information) Quantitative: Course surveys (Likert scale) Data collected from student participants (Quantitative: NALO assessment scores, self-efficacy ratings) K. Stofer Evaluation: Data Analysis Participants complete course Sept 15, 2023 Data compiled using SPSS (Version 26) Report on pilot project submitted Phase 2: Maintenance and Sustainability R. Judd-Murray, D. Spielmaker, & Educator/Graduate Student Evaluate the efficacy of the pilot project Sept 2023 Review data points from the pilot project Revise curriculum, content, and assessment process to improve the course R. Judd-Murray & D. Spielmaker Project enrollment Participants begin course Aug 2023- open enrollment Enroll 500 participants in ALCP Educator/Graduate Student TBD Participants begin course Sept 1, 2023-open enrollment (500 participants by June 1, 2024) Maintain student contact Answer questions Monitor course progression Monitor course assessments R. Judd-Murray, D. Spielmaker, & Educator/Graduate Student Data collection and evaluation Sept 2023-June 1, 2024 Data collected from all course participants (Qualitative: open-ended survey questions, student reflection information) Quantitative: Course surveys (Likert scale) Data collected from student participants (Quantitative: NALO assessment scores, self-efficacy ratings) K. Stofer R. Judd-Murray & D. Spielmaker Final Report Grant Completion June 2024 Deadline: January 31, 2025 Report submitted Co-PDs attend mandatory meeting for PDAL Grant in Washington D.C. What opportunities for training and professional development has the project provided?
Nothing Reported
How have the results been disseminated to communities of interest?
Nothing Reported
What do you plan to do during the next reporting period to accomplish the goals??The plan of action for 2022, includes the curation of agricultural literacy content for the 8-10 online modules. The educational content will include the aggregation of activities, lesson plans, and resources from the National Center for Agricultural LIteracy's Curriculum Matrix. It will require crafting new video and media content, as well as lesson plans, and educational audio/video media that instructs users in current issues, instructional techniques, and other areas deemed critical by the Delphi committee. The modules will begin development in January, 2022. It is anticipated thatmodules will be completed by August 2022. It is anticipated that an educator/graduate student will assist the PI with the content development and resource creation. Beyond developing curriculum, the web interface integration management and digital badging development must be developed. The co-PI (Debra Spielmaker) will work with the instructional designer from March 2022-January 2023 to ensure a platform that can incorporate course enrollment, content additon, payment/access codes, and is ADA compliant. When the framework is completed, the educational content will be uploaded.
Impacts What was accomplished under these goals?
?Objective #1: Develop a research-based online agricultural literacy certification program (ALCP). ACCOMPLISHMENTS: 1) The priorities of the ALCP have been determined using quantitative and qualitative feedback from an expert Delphi study. Those priorities will be reflected in how the content for each of the 10-12 educational modules will be curated. Additionally, 2) a professional instructional designer has been hired and work has begun to develop an online content portal in WordPress that will be ADA accessible,reflect research-based design, and allow users to easily enroll, navigate, and complete the certification program.
Publications
|