Source: UNIV OF WISCONSIN submitted to
CHANGING PUBLIC BEHAVIOR - INCREASING CITIZEN INVOLVEMENT THROUGH USE OF TARGET AUDIENCE INFORMATION
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
TERMINATED
Funding Source
Reporting Frequency
Annual
Accession No.
0208079
Grant No.
2006-51130-03749
Project No.
WIS01097
Proposal No.
2006-03926
Multistate No.
(N/A)
Program Code
110.A
Project Start Date
Sep 15, 2006
Project End Date
Aug 31, 2009
Grant Year
2006
Project Director
Andrews, E. L.
Recipient Organization
UNIV OF WISCONSIN
21 N PARK ST STE 6401
MADISON,WI 53715-1218
Performing Department
ENVIRONMENTAL RESOURCES CENTER
Non Technical Summary
Water educators transfer information to relevant audiences, provide water management tools and techniques, and facilitate the local environmental decision process. When educators focus on specific audiences, their work is more likely to lead to desired results. Many factors can influence whether an individual will adopt an environmentally significant behavior. This project creates and implements resources that educators can use to integrate information about their local situation into an outreach strategy that encourages citizens to take appropriate actions in their home, business, organization, or community.
Animal Health Component
(N/A)
Research Effort Categories
Basic
(N/A)
Applied
75%
Developmental
25%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
1120320302025%
1120320303025%
1330320302025%
1330320303025%
Goals / Objectives
The project will: a) Translate research-based target audience information into searchable Internet resources; b) Collect easy to use, cost-effective community analysis tools; and integrate them into searchable Internet resources; c) Develop and implement a minimum of 3 in-person and 3 distance education trainings focusing on how to collect and incorporate information about targeted audiences into outreach planning and evaluation; d) Develop and implement measures to evaluate participant skill development at 3 accomplishment levels; e) Support activities for a Community of Practice that improve participant skills and resources for assessing target audiences.
Project Methods
To assure that project products address the needs of stakeholders and accomplish project goals, we have identified two project teams who will work with us on an informal basis. The Content Expert Team includes professors from three Universities and two federal agency professionals who have particular expertise in human behavior and in citizen participation. The Training Expert Team also has expertise in the proposed project content, but its members have extensive experience in translating this type of content for use in local education programs. Three of the Training Team members are the state water coordinators for their respective state Extension water programs. The project also plans to reinvigorate an existing Water Outreach Community of Practice (CoP) which includes about 200 professionals from across the country. These professionals joined a University of Wisconsin listserv over the last several years, as they learned about the opportunity for collaboration from participation in conferences and trainings. We will invite the CoP to become involved in the development of materials, to help identify training opportunities, and to evaluate the successful implementation of various new resources. We will also enlist them to identify new research and social science tools that define what practices are shown to have an impact on knowledge change, skills development, and behavior change. KEY ACTIVITIES 1. Translate research-based information about selected audiences for 14 audiences into searchable on-line resources for educators 2. Collect easy to use, cost-effective community analysis tools. 3. Develop and implement in-person and distance education training for how to collect and incorporate information about targeted audiences into outreach planning. 4. Develop and implement measures to evaluate skill development at 3 accomplishment levels 5. Support activities for a Community of Practice (CoP) that improves participant skills and resources for assessing target audiences

Progress 09/15/06 to 08/31/09

Outputs
OUTPUTS: GOAL 1) Translate research-based information about selected audiences into searchable on-line resources for educators: In Year 3, we completed review of 117, 2004-07 studies that investigated some aspect of water outreach or education. The review applied a meta-analysis strategy that we had developed for a previous project. The raw analysis will be posted on our water outreach Web site as part of our target audience research section. Findings are translated into the online searchable format we created in Year 1. Year 1 work also included entry of findings from 150 studies published from 1988 - 2004. Entry of 2004 - 07 findings will be completed in 2009. When all findings are entered, the data base will include audience-specific findings for about 250 studies published from 1988 - 2007. GOAL 2) Collect easy to use, cost-effective community analysis tools: In Years 1 and 2, we created a Changing Public Behavior Web site, as a complement to our Water Outreach Web site. Both Web sites provide resources to help natural resource and extension professionals to improve the quality of their outreach programs. Resources developed for this project were developed with the assistance and review of our project expert teams. In Year 3, we finalized all online and workshop resources materials for our 7-step behavior-change analysis process, including easy to use, cost-effective community analysis tools. The process is designed to help educators analyze their target audience and select one or more outreach techniques likely to be the most effect at producing desired outcomes. All materials are posted on our Changing Public Behavior Web site, along with a pdf copy of the workshop workbook. GOAL 3) Develop and implement in-person and distance education training for how to collect and incorporate information about targeted audiences into outreach planning: In Year 3, we integrated results of our 5, Year 2 pilot test workshops into final teaching products, as well as presentations, workshops, and posters at 3 national conferences. Products include a workshop workbook, and an online course outline incorporating all online resources into short lessons, to be available in 2010. Presentations were conducted at: the 2009 USDA Water Quality conference, Cary Conference XIII (focusing on science communication), and the US EPA 5th National Conference for Nonpoint Source and Stormwater Outreach. We also provided "changing public behavior" training for staff at the National Environmental Education Foundation. PARTICIPANTS: The project provided professional development for extension educators and natural resource professionals working on water outreach. About 500 professionals participated directly in training events or paper presentations (not including poster viewers). But it did not provide opportunities for training or professional development for individuals who worked on the project. PROJECT DIRECTION AT THE UNIVERSITY OF WISCONSIN: Elaine Andrews, PI; Kate Reilly, project manager; Kevin Graeme, instructional technology; Deanna, instructional technology; Micah Morton, student; John Moore, student; Lydia X. Bi, student; Sarah Bowen, student; Michelle Kijek, student. CONTENT EXPERT TEAM: Marianne Krasny, Cornell University (citizen science and action research studies); Barbara McDonald, USDA Forest Service (ecosystem management and adult education); Lorna Michael Butler, Iowa State University (anthropologist, Henry A. Wallace Endowed Chair for Sustainable Agriculture); Theresa Trainor, US EPA Office of Water (anthropologist). TRAINING EXPERT TEAM: Joe Bonnell, The Ohio State University (Extension state water quality coordinator); John Leatherman (for Robert Wilson), Kansas State University, Cooperative Extension Service, Office of Local Government; Nancy Mesner, Utah State University (Extension state water quality coordinator); Georgia Jeppesen, US FWS, National Conservation Training Center Bob Simmons, Washington State University (Extension state water quality coordinator); Kris Stepenuck, University of Wisconsin (Volunteer Monitoring National Facilitation Project) AGENCIES: US EPA (Theresa Trainor); US FWS National Conservation Training Center (Randy Rutan); USDA Forest Service (Barbara McDonald). ORGANIZED GROUPS: The Association for Natural Resources Extension Professionals (ANREP; Viviane Simon-Brown, President, Oregon State University); The NEMO National Network (Nonpoint source education for municipal officials; coordinators: Chet Arnold and David Dickson University of Connecticut); The National Volunteer Water Quality Monitoring Network (coordinators: University of Rhode Island, Linda Green; University of Wisconsin, Kris Stepenuck); The Southern Region Water Group (Mark McFarland, PI, University of North Carolina; Tom O'Breza, conference chair, University of Florida). OTHER UNIVERSITIES: Marianne Krasny, Cornell University; Lorna Michael Butler, Iowa State University (Henry A. Wallace Endowed Chair for Sustainable Agriculture); Bob Simmons, Washington State University (Western Region Extension water program); Robert Wilson, Kansas State University Extension. TARGET AUDIENCES: Target audiences: extension educators and natural resource professionals working on water management and outreach PROJECT MODIFICATIONS: Not relevant to this project.

Impacts
USE OF FINDINGS: In the development phase, we used pre-workshop surveys to design audience-specific content for each training event. The survey described fourteen educator skills and eight social assessment skills, and asked respondents to identify those for which they could use the most assistance. We adapted workshop content to address the needs identified through the assessment. Pilot test workshop needs assessments and evaluations were compiled for 5 workshops and used to revise project materials and teaching techniques. 2008 workshop evaluations for 139 participants, who worked with about 20 different target audiences, indicated that over 80% thought the workshop increased their *confidence* and *abilities*in using Changing Public Behavior planning steps; indicated they had increased confidence in *applying educator skills*, and felt that the workshop increased their *awareness of sources of information* about educator skills; that they had increased confidence in *applying social assessment skills*, and felt that the workshop increased their awareness of *sources of information* about social assessment skills. RESOURCES: Project resources support for the following activities: a) a project manager who helped to write and edit project materials, create a Changing Public Behavior Web site as part of our Water Outreach Web site, and manage outreach activities; b) technical support staff who designed our online data base that enables natural resource and extension professionals to identify research findings; c) students who supported the meta-analysis investigation of 2004 - 07 studies, provided background research for development of project content, and other Web site and materials development tasks; d) travel expenses to deliver 5 pilot test workshops, to attend the annual USDA Water Conference, and to attend a few additional conferences. IMPACTS: USDA Water conference symposium planners used our resources at symposia for each year of the 3 years of the project. US EPA is incorporating project content into a 2009 revision of its publication: Getting In Step: A Guide for Conducting Watershed Outreach Campaigns, EPA Number: 841B03002; NTIS # PB2004-103792. This publication is a widely-used resource by watershed managers around the US. We are working in collaboration with a USDA Social Indicators project to incorporate project content into its short course for undergraduate students. The National Environmental Education Foundation is using our materials to critique behavior changing components of their programs. Project results have also enabled us to redesign the Water Outreach and Changing Public Behavior Web sites to offer a design more usable by our target audience. And finally, we are using project resources to develop 17 short lessons for an online course for natural resource professionals.

Publications

  • Groffman, P., D. Osmond, N. Nadkarni, C. Driscoll, E. Andrews, A. Gold, S. Allred, A. Berkowitz, M. Klemens, T. Loecke, M. McGarry, K. Schwarz, and M. Washington. 2010. The Role of Interface Organizations in Science Communication and Understanding. Frontiers in Ecology and the Environment.[in review]
  • Andrews, E. 2009. Poster: Changing Public Behavior - Assessing Professional Development Needs. Cary Conference XIII, Connecting the scientist to audiences engaged in environmental controversies. Millbrook, NY. May 5-7, 2009.
  • Andrews, E. 2009. Poster: Water Outreach Education: Target Audience Study. Cary Conference XIII, Connecting the scientist to audiences engaged in environmental controversies. Millbrook, NY. May 5-7, 2009.
  • Andrews, E. 2009. Addressing Challenges of Applying Social Assessment in Water Management Strategies. 5th National Conference for Nonpoint Source and Stormwater Outreach. Portland, OR.
  • Andrews, E. & K. Reilly. 2009. Changing Public Behavior pilot workshop. Proceedings 5th National Conference for Nonpoint Source and Stormwater Outreach. Portland, OR, May 11, 2009.
  • Andrews, E. & K. Reilly. 2009. Changing Public Behavior - Assessing Educator Skills. Environmental Communication & Social Marketing, Vol. 2:1. Madison, WI. Accessed March 15, 2009 at http://ecsm.uwex.edu/pdfs/EC&SMNewsletter-sp-su09.pdf
  • Andrews, E., K. Reilly, & R. Smail. 2010. Changing Public Behavior - Assessing Educator Skills. Journal of Extension, http://www.joe.org/. [in review].
  • Reilly, K. & E. Andrews. 2009. Assessing Our Skills and Confidence in Changing Public Behavior. Proceedings 2009 USDA CSREES National Water Quality Conference. St. Louis, MO.
  • Reilly, K. & E. Andrews. 2009. Poster: Changing Public Behavior: 2008 National Facilitation Activities. Proceedings 2009 USDA CSREES National Water Quality Conference. St. Louis, MO.


Progress 09/15/07 to 09/14/08

Outputs
OUTPUTS: In Year 2 the project made progress on three key activities. (1). Translate research-based information about selected audiences into searchable on-line resources for educators: Completed review of 55 of 117 relevant studies published from 2004 - 2007, using procedures developed for a review of literature published 1988-2004. We are adding education-related study findings to the searchable database as time allows. All 117 new citations have been added to the online database. (2). Collect easy to use, cost-effective community analysis tools: Authored 14 background content pieces for use in in-person and online training events. These were to provide additional detail for the 7-step outreach analysis process we published online in Year 1. (3). Develop and implement in-person and distance education training for how to collect and incorporate information about targeted audiences into outreach planning: Implemented 5 pilot training events, delivered in-person to Extension and natural resource professionals. Workshop participants were natural resources educators, managers, and administrators from Extension programs, public agencies and non-government organizations. The pilot workshops were designed to reveal which techniques and resources are most satisfying to participants as well as which are most likely to increase their self-confidence in applying social science techniques to promote pro-environmental behaviors. We created and implemented a pre-workshop assessment of participant needs for all 5 events, and an in-depth post-event evaluation applied to two all-day events. **Presentations**: (i) Communication & Marketing Campaigns: Delivery methods and strategies. Proceedings of the 2008 USDA-CSREES National Water Quality Conference, Research, Extension and Education for Water Quality and Quantity, Reno, NV. (ii) Water Outreach and Changing Public Behavior projects. Social Indicators 406 Grant meeting, Chicago, IL. Feb. 22, 2008. (iii) Public Perceptions and Practice: Methods and Strategies. University of Florida Water Institute Sustainable Water Resources Symposium. February 26-27, 2008. (iv) Changing public behavior with help from target audience research. Paper presented at the American Educational Research Association 2008 Annual Meeting, New York, NY. American Educational Research Association, 1430 K Street NW, Suite 1200, Washington, DC 20005. (v) Community Based Social Marketing. UWEX CNRED Southern District. May 2008. Changing Public Behavior workshop. Association of Natural Resources Extension Professionals (ANREP) bi-annual conference, Madison, WI. May 2008 (vi) Changing Public Behavior pilot workshop. Raleigh, N. Carolina. June 11, 2008. (vii) Changing Public Behavior: Increase citizen involvement using target audience research. Ecological Society of America. August 5, 2008. Session OOS9 - Ecological Literacy in Public Audiences. (viii) Changing Public Behavior pilot workshop. Puyallup, Washington. September 24, 2008. PARTICIPANTS: The Project Training Expert Team designed the in-person training program: Joe Bonnell, The University of Ohio; Georgia Jeppesen, US Fish and Wildlife Service; Nancy Mesner, Utah State University; Kate Reilly, University of Wisconsin; Bob Simmons, Washington State University; Kris Stepenuck, University of Wisconsin; Robert Wilson, Kansas State University. The Team was assisted by local experts for each training event. TARGET AUDIENCES: Extension educators, natural resource professionals, and other professionals focused on water education and outreach PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.

Impacts
(1). Needs assessment results. The pre-workshop survey implemented for each training event described fourteen educator skills and asked respondents to identify those for which they could use the most assistance. We adapted workshop content to address needs identified through the assessment. The results showed that participants were most likely to want help with the following *educator skills*: developing and implementing outreach activities that influence selected behaviors (79%); using target audience information to assess the potential for behavior change (64%); monitoring (59%); and evaluating results (63%). The pre-workshop survey also asked about what *social assessment skills* ( a subset of educator skills) they felt they needed. The respondents were most likely to want help with the following social assessment skills: selecting a data gathering or social assessment procedure (72%); applying a data gathering procedure (61%); analyzing and summarizing results (60%); and applying results once the data has been analyzed (54%). (2). Pilot workshop evaluation results. Workshop evaluations were completed for two all-day workshops, involving about 80 educators who worked with about 20 different target audiences. While these were analyzed separately, they are combined in this report for simplicity. A) 81% thought the workshop increased their *confidence* in using Changing Public Behavior planning steps "Moderately" to "A Lot." B) 84% thought the workshop increased their *abilities* to use Changing Public Behavior planning steps "Moderately" to "A Lot." C) 82% indicated they had "Slightly" to "Moderately" increased confidence in *applying educator skills*, and most respondents (84%) felt that the workshop increased their *awareness of sources of information* about educator skills "Moderately" to "A Lot. D) 80% indicated they had "Slightly" to "Moderately" increased confidence in *applying social assessment skills*, and most respondents (82%) felt that the workshop increased their awareness of *sources of information* about social assessment skills "Moderately" to "A Lot."

Publications

  • Andrews, E. 2008. Changing Public Behavior Web information page, Participatory Action Learning. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Participatory Action Learning Sample Methods. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Education Practices Checklist. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Selecting Intervention Technique(s): A Continuum of Choices. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Structured Observation. Available at wateroutreach.uwex.edu.
  • Andrews, E. & K. Reilly. 2008. The Changing Public Behavior project. Proceedings of the 2008 USDA-CSREES National Water Quality Conference, Research, Extension and Education for Water Quality and Quantity, Reno, NV.
  • Andrews, E. Chapter 11. 2009. Free-Choice Environmental Learning in Practice/ Research to inform environmental education practice. Free-Choice Learning and the Environment. Edited by John Falk, Joe E. Heimlich, and Susan Foutz. Maryland: Alta Mira Press. (in press)
  • Monroe, M., E. Andrews, K. Biedenweg. 2007. A Framework for Environmental Education Strategies. Applied Environmental Education and Communication 6:205-216.
  • Reilly, K. & E. Andrews. 2008. Changing Public Behavior Web information page, Arkansas Case Study. Available at wateroutreach.uwex.edu.
  • Reilly, K. 2008. Changing Public Behavior Web information page, Use the Water Outreach Education Web Site. Available at wateroutreach.uwex.edu.
  • Reilly, K. 2008. Changing Public Behavior Web information page, Web Site Resource for Outreach Planning. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Behavior Change Planning Tool. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, An Integrative Model of Behavior: Behavior Theories Worksheet. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Behavior Theories and Techniques. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Community-Based Research and Outreach,Ethics Considerations. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Guidelines for Selecting a Social Assessment Tool. Available at wateroutreach.uwex.edu.
  • Andrews, E. 2008. Changing Public Behavior Web information page, Informal Interviews with Key Informants. Available at wateroutreach.uwex.edu.


Progress 09/15/06 to 09/14/07

Outputs
OUTPUTS: In Year 1, the project made progress on three key activities. Information developed during Year 1 has been disseminated only among Content and Training Expert Teams. *1. Translate research-based information about selected audiences into search able on-line resources for educators: In Year 1, we created and tested on-line search able database of educational findings from 150 research studies published 1988-2004. The database allows educators to search by citation, audience (17 audiences), study theme (8 themes), or education practice (5 areas referencing approximately 50 best practices). The target audience data base is a tool for identifying research-based findings about specific audiences of interest to water scientists and managers. Findings are derived from research papers describing studies that could claim to identify best education practices for specific audiences. We are in the process of reviewing over 100 additional studies published from 2004-2007 and will add study findings as we are able to. The database is on a "test" server and will be posted on a public server late in 2007. *2. Collect easy to use, cost-effective community analysis tools: In Year 1, we worked with a Content Expert Team of Nationally known social science experts, to develop a print resource, "About social assessment tools: Purpose, use, selection, application." This is an extensive guide written for natural resource and Extension professionals. We have submitted the print resource to our experts for review, but have also posted the draft as Step #4 of a self-study resource on our Changing Public Behavior Web site. *3. Develop and implement in-person and distance education training for how to collect and incorporate information about targeted audiences into outreach planning: In Year 1, we worked with our Training Expert Team to get preliminary advice about how we can best use their talents. The project is developing in-person and on-line training with accompanying support materials. To date, the training team has reviewed out training outline and sample materials, and has provided a preliminary test of the target audience search able database. The Team suggested several stages of planning where they can review progress. PARTICIPANTS: Individuals are listed by function. Organizations are repeated separately. Elaine Andrews, PI, University of Wisconsin; Kate Reilly, project manager, University of Wisconsin; Kevin Graeme, instructional technology, university of Wisconsin; Schneider, Deanna,instructional technology, University of Wisconsin; *Content Expert Team: Marianne Krasny, Cornell University (citizen science and action research studies); Barbara McDonald, USDA Forest Service (ecosystem management and adult education0; Lorna Michael Butler. Iowa State University (anthropologist, Henry A. Wallace Endowed Chair for Sustainable Agriculture); Theresa Trainor, US EPA Office of Water (anthropologist); *Training Expert Team: Joe Bonnell, The Ohio State University (Extension state water quality coordinator); John Leatherman (for Robert Wilson), Kansas State University, Cooperative Extension Service, Office of Local Government; Nancy Mesner, Utah State University (Extension state water quality coordinator); Georgia jeppesen, US FWS, National Conservation Training Center; Bob Simmons, Washington State University (Extension state water quality coordinator); Kris Stepenuck, University of Wisconsin (Volunteer Monitoring National Facilitation Project); *Agencies: US EPA (theresa Trainor); US FWS National Conservation Training Center (Georgia Jeppesen); USDA Forest Service (Barbara McDonald); *Organized groups:The Association for Natural Resources Extension Professionals (ANREP, Viviane Simon-Brown, President, Orgeon State University); The NEMO National Network (Nonpoint source education for municipal officials; coordinators: Chet Arnold and David Dickson University of Connecticut): The National Volunteer Water Quality Monitoring Network (coordinators: University of Rhode Island, Linda Green; University of Wisconsin, Kris Stepenuck); The Southern Region Water Group (Mark McFarland, PI, University of North Carolina; Tom O'Breza, conference chair, University of Florida);*Other Universities: Marianne Krasny, Cornell University, Lorna Michael Butler, Iowa State University 9Henry A. Wallace Endowed Chair for Sustainable Agriculture); Bob Simmons, Washington State University (Western Region Extension Water Program); Robert Wilson, Kansas State University Extension TARGET AUDIENCES: Extension educators, natural resource professional, and other professionals focused on water education and outreach. PROJECT MODIFICATIONS: Not relevant to this project.

Impacts
Activities in Year 1 created and supported activities for a small Community of Practice (COP) that focuses on improving participant skills and resources for assessing target audiences (a key activity).

Publications

  • Andrews, E. 2007. How to Use Audience Information: Educator Self-Study Module, Steps 1-4. http://wateroutreach.uwex.edu/CPBhomepage1.cfm.
  • Andrews, E. 2007. Educator Self-Study Module, Background Information: What types of actions can citizens take; Types of behavior that can make a difference; Sample social assessment tools; Range and variety of potential techniques. http://wateroutreach.uwex.edu/CPBhomepage1.cfm.