Progress 09/01/09 to 08/31/13
Outputs
Target Audience: U.S. Army Corps of Engineers administrators and park rangers, Corps lakes visitors, outdoor recreation researchers and students, user experience professionals Changes/Problems:
Nothing Reported
What opportunities for training and professional development has the project provided?
Nothing Reported
How have the results been disseminated to communities of interest? Conference presentations, journal article, user experience project reports What do you plan to do during the next reporting period to accomplish the goals?
Nothing Reported
Impacts
What was accomplished under these goals?
Outputs (2012-2013 grant): The goal of this revision grant was to continue and extend prior research conducted on the role of the Internet in knowledge transfer, knowledge management and public participation in outdoor recreation in order to make recommendations from the Corps and non-Corps community regarding the development of knowledge management (KM) features for the NRM Gateway (http://corpslakes.usace.army.mil), in particular the Lake Discovery web site (http://corpslakes.usace.army.mil/goodtime.html). Task 1 involved continued evaluation of the usability and accessibility of the Lake Discovery prototypes. Prototypes that vary in aesthetics and information architecture were evaluated as to their usability and aesthetics. Outputs include an evaluation of three prototypes of Lake Discovery by an Internet survey of Corps park rangers/managers. A report of the results of the ranger/manager evaluation was completed. The research was presented at the Human-Computer International Conference in July. Findings provide the basis for specific design recommendations made in the report and presentation. Task 2 involved creating design guidelines for improving the usability and accessibility of the Corps Lakes Gateway (Visitors Page of the NRM Gateway) based on a series of usability evaluations conducted through this grant in previous years with persons with disabilities, including blind, low vision, dyslexic, seniors, as well as groups of college students and sighted adults. The final report was completed. For Task 3, further understanding of appropriate uses of the Internet for public participation, a Corps of Engineers mobile application for public participation is in its initial design stages. The design is based on research reported in previous years and a 2013 literature synthesis described in a separate accomplishments form. Task 4 involved developing a mobile application for the Corps Lakes Gateway. The MSU research team designed the survey instrument and surveys across the US were conducted through the summer of 2012; a Q&A page about the survey is posted at www.CorpsLakes.us/VIsitorSurvey. Secondly, the team began designing a mobile application for the Corps Lakes Gateway. Concept prototypes were developed and a survey sent to a nonrandom, convenience sample of users. Based on survey results that are documented in the final report, we have a clearer understanding of the first four layers of the mobile application. Outcomes (2012-2013 grant): According to the Pew Internet and American Life Project, 74% of Americans use the Internet, an increase of 20 percent since 2002. Sixty percent of American households have broadband connections, an increase of 47% from 2007. Subsequently, government natural resource management agencies are using the Internet more to conduct their routine functions including planning, management, public participation and staff training. The more known about the impacts of the Internet on natural resource decision making, the more that usable and accessible websites can be designed to share knowledge, capture tacit (informal) knowledge, help field staff conduct their daily missions and communicate with various public sectors. Persons with disabilities are particularly challenged when attempting to use the Internet. Based on our research, Corps of Engineers web designers have made several key improvements in the usability, aesthetics and accessibility of the Corps' of Engineers' NRM Gateway, http://corpslakes.usace.army.mil/ for both Corps and non-Corps audiences. Participants in our study understood and felt good knowing that they played a role in improving the communications function of a very large organization. Knowledge generated will be used to improve the information architecture, usability, and aesthetics of the Lake Discovery website and a related mobile device application, increasing its usefulness for Corps employees, park/recreation managers, students, researchers and visitors. Based on the recommendations regarding improvements in accessibility, all visitors, including those with vision and cognitive impairments, will find a more inclusive website. Improvements include enhancing searching capabilities, reorganizing the page layout, improving the navigational structure, and increasing accessibility for persons with disabilities by using more headings, tagging PDF files for accessibility, and ensuring that basic information is not hidden in densely worded paragraphs. As for the public participation effort , the initial design of a mobile application is the major output. Evaluation of the design and refinements await further funding. Work is completed on all tasks.
Publications
- Type:
Journal Articles
Status:
Published
Year Published:
2013
Citation:
Propst, D. B., Swierenga, S. J., Pierce, G. L., Jeong, E., and Coursaris, C. K. (2013). From the ground-up: Role of usability and aesthetics evaluation in creating a knowledge-based website for the U.S. Army Corps of Engineers. In Marcus, A. (Ed.), Design, User Experience and Usability, HCII 2013, Part IV, LNCS 8015, pp. 274-283. Springer-Verlag Berlin Heidelberg 2013.
- Type:
Conference Papers and Presentations
Status:
Published
Year Published:
2013
Citation:
Propst, D. B., Swierenga, S. J., Pierce, G. L., Jeong, E., and Coursaris, C. K. (2013). From the ground-up: Role of usability and aesthetics evaluation in creating a knowledge-based website for the U.S. Army Corps of Engineers. Conference presentation at Human-Computer Interaction International Conference in Las Vegas, NV, July 24, 2013.
- Type:
Other
Status:
Published
Year Published:
2013
Citation:
Decloniemaclennan, R. N. , Ismirle, J., Figlan, C., and Swierenga, S. J. (2013, February 25). Corps Lakes Gateway Accessibility Compliance Evaluation. Final Report. USDA/CSREES, USDA/CSREES, Grant # 2009-39478-20071 (Renewal). East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
- Type:
Other
Status:
Published
Year Published:
2013
Citation:
Propst, D. B., Swierenga, S. J., Pierce, G. L., and Jeong, E. (2013, January 23). Lake Discovery Usability and Aesthetics Internet Survey of USACE Park Rangers and Managers Final Report. USDA/CSREES, Grant # 2009-39478-20071 (Renewal). East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
- Type:
Other
Status:
Published
Year Published:
2013
Citation:
Swierenga, S. J. (2013, January 18). Corps Lakes Visitors Website Accessibility Recommendations from Usability Evaluations with Persons with Disabilities. Final Report. USDA/CSREES, Grant # 2009-39478-20071 (Renewal). East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
- Type:
Journal Articles
Status:
Published
Year Published:
2011
Citation:
Swierenga, S. J., Sung, J. E., Pierce, G. L., and Propst, D. B. (2011). Website design and usability assessment implications from a usability study with visually impaired and sighted users. In Stephanidis, C. (ed.), Universal Access in HCI, Part II, HCII 2011, LNCS 6766, pp. 382-389. Springer-Verlag Berlin Heidelberg 2011.
|
Progress 09/01/11 to 08/31/12
Outputs
OUTPUTS: For objective 1, enhancement of web-based knowledge management capabilities in the field of outdoor recreation, the purpose is to continue making recommendations from the Corps and non-Corps community regarding the development of knowledge management (KM) features for the NRM Gateway (http://corpslakes.usace.army.mil), in particular the Lake Discovery web site (http://corpslakes.usace.army.mil/goodtime.html). Objective 1a involved continued evaluation of the usability and accessibility of the Lake Discovery prototypes. Prototypes that vary in aesthetics and information architecture were evaluated as to their usability and aesthetics. Outputs include an evaluation of three prototypes of Lake Discovery by an Internet survey of Corps park rangers/managers. A report of the results of the ranger/manager evaluation is in progress; an abstract was accepted, data have been analyzed and a PowerPoint presentation was presented at the Leisure Research Symposium at the National Recreation and Parks Association Conference in November. Findings provide the basis for specific design recommendations made in the report and presentation. For objective 1b, continued evaluation of the usability and accessibility of the Visitors Page of the NRM Gateway by persons with disabilities and by seniors, there are no new outputs beyond those reported in previous years. For objective 2, further understanding of appropriate uses of the Internet for public participation, a Plan B master's paper, which updated the literature review on electronic methods of public participation and combined the results from all four previous case studies, was prepared and successfully defended by the student. The student's paper is currently being revised for journal submission. Two additional tasks agreed upon by Corps of Engineers and MSU research team included 1) providing technical assistance with instrument design and data analysis of the Corps of Engineers' national visitor survey, and 2) developing a mobile application for the Corps Lakes Gateway. The MSU research team designed the survey instrument, which was launched in August, 2011. Surveys across the US were conducted through the summer of 2012 and a Q&A page about the survey is posted at www.CorpsLakes.us/VIsitorSurvey. Secondly, work has begun on the development of a prototype of a mobile website/application for the Corps Lakes Gateway. Concept prototypes were developed and a survey sent to a nonrandom, convenience sample of users. Report development is underway. Based on survey results, we have a clearer understanding of the first four layers of the mobile application. Further testing and evaluation of the revised mobile application prototype will take place, this time by having outdoor recreationists complete tasks and provide feedback. PARTICIPANTS: MSU user experience researcher, Graham Pierce, analyzed data and co-authored some of the reports and presentations. Dr. Constantinos Coursaris, assistant professor of Telecommunications, Information Studies and Media, MSU, assisted in the development of the mobile application and related survey. TARGET AUDIENCES: Nothing significant to report during this reporting period. PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.
Impacts
According to the Pew Internet and American Life Project, 74% of Americans use the Internet, an increase of 20 percent since 2002. Sixty percent of American households have broadband connections, an increase of 47% from 2007. Subsequently, government natural resource management agencies are using the Internet more to conduct their routine functions including planning, management, public participation and staff training. The more known about the impacts of the Internet on natural resource decision making, the more that usable and accessible websites can be designed to share knowledge, capture tacit (informal) knowledge, help field staff conduct their daily missions and communicate with various public sectors. Persons with disabilities are particularly challenged when attempting to use the Internet. Based on our research, Corps of Engineers web designers have made several key improvements in the usability, aesthetics and accessibility of the Corps' of Engineers' NRM Gateway, http://corpslakes.usace.army.mil/ for both Corps and non-Corps audiences. Subjects who participated in our study understood and felt good knowing that they played a role in improving the communications function of a very large organization. Knowledge generated will be used to improve the information architecture, usability, and aesthetics of the Lake Discovery website and a related mobile device application, increasing its usefulness for Corps employees, park/recreation managers, students, researchers and visitors. Based on the recommendations regarding improvements in accessibility, all visitors, including those with vision and cognitive impairments, will find a more inclusive website. Improvements include enhancing searching capabilities, reorganizing the page layout, improving the navigational structure, and increasing accessibility for persons with disabilities by using more headings, tagging PDF files for accessibility, and ensuring that basic information is not hidden in densely worded paragraphs. As for the public participation study, in addition, subjects understood that the Internet is being used more and more by federal agencies to obtain public comment for policy decisions. Both agency personnel and citizens were happy to participate in a study that will help lead to improved democratic processes in the field of natural resource management and planning. Agency personnel who served as subjects wanted to know more about how to incorporate the factors that contribute to transparent and deliberative public participation processes into the design of their websites. Work is completed on one and partially completed on the two new tasks. Our assistance in the development of a survey instrument for a large federal agency will provide valuable planning and policy-related data for many years to come. As for the second new task, development of a mobile application prototype, usability testing is still underway and therefore the outcomes are pending.
Publications
- Parker, L. D., Propst, D. B., Pynnonen, D., & Dilworth, D. (2012). Electronic Public Participation in Natural Resource Decision Making: Internet Innovation or Traditional Public Meeting in Disguise East Lansing, MI: MSU, Social Science Lab, Department of Forestry.
- Swierenga, S. J., & Propst, D. B. (2012). User Experience Evaluation Techniques for Designing Usable and Accessible Websites. Workshop presented at the Michigan Recreation and Parks Association (MRPA) conference, February 2, 2012, Dearborn, MI.
|
Progress 09/01/10 to 08/31/11
Outputs
OUTPUTS: All efforts on objective 1, conduct selected economic impact assessments of the Corps' recreation program, ceased in December 2009. This objective was achieved at that time and the responsible investigator removed himself from the project. For objective 2, enhancement of web-based knowledge management capabilities in the field of outdoor recreation, the purpose is to continue making recommendations from the Corps and non-Corps community regarding the development of knowledge management features for the NRM Gateway (http://corpslakes.usace.army.mil), in particular the Lake Discovery website (http://corpslakes.usace.army.mil/goodtime.html). Prototypes that vary in aesthetics and information architecture were evaluated as to their usability and aesthetics. Outputs include two evaluations of three prototypes of Lake Discovery, one via interviews of college students and one by an Internet survey of Corps park rangers/managers. A final report for the student evaluation was revised and submitted to the Corps of Engineers. A report of the results of the ranger/manager evaluation is in progress; an abstract was accepted, data have been analyzed and a powerpoint presentation has been prepared for the Leisure Research Symposium at the National Recreation and Parks Association Conference in November. For objective 2, continued evaluation of the usability and accessibility of the Visitors Page of the NRM Gateway by persons with disabilities and by seniors, outputs include evaluations by persons who have dyslexia, healthy seniors, and a control group of sighted persons (http://corpslakes.usace.army.mil/visitors) and three reports regarding results as they pertain to usability and accessibility. Two papers were presented at separate international conferences and published in the proceedings. A third presentation was delivered as a refereed poster at an international conference. For objective 3, further understanding of appropriate uses of the Internet for public participation, we finished analyzing data from a case study at a Corp of Engineers project. The data came from semi-structured interviews conducted with agency personnel and citizens who participated in a shoreline management planning process. The interviews gauged satisfaction with electronic versus nonelectronic (i.e., "traditional") means of public participation. Outputs include a report of the findings and completed Master's thesis. Finally, two additional tasks agreed upon by Corps of Engineers and MSU research team included 1) providing technical assistance with instrument design and data analysis of the Corps of Engineers' national visitor survey, and 2) developing a mobile application for the Corps Lakes Gateway. The MSU research team designed the survey instrument, which was launched in August. Results are pending. Secondly, work has begun on the development of a prototype of a mobile website/application for the Corps Lakes Gateway. The team conducted a focus group with potential Corps visitors. The focus group explored features of existing mobile sites and applications for inclusion in a Corps Lakes Gateway mobile site. A report of the results of the focus group was submitted. PARTICIPANTS: In addition to participants previously reported, Eunseong Jeong and Jieun Sung, MSU graduate research assistants, assisted in data analysis, report writing and website design. Research Specialist, Graham Pierce, analyzed data and co-authored some of the reports and presentations. Dr. Constantinos Coursaris, assistant professor of Telecommunications, Information Studies and Media, MSU, assisted in the development of the mobile application and related focus group evaluation study. TARGET AUDIENCES: Nothing significant to report during this reporting period. PROJECT MODIFICATIONS: A second extension was approved by USDA NIFA, extending the termination date to 08/31/2012. The extension was approved on 07/13/2011.
Impacts
The more known about the impacts of the Internet on natural resource decision making, the more that usable and accessible websites can be designed to share knowledge, capture tacit (informal) knowledge, help field staff conduct their daily missions and communicate with various public sectors. Persons with disabilities are particularly challenged when attempting to use the Internet. During the current year, we conducted usability evaluations of the Visitors Page of the NRM Gateway with persons who have dyslexia and healthy seniors, as well as a group of adults without disabilities. These evaluations have enabled us to explore the strategies people with and without various abilities employ to access natural resources information over the Internet and through mobile applications. Methods entail website usability and accessibility testing using surveys, interviews and laboratory exercises that measure task performance on the Internet. The Corps of Engineers created its current knowledge management gateway on the Internet exclusively by and for Corps of Engineers managers. Educators, students, visitors and non-Corps public recreation managers have had little input as communities of interest. Our research yielded several best practices for designing effective public websites. Based on recommendations from this research, Corps of Engineers web designers have made, or are making, several key improvements in the effectiveness of the Corps' of Engineers' NRM Gateway, http://corpslakes.usace.army.mil/ for both Corps and nonCorps audiences. Improvements include enhancing searching capabilities, reorganizing the page layout, improving the navigational structure, and increasing accessibility for persons with disabilities by using more headings, tagging PDF files for accessibility, and ensuring that basic information is not hidden in densely worded paragraphs. A third set of methods involves in-depth interviews of agency managers and citizens who are or have been involved in online public participation processes. There are numerous benefits associated with using the Internet for public participation processes. At the same time, use of the Internet to meet public participation requirements may have unintended exclusionary consequences for certain citizen groups. Knowledge of advantages and limitations will enable web developers and Corps planners to make improvements to both online and off-line means of public participation. Knowledge of whose voices are included and excluded as federal agencies increasingly rely on the Internet to obtain public comment for policy decisions will lead to improved democratic processes in the field of natural resource management and planning.
Publications
- Coursaris, C. K., Swierenga, S. J., & Pierce, G. L. (2011). Corps Lakes Gateway Mobile Application/Website: Focus Group Report. East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
- Dilworth, D.M. & Propst, D.B. (2011). Use of the Internet for Public Participation in Natural Resource Decisionmaking: U.S. Army Corps of Engineers and the McNary Shoreline Management Plan. East Lansing, MI: Michigan State University, Social Science Lab, Department of Forestry. Parker, L.D. and Propst, D.B. (2011). Electronic public participation: Issues in effectiveness and equity. Presentation at the 17th International Symposium on Society and Resource Management, June 4-8, 2011. Madison, WI: University of Wisconsin.
- Swierenga, S. J., Sung, J. E., Pierce, G. L., & Propst, D. B. (2011). Website design and usability assessment implications from a usability study with visually impaired and sighted users. In Stephanidis, C. (ed.), Universal Access in HCI, Part II, HCII 2011, LNCS 6766, pp. 382-389. Springer-Verlag Berlin Heidelberg.
- Swierenga, S. J., Sung, J. E., & Propst, D. B. (2011). Outdoor recreation information website usability study with visually impaired and sighted users. In International Technology and Persons with Disabilities Conference Proceedings. Los Angeles, CA: CSU Northridge. Available online at: http://www.csunconference.org/index.cfmEID=80000300 Swierenga, S. J., Sung, J. E., & Propst, D. B. (2011). Lake Discovery: Usability and Aesthetics Evaluation with Undergraduate Recreation and Non-recreation Majors: Final Report. East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
- Swierenga, S. J., Propst, D. B., Pierce, G. L., & Sung, J. E. (2011). Impact of visual impairments on the duration of usability tests. Presented at the Usability Professionals' Association International Conference 2011, Atlanta, GA.
- Swierenga, S. J., & Sung, J. E. (2011). Corps Lakes Visitors Website, Dyslexic Users: Usability Test Report. East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
|
Progress 09/01/09 to 08/31/10
Outputs
OUTPUTS: 1. Conduct Selected Economic Impact Assessments and Communicate Results. Objectives are to update and maintain databases and conduct economic impact assessments that reflect a diversity of regional economic impact analysis problems pertaining to the Corps of Engineers (COE) recreation program. The purpose of these assessments is to demonstrate their utility to current and potential users. Outputs include reports that communicate the results of the applications and guidance on economic impact assessment procedures and web pages within the Corps Natural Resource Management Gateway (http://corpslakes.usace.army.mil). For example, see Value to the Nation (http://www.vtn.iwr.usace.army.mil/recreation/default.htm) where economic impact results, economic impact analysis tools and other related management guidance are shared with a wide variety of internal and external audiences. 2. Further Enhancement of Lake Discovery and the NRM Gateway Visitors Page. Purpose is to continue implementing recommendations from the Corps and non-Corps community regarding the development of knowledge management (KM) features for the NRM Gateway (http://corpslakes.usace.army.mil), in particular the Lake Discovery web site (http://corpslakes.usace.army.mil/goodtime.html). The two objectives are: continued enhancement and evaluation of the usability and aesthetics of the Lake Discovery prototypes, and continued evaluation of the usability and accessibility of the Visitors Page of the NRM Gateway by persons with disabilities and by seniors. Prototypes that vary in aesthetics and information architecture werr evaluated as to their usability and likelihood of generating tacit knowledge and social networks. Outputs include 2 separate evaluations of three prototypes of "Lake Discovery", one performed in-person by a sample of college students and one by a sample of Corps park rangers/managers. A report of the results of the student evaluation is complete and a report on the ranger/manager evaluation is in progress. Other outputs include evaluations by visually impaired (blind and low vision) and sighted persons of the NRM Gateway (http://corpslakes.usace.army.mil/visitors)and a report regarding results as they pertain to usability and accessibility. Several abstracts have been submitted to national conferences. 3. Further Understanding of Appropriate Uses of the Internet for Public Participation. The primary objective is to continue our case study research at at a Corp of Engineers project in which there was a recent public comment period regarding a natural resource planning or management issue. Semi-structured interviews were conducted with agency personnel and citizens who participated in the process to learn more about their demographic characteristics and satisfaction with electronic versus nonelectronic (i.e., "traditional") means of public participation. Outputs include a report of the findings, which is in progress, and a completed Master's thesis. PARTICIPANTS: In addition to participants previously reported, Eunseong Jeong, an MSU graduate research assistant, analyzed data pertaining to the ranger/manager evaluations of the three Lake Discovery website prototypes. In addition, Graham L. Pierce (Ph.D.), research specialist, has co-authored some of the reports and manuscripts. TARGET AUDIENCES: Nothing significant to report during this reporting period. PROJECT MODIFICATIONS: Nothing significant to report during this reporting period.
Impacts
According to the latest results from the Pew Internet and American Life Project, 74 percent of Americans use the Internet, an increase of 20 percent in seven years since 2002. Sixty percent American households have broadband connections, an increase from 47% in 2007. Subsequently, government agencies are using the Internet more to conduct their routine functions including planning, management, public participation and staff training. The more known about the impacts of the Internet on natural resource decision making, the more that usable and accessible websites can be designed to share knowledge, capture tacit (informal) knowledge, help field staff conduct their daily missions and communicate with various publics. Persons with disabilities are particularly challenged when attempting to use the internet. During the current year, we increased our sample size for blind and low vision persons. Currently we are conducting usability evaluations of the Visitors Page of the NRM Gateway with persons who have dyslexia and healthy seniors, as well as a group of adults without disabilities. These evaluations will allow us to explore the strategies people with and without various abilities employ to access natural resources information over the Internet. Methods entail website usability and accessibility testing using surveys, interviews and laboratory exercises that measure task performance on the Internet. The Corps of Engineers created its current knowledge management gateway on the Internet exclusively by and for Corps of Engineers managers. Educators, students, visitors and non-Corps public recreation managers have had little input as communities of interest. Our research yielded several best practices for designing effective public websites. Based on recommendations from this research, Corps of Engineers web designers have made, or are making, several key improvements in the effectiveness of the Corps' of Engineers' NRM Gateway, http://corpslakes.usace.army.mil/ for both Corps and nonCorps audiences. Improvements include enhancing searching capabilities, reorganizing the page layout, improving the navigational structure, and increasing accessibility for persons with disabilities by using more headings, tagging PDF files for accessibility, and ensuring that basic information is not hidden in densely worded paragraphs. A third set of methods involves in-depth interviews of agency managers and citizens who are or have been involved in online public participation processes. There are numerous benefits associated with using the Internet for public participation processes. At the same time, use of the Internet to meet public participation requirements may have unintended exclusionary consequences for certain citizen groups. Knowledge of advantages and limitations will enable web developers and Corps planners to make improvements to both online and off-line means of public participation. Knowledge of whose voices are included and excluded as federal agencies increasingly rely on the Internet to obtain public comment for policy decisions will lead to improved democratic processes in the field of natural resource management and planning.
Publications
- Dilworth, D.W. (2010). Use of the Internet for public participation in natural resource decision making:US Army Corps of Engineers and the McNary Shoreline Management Plan. MS Thesis. Michigan State University, East Lansing, MI.
- Swierenga, S. J., Sung, J. E., & Propst, D. B. (2010, July 27). Lake Discovery: Usability and Aesthetics Evaluation with Undergraduate Recreation and Non-recreation Majors: Final Report. East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
- Swierenga, S. J., Roberts, H., E., & Sung, J. E. (2010, September 27). Corps Lakes Visitors Website with Blind, Low Vision, and Sighted Users: Usability Test Report, v1.1. East Lansing, MI: Michigan State University, Usability/Accessibility Research and Consulting.
|
|