Source: UNIV OF IDAHO submitted to NRP
PARTNERSHIP: REVISIONING PRECISION FORESTRY THROUGH TREE LEVEL MONITORING AND MODELING
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
ACTIVE
Funding Source
Reporting Frequency
Annual
Accession No.
1028775
Grant No.
2022-67021-37857
Cumulative Award Amt.
$729,251.00
Proposal No.
2021-11057
Multistate No.
(N/A)
Project Start Date
Sep 1, 2022
Project End Date
Feb 28, 2026
Grant Year
2022
Program Code
[A1521]- Agricultural Engineering
Recipient Organization
UNIV OF IDAHO
875 PERIMETER DRIVE
MOSCOW,ID 83844-9803
Performing Department
FRFS
Non Technical Summary
Revisioning Precision Forestry designs, develops, and tests the accuracy and precision of novel imaging technologies using drones (UAS) and other systems to implement improved processes for derivingforest inventory metrics within operational management standards. Our priority is to resolve constraints on access and use of terrestrial and aerial remote sensing technology to monitor, measure, and manage western United States forested ecosystems, which are under significant stress due to climate change, wildfires, insect attacks, increasing wood utilization demand, and a burgeoning carbon offset market. We propose to reduce access constraints by developing and publishing automated, open-access software algorithms forprocessing terrestrial and UAS remote sensing data into formats that aid visualizing, managing, and communicating forest stand and tree attributes using currently available, open-source forest modeling software. Specifically, we envision democratizing precision forestry through exploring novel principles, such as allometric relationships, to more precisely fuse (co-register) above and below canopy point clouds derived from terrestrial and UAS remote sensing platforms. We will then assess the automation of deriving individual tree and forest stand attributes from fused point clouds that would be directly ingestible by the Forest Vegetation Simulator program, the most widely used forest growth and yield software program within the United States. Lastly, we will evaluate the cost/benefit of utilizing photogrammetry alone to estimate forest and tree attributes, relative to more costly lidar remote sensing platforms. We will use advancements in computational machine learning (e.g., XGBoost), coupled with open-source analytical platforms (SQL, Python, R) to test and develop new methods for modeling the forested environment through readily accessible and relatively inexpensive remote sensing technologies.This research project is designed to solve a key national problem limiting the optimization of forest resource management. Namely, that many organizations and land managers have limited or no access to software support systems that enable comprehensive remote sensing quantification of tree and forest attributes. Accurate and comprehensive quantification of forest and tree attributes, in actionable and meaningful formats, is critical to proactively maintaining healthy and productive forests, capable of supplying long-term ecosystem services (e.g., fiber, carbon sequestration, habitat, water quality, cultural traditions). We intend to overcome these software and data access limitations by developing open-access software algorithms for processing point clouds of forested environments. Open-access is critical, as the threats and opportunities facing our forested ecosystems and the services they provide culturally, ecologically, and economically are only increasing. Access should not be limited to those with significant financial resources, but to all who have an interest and responsibility to manage our national forest resource. Project outcomes will provide software tools accessible by all stakeholders in the forest management community to allow precision forestry to 1) Promote sustainable forest ecosystem services, 2) Sustain natural resource-based economies, and 3) Advance the integration of technology into organizational forest management workflows.
Animal Health Component
100%
Research Effort Categories
Basic
(N/A)
Applied
100%
Developmental
(N/A)
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
12372102090100%
Goals / Objectives
Ourgoals are to: 1) democratize precision forestry through testing and validating low-cost off the shelf remote sensing platforms to accurately measure forest attributes above and below forest canopy (stem size, species, and location); 2) develop open-source algorithms for co-registering above and below canopy point clouds derived from lidar and photogrammetry; and 3) create an open-source software to convert point clouds into tree lists digestible by forest modeling platforms. These goals will be achieved through the completion of the following four objectives.Objective 1 seeks to enhance existing point cloud co-registration algorithms by integrating allometric models into the alignment process. We hypothesize that the allometric informed approaches will reduce above and below canopy point cloud co-registering errors. We will deliver open-source software allowing any individual or organization to produce an allometric informed co-registered point cloud collected above and below a forest canopy.Objective 2 will assess tree measurement accuracy from co-registered above and below canopy point clouds derived from Structure from Motion (SfM - inexpensive) against co-registered below canopy handheld mobile lidar scanning (HMLS - expensive) and above canopy SfM. Accuracy comparisons will occur across multiple forest productivity zones and species compositions in the western U.S. Stem mapped plots will be used to evaluate platform accuracy across Idaho, Oregon, and Colorado within Douglas-fir and ponderosa pine forests - the two most ecologically and economically important species in the western U.S.Objective 3 will perform a cost-benefit analysis of the remote sensing platform accuracy, error propagation, acquisition time, and tradeoffs between equipment cost and post-acquisition processing requirements.Objective 4 will develop an open-source software package to process SfM/HMLS derived point clouds, co-register, and produce an individual tree list for the scanned area. This tree list will be formatted to be compatible with the most widely used forest modeling software package in the U.S. - the US Forest Service Forest Vegetation Simulator.
Project Methods
Methods - Objective 1:The proposed methods will operate iteratively through the following four steps: 1) Generate local predictions of DBH using the heights of each tree extracted from the UAS-SfM dataset, where the prediction will be based on data from freely availableU.S. Forest Service Forest Inventory and Analysis data, a dataset containing more than 100,000 forest plots across the U.S. 2) Match the predicted DBH values for the UAS-SfM dataset with DBH values extracted from the terrestrial point cloud so that they minimize values extracted from the terrestrial point cloud and minimize DBH error. 3) Determine the x,y,z transformation that will minimize the distance between the matched predicted and extracted DBH values. 4) The resulting transformation will then be applied to the point clouds to generate a single co-registered dataset using the Maximum Likelihood Estimation Sample Consensus (MLESAC) algorithm, which will be classed into ground and tree architecture returns. We will assess the effectiveness of the proposed co-registration algorithm by assessing tree location accuracy within the individual above and below canopy datasets against the accuracy within the co-registered dataset. These accuracies will be quantified by comparing remotely sensed trees to the stem mapped trees. Although we will assess a suite of different RMSE metrics, vertical error metrics will include deviations from the tree base and tree height elevations, and horizontal error metrics will include deviations from the centered location of each tree.Methods - Objective 2:In each of the 16 study stands, traditional fixed area plots will be installed and located using a RTK GPS to ensure the data can be spatially aligned with remote sensing observations for validation. At each fixed plot area, all trees will be spatially located (elevation of tree base and x,y coordinate) and have their DBH, upper stem diameter (5.18 m above ground), height, crown base height, and species recorded. Shrub cover and height will be recorded and locations of large, downed wood to assess co-registration variability. These observations will allow for thevalidation of the remotely sensed tree-level parameters, such as DBH, height, and timber volume, but will also provide traditional stand-level summary estimates of density (i.e., basal area and trees per hectare) and biomass (i.e., cubic meters and tons per hectare of timber) for comparison with remote sensing estimates.Each of the study stands will be photographed using a Sony Alpha 7II with a 14 mm lens connected to an Emlid M2 RTK transponder to geotag the images. Photos will be collected while walking parallel paths through the stand spaced approximately 10 m apart. These photos will be processed using Agisoft Metashape Structure for Motion algorithm to generate high density terrestrial point clouds. Through segmentation of individual trees within the point cloud, characteristics, including DBH and upper stem diameter, will be extracted. A Zeb Horizon HMLS capable of measuring up to 300,000 points per second in single return mode within a maximum range of 100 m will be used to scan each of the 16 study sites. Scanner paths will be spaced approximately 20 m apart to ensure optimal coverage of each study area, obtain low scanner range noise, and reduce the drift associated with the receiver algorithm. The HMLS field data will be processed in GeoSLAM Hub software using the SLAM algorithm to integrate IMU positional data and calculated trajectory with distance and angle of each point to determine theirrelative position. Resulting point clouds will then undergo identical processing as the T-SfM data for extracting tree stem metrics.Each study stand will be flown with a DJI Matrice 210 RTK multirotor UAS equipped with a Zenmuse X5S camera (20.8 MP, 15 mm lens). Images will be acquired in a serpentine pattern with 90% forward and 85% side image overlap. The UAS will be operated at ~90 m altitude and a flight speed of 4 m s-1. Acquired imagery will be processed using Agisoft Metashape to generate high density point clouds for maximizing tree extraction from the resulting canopy height model (CHM). The site CHMs will be processed using a variable window function (VWF) to identify individual tree locations and heights.After data collection, the UAS-SfM datasets will be co-registered in separate steps with the coincident T-SfM and HMLS datasets to create two datasets for each site containing the above and below canopy point clouds. Extracted tree locations will be compared against field stem mapped tree locations to quantify omission and commission of individual trees, which will be analyzed against tree size and local forest density metrics to understand how forest structure impacts the success of remote sensing tree extraction. Additionally, individual tree DBH, upper stem diameter, taper, height, and volume from the remotely sensed datasets will be compared to the stem mapped values to quantify tree-level accuracy. We will compare remote sensing and stem mapped parameters using regression-based statistical equivalence testing. Further, we will test for intercept and slope equality between the sets of measures of the same parameter.We will assess individual species through constraining RandomForest (RF) classification predictions to potential species that are likely present within a stand due to soil type, latitude, elevation, aspect, moisture availability, etc. We will integrate forest attribute data, point cloud-derived structural data, and spectral datasets from the UAS systems. Through the RF approach, we will generate 1000 classification trees from a random 60% subset an calculate bootstrap error estimates by classifying 40% of the remaining training data. Based on the bootstrap calculations, we will determine species specific True Positive and False Positive rates.Methods - Objective 3:We will conduct a cost-benefit assessment of pure SfM and SfM+HMLS remote sensing technologies against traditional forest inventory strategies.During remote sensing data collection and processing, detailed records of vested time will be tracked and standardized as a measure of hours per acre so that direct comparisons of invested time can be made. These comparisons will also be compared against published standards for traditional forest inventory methodologies. Since the largest component of these remote sensing systems is expected to be the cost of terrestrial data collection, we will augment this effort by investigating how the intensity (e.g., proportion of area sampled) and strategy (i.e., strip, circular, square plots) of terrestrial remote sensing data collection impacts the cost-benefit relationship of precision forestry from remote sensing. This will be done by collecting 100% census of terrestrial data at each of the study sites and then resampling these data to represent different collection strategies. This will enable us to determine what percentage of the area needs to be sampled to still attain metrics to a precision acceptable to our stakeholders, thereby assessing realistic estimates of future cost. Cost will be measured as both fixed (i.e., equipment) and variable (i.e., collection and processing time) against different derived metrics of forest inventory precision.Methods - Objective 4:A simple graphical user interface (GUI) will be developed, which wraps the co-registration (Objective 1) and tree attribute derivation algorithms (Objective 2) into a package that allows the user to input co-registered point clouds, specify parameters, visualize the segmented trees, check for accuracies, and output tree attributes to an FVS-ready comma separated value (.csv) format. This GUI will allow the user to have control of the process using buttons, drop downs, checkboxes, and other control options typically found in interface design.

Progress 09/01/23 to 08/31/24

Outputs
Target Audience:Similar to prior year reporting, results were presented at varying regional and national/international conferences attended by our target audience: IUFRO Society of American Foresters annual conference International Conference on Forest Engineering Intermountain Forestry Cooperative Technical meeting Demonstrations to Roseburg Forest Products and Starker Forests Workshop with regional forest consultants on use in NIPF forest inventory development Changes/Problems:A hard drive hosting an aligned point cloud dataset crashed, and the derived product was unrecoverable. Effort began to reconstruct from the saved, original, raw data. Full recovery of this derived product is anticipated early 2025. What opportunities for training and professional development has the project provided?University of Idaho undergraduate and graduate students were trained in the use of Virtual Reality using Meta Quest 3 VR headsets and VR Forest to measure and validate tree metrics against field stem mapped plots. One graduate student and one undergraduate student from Oregon State University were trained in aligning point clouds obtained from various sources: terrestrial and aerial. A USFS research associate and graduate student assisted CO-I Tinkham with an uncrewed aerial system demonstration during a field tour as part of the Society of American Foresters 2024 National Convention. This data was then also used for a special session at the conference as a case study to demonstrate the process and how UAS data can be integrated into forest inventory strategies. How have the results been disseminated to communities of interest?Six invited and contributed presentations were delivered in this reporting year. These presentations spanned local meetings with project stakeholders to regional/national/international conferences. In addition, a webinar and a science bulletin were developed/delivered to illustrate the use of project research in developing remotely sensed forest inventory. What do you plan to do during the next reporting period to accomplish the goals?Work with the Forest Vegetation Simulator steering committee to develop method for using the near-census inventory data developed in the project as inputs to the model. These methods will be documented for broad dissemination and the resulting tool will be published for open-access use. - Creating an optimized structure from motion data processing workflow for individual tree segmentation that will be published. Evaluatethe influence of UAS acquisition parameters on forest inventory accuracy and data collection/processing efficiency to optimize methods for management implementation. Build out Objective 3 to validate project derived segmentation algorithms, compare against current open-source algorithms, and to provide error and efficiency metrics using mobile and UAV sensors relative to traditional, more expensive plane-based sensors.Rebuild terrestrial and aerial point cloud alignment derived products due to systems hard drive crash. Co-I Tinkham will be the lead instructor of a USDA Forest Service UAS Mapping Workshop to promote data collection and processing techniques that ensure quality data is being collected by federal agencies for management decision making.

Impacts
What was accomplished under these goals? Tested multiple open-source segmentation algorithms on project derived lidar from mobile/UAV/plane platforms. F-score tests used to assess outcomes from Objectives 1 through 4 and evaluate against project derived segmentation code. Algorithms tested were SegmentAnyTree, PointToTree, and LidR. Converted individual tree segmentation Python code from Linux based operating system to Python on a Windows based operating system. The conversion is still under development. Completed all forest sampling and remote sensing acquisitions of the Central Rockies study sites. Optimized R Statistical Program structure from motion point cloud processing for tree segmentation and DBH modeling, reducing data processing time by 70%. Year 2 data is under QA/QC for use in Objectives 2 through 4.

Publications

  • Type: Peer Reviewed Journal Articles Status: Published Year Published: 2024 Citation: Tinkham, W.T., Woolsey, G.A. 2024. Influence of Structure for Motion Algorithm Parameters on Metrics of Individual Tree Detection Accuracy and Precision. Remote Sensing 16(20), 3844
  • Type: Conference Papers and Presentations Status: Published Year Published: 2023 Citation: Tinkham, W.T. 2023. What Does the Future of Forest Inventory Look Like?  Panel Discussion. Society of American Forests  National Convention, October 2023. Sacramento, CA.
  • Type: Conference Papers and Presentations Status: Published Year Published: 2024 Citation: Tinkham, W.T., Kimsey, M., Strombu, B. 2024. Advances in Terrestrial and Drone-Based Remote Sensing at the Individual Tree Level. Intermountain Forestry Cooperative Annual Meeting, March 2024. Moscow, ID.
  • Type: Conference Papers and Presentations Status: Published Year Published: 2024 Citation: Tinkham, W.T., Woolsey, G. 2024. Eyes From the Sky: Drone Characterization of Dry Conifer Forests. Northern Colorado Technology Roadshow, May 2024. Fort Collins, CO.
  • Type: Conference Papers and Presentations Status: Published Year Published: 2024 Citation: Kimsey, M., Tinkham, W.T., Strombu, B. 2024. Democratizing precision forestry: Inclusive access for small landowners and enterpreneurs. NIFA-AFRI Program Managers Conference, July 2024. Manhattan, KS.
  • Type: Conference Papers and Presentations Status: Published Year Published: 2024 Citation: Tinkham, W.T., Woolsey, G., Battaglia, M.A., Lad, L.E. Drone Augmented Forest Inventories to Inform Silvicultural Prescriptions from Tree to Stand Scales. National Silviculture Workshop, August 2024. Olympia, WA.
  • Type: Other Status: Published Year Published: 2023 Citation: Eyes in the Sky: Using Drones for Forest Monitoring. Rocky Mountain Research Station: Science You Can Use Bulletin, Issue 63. https://www.fs.usda.gov/research/treesearch/67027
  • Type: Peer Reviewed Journal Articles Status: Published Year Published: 2023 Citation: Aaron M. Sparks, Alistair M.S. Smith, Andrew T. Hudak, Mark V. Corrao, Robert L. Kremens, Robert F. Keefe, Integrating active fire behavior observations and multitemporal airborne laser scanning data to quantify fire impacts on tree growth: A pilot study in mature Pinus ponderosa stands, Forest Ecology and Management, Volume 545, 2023, 121246, ISSN 0378-1127, https://doi.org/10.1016/j.foreco.2023.121246.


Progress 09/01/22 to 08/31/23

Outputs
Target Audience:The target audience are mainly land managers and researchers active in the forest management area. The focus will be on foresters that are engaged in the application of remote sensing techniques in forest inventory and assessment. Project topic was presented at numerous (9) regional and national conferences targeting NIPF, Industry, State and Federal forest land management organizations and employees - conferences listed below.Support for this project was excellent and individuals within each stakeholder group were identified to serve on the project advisory board. Conferences: 1) Society of American ForestersConference 2) Ecological Society of AmericaConference 3) North America Forest Menusurationists Conference 4) Intermountain Forestry Cooperative Conference 5) Multiple Regional/State SAF technical meetings 6) USFS online webinars 7) Mountain West UAS monthly meeting Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?Graduate students have been trained in the use of UAVs and ground-based mobile platforms for lidar and spectral data acquisition. Graduate students are being trained to QA/QC acquired data through code-based processing platforms. Trained graduate students in co-registration of aerial and terrestrial point clouds. Trained graduate students in aligning point clouds developed from different UAS flights. How have the results been disseminated to communities of interest? Nothing Reported What do you plan to do during the next reporting period to accomplish the goals?Finalize data acquisition with aerial and terrestrial lidar. Co-register the lidar-based point clouds for all three project areas. Finalize QA/QC of lidar, spectral, and mensurational data and begin algorithm development.Apply the tree identification and dimensional measurement algorithm to at least one of the areas. Current results will be presented at regional conferences to stakeholders.

Impacts
What was accomplished under these goals? Graduate students were onboarded at the three collaborating institutions to work concurrently on this project. Lidar and spectral remote sensing platforms were identified and obtained. Protocols for forest sampling were created to standardize mensurational acquisitions across the three research regions (Pacific Northwest, Northern Rockies, Central Rockies). All forest sampling (mensurational and stem maps) and remote sensing acquisitions havebeen completed in the Northern Rockies. Remote sensing acquisitions have been completed in the Pacific Northwest Region. Collected data is under QA/QC for future algorithm development.Enhanced the Python code for individual tree inventory from terrestrial laser scanning. ImprovedPython code for tree segmentation from aerial point clouds.

Publications