Surveying seedlings for precision forestry
Part two of our feature on Scion’s recent advances in deep learning technology.
In the last few decades, the forestry sector has embraced a range of new precision management tools and techniques to manage forests on a new scale. Precision management is based on the concept that big productivity gains can come from smaller-scale, tailored management techniques. To continue this evolution, the forestry sector will require new technologies for data capture, giving rise to a suite of new, nuanced management methods.
Deep learning has the potential to play a large role in this transformation. Scion is pioneering a new deep learning-based system that uses low-cost visual (RGB) imagery collected by UAV (unmanned aerial vehicle) mounted cameras that can identify and map radiata pine seedlings. The algorithm that has been created could soon replace manual surveys, which are laborious, expensive, sometimes dangerous and only suited to small areas.
Scion’s initial deep learning models detected seedlings with extremely high accuracy. Between 94-98 per cent of seedlings in a range of test sites and landscapes were identified. This year, the team has taken that technology one step further, and we can now detect and pinpoint the location of each seedling.
How did we do it?
The process begins by gathering high-resolution imagery from a UAV, stitching it together, scaling and geographically aligning it – creating an orthomosaic. This provides an accurate way to connect objects in the imagery with precise physical locations that can be utilised by the algorithm. A key development of this work was to prepare this imagery using a ‘tile and buffer’ approach. This ensures small objects like seedlings are not lost when these large orthomosaics are fed into deep learning models designed for use on images from a smartphone.
Scion scientists Drs Alan Tan and Grant Pearse worked with Dr Matthias Franz from Hochschule Konstanz University in Germany to test their approach at Rangipo in the central North Island. The site was pastureland that has converted to an experimental forest establishment trial as part of Scion’s Growing Confidence in Forestry’s Future programme.
The model was given part of the dataset (imagery and field measurements with spatial data) that had many seedlings pre-identified to teach it how to recognise them. As there were so many seedlings the model could only be given a point to represent the seedling’s location. This is unusual for deep learning, which usually requires a ‘bounding’ box carefully drawn around the objects.
Data capture using a UAV, this imagery is then used by the deep learning algorithm.
What were the results?
The model achieved a very high detection rate of 99.5 per cent and only missed 16 of the 3014 seedlings in the dataset. The false negatives occurred where seedlings were undetected due to dense weed cover. There were also a few false positives caused by tall weeds being identified as seedlings.
The model’s performance was impressive. It only needed point locations for training which dramatically reduced the time and cost that would have been needed for traditional methods. The field measurements also played a big role in revealing seedlings hidden by weeds that would have been missed otherwise. Overall, the error rate remained very low and many seedlings hidden in weedy areas were still correctly detected.
Big picture
Seedling detection using remotely sensed data and deep learning techniques could provide a more efficient, safe and accurate assessment of stand densities and a way to accurately map seedlings. There are a range of tools that this individual tree level data could lead to in the future, including precision weed and disease control operations from UAVs and tree-level inventory.
In the coming years, New Zealand will need to plant a lot of trees to meet our goal of net zero carbon by 2050, and to provide more wood fibre-based resources for the future. Precision forestry techniques, like deep learning, will enable future forests to be optimised for productivity, sustainability and health, ensuring our forests meet their full potential.
