Tree species classification of drone hyperspectral and RGB imagery with deep learning convolutional neural networks
Nezami, S., Khoramshahi, E., Nevalainen, O., Pölönen, I., & Honkavaara, E. (2020). Tree species classification of drone hyperspectral and RGB imagery with deep learning convolutional neural networks. Remote Sensing, 12(7), Article 1070. https://doi.org/10.3390/rs12071070
Published inRemote Sensing
© 2020 by the authors. Licensee MDPI, Basel, Switzerland
Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include the detection of individual trees, tree species classification, biomass estimation, etc. Deep neural networks (DNN) have shown superior results when comparing with conventional machine learning methods such as multi-layer perceptron (MLP) in cases of huge input data. The objective of this research is to investigate 3D convolutional neural networks (3D-CNN) to classify three major tree species in a boreal forest: pine, spruce, and birch. The proposed 3D-CNN models were employed to classify tree species in a test site in Finland. The classifiers were trained with a dataset of 3039 manually labelled trees. Then the accuracies were assessed by employing independent datasets of 803 records. To find the most efficient set of feature combination, we compare the performances of 3D-CNN models trained with hyperspectral (HS) channels, Red-Green-Blue (RGB) channels, and canopy height model (CHM), separately and combined. It is demonstrated that the proposed 3D-CNN model with RGB and HS layers produces the highest classification accuracy. The producer accuracy of the best 3D-CNN classifier on the test dataset were 99.6%, 94.8%, and 97.4% for pines, spruces, and birches, respectively. The best 3D-CNN classifier produced ~5% better classification accuracy than the MLP with all layers. Our results suggest that the proposed method provides excellent classification results with acceptable performance metrics for HS datasets. Our results show that pine class was detectable in most layers. Spruce was most detectable in RGB data, while birch was most detectable in the HS layers. Furthermore, the RGB datasets provide acceptable results for many low-accuracy applications. ...
Publication in research information system
MetadataShow full item record
Additional information about fundingThis research was financially supported by the Business Finland DroneKnowledge project (Dnro 973 1617/31/2016) and by the Academy of Finland project “Autonomous tree health analyzer based on imaging UAV spectrometry” (Decision number 327861).
Showing items with similar title or keywords.
Chlorophyll Concentration Retrieval by Training Convolutional Neural Network for Stochastic Model of Leaf Optical Properties (SLOP) Inversion Annala, Leevi; Honkavaara, Eija; Tuominen, Sakari; Pölönen, Ilkka (MDPI AG, 2020)Miniaturized hyperspectral imaging techniques have developed rapidly in recent years and have become widely available for different applications. Combining calibrated hyperspectral imagery with inverse physically based ...
Estimating Grass Sward Quality and Quantity Parameters Using Drone Remote Sensing with Deep Neural Networks Karila, Kirsi; Alves Oliveira, Raquel; Ek, Johannes; Kaivosoja, Jere; Koivumäki, Niko; Korhonen, Panu; Niemeläinen, Oiva; Nyholm, Laura; Näsi, Roope; Pölönen, Ilkka; Honkavaara, Eija (MDPI AG, 2022)The objective of this study is to investigate the potential of novel neural network architectures for measuring the quality and quantity parameters of silage grass swards, using drone RGB and hyperspectral images (HSI), ...
Using Aerial Platforms in Predicting Water Quality Parameters from Hyperspectral Imaging Data with Deep Neural Networks Hakala, Taina; Pölönen, Ilkka; Honkavaara, Eija; Näsi, Roope; Hakala, Teemu; Lindfors, Antti (Springer, 2020)In near future it is assumable that automated unmanned aerial platforms are coming more common. There are visions that transportation of different goods would be done with large planes, which can handle over 1000 kg payloads. ...
Pölönen, Ilkka; Annala, Leevi; Rahkonen, Samuli; Nevalainen, Olli; Honkavaara, Eija; Tuominen, Sakari; Viljanen, Niko; Hakala, Teemu (IEEE, 2019)In this study we apply 3D convolutional neural network (CNN) for tree species identification. Study includes the three most common Finnish tree species. Study uses a relatively large high-resolution spectral data set, ...
Differentiating Malignant from Benign Pigmented or Non-Pigmented Skin Tumours : A Pilot Study on 3D Hyperspectral Imaging of Complex Skin Surfaces and Convolutional Neural Networks Lindholm, Vivian; Raita-Hakola, Anna-Maria; Annala, Leevi; Salmivuori, Mari; Jeskanen, Leila; Saari, Heikki; Koskenmies, Sari; Pitkänen, Sari; Pölönen, Ilkka; Isoherranen, Kirsi; Ranki, Annamari (MDPI AG, 2022)Several optical imaging techniques have been developed to ease the burden of skin cancer disease on our health care system. Hyperspectral images can be used to identify biological tissues by their diffuse reflected spectra. ...