On behalf of an intelligent approach based on 3D CNN and multimodal remote sensing data for precise crop yield estimation: Case study of wheat in Morocco
Main Article Content
Abstract
Agriculture is a key sector in the global economy, and crop yield is a primary element in this field. Its estimation represents a troublesome task considering its link to market planning. Different techniques have been tested to estimate crop yield. However, they present several limits in terms of human effort and time. The agricultural world is now experiencing a digital revolution, for example the utilization of UAV (Unmanned Aerial Vehicle) provides high-resolution images of crops. Besides this, artificial intelligence techniques namely, DL (Deep Learning) enables today a revolution of the flow processing and improves the resulting information. This paper presents a case study of wheat yield estimation in Morocco using UAV multimodal remote sensing data and 3D CNN (3D Convolutional Neural Network). Our data was acquired during the growth season, and predicted yield was compared to in situ data. Based on our results, the RMSE value was 0.175 qx/ha. Our conclusions highlight the efficient role of convolutional neural network in capturing features in raw image data and the importance to improve resulting predictions by acquiring data over the entire period of growth, and the necessity to choose a temporal architecture, which is able to process temporal variations.
Article Details
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Weiss, M., Jacob, F., & Duveiller, G. (2020). Remote sensing for agricultural applications: A meta-review. Remote Sensing of Environment, 236, 111402.
Sagan, V., Maimaitijiang, M., Bhadra, S., Maimaitiyiming, M., Brown, D. R., Sidike, P., & Fritschi, F. B. (2021). Field-scale crop yield prediction using multi-temporal WorldView-3 and PlanetScope satellite data and deep learning. ISPRS journal of photogrammetry and remote sensing, 174, 265-281.
Nevavuori, P., Narra, N., Linna, P., & Lipping, T. (2020). Crop yield prediction using multitemporal UAV data and spatio-temporal deep learning models. Remote Sensing, 12(23), 4000.
Livieris, I. E., Dafnis, S. D., Papadopoulos, G. K., & Kalivas, D. P. (2020). A multiple-input neural network model for predicting cotton production quantity: a case study. Algorithms, 13(11), 273.
Alzadjali, A., Alali, M. H., Veeranampalayam Sivakumar, A. N., Deogun, J. S., Scott, S., Schnable, J. C., & Shi, Y. (2021). Maize tassel detection from uav imagery using deep learning. Frontiers in Robotics and AI, 136.
Martos, V., Ahmad, A., Cartujo, P., & Ordoñez, J. (2021). Ensuring agricultural sustainability through remote sensing in the era of agriculture 5.0. Applied Sciences, 11(13), 5911.
Zannou, J. G. N., & Houndji, V. R. (2019, April). Sorghum yield prediction using machine learning. In 2019 3rd International Conference on Bio-engineering for Smart Technologies (BioSMART) (pp. 1-4). IEEE.
Zhang, L., Zhang, Z., Luo, Y., Cao, J., & Tao, F. (2019). Combining optical, fluorescence, thermal satellite, and environmental data to predict county-level maize yield in China using machine learning approaches. Remote Sensing, 12(1), 21.
Gao, Y., Wang, S., Guan, K., Wolanin, A., You, L., Ju, W., & Zhang, Y. (2020). The ability of sun-induced chlorophyll fluorescence from OCO-2 and MODIS-EVI to monitor spatial variations of soybean and maize yields in the Midwestern USA. Remote Sensing, 12(7), 1111.
Wang, Y., Zhang, Z., Feng, L., Du, Q., & Runge, T. (2020). Combining multi-source data and machine learning approaches to predict winter wheat yield in the conterminous United States. Remote Sensing, 12(8), 1232.
Espinosa, C. E., Velásquez, S., & Hernández, F. L. (2020, March). Sugarcane Productivity Estimation Through Processing Hyperspectral Signatures Using Artificial Neural Networks. In 2020 IEEE Latin American GRSS & ISPRS Remote Sensing Conference (LAGIRS) (pp. 290-295). IEEE.
Wang, F., Wang, F., Zhang, Y., Hu, J., Huang, J., & Xie, J. (2019). Rice yield estimation using parcel-level relative spectral variables from UAV-based hyperspectral imagery. Frontiers in plant science, 10, 453.
Han, X., Wei, Z., Chen, H., Zhang, B., Li, Y., & Du, T. (2021). Inversion of winter wheat growth parameters and yield under different water treatments based on UAV multispectral remote sensing. Frontiers in plant science, 639.
Zheng, C., Abd-Elrahman, A., & Whitaker, V. (2021). Remote sensing and machine learning in crop phenotyping and management, with an emphasis on applications in strawberry farming. Remote Sensing, 13(3), 531.
Astaoui, G., Dadaiss, J. E., Sebari, I., Benmansour, S., & Mohamed, E. (2021). Mapping wheat dry matter and nitrogen content dynamics and estimation of wheat yield using UAV multispectral imagery machine learning and a variety-based approach: Case study of Morocco. AgriEngineering, 3(1), 29-49.
Mu, H., Zhou, L., Dang, X., & Yuan, B. (2019, August). Winter wheat yield estimation from multitemporal remote sensing images based on convolutional neural networks. In 2019 10th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp) (pp. 1-4). IEEE.
Wang, X., Huang, J., Feng, Q., & Yin, D. (2020). Winter wheat yield prediction at county level and uncertainty analysis in main wheat-producing regions of China with deep learning approaches. Remote Sensing, 12(11), 1744.
García-Martínez, H., Flores-Magdaleno, H., Ascencio-Hernández, R., Khalil-Gardezi, A., Tijerina-Chávez, L., Mancilla-Villa, O. R., & Vázquez-Peña, M. A. (2020). Corn grain yield estimation from vegetation indices, canopy cover, plant density, and a neural network using multispectral and RGB images acquired with unmanned aerial vehicles. Agriculture, 10(7), 277.
Yang, Q., Shi, L., & Lin, L. (2019, July). Plot-scale rice grain yield estimation using UAV-based remotely sensed images via CNN with time-invariant deep features decomposition. In IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium (pp. 7180-7183). IEEE.
https://www.codesofinterest.com/2016/11/difference-artificial-intelligence-machine-learning-deep-learning.html , [last accessed: July 02 2022].
Kim, N., & Lee, Y. W. (2016). Machine learning approaches to corn yield estimation using satellite images and climate data: a case of Iowa State. Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 34(4), 383-390.
Tian, H., Wang, P., Tansey, K., Han, D., Zhang, J., Zhang, S., & Li, H. (2021). A deep learning framework under attention mechanism for wheat yield estimation using remotely sensed indices in the Guanzhong Plain, PR China. International Journal of Applied Earth Observation and Geoinformation, 102, 102375.
Gavahi, K., Abbaszadeh, P., & Moradkhani, H. (2021). DeepYield: A combined convolutional neural network with long short-term memory for crop yield forecasting. Expert Systems with Applications, 184, 115511.
Merenda, M., Porcaro, C., & Iero, D. (2020). Edge machine learning for ai-enabled iot devices: A review. Sensors, 20(9), 2533.
Alibabaei, K., Gaspar, P. D., & Lima, T. M. (2021). Crop yield estimation using deep learning based on climate big data and irrigation scheduling. Energies, 14(11), 3004.
Li, J., Li, X., & He, D. (2019). A directed acyclic graph network combined with CNN and LSTM for remaining useful life prediction. IEEE Access, 7, 75464-75475.
Fernandez-Beltran, R., Baidar, T., Kang, J., & Pla, F. (2021). Rice-yield prediction with multi-temporal sentinel-2 data and 3D CNN: A case study in Nepal. Remote Sensing, 13(7), 1391.
Roy, A., & Mishra, D. (2019, October). ECNN: Activity Recognition Using Ensembled Convolutional Neural Networks. In TENCON 2019-2019 IEEE Region 10 Conference (TENCON) (pp. 757-760). IEEE.
Kang, Y., Meng, Q., Liu, M., Zou, Y., & Wang, X. (2021). Crop classification based on red edge features analysis of GF-6 WFV data. Sensors, 21(13), 4328.
Meghraoui, K., Sebari, I., El Kadi, K. A., & Bensiali, S. (2022). Towards 3D CNN for precise crop yield estimation using multimodal remote sensing data: Case study of wheat in Morocco. Advanced Engineering Days (AED), 3, 79-81.