UAV and smartphone-based 3D modeling integration with augmented reality (AR) animation
Main Article Content
Abstract
Unmanned Aerial Vehicles (UAVs), commonly referred to as drones, have increasingly become an essential tool in various domains, from agriculture to entertainment. One of their most transformative applications lies in the realm of 3D modeling. By utilizing high-resolution cameras and state-of-the-art sensors, smartphone and UAVs can capture spatial data from the environment, facilitating the generation of detailed 3D models of landscapes, structures, and objects. These models, in turn, can be seamlessly integrated into the domain of Augmented Reality (AR) to offer an immersive and interactive experience. This fusion of UAV-based 3D modeling with AR technology is not only pushing the boundaries of what's possible in various industries but also reshaping the way we interact with the digital and physical worlds. Also, UAVs can soar over regions that are either inaccessible or difficult for humans to reach, capturing a myriad of perspectives and angles. This ability ensures that the resultant 3D models are comprehensive, accurate, and rich in detail. On the other hand, AR technology superimposes digital information onto the real world, through devices such as smartphones, tablets, or AR glasses. When these precise 3D models generated by UAVs are embedded into AR environments, users can virtually explore, analyze, or manipulate these models within a real-world context. The symbiotic relationship between smartphone and UAV-based 3D modeling and AR holds promise for a multitude of applications. Whether it's for urban planning, entertainment, historical site preservation, or education, the merging of these two groundbreaking technologies is paving the way for innovative solutions and captivating experiences. This journey will delve into the intricacies of how smartphone and UAVs create 3D models and how these models find their application in the captivating world of AR. In this study, human 3D model was animated with different motions on building 3D model.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Ahmed, F., Mohanta, J. C., Keshari, A., & Yadav, P. S. (2022). Recent advances in unmanned aerial vehicles: a review. Arabian Journal for Science and Engineering, 47(7), 7963-7984. https://doi.org/10.1007/s13369-022-06738-0
Sevara, C., Verhoeven, G., Doneus, M., & Draganits, E. (2018). Surfaces from the visual past: Recovering high-resolution terrain data from historic aerial imagery for multitemporal landscape analysis. Journal of archaeological method and theory, 25, 611-642. https://doi.org/10.1007/s10816-017-9348-9
Alazzam, A., Aljarba, S., Alshomer, F., & Alawirdhi, B. (2021). The utility of smartphone 3D scanning, open-sourced computer-aided design, and desktop 3D printing in the surgical planning of microtia reconstruction: a step-by-step guide and concept assessment. JPRAS Open, 30, 17-22. https://doi.org/10.1016/j.jpra.2021.06.001
Ihsanudin, T., & Affriani, A. R. (2017, December). The Combination of Spherical Photogrammetry and UAV for 3D Modeling. In IOP Conference Series: Earth and Environmental Science, 98(1), 012057. https://doi.org/10.1088/1755-1315/98/1/012057
Erdoğan, A., Görken, M., & Kabadayı, A. (2022). Study on the use of unmanned aerial vehicles in open mine sites: A case study of Ordu Province Mine Site. Advanced UAV, 2(2), 35-40.
Karataş, L., Alptekin, A., & Yakar, M. (2022). Detection and documentation of stone material deterioration in historical masonry structures using UAV photogrammetry: A case study of Mersin Aba Mausoleum. Advanced UAV, 2(2), 51-64.
Kanun, E., Alptekin, A., Karataş, L., & Yakar, M. (2022). The use of UAV photogrammetry in modeling ancient structures: A case study of “Kanytellis”. Advanced UAV, 2(2), 41-50.
Chaudhry, M. H., Ahmad, A., & Gulzar, Q. (2020). Impact of UAV surveying parameters on mixed urban landuse surface modelling. ISPRS International Journal of Geo-Information, 9(11), 656. https://doi.org/10.3390/ijgi9110656
Kolev, K., Tanskanen, P., Speciale, P., & Pollefeys, M. (2014). Turning mobile phones into 3D scanners. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3946-3953.
Dabove, P., Grasso, N., & Piras, M. (2019). Smartphone-based photogrammetry for the 3D modeling of a geomorphological structure. Applied Sciences, 9(18), 3884. https://doi.org/10.3390/app9183884
Sirmacek, B., Shen, Y., Lindenbergh, R., Zlatanova, S., & Diakite, A. (2016). Comparison of Zeb1 and Leica C10 indoor laser scanning point clouds. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 3, 143-149. https://doi.org/10.5194/isprsannals-III-1-143-2016
Nocerino, E., Lago, F., Morabito, D., Remondino, F., Porzi, L., Poiesi, F., ... & Eisert, P. (2017). A smartphone-based 3D pipeline for the creative industry-the replicate EU project. 3D Virtual Reconstruction and Visualization of Complex Architectures, 42, 535-541. https://doi.org/10.5194/isprs-archives-XLII-2-W3-535-2017
Saorín, J. L., de la Torre-Cantero, J., Melián Díaz, D., & López-Chao, V. (2019). Cloud-based collaborative 3D modeling to train engineers for the industry 4.0. Applied Sciences, 9(21), 4559. https://doi.org/10.3390/app9214559
Scopigno, R., Callieri, M., Dellepiane, M., Ponchio, F., & Potenziani, M. (2017). Delivering and using 3D models on the web: are we ready?. Virtual Archaeology Review, 8(17), 1-9. https://doi.org/10.4995/var.2017.6405
Yiğit, A. Y., & Yakar, M. (2023). Modeling of the historical monument with mobile phone-based photogrammetry method. Advanced Engineering Days (AED), 6, 97-99.
Sang, X., Leng, X., Ran, X., Li, X., & Xue, L. (2022). A virtual 3D geological library based on UAV and SFM: application for promoting teaching and research on geological specimen and heritage online. Geoheritage, 14(2), 43. https://doi.org/10.1007/s12371-021-00615-2
Akay, S. S. (2023). İHA Tabanlı 3 Boyutlu Verilere Farklı Perspektiflerde Bakış: İTÜ Ayazağa Kampüsü. Turkish Journal of Remote Sensing and GIS, 4(1), 47-63. https://doi.org/10.48123/rsgis.1195012
Tavani, S., Pignalosa, A., Corradetti, A., Mercuri, M., Smeraglia, L., Riccardi, U., ... & Billi, A. (2020). Photogrammetric 3D model via smartphone GNSS sensor: Workflow, error estimate, and best practices. Remote Sensing, 12(21), 3616. https://doi.org/10.3390/rs12213616
Bemis, S. P., Micklethwaite, S., Turner, D., James, M. R., Akciz, S., Thiele, S. T., & Bangash, H. A. (2014). Ground-based and UAV-Based photogrammetry: A multi-scale, high-resolution mapping tool for structural geology and paleoseismology. Journal of structural geology, 69, 163-178. https://doi.org/10.1016/j.jsg.2014.10.007