Advanced UAV

UAV and smartphone-based 3D modeling integration with augmented reality (AR) animation

Semih Sami Akay — 2023-11-17

Unmanned Aerial Vehicles (UAVs), commonly referred to as drones, have increasingly become an essential tool in various domains, from agriculture to entertainment. One of their most transformative applications lies in the realm of 3D modeling. By utilizing high-resolution cameras and state-of-the-art sensors, smartphone and UAVs can capture spatial data from the environment, facilitating the generation of detailed 3D models of landscapes, structures, and objects. These models, in turn, can be seamlessly integrated into the domain of Augmented Reality (AR) to offer an immersive and interactive experience. This fusion of UAV-based 3D modeling with AR technology is not only pushing the boundaries of what's possible in various industries but also reshaping the way we interact with the digital and physical worlds. Also, UAVs can soar over regions that are either inaccessible or difficult for humans to reach, capturing a myriad of perspectives and angles. This ability ensures that the resultant 3D models are comprehensive, accurate, and rich in detail. On the other hand, AR technology superimposes digital information onto the real world, through devices such as smartphones, tablets, or AR glasses. When these precise 3D models generated by UAVs are embedded into AR environments, users can virtually explore, analyze, or manipulate these models within a real-world context. The symbiotic relationship between smartphone and UAV-based 3D modeling and AR holds promise for a multitude of applications. Whether it's for urban planning, entertainment, historical site preservation, or education, the merging of these two groundbreaking technologies is paving the way for innovative solutions and captivating experiences. This journey will delve into the intricacies of how smartphone and UAVs create 3D models and how these models find their application in the captivating world of AR. In this study, human 3D model was animated with different motions on building 3D model.

Using UAS for monitoring the summit of the Arenal Volcano Costa Rica

Ian Godfrey — 2023-11-17

The Arenal summit is seldom studied for several reasons. First, the eruptive activity has stopped since October 2010, second the active summit crater C is difficult to reach due to an intense steep climb through the tropical rainforest, and third, the summit has rapidly fluctuating weather patterns that make trails muddy and complicate field work sites. Still there is still significant international and national interest in the Arenal volcano in Costa Rica and our undertakings show the Arenal as it was in September 2022 when the summit was documented. The main objective of this survey was to document any potential emissions being emitted from the summit crater of Arenal. With both Sniffer4D units which gathered and log ged volcanic emission data on NO₂, SO₂, O₂, VOC’s, CO₂, CO, PM 1.0, PM 2.5, PM 10, O₃, NO₂+O₃ from the Sniffer4D and SO_2,CO_2, H₂S, HF, HCI, CO, CxHy/CH₄/LEL, H₂ from the SnifferV. By tracking these emissions at the active summit crater C valued volcanic emission data can be acquired and used by the Arenal SINAC park rangers, Universidad Nacional and the National Risk Management Group in Costa Rica the CNE. In addition, by conducting a survey with the FLIR One Pro thermal IR cameras we can inspect the summit area for potential thermal anomalies. By obtaining this temperature data more will be known about the level of thermal energy release at crater C, combined with the gas emissions recognized by the Sniffer units, a periodic “snap-shot” was obtained for the Arenal volcano. The final objective will be to document the unstable regions of the crater with a UAS and collect high quality videography and imagery used for creating Digital Surface Models with Nira software. We are also able to lift the Sniffer4D as a payload with the DJI Mavic 3 drone and document the degassing fumaroles identified with the thermal cameras. Three drone surveillance flights collected valued data that will contribute to overall general knowledge of the volcanic structure, vegetation coverage, erosion and areas of potential rock falls and fumarole fields.

Extraction of building areas with the use of unmanned aerial vehicles, calculation of building roof slopes

Mustafa Kaynarca — 2023-11-17

Extraction of building areas and calculation of roof slopes is a data set used in many areas such as urbanism, pre-disaster and post-disaster situation, city information systems, urban transformation, infrastructure, etc. The data obtained with the help of unmanned aerial vehicles is used in many sectors and fields. Being fast and economical, sensitive and detailed data production makes unmanned aerial vehicles advantageous. In our study, 540 photographs were taken with a UAV in an area of 75,000 m², various image processing techniques used in remote sensing and various analysis methods used in geographic information systems, buildings were extracted and roof slopes were classified. In the study, first planning was made for the area, ground control points were established and flights were made. The data obtained after these processes were obtained by photogrammetric methods, point cloud, digital surface model, digital terrain model and normalized digital elevation model and orthophoto data. With the help of orthophoto data with (rgb) red, green and blue bands, vegetation areas were tried to be determined with the help of red green blue vegetation index. In the normalized digital elevation model (ndsm) data obtained from the digital terrain model and the digital elevation model difference, the 3m threshold value was accepted for building detection, and the calculation was made by accepting objects higher than this value as buildings. It was tried to exclude vegetation from the valuation by masking with the help of red green blue vegetation index. After this process, morphology filter was applied on raster data. The generated building data was converted into vectorial data and a point was drawn in the center of the buildings by using orthophoto data for accuracy analysis in the study. It has been determined that there are 729 real buildings in the study area. It has been determined that there are 686 building data produced as vector data. Spatial intersection analysis used in geographic information systems was made from the name of this process. With the help of this intersection analysis, accuracy and precision were determined in the study. In addition to removing the building areas, it is aimed to determine the roof slopes. For this reason, the slope of the roof areas was calculated using the nsdm data. The slope calculation process is classified into 10% sections, and each 10% slope group is included in a class. However, a homogeneous slope data could not be reached due to the day heat, small warehouses and various materials on the roofs. For this reason, using the obtained slope data and the generated vector building data, the most repeated value of the slopes from the roof areas of the building was calculated and accepted as the building roof slope. As a result, the building areas and the slopes of the tents of these buildings were determined with high accuracy.

Statistical properties of image pixel brightness from the onboard optical location system

Andrei Sergeevich Solonar — 2023-11-17

The statistical properties of image pixel brightness were investigated to provide a rationale for the choice of the necessary mathematical image model. Video recordings of the ground situation, obtained from the onboard optical-location system of an unmanned aerial vehicle, were generated and analyzed. The requirements for a mathematical model of brightness under ground-based background-target conditions were formulated. Based on these requirements, a semi-Markov model of brightness with Poisson moments of transition from one state to another was proposed to describe pixel brightness. The adequacy of the proposed model in describing pixel brightness has been verified.

Launching the SnifferV and Sniffer4D multigas detectors into the active crater of the Poás Volcano in Costa Rica using unmanned aerial systems

Ian Godfrey — 2023-11-17

There are two Sniffer4D V2 devices we have been deploying in the field for scientific research with the Laboratory of Atmospheric Chemistry. We have successfully tested for volcanic emissions at the Turrialba volcano, Irazú volcano, Poás volcano, Arenal volcano and Tenorio volcano in Costa Rica. Sniffer4D - VOCs, O₂, SO₂, CO, CO₂, PM _{1, 2.5,10}, NO₂, O₃, NO₂ + O₃ which was used at the Poás Volcano National Park in Costa Rica during February and April of 2022 was now paired with another device specifically configured for volcanic emissions. The SnifferV (Volcanic) - SO₂, CO, CxHy, H₂S, CHL, CO₂, H₂ and HF. These Sniffer devices log longitude and latitude, temperature and humidity and calculate the area tested per each measurement which allowed us to measure the exact fumaroles with precision. There were 3 objectives for our trip to the Poas Volcano National Park 1. The first objective was to attach the SnifferV to the Aki-01 and conduct a flight with this drone system to the degassing fumaroles next to Laguna Caliente inside the active volcano crater of the Poás Volcano National Park. 2. The second objective was to walk with both Sniffer devices to the dormant crater of the Poas Volcano National Park named the Botos Lagoon. 3. The third mission was to hike in between these two craters Laguna Caliente and Botos Lagoon and find an acceptable control station on the eastern rim of the active crater to take gas readings with both Sniffer units.