SOAR: Simultaneous Exploration and Photographing with Heterogeneous UAVs for Fast Autonomous Reconstruction

IROS 2024 Oral

Mingjie Zhang1,3,*, Chen Feng2,*, Zengzhi Li1,4, Guiyong Zheng1, Yiming Luo1,
Zhu Wang4, Jinni Zhou5, Shaojie Shen2, Boyu Zhou1,†

1 Sun Yat-Sen University.    2 The Hong Kong University of Science and Technology.    3 Northwestern Polytechnical University.   
4 North China Electric Power University.    5 The Hong Kong University of Science and Technology(Guang Zhou).   
*Equal Contribution    Corresponding Authors



Two demonstrations of SOAR. (The left scene is Pisa Cathedral, and the right is Sydney Opera House.)

Abstract


Unmanned Aerial Vehicles (UAVs) have gained significant popularity in scene reconstruction. This paper presents SOAR, a LiDAR-Visual heterogeneous multi-UAV system specifically designed for efficient reconstruction of complex environments. Our system comprises a LiDAR-equipped explorer with a large field-of-view (FoV), alongside photographers equipped with cameras. To ensure rapid acquisition of the scene's surface geometry, we employ a surface frontier-based exploration strategy for the explorer. As the surface is progressively explored, we identify the uncovered areas and generate viewpoints incrementally. These viewpoints are then assigned to photographers through solving a Consistent Multiple Depot Multiple Traveling Salesman Problem (Consistent-MDMTSP), which optimizes scanning efficiency and guarantees task consistency. Finally, photographers utilize the assigned viewpoints to determine optimal coverage paths for acquiring images. We present extensive benchmarks in the realistic simulator, which validates the performance of SOAR compared with classical and state-of-the-art methods.

System Overview


Top


Experimental Scenes


Experiment Details


Reconstruction Results


Special Demo for IROS2024


TODO


In the coming days, we'll be unveiling additional technical details and more demos of various scenarios. Stay tuned for updates on our website!