J Shanghai Jiaotong Univ Sci ›› 2026, Vol. 31 ›› Issue (1): 209-220.doi: 10.1007/s12204-026-2903-3

• Intelligent Robots • Previous Articles     Next Articles

Synthetic Data-Driven Multi-Task Framework for UAV Detection and Classification

合成数据驱动的无人机检测与分类多任务框架

张靖凯,李新德,魏王子超,王紫瑶,马轲   

  1. School of Automation, Southeast University, Nanjing 210096, China
  2. 东南大学 自动化学院,南京210096
  • Received:2025-09-15 Revised:2025-10-10 Accepted:2025-10-15 Online:2026-02-28 Published:2026-02-03

Abstract: With the rapid development of unmanned aerial vehicle (UAV) technology, there is an increasingly urgent demand for intelligent detection, identification, and performance parameter inference techniques. However, existing UAV datasets face severe challenges including high acquisition costs, labor-intensive annotation, and data scarcity, and lack methods for directly predicting functional performance from single images. This paper proposes a UAV analysis framework based on synthetic data generation and multi-task deep learning. We construct an adaptive dataset generation system based on Unreal Engine 5, incorporating UAV size classification, adaptive distance adjustment algorithms, and enhanced 3D-to-2D coordinate transformation techniques for automated high-quality synthetic data generation. We design a multi-task collaborative learning network integrating visual information, distance information, and uncertainty quantification modules, supporting UAV detection, parameter prediction, functional classification, and size prediction. Experimental results demonstrate high similarity between synthetic and real data (Fr´echet inception distance is 21.05), with parameter prediction achieving mean absolute percentage errors of 29.1% and 27.0% for maximum speed and altitude respectively, and military-civilian classification accuracy reaching 62.5%. This method provides a low-cost, efficient solution for intelligent UAV analysis with considerable practical value.

Key words: unmanned aerial vehicle (UAV), synthetic dataset generation, multi-task learning, parameter prediction, uncertainty quantification

摘要: 随着无人机技术的快速发展,对智能检测、识别及性能参数推断技术的需求日益迫切。然而,现有的无人机数据集生成方法面临诸多严峻挑战,包括高昂的采集成本、劳动密集型标注以及数据稀缺。目前也缺乏能够从单张图像直接预测功能性能的方法。本文提出了一个基于合成数据的多任务无人机检测分类网络。构建了一个基于Unreal Engine 5的自适应数据集生成系统,结合无人机尺寸分类、自适应距离调整算法以及增强的 3D 到 2D 坐标变换技术,以实现高质量的合成数据自动化生成。设计了一个多任务学习网络,集成视觉信息、距离信息及不确定性量化模块,并支持无人机检测、参数预测、功能分类和尺寸预测的功能。实验结果表明:合成数据与真实数据之间具有高度的相似性(Fréchet初始距离为21.05),且参数预测在最大速度和高度方面的平均绝对百分比误差分别达到 29.1% 和 27.0%,军事-民用分类准确率达到62.5%。该方法为智能无人机分析提供了一种低成本、高效的解决方案,具有相当大的应用价值。

关键词: 无人机,合成数据集生成,多任务学习,参数预测,不确定性量化

CLC Number: