|
|
|
| Low Signature Target Group Detection Based on Multimodal Data Learning Fusion Network |
| ZHAO Huipan 1， LIU Huanyu 2 |
| 1. CETC Network Communication Research Institute， Shijiazhuang 050081， Hebei， China；2. School of Electronics and Information Engineering， Harbin Institute of Technology， Harbin 150001， Heilongjiang， China |
|
|
|
|
Abstract Low signature target group detection is a difficult problem. With the development of sensor technology, the target detection method based on multimodal data fusion becomes possible. Traditional methods focus on the artificial design of multi-modal data fusion level, by using signal level and decision-making level fusion, and neglecting multi-modal inherent fusion features. In order to make full use of the inherent multimodal feature expression ability of deep convolution network, a point to point multimodal data learning fusion network is proposed, which can fuse data from visible, infrared and Doppler pulse radar data devices. The experimental results on FLIR_ADAS dataset show that the proposed algorithm can significantly improve the performance of low signature target group detection.
|
|
Received: 11 June 2021
Published: 06 September 2021
|
|
|
|
|
|
| [1] |
WANG Jianyuan, CHEN Xiaotong, ZHANG Yue, SUN Junge, SHI Donghao, CHEN Jinbao. Urban Target Detection Algorithm Based on Multi-Modal Fusion of UAV[J]. Air & Space Defense, 2024, 7(1): 32-39. |
| [2] |
WANG Mingyang (王明阳), SHI Liangren∗ (时良仁), LI Yuanlong (李元龙). Indoor Vehicle Positioning Based on Multi-Sensor Data Fusion[J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 77-85. |
| [3] |
SHI Jichao1 (石继超), WANG Ziheng2 (王子恒), ZHAO Xianchao1 (赵现朝), ZHANG Zhinan1∗ (张执南). Target Detection Algorithm Based On Human Judge Mechanism[J]. J Shanghai Jiaotong Univ Sci, 2022, 27(5): 660-670. |
| [4] |
DENG Chen, KONG Yinan, WANG Qing, CHEN Gong. Research on Empirical Engineering Correction Algorithm Integrating Physical Laws[J]. Air & Space Defense, 2022, 5(3): 73-79. |
| [5] |
ZHENG Dezhong, YANG Yuanyuan, HUANG Haozhe, XIE Zhe, LI Wentao. Multimodal Fusion Classification Network Based on Distance Confidence Score[J]. Journal of Shanghai Jiao Tong University, 2022, 56(1): 89-100. |
| [6] |
CAI Yunze, ZHANG Yanjun. Infrared Dim and Small Target Detection Based on Dual-Channel Feature-Enhancement Integrated Attention Network[J]. Air & Space Defense, 2021, 4(4): 14-22. |
| [7] |
WANG Yuexing, WU Yongguo, XU Chuangang. Infrared Ship Target Detection Algorithm Based on Deep Transfer Learning[J]. Air & Space Defense, 2021, 4(4): 61-66. |
| [8] |
TONG Pengfei, CHEN Hao, XU Xinpeng, ZHOU Ge. Study on Information Fusion Technology of Multi-missile Multi-target Collaborative Detection[J]. Air & Space Defense, 2020, 3(3): 54-62. |
| [9] |
ZHANG Yan, JIA Zhenyu, ZHOU Guren, HUANG Zhengrong, LIU Jingqiu. Infrared Dim Target Detection Based on Multi-directional Mixed Template[J]. Air & Space Defense, 2019, 2(1): 64-69. |
| [10] |
LI Shuoming (李硕明), CHEN Lei (陈磊), CHEN Shihong (陈世鸿). An SNN Ontology Based Environment Monitoring Method for Intelligent Irrigation System[J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(4): 577-. |
| [11] |
SUN Ting1,2,GENG Guohua2,ZHENG Enming3,WANG Ping4. The Weak Target Detection Method Based on
the Subspace Bearing Stability[J]. Journal of Shanghai Jiaotong University, 2018, 52(4): 480-487. |
| [12] |
ZHAO Yong (赵勇), HU Cheng (胡程), PENG Jin-liang*(彭金良), QIN Bin-jie* (秦斌杰). Target-to-Background Separation for Spectral Unmixing in In-Vivo Fluorescence Imaging[J]. Journal of shanghai Jiaotong University (Science), 2014, 19(5): 600-611. |
| [13] |
LI Jian,HE Liming,CAI Yunze. Multi-Sensor Data Fusion Algorithm with State Equality Constraints[J]. Journal of Shanghai Jiaotong University, 2014, 48(07): 893-898. |
| [14] |
LI Wu-yue1, LI Zhi-qiang1, FANG Tao1, HUO Hong1, GE Wei-li2. Saliency Detection Based on Phase Spectrum of Color Information[J]. Journal of Shanghai Jiaotong University, 2008, 42(10): 1613-1617. |
| [15] |
WANG Zhong-wei, CAO Qi-xin, LUAN Nan, ZHANG Lei. Autonomous Localization Technique of Submarine Inpipe Robot Based on Multisensor Data Fusion[J]. Journal of Shanghai Jiaotong University, 2008, 42(10): 1707-1711. |
|
|
|
|
2021, Vol. 4 
