上海交通大学学报(英文版) ›› 2017, Vol. 22 ›› Issue (3): 322-328.doi: 10.1007/s12204-017-1838-0
JIAN Lixuan* (简立轩), YIN Dong (尹栋), SHEN Lincheng (沈林成), NIU Yifeng (牛轶峰)
出版日期:
2017-06-02
发布日期:
2017-06-04
通讯作者:
JIAN Lixuan (简立轩)
E-mail: jianlixuan@foxmail.com
JIAN Lixuan* (简立轩), YIN Dong (尹栋), SHEN Lincheng (沈林成), NIU Yifeng (牛轶峰)
Online:
2017-06-02
Published:
2017-06-04
Contact:
JIAN Lixuan (简立轩)
E-mail: jianlixuan@foxmail.com
摘要: Many human-machine collaborative support scheduling systems are used to aid human decision making by providing several optimal scheduling algorithms that do not take operator’s attention into consideration. However, the current systems should take advantage of the operator’s attention to obtain the optimal solution. In this paper, we innovatively propose a human-machine collaborative support scheduling system of intelligence information from multi-UAVs based on eye-tracker. Firstly, the target recognition algorithm is applied to the images from the multiple unmanned aerial vehicles (multi-UAVs) to recognize the targets in the images. Then, the support system utilizes the eye tracker to gain the eye-gaze points which are intended to obtain the focused targets in the images. Finally, the heuristic scheduling algorithms take both the attributes of targets and the operator’s attention into consideration to obtain the sequence of the images. As the processing time of the images collected by the multi-UAVs is uncertain, however the upper bounds and lower bounds of the processing time are known before. So the processing time of the images is modeled by the interval processing time. The objective of the scheduling problem is to minimize mean weighted completion time. This paper proposes some new polynomial time heuristic scheduling algorithms which firstly schedule the images including the focused targets. We conduct the scheduling experiments under six different distributions. The results indicate that the proposed algorithm is not sensitive to the different distributions of the processing time and has a negligible computational time. The absolute error of the best performing heuristic solution is only about 1%. Then, we incorporate the best performing heuristic algorithm into the human-machine collaborative support systems to verify the performance of the system.
中图分类号:
JIAN Lixuan* (简立轩), YIN Dong (尹栋), SHEN Lincheng (沈林成), NIU Yifeng (牛轶峰). Human Machine Collaborative Support Scheduling System of Intelligence Information from Multiple Unmanned Aerial Vehicles Based on Eye Tracker[J]. 上海交通大学学报(英文版), 2017, 22(3): 322-328.
JIAN Lixuan* (简立轩), YIN Dong (尹栋), SHEN Lincheng (沈林成), NIU Yifeng (牛轶峰). Human Machine Collaborative Support Scheduling System of Intelligence Information from Multiple Unmanned Aerial Vehicles Based on Eye Tracker[J]. Journal of shanghai Jiaotong University (Science), 2017, 22(3): 322-328.
[1] | CUMMINGS M L, BRUNI S, MERCIER S, et al. Automationarchitecture for single operator multiple UAVcommand and control [J]. International Command andControl Journal, 2007, 1(2): 1-24. |
[2] | JIAN L X, YIN D, SHEN LC, et al. Optimal attentionallocation to visual search tasks of multi-UAVs basedon operator model [C]//Proceedings of 2015 IEEE InternationalConference on Mechatronics and Automation.Beijing: IEEE, 2015: 1767-1771. |
[3] | SRIVASTAVA V, SURANA A, BULLO F. Adaptiveattention allocation in human-robot systems[C]//American Control Conference. Montr′eal: AACC,2012: 2267-2774. |
[4] | VERMA A, RAI R. Modeling multi operator-multi-UAV (MOMU) operator attention allocation problem[C]//Proceedings of 2013 International MechanicalEngineering Congress and Exposition. San Diego,California: ASME, 2013: 1-6. |
[5] | BERTUCCELLI L F, BECKERS N W M, CUMMINGSM L. Developing operator models for UAVsearch scheduling [C]//In AIAA Conference on Guidance,Navigation and Control. Toronto: AIAA, 2010:1-15. |
[6] | BERTUCCELLI L F, CUMMINGS M L. Scenariobasedrobust scheduling for collaborative human-UAVvisual search tasks [C]//Proceedings of 2011 50th IEEEConference on Decision and Control and EuropeanControl Conference. Orlando, Florida: IEEE, 2011:5702-5707. |
[7] | BAKER K, TRIETSCH D. Principles of sequencingand scheduling [M]. New York: Wiley-Blackwell, 2009. |
[8] | IRANPOOR M, FATEMI GHOMI S M T, ZANDIEHM. Due-date assignment and machine scheduling in alow machine-rate situation with stochastic processingtimes [J]. Computers & Operations Research, 2013, 40:1100-1108. |
[9] | SOTSKOV Y N, EGOROVA N G, LAI T C. Minimizingtotal weighted flow time of a set of jobs withinterval processing times [J]. Mathematical and ComputerModelling, 2009, 50: 556-573. |
[10] | PINEDO M L. Scheduling: Theory. Algorithms, andsystems [M]. New York: Springer, 2012. |
[11] | ALLAHVERDI A, AYDILEK H, AYDILEK A. Singlemachine scheduling problem with interval processingtimes to minimize mean weighted completion time [J].Computers & Operations Research, 2014, 51: 200-207. |
[1] | . [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 757-767. |
[2] | . [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(2): 190-201. |
[3] | . [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(1): 99-111. |
[4] | . [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(5): 577-586. |
[5] | . [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(5): 587-597. |
[6] | ZHAN Zhu (占竹), ZHANG Wenjun (张文俊), CHEN Xia (陈霞), WANG Jun (汪军) . Objective Evaluation of Fabric Flatness Grade Based on Convolutional Neural Network[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 503-510. |
[7] | XU Jiangchang (许江长), HE Shamin (何莎敏), YU Dedong (于德栋), WU Yiqun (吴轶群), CHEN Xiaojun, (陈晓军). Automatic Segmentation Method for Cone-Beam Computed Tomography Image of the Bone Graft Region within Maxillary Sinus Based on the Atrous Spatial Pyramid Convolution Network[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 298-305. |
[8] | ZHANG Yue (张月), LIU Shijie (刘世界), LI Chunlai (李春来), WANG Jianyu (王建宇). Rethinking the Dice Loss for Deep Learning Lesion Segmentation in Medical Images[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(1): 93-102. |
[9] | WU Jin, MIN Yu, YANG Xiaodie, MA Simin . Micro-Expression Recognition Algorithm Based on Information Entropy Feature[J]. Journal of Shanghai Jiao Tong University(Science), 2020, 25(5): 589-599. |
[10] | LIU Min, DENG Bin, TANG Ying, WU Minghu, WANG Juan . Low-Cost Approach for Improving Video Transmission Efficiency in WVSN[J]. Journal of Shanghai Jiao Tong University(Science), 2020, 25(5): 600-605. |
[11] | WANG Yuzong (王毓综), DENG Fei (邓飞), ZHAO Daxu (赵大旭), YE Jiaying (叶佳英), WANG Peixin. Monocular Dynamic Machine Vision-Based Pearl Shape Detection[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(5): 654-662. |
[12] | LI Dan (李丹), NIU Zhongbin (牛中彬), PENG Dongxu (彭冬旭) . Magnetic Tile Surface Defect Detection Based on Texture Feature Clustering[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(5): 663-670. |
[13] | XUE Ankang (薛安康), LI Fan* (李凡), XIONG Yin (熊吟). Automatic Identification of Butterfly Species Based on Gray-Level Co-occurrence Matrix Features of Image Block[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(2): 220-225. |
[14] | ZHOU Jingmei *(周经美), ZHAO Xiangmo (赵祥模), CHENG Xin (程鑫), XU Zhigang (徐志刚), ZHAO. Vehicle Ego-Localization Based on Streetscape Image Database Under Blind Area of Global Positioning System[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(1): 122-129. |
[15] | MA Jin (马进), XUE Teng (薛腾), SHAO Quanquan (邵全全), HU Jie (胡洁), WANG Weiming (王伟明. Research on Spatially Adaptive High-Order Total Variation Model for Weak Fluorescence Image Restoration[J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(Sup. 1): 1-7. |
阅读次数 | ||||||||||||||||||||||||||||||||||||||||||||||||||
全文 273
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||
摘要 681
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||