Method of Multi-agent Autonomous State Reconfiguration of Shipboard Chilled Water System

Abstract

Abstract: In consideration of the uncertainty of the modern ship environment and the requirements for the intelligence of integrated management of power platform, taking the shipboard chilled water system as the research object, the method of state reconfiguration based on the multi-agent autonomous decision making model with the existence of uncertainty was studied. The problem of state reconfiguration is formulated as a loosely coupled Markov decision process (MDP). Then the multi-agent autonomous decision making model based on MDP is established and the optimal policy is obtained by using genetic algorithm. Finally the performance of the optimal policy is examined in the numerical calculation and the autonomous state reconfiguration is realized by following the received policy. This method can increase the autonomous decision making level and enhance the mission effectiveness of shipboard chilled water system.

Key words: multi-agent, shipboard chilled water system, autonomous decision making, state reconfiguration, Markov decision process (MDP), genetic algorithm

CLC Number:

U 664.121

QIN Jiu-Feng, ZENG Fan-Ming, CHEN Yu-Tao. Method of Multi-agent Autonomous State Reconfiguration of Shipboard Chilled Water System[J]. Journal of Shanghai Jiaotong University, 2013, 47(02): 284-289.

References

［1］Scheidt D. Intelligent control of auxiliary ship systems［C］// The 2nd World Maritime Technology Conference. London, UK: IMarEST, 2006: 10721079.

［2］Scheidt D. Intelligent agentbased control［J］. Johns Hopkins APL Technical Digest, 2002, 23(4):423.

［3］Lively K, Scheidt D. Mission based engineering plant［C］// Proceedings of ASNE Reconfiguration and Survivability Symposium. Orlando: IEEE Press, 2005: 311318.

［4］Tichy P, Slechta P. Industrial MAS for planning and control［J］. Lecture Notes in Computer Science, 2002, 2322(12):137154.

［5］Maturana F, Staron R. Agent virtual machine for automation controllers example application: Shipboard automation［J］. Robotics and ComputerIntegrated Manufacturing, 2008, 24(5):616624.

［6］朱琼, 陈雪芳, 张洁. 面向代理的车间动态调度方法［J］. 上海交通大学学报, 2008, 42(7): 10461050.

ZHU Qiong, CHEN Xuefang, ZHANG Jie. Multiagent based dynamic job shop scheduling method［J］. Journal of Shanghai Jiaotong University, 2008, 42(7): 10461050.

［7］赵敏, 姚敏, 刘兼唐. 基于遗传算法的小卫星多Agent任务调度优化设计［J］. 仪器仪表学报, 2008, 29(7): 14751479.

ZHAO Min, YAO Min, LIU Jiantang. Task scheduling optimization design for small satellite based on multiagent and genetic algorithm［J］. Chinese Journal of Scientific Instrument, 2008, 29(7): 14751479.

［8］刘波, 陈哨东, 贺建良. 基于概率群集的多战机协同空战决策算法［J］. 上海交通大学学报, 2011, 45(2): 257261.

LIU Bo, CHEN Shaodong, HE Jianliang. Air combat decisionmaking for multiflight coordinated attack based on probability collectives［J］. Journal of Shanghai Jiaotong University, 2011, 45(2): 257261.

［9］Spaan M T J, Groen F C A. Team coordination among robotic soccer players［J］. Journal of Control Science and Engineering, 2009, 23(8). 112119.

［10］黎恒烜, 孙海顺, 文劲宇, 等. 用于舰船电力系统重构的多代理系统设计［J］. 中国电机工程学报, 2011, 10(31): 8187.

LI Hengxuan, SUN Haishun, WEN Jinyu, et al. Design of a multiagent system for shipboard power system reconfiguration［J］. Proceedings of the CSEE, 2011, 10(31): 8187.

［11］尚永爽, 李文海, 刘长捷. 部分可观测信息条件下装备剩余寿命预测［J］. 航空学报, 2012, 33(5): 848894.

SHANG Yongshuang, LI Wenhai, LIU Changjie. Prediction of remaining useful life for equipment with partially observed information［J］. Acta Aeronautica et Astronautica Sinica, 2012, 33(5): 848894.

［12］周坡, 曹志刚. 基于马尔可夫过程的卫星移动信道模型及长期预测方法［J］. 电子与信息学报, 2011, 33(12): 29482953.

ZHOU Po, CAO Zhigang. Markov process based satellite mobile channel model and long term prediction method［J］. Journal of Electronics & Information Technology, 2011, 33(12): 29482953.

［13］刘克. 实用马尔可夫决策过程［M］. 北京：清华大学出版社, 2004:710.

［14］LI Yongchang. A multiagent autonomous decision making process for resource allocation［J］. Journal of American Society of Naval Engineers, 2007, 38(6):10961107.

[1]	LIU Yahui, SHEN Xingwang, GU Xinghai, PENG Tao, BAO Jinsong, ZHANG Dan. A Dual-System Reinforcement Learning Method for Flexible Job Shop Dynamic Scheduling [J]. Journal of Shanghai Jiao Tong University, 2022, 56(9): 1262-1275.
[2]	YAN Qing, LU Jiansha, JIANG Weiguang, SHAO Yiping, TANG Hongtao, LI Yingde. Path Optimization of Stacker in Compact Storage System with Dual-Port Layout [J]. Journal of Shanghai Jiao Tong University, 2022, 56(7): 858-867.
[3]	ZHOU Tianyan, FENG Xiaoen, FAN Yunfeng, DONG Shiyin, LI Yuqing, JIN Huizhong. Optimization Model of Ground Air Defense Force Deployment to Avoid Excessive Air Defense Firepower [J]. Air & Space Defense, 2022, 5(4): 19-23.
[4]	WANG Xiaojian, HONG Jun, CHEN Jinghua, LI Hongguang. Weight Reduction Study of Box Structure Based on Parametric Modeling and Response Surface Optimization [J]. Air & Space Defense, 2022, 5(4): 60-66.
[5]	LIU Jiea (刘洁), ZHANG Baojib∗ (张宝吉). Multiobjective Optimization of Hull Form Based on Global Optimization Algorithm [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(3): 346-355.
[6]	WANG Zhuoxin, ZHAO Haitao, XIE Yuehan, REN Hantao, YUAN Mingqing, ZHANG Boming, CHEN Ji’an. Prediction of Modulus of Composite Materials by BP Neural Network Optimized by Genetic Algorithm [J]. Journal of Shanghai Jiao Tong University, 2022, 56(10): 1341-1348.
[7]	ZHOU Yutai, XU Yue, LI Yu, JIANG Guotao. Genetic Algorithm Based Method of Optimal Deployment for Three-Dimensional Radar Networks Under Jamming Situation [J]. Air & Space Defense, 2022, 5(1): 52-59.
[8]	LI Cuiming, WANG Ning, ZHANG Chen. Hierarchical Mission Planning for Cleaning Photovoltaic Panels Based on Improved Genetic Algorithm [J]. Journal of Shanghai Jiao Tong University, 2021, 55(9): 1169-1174.
[9]	JI Xiukun (冀秀坤), HAI Jintao (海金涛), LUO Wenguang (罗文广), LIN Cuixia (林翠霞), XIONG Yu(熊禹), OU Zengkai (殴增开), WEN Jiayan(文家燕). Obstacle Avoidance in Multi-Agent Formation Process Based on Deep Reinforcement Learning [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(5): 680-685.
[10]	JIN Yudong (靳宇栋), FENG Jiabo (冯家波), ZHANG Weijun (张伟军). UAV Task Allocation for Hierarchical Multiobjective Optimization in Complex Conditions Using Modified NSGA-III with Segmented Encoding [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 431-445.
[11]	GU Yifan, ZHAO Wenlong, TANG Shanjun, YANG Qingyu, ZHENG Xin. Research on Target Spatial Collaborative Positioning Methods for Distributed Active/Passive Imaging Detection System [J]. Air & Space Defense, 2021, 4(4): 119-126.
[12]	LI Biao, WANG Liwen, XING Zhiwei, WANG Sibo, LUO Qian. Cooperative Control of Aircraft Ground Deicing Resources [J]. Journal of Shanghai Jiao Tong University, 2021, 55(11): 1362-1370.
[13]	ZHUO Pengcheng, YAN Jin, ZHENG Meimei, XIA Tangbin, XI Lifeng. GA-OIHF Elman Neural Network Algorithm for Fault Diagnosis of Full Life Cycle of Rolling Bearing [J]. Journal of Shanghai Jiao Tong University, 2021, 55(10): 1255-1262.
[14]	WANG Jinfeng, CHEN Lu, YANG Wenhui. A Single Machine Scheduling Problem Considering Machine Availability Constraints [J]. Journal of Shanghai Jiao Tong University, 2021, 55(1): 103-110.
[15]	ZHAO Chaowang (赵朝望), YANG Jian (杨健), XIONG Wuyue (熊吴越), LI Jiatong (李佳潼). Two Generative Design Methods of Hospital Operating Department Layouts Based on Healthcare Systematic Layout Planning and Generative Adversarial Network [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(1): 103-115.