Method of Multi-agent Autonomous State Reconfiguration of Shipboard Chilled Water System

Abstract

Abstract: In consideration of the uncertainty of the modern ship environment and the requirements for the intelligence of integrated management of power platform, taking the shipboard chilled water system as the research object, the method of state reconfiguration based on the multi-agent autonomous decision making model with the existence of uncertainty was studied. The problem of state reconfiguration is formulated as a loosely coupled Markov decision process (MDP). Then the multi-agent autonomous decision making model based on MDP is established and the optimal policy is obtained by using genetic algorithm. Finally the performance of the optimal policy is examined in the numerical calculation and the autonomous state reconfiguration is realized by following the received policy. This method can increase the autonomous decision making level and enhance the mission effectiveness of shipboard chilled water system.

Key words: multi-agent, shipboard chilled water system, autonomous decision making, state reconfiguration, Markov decision process (MDP), genetic algorithm

CLC Number:

U 664.121

QIN Jiu-Feng, ZENG Fan-Ming, CHEN Yu-Tao. Method of Multi-agent Autonomous State Reconfiguration of Shipboard Chilled Water System[J]. Journal of Shanghai Jiaotong University, 2013, 47(02): 284-289.

References

［1］Scheidt D. Intelligent control of auxiliary ship systems［C］// The 2nd World Maritime Technology Conference. London, UK: IMarEST, 2006: 10721079.

［2］Scheidt D. Intelligent agentbased control［J］. Johns Hopkins APL Technical Digest, 2002, 23(4):423.

［3］Lively K, Scheidt D. Mission based engineering plant［C］// Proceedings of ASNE Reconfiguration and Survivability Symposium. Orlando: IEEE Press, 2005: 311318.

［4］Tichy P, Slechta P. Industrial MAS for planning and control［J］. Lecture Notes in Computer Science, 2002, 2322(12):137154.

［5］Maturana F, Staron R. Agent virtual machine for automation controllers example application: Shipboard automation［J］. Robotics and ComputerIntegrated Manufacturing, 2008, 24(5):616624.

［6］朱琼, 陈雪芳, 张洁. 面向代理的车间动态调度方法［J］. 上海交通大学学报, 2008, 42(7): 10461050.

ZHU Qiong, CHEN Xuefang, ZHANG Jie. Multiagent based dynamic job shop scheduling method［J］. Journal of Shanghai Jiaotong University, 2008, 42(7): 10461050.

［7］赵敏, 姚敏, 刘兼唐. 基于遗传算法的小卫星多Agent任务调度优化设计［J］. 仪器仪表学报, 2008, 29(7): 14751479.

ZHAO Min, YAO Min, LIU Jiantang. Task scheduling optimization design for small satellite based on multiagent and genetic algorithm［J］. Chinese Journal of Scientific Instrument, 2008, 29(7): 14751479.

［8］刘波, 陈哨东, 贺建良. 基于概率群集的多战机协同空战决策算法［J］. 上海交通大学学报, 2011, 45(2): 257261.

LIU Bo, CHEN Shaodong, HE Jianliang. Air combat decisionmaking for multiflight coordinated attack based on probability collectives［J］. Journal of Shanghai Jiaotong University, 2011, 45(2): 257261.

［9］Spaan M T J, Groen F C A. Team coordination among robotic soccer players［J］. Journal of Control Science and Engineering, 2009, 23(8). 112119.

［10］黎恒烜, 孙海顺, 文劲宇, 等. 用于舰船电力系统重构的多代理系统设计［J］. 中国电机工程学报, 2011, 10(31): 8187.

LI Hengxuan, SUN Haishun, WEN Jinyu, et al. Design of a multiagent system for shipboard power system reconfiguration［J］. Proceedings of the CSEE, 2011, 10(31): 8187.

［11］尚永爽, 李文海, 刘长捷. 部分可观测信息条件下装备剩余寿命预测［J］. 航空学报, 2012, 33(5): 848894.

SHANG Yongshuang, LI Wenhai, LIU Changjie. Prediction of remaining useful life for equipment with partially observed information［J］. Acta Aeronautica et Astronautica Sinica, 2012, 33(5): 848894.

［12］周坡, 曹志刚. 基于马尔可夫过程的卫星移动信道模型及长期预测方法［J］. 电子与信息学报, 2011, 33(12): 29482953.

ZHOU Po, CAO Zhigang. Markov process based satellite mobile channel model and long term prediction method［J］. Journal of Electronics & Information Technology, 2011, 33(12): 29482953.

［13］刘克. 实用马尔可夫决策过程［M］. 北京：清华大学出版社, 2004:710.

［14］LI Yongchang. A multiagent autonomous decision making process for resource allocation［J］. Journal of American Society of Naval Engineers, 2007, 38(6):10961107.

[1]	Liu Peijin, Ding Haojian, Yan Dongyang, Sun Haofeng, Huang Tao, Li Jie. Multi-Objective Approach for Optimizing Production Parameters of Low-Permeability Oil Well to Enhance Energy Efficiency [J]. J Shanghai Jiaotong Univ Sci, 2026, 31(2): 486-498.
[2]	Qu Xingru, Li Chu, Jiang Yuze, Long Feifei, Zhang Rubo. Cooperative Pursuit of Unmanned Surface Vehicles Using Multi-Agent Reinforcement Learning [J]. J Shanghai Jiaotong Univ Sci, 2026, 31(1): 187-194.
[3]	LU Bin, WANG Yixiao, PU Chuanqing, CHEN Yunhui, CHEN Bobo, FAN Feilong. Asynchronous Coordinated Control Method for Regional Multi-Agent Integrated Energy Systems Considering Voltage Deviation [J]. Journal of Shanghai Jiao Tong University, 2025, 59(6): 758-767.
[4]	YE Qichang, WAN Shizheng, LI Yueshu, CHEN Zhumei, LIU Shanglin. Research on Multi-Agent Training for Maritime Joint Air Defence Based on a Multi-Algorithm Framework with Adaptive Hierarchical Sharing [J]. Air & Space Defense, 2025, 8(6): 121-128.
[5]	ZHANG Cong, SHU Bingnan, ZHANG Jiangtao, JIN Yong. Multi-Objective Optimization Design of Ship Propulsion Shafting Based on Response Surface Methodology and Genetic Algorithm [J]. Journal of Shanghai Jiao Tong University, 2025, 59(4): 466-475.
[6]	ZHANG Rongfu, WANG Jinqiang, LIU Minxia. Optimal Design Method of Complex System Based on Resource Optimization [J]. Air & Space Defense, 2025, 8(3): 86-94.
[7]	LI Yijia, LI Jianuo, KE Liangjun. Design and Verification of UAV Cooperative Defense Strategy Based on Reinforcement Learning [J]. Air & Space Defense, 2025, 8(3): 73-85.
[8]	HAN Yiming, HE Bin, YANG Bo, LI Jiale. Optimal Planning of Electric Vehicle Charging Stations Combined with Battery Energy Storage Systems Considering Driving Characteristics [J]. Journal of Shanghai Jiao Tong University, 2025, 59(11): 1720-1731.
[9]	SUN Dongyi, PU Yuting, ZHANG Jianbang. Target Assignment Method of Air Defense Missile Based on GA-BP Neural Network [J]. Air & Space Defense, 2025, 8(1): 62-70.
[10]	LU Qingchang, LIU Peng, QIN Han, XU Pengcheng. Optimization of Road Network Recovery Decisions Considering Road Section Recovery Differences [J]. Journal of Shanghai Jiao Tong University, 2024, 58(7): 1118-1129.
[11]	DU Haikuo^1,2 (杜海阔), GUO Zhengyu^3，4(郭正玉), ZHANG Lulu^1,2(章露露), CAI Yunze^1,2∗ (蔡云泽). Multi-Objective Loosely Synchronized Search for Multi-Objective Multi-Agent Path Finding with Asynchronous Actions [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 667-677.
[12]	JIN Feiyu (金飞宇), CHEN Longsheng^∗ (陈龙胜), LI Tongshuai (李统帅), SHI Tongxin (石童昕). Distributed Cooperative Anti-Disturbance Control for High-Order MIMO Nonlinear Multi-Agent Systems [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 656-666.
[13]	DONG Yubo¹ (董玉博), CUI Tao¹ (崔涛), ZHOU Yufan¹ (周禹帆), SONG Xun² (宋勋), ZHU Yue² (祝月), DONG Peng^1∗ (董鹏). Reward Function Design Method for Long Episode Pursuit Tasks Under Polar Coordinate in Multi-Agent Reinforcement Learning [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 646-655.
[14]	GENG Zongsheng¹ (耿宗盛), ZHAO Dongdong^1,2 (赵东东), ZHOU Xingwen¹ (周兴文), YAN Lei¹ (闫磊), YAN Shi^1,2∗ (阎石). Leader-Following Consensus of Multi-Agent Systems via Fully Distributed Event-Based Control [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 640-645.
[15]	XING Youjing¹ (邢优靖), GAO Jinfeng^1∗ (高金凤), LIU Xiaoping^{1, 2} (刘小平), WU Ping¹ (吴平). Event-Triggered Fixed-Time Consensus of Second-Order Nonlinear Multi-Agent Systems with Delay and Switching Topologies [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 625-639.