上海交通大学学报

上海交通大学学报（自然版） ›› 2013, Vol. 47 ›› Issue (07): 1009-1014.

• 自动化技术、计算机技术 •    下一篇

基于启发式退火拓扑择优机制的稀疏联想记忆实现

杨静1，孔斌1，王斌2   

  1. （1. 中国科学院合肥智能机械研究所，合肥 230031； 2. 中国科学技术大学 信息科学与技术学院，合肥 230022）
  • 收稿日期:2012-08-27 出版日期:2013-07-30 发布日期:2013-07-30
  • 基金资助:

    国家自然科学基金资助项目（91120307）

Sparsely Connected Associative Memory Based on the Preferential Mechanism of Heuristic Annealed Topology

YANG Jing1,KONG Bin1,WANG Bin2   

  1. (1. Institute of Intelligent Machines， Chinese Academy of Sciences，Hefei 230031，China；2. School of Information Science and Technology， University of Science and Technology of China， Hefei 230022， China)
  • Received:2012-08-27 Online:2013-07-30 Published:2013-07-30

摘要：

借鉴统计物理学中的“退火”概念，针对已有稀疏互联联想记忆模型中只考虑网络连接随机稀疏方式，缺乏面向特定模式存储任务的确定性操作，使用非平衡态统计分析方法，讨论了有限代谢能量资源约束下的网络结构最优稀疏原则，给出了相应的理论推导.在此基础上，研究了面向特定学习任务的网络稀疏结构自适应方法，构建了基于启发式退火拓扑择优机制的稀疏联想记忆模型.实验表明，该模型既具有一定的生物学基础，维持了网络结构广泛稀疏互联的特性，又能在网络资源受限条件下达到最优联想记忆性能，符合神经生物系统本身自组织、自学习的特点.
 

关键词: 联想记忆, 稀疏互联, 结构自适应, 退火拓扑择优

Abstract:

A novel sparsely connected associative memory based on the preferential mechanism of heuristic annealed topology was proposed in this paper. Aimed at overcoming the disadvantage of quenched dilution as random synapses disconnection of the existing methods, this model, taking the ideology of annealed dilution of statistical physics into account, investigates the optimal synaptic dilution strategy under the constraints of limited metabolic energy, namely limited amount of neurons and connections. Based on explicit theoretical analysis, this model constructs a learning task-dependent network topology in a heuristic annealed way which is much closer to biological genuine system as possessing flexible adaptive topology. It can achieve better performance than the existing counterparts of the same class. The effectiveness and robustness of the proposed model is validated by a great number of experiments.
 

Key words: associative memory, sparsely connected, adaptive topology, annealed topology preferential

中图分类号: