Analysis of Span-Lateral Inhibition Neural Network and Its Application

Abstract

Abstract:

A novel neural network model S-LINN was proposed based on the neurons connection and lateral inhibition mechanism in the cortex. Considering the multilayer and span connection of cortex neurons, the model was used to simulate the cerebral cortex structure. The approximation ability was verified throuth the universial approximate analysis. Meanwhile, a supervised algorithm based on the error backpropagation and gradient descent theory was developed to train the network parameters. Simulation results for the abalone age prediction demonstrate that the proposed model can achieve higher accuracy of approximation and generalization with a comparable compact network structure.

Key words: bionics, lateral inhibition, neural network, universal approximator

CLC Number:

TP 183

YANG Gang1, 2,QIAO Junfei1. Analysis of Span-Lateral Inhibition Neural Network and Its Application[J]. Journal of Shanghai Jiaotong University, 2014, 48(07): 965-970.

References

［1］Leung F H F, Lam H K, Ling S H. et al. Tuning of the structure and parameters of a neural network using an improved genetic algorithm ［J］. IEEE Transactions on Neural Networks, 2003, 14(1): 7988.

［2］Tsai J, Chou J， Liu T. Tuning the structure and parameters of a neural network by using hybrid taguchigenetic algorithm ［J］. IEEE Transactions on Neural Networks, 2006, 17(1): 6980.

［3］Islam M M, Sattar MA, Amin M F, et al. A new constructive algorithm for architectural and functional adaptation of artificial neural networks ［J］. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), 2009, 39(6): 15901605.

［4］宋彦坡, 彭小奇. 一种结构自适应神经网络及其训练方法［J］. 控制与决策, 2010, 25(8): 12651268.

SONG Yanpo, PENG Xiaoqi. New structure adapting neural network and its training method ［J］. Control and Decision, 2010, 25(8): 12651268.

［5］Jaeger H, Haas H. Harnessing Nonlinearity: Predicting chaotic systems and saving energy in wireless communication ［J］. Science, 2004, 304(5667): 7880.

［6］朱小龙, 杨建国, 代贵松. 基于AVQ聚类和OIFElman神经网络的机床热误差建模［J］. 上海交通大学学报, 2014, 48 (1): 1621.

ZHU Xiaolong, YANG Jianguo, DAI Guisong. AVQ clustering algorithm and OIFElman neural network for machine tool thermal error ［J］. Journal of Shanghai Jiaotong University, 2014, 48 (1): 1621.

［7］Lorente De Nó R. Cerebral Cortex: Architecture, intracortical connections, motor projections［C］∥ Fulton J F. Physiology of the Nervous System. New York ：Oxford University Press, 1949: 288312.

［8］Cruikshank S J, Lewis T J ，Connors B W. Synaptic basis for intense thalamocortical activation of feedforward inhibitory cells in neocortex ［J］. Nature Neuroscience, 2007, 10(4): 462468.

［9］Hornik K, Stinchcombe M, White H. Multilayer feedforward networks are universal approximators［J］.

Neural Networks, 1989, 2(5): 359366.

［10］Blake C, Merz C. UCI repository of machine learning databases［DB］. http: ∥www.ics.uci.edu/ ~mlearn/MLRepository.html, Department of Information and Computer Sciences, University of California, Irvine, USA, 1998.

［11］Huang G B, Saratchandran P, Sundararajan N. An efficient sequential learning algorithm for growing and pruning RBF (GAPRBF) networks ［J］. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2004, 34(6): 22842292.

［12］Liang N Y, Huang G B, Saratchandran P, et al. A fast and accurate online sequential learning algorithm for feedforward networks ［J］. IEEE Transactions on Neural Networks, 2006, 17(6): 14111423.

［13］Li G, Niu P. An enhanced extreme learning machine based on ridge regression for regression ［J］. Neural Computing and Applications, 2013, 22: 804810.

［14］Huynh H T, Won Y. Regularized online sequential learning algorithm for singlehidden layer feedforward neural networks ［J］. Pattern Recognition Letters, 2011, 32(14): 19301935.

［15］韩敏, 王新迎. 基于信赖域Newton算法的ELM网络［J］. 控制与决策, 2011, 26(5): 757760.

HAN Min, WANG Xinying. ELM based on trust region Newton method ［J］. Control and Decision, 2011, 26(5): 757760.

[1]	ZENG Guozhi, WEI Ziqing, YUE Bao, DING Yunxiao, ZHENG Chunyuan, ZHAI Xiaoqiang. Energy Consumption Prediction of Office Buildings Based on CNN-RNN Combined Model [J]. Journal of Shanghai Jiao Tong University, 2022, 56(9): 1256-1261.
[2]	WU Shuchen, QI Zongfeng, LI Jianxun. Intelligent Global Sensitivity Analysis Based on Deep Learning [J]. Journal of Shanghai Jiao Tong University, 2022, 56(7): 840-849.
[3]	QUAN Daying, CHEN Yun, TANG Zeyu, LI Shitong, WANG Xiaofeng, JIN Xiaoping. Radar Signal Recognition Based on Dual Channel Convolutional Neural Network [J]. Journal of Shanghai Jiao Tong University, 2022, 56(7): 877-885.
[4]	QIN Pengfei (秦鹏飞), WANG Xiaoliang∗ (王晓亮). Construction on Aerodynamic Surrogate Model of Stratospheric Airship [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 768-779.
[5]	SU Hong1 (苏红), WU Bozhao2 (吴博钊), MAO Xuchu1∗ (茅旭初). Non-Line-of-Sight Multipath Detection Method for BDS/GPS Fusion System Based on Deep Learning [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 844-854.
[6]	LÜ Qibing (吕其兵), LIU Tianyuan (刘天元), ZHANG Rong (张荣), JIANG Yanan (江亚南), XIAO Lei (肖雷), BAO Jingsong∗ (鲍劲松). Generation Approach of Human-Robot Cooperative Assembly Strategy Based on Transfer Learning [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(5): 602-613.
[7]	LIU Min (刘敏), YI Ming (易鸣), WU Minghu∗ (武明虎), WANG Juan (王娟), HE Yu (何宇). Breast Pathological Image Classification Based on VGG16 Feature Concatenation [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(4): 473-484.
[8]	JIANG Zhiguo (蒋志国), CHANG Qing∗ (常青). USSL Net: Focusing on Structural Similarity with Light U-Structure for Stroke Lesion Segmentation [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(4): 485-497.
[9]	LU Guannan1 (卢冠男), WANG Mengling1∗ (王梦灵), FOX Tamara2, JIANG Peng3 (蒋鹏), JIANG Fusong3 (蒋伏松). Novel Indicators for Adverse Glycemic Events Detection Analysis Based on Continuous Glucose Monitoring Neural Network Predictive Models [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(4): 498-504.
[10]	QIN Yichao, HUANG Limin, WANG Xiao, MA Xuewen, DUAN Wenyang, HAO Wei. Feasibility of Wave Measurement by Using a Sailing Buoy and the Artificial Neural Network Technique [J]. Journal of Shanghai Jiao Tong University, 2022, 56(4): 498-505.
[11]	ZHAO Yong, SU Dan. Rogue Wave Prediction Based on Four Combined Long Short-Term Memory Neural Network Models [J]. Journal of Shanghai Jiao Tong University, 2022, 56(4): 516-522.
[12]	YUAN Xiaoqi (袁筱祺), ZHU Lelan (朱乐兰), XU Qiongfan(徐琼凡), GAO Wei (高玮). Risk Prediction Model of Gallbladder Disease in Shanghai Middle-Aged and Elderly People Based on Neural Networks [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(2): 153-159.
[13]	NIE Rui, WANG Hongru. Fault Diagnosis of UAV Formation Actuator Based on Neural Network Observer [J]. Air & Space Defense, 2022, 5(2): 32-41.
[14]	DING Ming, MENG Shuai, WANG Shuheng, XIA Xi. Neural-Network-Based Adaptive Feedback Linearization Control for 6-DOF Wave Compensation Platform [J]. Journal of Shanghai Jiao Tong University, 2022, 56(2): 165-172.
[15]	LIU Xiuli, XU Xiaoli. A Fault Diagnosis Method Based on Feature Pyramid CRNN Network [J]. Journal of Shanghai Jiao Tong University, 2022, 56(2): 182-190.