Journal of Shanghai Jiaotong University ›› 2014, Vol. 48 ›› Issue (07): 948-952.

• Automation Technique, Computer Technology • Previous Articles     Next Articles

A Distributed Redundant Real-Time Data Storage Mechanism

LI Dewen,HUANG Wenjun,HU Jinghong,QIAN Yizhou   

  1. (1.Institute of CyberSystem and Control, Zhejiang University, Hangzhou 310027, China; 2.Zhejiang Supcon Technology Co. Ltd., Hangzhou 310053, China)
  • Received:2013-07-03 Online:2014-07-28 Published:2014-07-28

Abstract:

A real-time data storage and retrieval mechanism with the management of multi-replication based on distributed architecture was proposed to solve the deficiencies in throughput, fault tolerance, and scalability of traditional centralized real-time database. Combining the consistent hashing algorithm with data organization based on multi-version control, the mechanism was designed and optimized from three aspects of realtime data storage, management and query. It implements backup synchronization and consistency repair under the premise of ensuring real-time data access, thus improves mass data storage and processing capacity of realtime database, and lays a good foundation on the changes of realtime database distributed storage, multiple redundant backup, dynamically adjustment of system’s scale and other directions. By simulation and testing the mechanism in the prototype system, it is shown that this mechanism can achieve the design targets and performance requirements.

Key words: distributed, multi-replication, storage and retrieval, consistent hashing, multi-version control

CLC Number: