上海交通大学学报

上海交通大学学报（自然版） ›› 2014, Vol. 48 ›› Issue (07): 948-952.

• 自动化技术、计算机技术 • 上一篇    下一篇

一种分布式冗余的实时数据存储检索机制

李德文1，黄文君1,2，胡静泓1，钱益舟1
  

  1. （1.浙江大学 智能系统与控制研究所，  杭州 310027； 2.浙江中控技术股份有限公司，  杭州 310053）
     
     
     
     
     
  • 收稿日期:2013-07-03 出版日期:2014-07-28 发布日期:2014-07-28
  • 基金资助:

    国家自然科学基金资助项目（61273100）

A Distributed Redundant Real-Time Data Storage Mechanism

LI Dewen,HUANG Wenjun,HU Jinghong,QIAN Yizhou   

  1. （1.Institute of CyberSystem and Control, Zhejiang University, Hangzhou 310027, China; 2.Zhejiang Supcon Technology Co. Ltd., Hangzhou 310053, China）
  • Received:2013-07-03 Online:2014-07-28 Published:2014-07-28

摘要：

为解决传统集中式实时数据库吞吐量、容错性、可扩展性不足的难题，提出一种基于分布式架构、具备多重副本管理功能的实时数据存储检索机制.该机制结合一致性哈希算法与基于多版本控制的数据组织方案，从实时数据的存储、管理、查询三方面进行设计和优化，在保证数据存取实时性的基础上实现了备份同步、一致性修复等核心功能，从而有效提高了实时数据库的海量数据存储与处理能力，为实时数据库向分布式存储、多重冗余备份、系统规模动态调整等方向的转变奠定了基础.通过在原型系统中测试验证，结果表明该机制能够达到设计预期目标和性能要求.

 
 

关键词: 分布式, 多重副本, 存储检索, 一致性哈希, 多版本控制

Abstract:

A real-time data storage and retrieval mechanism with the management of multi-replication based on distributed architecture was proposed to solve the deficiencies in throughput, fault tolerance, and scalability of traditional centralized real-time database. Combining the consistent hashing algorithm with data organization based on multi-version control, the mechanism was designed and optimized from three aspects of realtime data storage, management and query. It implements backup synchronization and consistency repair under the premise of ensuring real-time data access, thus improves mass data storage and processing capacity of realtime database, and lays a good foundation on the changes of realtime database distributed storage, multiple redundant backup, dynamically adjustment of system’s scale and other directions. By simulation and testing the mechanism in the prototype system, it is shown that this mechanism can achieve the design targets and performance requirements.

Key words: distributed, multi-replication, storage and retrieval, consistent hashing, multi-version control

中图分类号: