CN106469100B - 一种数据恢复的方法、存储的方法相应的装置及系统 - Google Patents

一种数据恢复的方法、存储的方法相应的装置及系统 Download PDF

Info

Publication number
CN106469100B
CN106469100B CN201510504685.8A CN201510504685A CN106469100B CN 106469100 B CN106469100 B CN 106469100B CN 201510504685 A CN201510504685 A CN 201510504685A CN 106469100 B CN106469100 B CN 106469100B
Authority
CN
China
Prior art keywords
coding
block
byte
data processing
processing equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510504685.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN106469100A (zh
Inventor
庄仕岳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201510504685.8A priority Critical patent/CN106469100B/zh
Priority to PCT/CN2016/071339 priority patent/WO2017028494A1/zh
Priority to EP16836360.4A priority patent/EP3327571B1/de
Publication of CN106469100A publication Critical patent/CN106469100A/zh
Priority to US15/893,201 priority patent/US10810091B2/en
Application granted granted Critical
Publication of CN106469100B publication Critical patent/CN106469100B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1469—Backup restoration techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201510504685.8A 2015-08-17 2015-08-17 一种数据恢复的方法、存储的方法相应的装置及系统 Active CN106469100B (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201510504685.8A CN106469100B (zh) 2015-08-17 2015-08-17 一种数据恢复的方法、存储的方法相应的装置及系统
PCT/CN2016/071339 WO2017028494A1 (zh) 2015-08-17 2016-01-19 一种数据恢复的方法、存储的方法相应的装置及系统
EP16836360.4A EP3327571B1 (de) 2015-08-17 2016-01-19 Datenspeicherverfahren sowie zugehörige vorrichtung
US15/893,201 US10810091B2 (en) 2015-08-17 2018-02-09 Data recovery method, data storage method, and corresponding apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510504685.8A CN106469100B (zh) 2015-08-17 2015-08-17 一种数据恢复的方法、存储的方法相应的装置及系统

Publications (2)

Publication Number Publication Date
CN106469100A CN106469100A (zh) 2017-03-01
CN106469100B true CN106469100B (zh) 2019-04-05

Family

ID=58050726

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510504685.8A Active CN106469100B (zh) 2015-08-17 2015-08-17 一种数据恢复的方法、存储的方法相应的装置及系统

Country Status (4)

Country Link
US (1) US10810091B2 (de)
EP (1) EP3327571B1 (de)
CN (1) CN106469100B (de)
WO (1) WO2017028494A1 (de)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107026912A (zh) * 2017-05-12 2017-08-08 成都优孚达信息技术有限公司 嵌入式通信设备数据传输方法
CN109144782B (zh) * 2018-08-22 2021-08-10 郑州云海信息技术有限公司 一种数据恢复方法及装置
CN112152974B (zh) * 2019-06-28 2022-02-25 华为技术有限公司 基于区块链网络的数据确权方法及相关装置
CN112748851B (zh) * 2019-10-30 2024-09-10 北京白山耘科技有限公司 数据读取方法、装置和系统
CN111782623B (zh) * 2020-05-21 2024-10-25 北京交通大学 Hdfs存储平台中的文件校验修复方法
CN111698330B (zh) * 2020-06-12 2022-06-21 北京金山云网络技术有限公司 存储集群的数据恢复方法、装置及服务器
CN112256472B (zh) * 2020-10-20 2024-06-25 平安科技（深圳）有限公司 分布式数据调取方法、装置、电子设备及存储介质
CN113966499B (zh) 2021-09-08 2023-10-27 长江存储科技有限责任公司 用于存储器的数据保护方法及其存储装置
US20230082636A1 (en) * 2021-09-16 2023-03-16 Micron Technology, Inc. Parity data modification for partial stripe data update
CN115119015A (zh) * 2022-06-28 2022-09-27 广州势创信息科技有限公司 一种数据传输系统及方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101488104A (zh) * 2009-02-26 2009-07-22 北京世纪互联宽带数据中心有限公司 一种实现高效安全存储的系统和方法
US7636724B2 (en) * 2001-08-31 2009-12-22 Peerify Technologies LLC Data storage system and method by shredding and deshredding
CN103023968A (zh) * 2012-11-15 2013-04-03 中科院成都信息技术有限公司 一种网络分布式文件存储与读取方法
CN103699494A (zh) * 2013-12-06 2014-04-02 北京奇虎科技有限公司 一种数据存储方法、数据存储设备和分布式存储系统

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4887204A (en) * 1987-02-13 1989-12-12 International Business Machines Corporation System and method for accessing remote files in a distributed networking environment
US7240236B2 (en) * 2004-03-23 2007-07-03 Archivas, Inc. Fixed content distributed data storage using permutation ring encoding
US9495381B2 (en) * 2005-01-12 2016-11-15 Wandisco, Inc. Geographically-distributed file system using coordinated namespace replication over a wide area network
US9424272B2 (en) * 2005-01-12 2016-08-23 Wandisco, Inc. Distributed file system using consensus nodes
EP2396717A1 (de) * 2009-02-11 2011-12-21 Infinidat Ltd Virtualisiertes speichersystem und verfahren zu seinem betrieb
CN101630282B (zh) * 2009-07-29 2012-07-04 国网电力科学研究院 一种基于Erasure编码和副本技术的数据备份方法
US8756473B1 (en) * 2010-12-23 2014-06-17 Sk Hynix Memory Solutions Inc. Solid state device coding architecture for chipkill and endurance improvement
US8949558B2 (en) * 2011-04-29 2015-02-03 International Business Machines Corporation Cost-aware replication of intermediate data in dataflows
US8719232B2 (en) * 2011-06-30 2014-05-06 Verisign, Inc. Systems and methods for data integrity checking
TWI461929B (zh) * 2011-12-09 2014-11-21 Promise Tecnnology Inc 雲端數據儲存系統
US9268590B2 (en) * 2012-02-29 2016-02-23 Vmware, Inc. Provisioning a cluster of distributed computing platform based on placement strategy
CN102750195A (zh) * 2012-06-07 2012-10-24 浪潮电子信息产业股份有限公司 一种集群文件系统数据容错的方法
CN104572339A (zh) * 2013-10-17 2015-04-29 捷达世软件（深圳）有限公司 基于分布式文件系统的数据备份还原系统及方法
US9507800B2 (en) * 2013-10-23 2016-11-29 Netapp, Inc. Data management in distributed file systems
CN103605582B (zh) 2013-11-27 2017-01-25 华中科技大学 一种基于写重定向的纠删码存储重构优化方法
CN103645861B (zh) 2013-12-03 2016-04-13 华中科技大学 一种纠删码集群中失效节点的重构方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7636724B2 (en) * 2001-08-31 2009-12-22 Peerify Technologies LLC Data storage system and method by shredding and deshredding
CN101488104A (zh) * 2009-02-26 2009-07-22 北京世纪互联宽带数据中心有限公司 一种实现高效安全存储的系统和方法
CN103023968A (zh) * 2012-11-15 2013-04-03 中科院成都信息技术有限公司 一种网络分布式文件存储与读取方法
CN103699494A (zh) * 2013-12-06 2014-04-02 北京奇虎科技有限公司 一种数据存储方法、数据存储设备和分布式存储系统

Also Published As

Publication number Publication date
EP3327571A4 (de) 2018-05-30
CN106469100A (zh) 2017-03-01
US20180165164A1 (en) 2018-06-14
EP3327571B1 (de) 2021-03-10
US10810091B2 (en) 2020-10-20
WO2017028494A1 (zh) 2017-02-23
EP3327571A1 (de) 2018-05-30

Similar Documents

Publication Publication Date Title
CN106469100B (zh) 一种数据恢复的方法、存储的方法相应的装置及系统
Qi et al. A reliable storage partition for permissioned blockchain
US10031806B2 (en) Efficient repair of erasure coded data based on coefficient matrix decomposition
Wu Existence and construction of capacity-achieving network codes for distributed storage
Rashmi et al. Having your cake and eating it too: Jointly optimal erasure codes for {I/O}, storage, and network-bandwidth
CN102833040B (zh) 解码处理方法、装置及编解码系统
CN109598147B (zh) 基于区块链的数据处理方法及装置、电子设备
US20200151066A1 (en) Byzantine Fault Tolerance with Verifiable Secret Sharing at Constant Overhead
WO2013191658A1 (en) System and methods for distributed data storage
Cullina et al. Searching for minimum storage regenerating codes
CN113726751B (zh) 一种块链式账本中的权重管理方法、装置及设备
CN112261163B (zh) 一种区块链系统中的状态存储方法及区块链系统、节点
US20080235409A1 (en) Multiple Phase Buffer Enlargement for Rdma Data Transfer Related Applications
CN109799948A (zh) 一种数据存储方法及装置
CN113946361A (zh) 一种芯片fpga静态全局升级重构方法、系统、设备及其介质
CN110018897A (zh) 数据处理方法、装置及计算设备
CN105007286B (zh) 解码方法和装置及云存储方法和系统
CN109062724A (zh) 一种纠删码转换方法及终端
US20060195643A1 (en) Method for designing an initiatior in an integrated circuit
CN109101611A (zh) 文件系统目录最大化测试方法、装置、终端及存储介质
Sipos et al. Erasure coded storage on a changing network: The untold story
US20230179423A1 (en) Method and apparatus for storing blockchain transaction data and distributed storage system using the same
CN103888314B (zh) 基于uio序列法验证有限状态机所处状态的方法
CN109815047A (zh) 一种数据处理的方法和相关装置
CN109889418A (zh) 基于can总线的数据传输方法和装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant