EP3803599A4 - Codage à effacement avec codes de reconstruction locale à chevauchement - Google Patents

Codage à effacement avec codes de reconstruction locale à chevauchement Download PDF

Info

Publication number
EP3803599A4
EP3803599A4 EP18920511.5A EP18920511A EP3803599A4 EP 3803599 A4 EP3803599 A4 EP 3803599A4 EP 18920511 A EP18920511 A EP 18920511A EP 3803599 A4 EP3803599 A4 EP 3803599A4
Authority
EP
European Patent Office
Prior art keywords
erasure coding
local reconstruction
overlapping local
reconstruction codes
codes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP18920511.5A
Other languages
German (de)
English (en)
Other versions
EP3803599A1 (fr
Inventor
Jianfeng Zhu
Yiheng TAO
Cheng Huang
Aaron William Ogus
Yilong ZHAO
Terry Chen
Zhenshan YU
Tejas Shah
Sridhar Srinivasan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of EP3803599A1 publication Critical patent/EP3803599A1/fr
Publication of EP3803599A4 publication Critical patent/EP3803599A4/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1004—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1008—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
    • G06F11/1012—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices using codes or arrangements adapted for a specific type of error
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
    • H03M13/37—Decoding methods or techniques, not specific to the particular type of coding provided for in groups H03M13/03 - H03M13/35
    • H03M13/373—Decoding methods or techniques, not specific to the particular type of coding provided for in groups H03M13/03 - H03M13/35 with erasure correction and erasure determination, e.g. for packet loss recovery or setting of erasures for the decoding of Reed-Solomon codes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Probability & Statistics with Applications (AREA)
  • Error Detection And Correction (AREA)
  • Detection And Correction Of Errors (AREA)
EP18920511.5A 2018-06-01 2018-06-01 Codage à effacement avec codes de reconstruction locale à chevauchement Withdrawn EP3803599A4 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/089534 WO2019227465A1 (fr) 2018-06-01 2018-06-01 Codage à effacement avec codes de reconstruction locale à chevauchement

Publications (2)

Publication Number Publication Date
EP3803599A1 EP3803599A1 (fr) 2021-04-14
EP3803599A4 true EP3803599A4 (fr) 2022-01-26

Family

ID=68697770

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18920511.5A Withdrawn EP3803599A4 (fr) 2018-06-01 2018-06-01 Codage à effacement avec codes de reconstruction locale à chevauchement

Country Status (4)

Country Link
US (1) US11748009B2 (fr)
EP (1) EP3803599A4 (fr)
CN (1) CN112313628A (fr)
WO (1) WO2019227465A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12566568B2 (en) 2020-07-17 2026-03-03 Commvault Systems, Inc. Migrating erasure-coded data fragments within a growing distributed data storage system with at least data plus parity nodes
US11614883B2 (en) * 2020-07-17 2023-03-28 Commvault Systems, Inc. Distributed data storage system using erasure coding on storage nodes fewer than data plus parity fragments
US11907068B2 (en) * 2021-02-16 2024-02-20 Nyriad, Inc. Read request response for reconstructed data in a degraded drive
CN112835738B (zh) * 2021-02-20 2022-05-20 华中科技大学 一种条带数据存储结构的构建方法
US11734117B2 (en) * 2021-04-29 2023-08-22 Vast Data Ltd. Data recovery in a storage system
CN114385409B (zh) * 2021-12-21 2026-02-27 阿里巴巴（中国）有限公司 基于纠删码的编码方法、分布式系统、设备及存储介质
CN115642987B (zh) * 2022-10-13 2025-05-13 上海哔哩哔哩科技有限公司 编码方法、装置、计算设备及计算机存储介质
KR102926014B1 (ko) * 2023-02-20 2026-02-11 한국전자통신연구원 소거 코드 기반 블록체인 트랜잭션 데이터 분산 저장 시스템 및 방법
CN117370067B (zh) * 2023-12-07 2024-04-12 融科联创(天津)信息技术有限公司 一种大规模对象存储系统的数据布局和编码方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140380125A1 (en) * 2013-06-25 2014-12-25 Microsoft Corporation Erasure coding across multiple zones
US20140380126A1 (en) * 2013-06-25 2014-12-25 Microsoft Corporation Erasure coding across multiple zones and sub-zones

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7346831B1 (en) * 2001-11-13 2008-03-18 Network Appliance, Inc. Parity assignment technique for parity declustering in a parity array of a storage system
US7073115B2 (en) 2001-12-28 2006-07-04 Network Appliance, Inc. Correcting multiple block data loss in a storage array using a combination of a single diagonal parity group and multiple row parity groups
US7640484B2 (en) 2001-12-28 2009-12-29 Netapp, Inc. Triple parity technique for enabling efficient recovery from triple failures in a storage array
US7406621B2 (en) 2004-04-02 2008-07-29 Seagate Technology Llc Dual redundant data storage format and method
US8200887B2 (en) * 2007-03-29 2012-06-12 Violin Memory, Inc. Memory management system and method
EP2158542B1 (fr) 2006-04-04 2019-06-05 Red Hat, Inc. Technique d'affectation de stockage et de codage d'effacement pour système de stockage évolutif et insensible aux défaillances
US7904782B2 (en) 2007-03-09 2011-03-08 Microsoft Corporation Multiple protection group codes having maximally recoverable property
US7930611B2 (en) 2007-03-09 2011-04-19 Microsoft Corporation Erasure-resilient codes having multiple protection groups
US8051362B2 (en) 2007-06-15 2011-11-01 Microsoft Corporation Distributed data storage using erasure resilient coding
US8171379B2 (en) 2008-02-18 2012-05-01 Dell Products L.P. Methods, systems and media for data recovery using global parity for multiple independent RAID levels
CN100570573C (zh) * 2008-05-22 2009-12-16 清华大学 大规模磁盘阵列存储系统的磁盘容错方法
US8458287B2 (en) 2009-07-31 2013-06-04 Microsoft Corporation Erasure coded storage aggregation in data centers
GB2482112A (en) 2010-07-14 2012-01-25 Extas Global Ltd Distributed data storage and recovery
US8473778B2 (en) 2010-09-08 2013-06-25 Microsoft Corporation Erasure coding immutable data
EP2469413B1 (fr) 2010-12-27 2013-06-05 Amplidata NV Système de stockage d'objets distribués hiérarchiques
US9342405B2 (en) 2011-02-25 2016-05-17 Seagate Technology Llc Hierarchical data compression testing
US8621330B2 (en) 2011-03-21 2013-12-31 Microsoft Corporation High rate locally decodable codes
US9141679B2 (en) 2011-08-31 2015-09-22 Microsoft Technology Licensing, Llc Cloud data storage using redundant encoding
US8327185B1 (en) 2012-03-23 2012-12-04 DSSD, Inc. Method and system for multi-dimensional raid
CN103577274B (zh) 2012-07-31 2016-07-06 国际商业机器公司 管理存储器阵列的方法和装置
CN107153506A (zh) * 2016-03-02 2017-09-12 上海云熵网络科技有限公司 基于再生码的分布式存储系统与处理方法
CN106294026A (zh) * 2016-08-19 2017-01-04 浪潮(北京)电子信息产业有限公司 一种固态盘异常掉电后的映射表恢复方法及其系统

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140380125A1 (en) * 2013-06-25 2014-12-25 Microsoft Corporation Erasure coding across multiple zones
US20140380126A1 (en) * 2013-06-25 2014-12-25 Microsoft Corporation Erasure coding across multiple zones and sub-zones

Also Published As

Publication number Publication date
EP3803599A1 (fr) 2021-04-14
US20210208782A1 (en) 2021-07-08
US11748009B2 (en) 2023-09-05
WO2019227465A1 (fr) 2019-12-05
CN112313628A (zh) 2021-02-02

Similar Documents

Publication Publication Date Title
EP3803599A4 (fr) Codage à effacement avec codes de reconstruction locale à chevauchement
EP3776548C0 (fr) Codage prédictif tronquable
EP3814032C0 (fr) Outil de pliage comprenant un élément d'écartement
EP3602795A4 (fr) Codes qc-ldpc améliorés
MA52090A (fr) Polythérapie
EP3625459A4 (fr) Compresseur à spirale
EP3990717C0 (fr) Élément de bardage à bords profilés
DK3741275T3 (da) Vippefastgørelsesmiddel
EP3853435A4 (fr) Renforcement hélicoïdal
EP3959406A4 (fr) Revêtement architectural comprenant un matériau tissé
EP3691587A4 (fr) Pansement à fenêtre renforcé
EP3575601A4 (fr) Compresseur à spirale
DK3604801T3 (da) Scruton-spiral
DE112019002636A5 (de) Konstruktionsprofil
EP4031009C0 (fr) Tomodensitomètre
EP3575602A4 (fr) Compresseur à spirale
EP3619811A4 (fr) Codes polaires crc distribués
EP3730692A4 (fr) Cordon à renfort élastomère
DK3685015T3 (da) Tunnelprofilelement
EP3736476A4 (fr) Tube en résine fluorée thermoplastique
IT201800007717A1 (it) Scaletta retrattile.
MA56057A (fr) Polythérapie
EP3894654A4 (fr) Échelle
DK3857076T3 (da) Stolpe-til-bjælke fastgørelseselement
EP3766915A4 (fr) Résine polyester

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201119

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIN1 Information on inventor provided before grant (corrected)

Inventor name: SRINIVASAN, SRIDHAR

Inventor name: SHAH, TEJAS

Inventor name: YU, ZHENSHAN

Inventor name: ZHAO, YILONG

Inventor name: OGUS, AARON WILLIAM

Inventor name: HUANG, CHENG

Inventor name: TAO, YIHENG

Inventor name: ZHU, JIANFENG

Inventor name: CHEN, TERRY

RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC

A4 Supplementary search report drawn up and despatched

Effective date: 20211223

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 11/10 20060101AFI20211217BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20250224