DK3400542T3 - Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer - Google Patents

Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer Download PDF

Info

Publication number
DK3400542T3
DK3400542T3 DK17701016.2T DK17701016T DK3400542T3 DK 3400542 T3 DK3400542 T3 DK 3400542T3 DK 17701016 T DK17701016 T DK 17701016T DK 3400542 T3 DK3400542 T3 DK 3400542T3
Authority
DK
Denmark
Prior art keywords
techniques
storage systems
data storage
reconciliation
distributed data
Prior art date
Application number
DK17701016.2T
Other languages
English (en)
Inventor
Ioannis Papapanagiotou
Shailesh Birari
Jason Cacciatore
Minh Do
Christos Kalantzis
Original Assignee
Netflix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netflix Inc filed Critical Netflix Inc
Application granted granted Critical
Publication of DK3400542T3 publication Critical patent/DK3400542T3/da

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/128—Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/178—Techniques for file synchronisation in file systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/835—Timestamp
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
DK17701016.2T 2016-01-04 2017-01-04 Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer DK3400542T3 (da)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/987,649 US11789926B2 (en) 2016-01-04 2016-01-04 Techniques for performing data reconciliation in distributed data store systems
PCT/US2017/012214 WO2017120257A1 (en) 2016-01-04 2017-01-04 Techniques for performing data reconciliation in distributed data store systems

Publications (1)

Publication Number Publication Date
DK3400542T3 true DK3400542T3 (da) 2022-01-03

Family

ID=57861288

Family Applications (1)

Application Number Title Priority Date Filing Date
DK17701016.2T DK3400542T3 (da) 2016-01-04 2017-01-04 Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer

Country Status (7)

Country Link
US (1) US11789926B2 (da)
EP (1) EP3400542B1 (da)
CN (1) CN108701156B (da)
AU (2) AU2017205975A1 (da)
DK (1) DK3400542T3 (da)
MX (1) MX2018008318A (da)
WO (1) WO2017120257A1 (da)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10033827B2 (en) * 2016-06-08 2018-07-24 Microsoft Technology Licensing, Llc Scalable management of composite data collected with varied identifiers
US10165077B2 (en) * 2016-06-08 2018-12-25 Microsoft Technology Licensing, Llc Cache management in a composite data environment
US10331523B2 (en) 2017-04-04 2019-06-25 International Business Machines Corporation Recovering a failed clustered system using configuration data fragments
US10824612B2 (en) 2017-08-21 2020-11-03 Western Digital Technologies, Inc. Key ticketing system with lock-free concurrency and versioning
US11210212B2 (en) * 2017-08-21 2021-12-28 Western Digital Technologies, Inc. Conflict resolution and garbage collection in distributed databases
US11055266B2 (en) 2017-08-21 2021-07-06 Western Digital Technologies, Inc. Efficient key data store entry traversal and result generation
US11210211B2 (en) 2017-08-21 2021-12-28 Western Digital Technologies, Inc. Key data store garbage collection and multipart object management
US11520905B2 (en) * 2019-11-20 2022-12-06 Kyndryl, Inc. Smart data protection
US11892975B1 (en) * 2021-09-30 2024-02-06 Amazon Technologies, Inc. Asynchronous consistent snapshots in a distributed system
US12248445B2 (en) * 2022-09-08 2025-03-11 Jpmorgan Chase Bank, N.A. Method and system for providing data quality capability within distributed data lakes
US11907205B1 (en) * 2023-01-23 2024-02-20 Intuit, Inc. Generic parity solution for highly dynamic sources
US12299000B2 (en) 2023-03-16 2025-05-13 Bank Of America Corporation Data reconciliation system and method
US11809915B1 (en) 2023-04-05 2023-11-07 Sas Institute Inc. Parallel processing techniques for expediting reconciliation for a hierarchy of forecasts on a computer system
CN116644802A (zh) * 2023-07-19 2023-08-25 支付宝(杭州)信息技术有限公司 模型训练方法及装置
US20250077241A1 (en) * 2023-09-06 2025-03-06 Dell Products L.P. Generating executable tasks from non-executable text files

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06324928A (ja) * 1993-05-14 1994-11-25 Mitsubishi Electric Corp ログ生成装置とファイルの異なるバージョンの調停のための装置及び異なる場所にあるコンピュータファイルの異なるバージョンを調停するための装置
US20070106771A1 (en) * 2005-11-10 2007-05-10 International Business Machines Corporation Reconciliation of independently updated distributed data
CN102054035B (zh) 2010-12-29 2013-01-02 北京播思软件技术有限公司 一种基于数据范围的数据库数据同步方法
US10423481B2 (en) * 2014-03-14 2019-09-24 Cisco Technology, Inc. Reconciling redundant copies of media content
CN103870602B (zh) 2014-04-03 2017-05-31 中国科学院地理科学与资源研究所 数据库空间分片复制方法及系统

Also Published As

Publication number Publication date
WO2017120257A1 (en) 2017-07-13
CN108701156B (zh) 2022-08-23
MX2018008318A (es) 2019-02-25
CN108701156A (zh) 2018-10-23
AU2020202621B2 (en) 2021-10-28
AU2017205975A1 (en) 2018-07-19
EP3400542A1 (en) 2018-11-14
US20170193031A1 (en) 2017-07-06
AU2020202621A1 (en) 2020-05-14
US11789926B2 (en) 2023-10-17
EP3400542B1 (en) 2021-11-17

Similar Documents

Publication Publication Date Title
DK3400542T3 (da) Teknikker til udførelse af dataafstemning i fordelte datalagringssystemer
EP3729417C0 (en) TRACKING IN HAPTIC SYSTEMS
EP3303186C0 (en) TEMPERATURE CONTROLLED STORAGE SYSTEM
EP3469486A4 (en) MULTI-PORT INTERPOSER ARCHITECTURES IN DATA STORAGE SYSTEMS
EP3542294A4 (en) NUCLEIC ACID-BASED DATA STORAGE
DK3569525T3 (da) Opbevaringssystem
DK3262513T3 (da) Lagring af data
DK3326452T3 (da) Dyrkningsopbevaringssystem
EP3534322A4 (en) INFORMATION MANAGEMENT SYSTEM
DK3278041T3 (da) Automatiseret kryogent opbevaringssystem
EP4223667C0 (en) STORAGE SYSTEM
EP3283404C0 (en) STORAGE SYSTEM AND METHODS
EP3283403C0 (en) STORAGE SYSTEMS AND METHODS
DE112015000710T8 (de) Verteiltes Speichersystem
DK3129912T3 (da) Fremgangsmåde og system til sikring af data
DK3107841T3 (da) Afkølet opbevaringssystem
DK4376425T3 (da) Fremgangsmåder og systemer til supplering af medieaktiver under hurtigadgangsafspilningsoperationer
PL3178022T3 (pl) Przechowywanie danych po awarii bazy danych
EP3807189C0 (en) STORAGE SYSTEM
DK3188051T3 (da) Systemer og fremgangsmåder til generering af søgeskabeloner
EP3530592A4 (en) Stacker crane
DK3811770T3 (da) Opbevaringssystem
DK3807187T3 (da) Lagringssystem
EP3556062A4 (en) DATA STORAGE FUNCTION SELECTION
EP3468895A4 (en) PLATE STORAGE KIT