CA2896809C - Dispositif de traitement de donnees et procede de traitement de donnees - Google Patents

Dispositif de traitement de donnees et procede de traitement de donnees Download PDF

Info

Publication number
CA2896809C
CA2896809C CA2896809A CA2896809A CA2896809C CA 2896809 C CA2896809 C CA 2896809C CA 2896809 A CA2896809 A CA 2896809A CA 2896809 A CA2896809 A CA 2896809A CA 2896809 C CA2896809 C CA 2896809C
Authority
CA
Canada
Prior art keywords
data
storage unit
volatile storage
memory
log file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2896809A
Other languages
English (en)
Other versions
CA2896809A1 (fr
Inventor
Tianfu JIN
Nunu REN
Mingjun Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CA2896809A1 publication Critical patent/CA2896809A1/fr
Application granted granted Critical
Publication of CA2896809C publication Critical patent/CA2896809C/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1471—Error detection or correction of the data by redundancy in operations involving logging of persistent data for recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1456—Hardware arrangements for backup
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1469—Backup restoration techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/1608—Error detection by comparing the output signals of redundant hardware
    • G06F11/1612—Error detection by comparing the output signals of redundant hardware where the redundant component is persistent storage
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0643—Management of files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/82—Solving problems relating to consistency
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/85—Active fault masking without idle spares
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Quality & Reliability (AREA)
  • Computer Security & Cryptography (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)

Abstract

Les modes de réalisation de l'invention concernent un dispositif de traitement de données et un procédé de traitement de données permettant de résoudre le problème qui est que, dans l'état de la technique, la sécurité des données dans une mémoire est faible parce que la vitesse de sauvegarde de données dans la mémoire est lente. Par écriture de premières données écrites dans une mémoire dans une unité de stockage non volatile sous la forme d'un fichier journal, et écriture du fichier journal des premières données écrit dans la première unité de stockage non volatile dans une seconde unité de stockage non volatile, étant donné que la vitesse d'écriture de données de la première unité de stockage non volatile est plus grande que celle de la seconde unité de stockage non volatile, le dispositif de traitement de données et le procédé de traitement de données décrits par les modes de réalisation de l'invention peuvent réaliser la sauvegarde rapide des données dans la mémoire et assurer la sécurité des données dans la mémoire quand les données dans la mémoire sont perdues dans des cas exceptionnels.
CA2896809A 2013-12-02 2013-12-02 Dispositif de traitement de donnees et procede de traitement de donnees Active CA2896809C (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2013/088324 WO2015081470A1 (fr) 2013-12-02 2013-12-02 Dispositif de traitement de données et procédé de traitement de données

Publications (2)

Publication Number Publication Date
CA2896809A1 CA2896809A1 (fr) 2015-06-11
CA2896809C true CA2896809C (fr) 2020-06-02

Family

ID=53265424

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2896809A Active CA2896809C (fr) 2013-12-02 2013-12-02 Dispositif de traitement de donnees et procede de traitement de donnees

Country Status (7)

Country Link
US (3) US9354985B2 (fr)
EP (2) EP3229140B1 (fr)
JP (1) JP6166796B2 (fr)
CN (2) CN107357680A (fr)
CA (1) CA2896809C (fr)
ES (1) ES2627084T3 (fr)
WO (1) WO2015081470A1 (fr)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11829333B2 (en) * 2015-05-08 2023-11-28 Chicago Mercantile Exchange Inc. Thread safe lock-free concurrent write operations for use with multi-threaded in-line logging
CN106469123A (zh) * 2015-08-10 2017-03-01 北京忆恒创源科技有限公司 一种基于nvdimm的写缓存分配、释放方法及其装置
CN111007991B (zh) * 2015-08-13 2024-01-26 北京忆恒创源科技股份有限公司 基于nvdimm分离读写请求的方法及其计算机
CN106919474A (zh) * 2015-12-28 2017-07-04 中移(苏州)软件技术有限公司 一种缓存数据保护方法和装置
US10210056B2 (en) * 2016-03-31 2019-02-19 Netapp, Inc. Methods for filesystem metadata caching to improve failover performance and devices thereof
CN107562567A (zh) * 2016-06-30 2018-01-09 华为技术有限公司 一种数据处理方法以及数据处理设备
US11977484B2 (en) 2016-07-19 2024-05-07 Sap Se Adapting in-memory database in hybrid memory systems and operating system interface
US10783146B2 (en) * 2016-07-19 2020-09-22 Sap Se Join operations in hybrid main memory systems
US10698732B2 (en) 2016-07-19 2020-06-30 Sap Se Page ranking in operating system virtual pages in hybrid memory systems
WO2018233820A1 (fr) * 2017-06-21 2018-12-27 Huawei Technologies Co., Ltd. Systèmes et procédés de gestion de structure de journal
US11010379B2 (en) 2017-08-15 2021-05-18 Sap Se Increasing performance of in-memory databases using re-ordered query execution plans
CN109992448B (zh) * 2017-12-31 2021-08-06 中国移动通信集团山西有限公司 文件变化增量备份方法、装置、设备及介质
CN108494481B (zh) * 2018-03-30 2020-06-09 青岛海信宽带多媒体技术有限公司 光模块的监控数据处理方法、装置及光模块
CN108521551A (zh) * 2018-05-14 2018-09-11 河北远东通信系统工程有限公司 一种网络实时视频录制存储方法和系统以及文件恢复方法
CN108763572B (zh) * 2018-06-06 2021-06-22 湖南蚁坊软件股份有限公司 一种实现Apache Solr读写分离的方法和装置
CN109165117B (zh) * 2018-06-29 2022-05-31 华为技术有限公司 数据处理的方法和系统
WO2021226822A1 (fr) * 2020-05-12 2021-11-18 深圳市欢太科技有限公司 Procédé et appareil d'écriture de journal, dispositif électronique et support de stockage
US11947839B2 (en) 2021-05-10 2024-04-02 Samsung Electronics Co., Ltd. Storage device, system, and method for customizable metadata
CN113722158B (zh) * 2021-10-08 2022-08-30 亿次网联(杭州)科技有限公司 电子设备及其掉电保护方法、装置、存储介质
CN114780356B (zh) * 2022-06-22 2022-09-23 北京得瑞领新科技有限公司 Ssd系统日志数据的存储方法及装置、介质、设备

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR900019014A (ko) * 1988-05-25 1990-12-22 아오이 죠이치 반도체메모리의 데이터기록방법 및 그 장치
JP3594248B2 (ja) * 1993-03-30 2004-11-24 富士通株式会社 ログデータの分類取得システム
US5544359A (en) * 1993-03-30 1996-08-06 Fujitsu Limited Apparatus and method for classifying and acquiring log data by updating and storing log data
US5721918A (en) * 1996-02-06 1998-02-24 Telefonaktiebolaget Lm Ericsson Method and system for fast recovery of a primary store database using selective recovery by data type
JP2003131955A (ja) * 2001-10-19 2003-05-09 Kyocera Corp データバックアップ回路
US7596672B1 (en) 2003-10-24 2009-09-29 Network Appliance, Inc. Synchronous mirroring including writing image updates to a file
US7203796B1 (en) * 2003-10-24 2007-04-10 Network Appliance, Inc. Method and apparatus for synchronous data mirroring
US7197520B1 (en) * 2004-04-14 2007-03-27 Veritas Operating Corporation Two-tier backup mechanism
CN100349127C (zh) * 2004-12-03 2007-11-14 华为技术有限公司 嵌入式系统数据备份装置及方法
CN100399288C (zh) * 2005-09-30 2008-07-02 联想(北京)有限公司 一种内存备份装置和方法
JP5009700B2 (ja) * 2007-06-26 2012-08-22 株式会社リコー データ記憶装置、プログラムおよびデータ記憶方法
CN101216772B (zh) * 2008-01-15 2011-05-11 中兴通讯股份有限公司 一种嵌入式设备的启动方法及软件升级方法
JP4919983B2 (ja) * 2008-02-21 2012-04-18 ヒタチグローバルストレージテクノロジーズネザーランドビーブイ データ記憶装置及びデータ記憶装置におけるデータ管理方法
US8041679B1 (en) * 2008-06-04 2011-10-18 Symantec Operating Corporation Synthetic differential backups creation for a database using binary log conversion
CN101620460A (zh) * 2008-07-02 2010-01-06 联想(北京)有限公司 一种计算机系统休眠方法和一种计算机系统
JP2010152514A (ja) * 2008-12-24 2010-07-08 Toshiba Corp メモリシステム
KR20100133710A (ko) * 2009-06-12 2010-12-22 삼성전자주식회사 메모리 시스템 및 그것의 코드 데이터 로딩 방법
CN101996677B (zh) * 2009-08-26 2013-12-11 联华电子股份有限公司 非易失性静态随机存取存储器元件
WO2011070611A1 (fr) * 2009-12-08 2011-06-16 Hitachi, Ltd. Système de stockage et appareil de commande de stockage pourvus de groupe de mémoire cache comprenant des mémoires volatile et non volatile
US8572311B1 (en) * 2010-01-11 2013-10-29 Apple Inc. Redundant data storage in multi-die memory systems
CN102014152A (zh) * 2010-10-18 2011-04-13 浪潮(北京)电子信息产业有限公司 一种远程复制系统及其方法
US10817502B2 (en) * 2010-12-13 2020-10-27 Sandisk Technologies Llc Persistent memory management
US20140081911A1 (en) * 2011-01-10 2014-03-20 Netapp, Inc. Optimizing automatic deletion of backup files
CN102693170A (zh) * 2011-03-21 2012-09-26 北京千橡网景科技发展有限公司 用于内存管理的方法和设备
CN102467404A (zh) * 2011-10-14 2012-05-23 海尔集团技术研发中心 一种基于物理内存实现软件快速切换的方法及装置
CN102779072B (zh) * 2012-06-18 2014-06-25 中国科学院上海微系统与信息技术研究所 一种嵌入式系统及其应用进程的休眠与唤醒方法
JP5631938B2 (ja) * 2012-07-19 2014-11-26 株式会社東芝 半導体記憶装置
GB2508659A (en) * 2012-12-10 2014-06-11 Ibm Backing up an in-memory database
US11687292B2 (en) * 2013-02-26 2023-06-27 Seagate Technology Llc Data update management in a cloud computing environment
US9164856B2 (en) * 2013-11-11 2015-10-20 International Business Machines Corporation Persistent messaging mechanism

Also Published As

Publication number Publication date
EP2905706A4 (fr) 2016-05-04
ES2627084T3 (es) 2017-07-26
US20170103001A1 (en) 2017-04-13
US20150234615A1 (en) 2015-08-20
EP3229140A1 (fr) 2017-10-11
CN107357680A (zh) 2017-11-17
WO2015081470A1 (fr) 2015-06-11
JP2016509734A (ja) 2016-03-31
JP6166796B2 (ja) 2017-07-19
EP3229140B1 (fr) 2019-02-20
CA2896809A1 (fr) 2015-06-11
US9557927B2 (en) 2017-01-31
EP2905706A1 (fr) 2015-08-12
US9354985B2 (en) 2016-05-31
CN104919426A (zh) 2015-09-16
EP2905706B1 (fr) 2017-04-05
US20150154087A1 (en) 2015-06-04

Similar Documents

Publication Publication Date Title
EP3229140B1 (fr) Dispositif et procédé de traitement de données
US11397648B2 (en) Virtual machine recovery method and virtual machine management device
US9823877B2 (en) Virtual machine backup from storage snapshot
US10102076B2 (en) System and method for implementing a block-based backup restart
US9928003B2 (en) Management of writable snapshots in a network storage device
JP4903244B2 (ja) 計算機システム及び障害復旧方法
US20100058007A1 (en) Information processing apparatus and memory management method
CN104571955A (zh) 提高存储容量的方法和装置
WO2016095372A1 (fr) Procédé et appareil pour réaliser une sauvegarde d'image de journaux de transactions
US11740983B2 (en) High availability for persistent memory
US12265451B2 (en) Data processing method and apparatus in storage system, and storage system
KR102277731B1 (ko) 스토리지 시스템의 구동 방법 및 스토리지 컨트롤러
US11487428B2 (en) Storage control apparatus and storage control method
US20130332658A1 (en) Data storage system and method thereof
JP2011002998A (ja) バックアップシステムおよびバックアッププログラム
KR20140040018A (ko) 하이버네이션 기반 스냅샷 이미지 생성 및 부팅 장치 및 방법

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20150629

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 12TH ANNIV.) - STANDARD

Year of fee payment: 12

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20251104

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20251104