EP2186015A4 - De-duplication in virtualized server and virtualized storage environments - Google Patents

De-duplication in virtualized server and virtualized storage environments

Info

Publication number
EP2186015A4
EP2186015A4 EP20080829858 EP08829858A EP2186015A4 EP 2186015 A4 EP2186015 A4 EP 2186015A4 EP 20080829858 EP20080829858 EP 20080829858 EP 08829858 A EP08829858 A EP 08829858A EP 2186015 A4 EP2186015 A4 EP 2186015A4
Authority
EP
European Patent Office
Prior art keywords
virtualized
duplication
storage environments
server
virtualized storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP20080829858
Other languages
German (de)
French (fr)
Other versions
EP2186015A2 (en
Inventor
Jedidiah Yueh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
EMC Corp
Original Assignee
EMC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/864,583 external-priority patent/US8209506B2/en
Priority claimed from US11/864,756 external-priority patent/US8880797B2/en
Application filed by EMC Corp filed Critical EMC Corp
Publication of EP2186015A2 publication Critical patent/EP2186015A2/en
Publication of EP2186015A4 publication Critical patent/EP2186015A4/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
    • G06F16/1752—De-duplication implemented within the file system, e.g. based on file segments based on file chunks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
EP20080829858 2007-09-05 2008-09-05 De-duplication in virtualized server and virtualized storage environments Ceased EP2186015A4 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US97018707P 2007-09-05 2007-09-05
US97018107P 2007-09-05 2007-09-05
US11/864,583 US8209506B2 (en) 2007-09-05 2007-09-28 De-duplication in a virtualized storage environment
US11/864,756 US8880797B2 (en) 2007-09-05 2007-09-28 De-duplication in a virtualized server environment
PCT/US2008/075467 WO2009033074A2 (en) 2007-09-05 2008-09-05 De-duplication in virtualized server and virtualized storage environments

Publications (2)

Publication Number Publication Date
EP2186015A2 EP2186015A2 (en) 2010-05-19
EP2186015A4 true EP2186015A4 (en) 2015-04-29

Family

ID=40429720

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20080829858 Ceased EP2186015A4 (en) 2007-09-05 2008-09-05 De-duplication in virtualized server and virtualized storage environments

Country Status (3)

Country Link
EP (1) EP2186015A4 (en)
CN (2) CN102880626B (en)
WO (1) WO2009033074A2 (en)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8209506B2 (en) 2007-09-05 2012-06-26 Emc Corporation De-duplication in a virtualized storage environment
US8380681B2 (en) * 2010-12-16 2013-02-19 Microsoft Corporation Extensible pipeline for data deduplication
CN107092677B (en) * 2010-12-29 2021-09-07 亚马逊科技公司 Receiver-side data deduplication in data systems
CN102223409B (en) * 2011-06-13 2013-08-21 浪潮(北京)电子信息产业有限公司 Network storage resource application system and method
CN102221982B (en) * 2011-06-13 2013-09-11 北京卓微天成科技咨询有限公司 Method and system for implementing deletion of repeated data on block-level virtual storage equipment
US8468138B1 (en) * 2011-12-02 2013-06-18 International Business Machines Corporation Managing redundant immutable files using deduplication in storage clouds
US9235589B2 (en) * 2011-12-13 2016-01-12 International Business Machines Corporation Optimizing storage allocation in a virtual desktop environment
US9417811B2 (en) 2012-03-07 2016-08-16 International Business Machines Corporation Efficient inline data de-duplication on a storage system
US8923195B2 (en) * 2012-03-20 2014-12-30 Futurewei Technologies, Inc. Method and apparatus for efficient content delivery in radio access networks
CN104364774B (en) * 2012-04-27 2017-10-20 不列颠哥伦比亚大学 Deduplicate virtual machine image shifter
JP5965541B2 (en) 2012-10-31 2016-08-10 株式会社日立製作所 Storage device and storage device control method
GB2510185A (en) 2013-01-29 2014-07-30 Ibm Data de-duplication between emulated disk sub-systems
US9729659B2 (en) * 2013-03-14 2017-08-08 Microsoft Technology Licensing, Llc Caching content addressable data chunks for storage virtualization
WO2014185918A1 (en) * 2013-05-16 2014-11-20 Hewlett-Packard Development Company, L.P. Selecting a store for deduplicated data
CN105324765B (en) 2013-05-16 2019-11-08 慧与发展有限责任合伙企业 Choose a bucket for deduplication
CN103559282B (en) * 2013-11-07 2018-02-23 北京国双科技有限公司 The De-weight method and device of real-time system data
EP3126984A4 (en) 2014-04-03 2017-10-11 Strato Scale Ltd. Cluster-wide memory management using similarity-preserving signatures
US20150286414A1 (en) * 2014-04-03 2015-10-08 Strato Scale Ltd. Scanning memory for de-duplication using rdma
CN103942292A (en) * 2014-04-11 2014-07-23 华为技术有限公司 Virtual machine mirror image document processing method, device and system
US10897506B2 (en) 2014-07-02 2021-01-19 Hewlett Packard Enterprise Development Lp Managing port connections
CN104133888B (en) * 2014-07-30 2019-08-02 宇龙计算机通信科技(深圳)有限公司 A kind of multisystem data processing method, device and terminal
EP3195135A4 (en) * 2014-09-05 2018-05-02 Hewlett-Packard Enterprise Development LP Data storage over fibre channel
CN105612489B (en) * 2014-09-15 2017-08-29 华为技术有限公司 Data de-duplication method and storage array
US9390028B2 (en) 2014-10-19 2016-07-12 Strato Scale Ltd. Coordination between memory-saving mechanisms in computers that run virtual machines
US9912748B2 (en) 2015-01-12 2018-03-06 Strato Scale Ltd. Synchronization of snapshots in a distributed storage system
WO2016135570A1 (en) 2015-02-26 2016-09-01 Strato Scale Ltd. Using access-frequency hierarchy for selection of eviction destination
CN107515723B (en) * 2016-06-16 2020-04-24 伊姆西Ip控股有限责任公司 Method and system for managing memory in a storage system
CN107870922B (en) * 2016-09-23 2022-02-22 伊姆西Ip控股有限责任公司 Method, equipment and system for data deduplication
TWI663515B (en) * 2017-07-18 2019-06-21 先智雲端數據股份有限公司 Storage system of distributed deduplication for internet of things backup in data center and method for achieving the same
US11467775B2 (en) * 2019-10-15 2022-10-11 Hewlett Packard Enterprise Development Lp Virtual persistent volumes for containerized applications
CN111209229B (en) * 2019-12-30 2021-12-21 苏州艾利特机器人有限公司 Fieldbus method based on virtual equipment
US12135885B2 (en) 2020-01-31 2024-11-05 Hewlett Packard Enterprise Development Lp Virtual storage policies for virtual persistent volumes
US20210334024A1 (en) * 2020-04-28 2021-10-28 International Business Machines Corporation Transactional Memory Based Memory Page De-Duplication
CN114090551A (en) * 2020-07-29 2022-02-25 华为云计算技术有限公司 Method, device and system for storing data
CN115934257A (en) * 2022-12-26 2023-04-07 湖南麒麟信安科技股份有限公司 A virtualized cluster storage system and its implementation method
CN117991979B (en) * 2023-12-12 2026-05-01 天翼云科技有限公司 Multi-virtual machine thermomigration data deduplication method in cloud computing environment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6075938A (en) * 1997-06-10 2000-06-13 The Board Of Trustees Of The Leland Stanford Junior University Virtual machine monitors for scalable multiprocessors
US6374266B1 (en) * 1998-07-28 2002-04-16 Ralph Shnelvar Method and apparatus for storing information in a data processing system
US6389433B1 (en) * 1999-07-16 2002-05-14 Microsoft Corporation Method and system for automatically merging files into a single instance store
US6789156B1 (en) * 2001-05-22 2004-09-07 Vmware, Inc. Content-based, transparent sharing of memory units
US20070050423A1 (en) * 2005-08-30 2007-03-01 Scentric, Inc. Intelligent general duplicate management system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7043614B2 (en) * 2002-07-11 2006-05-09 Veritas Operating Corporation Storage services and systems
CN1826805A (en) * 2003-07-24 2006-08-30 皇家飞利浦电子股份有限公司 Optimisation of stored video data
US20050081099A1 (en) * 2003-10-09 2005-04-14 International Business Machines Corporation Method and apparatus for ensuring valid journaled file system metadata during a backup operation
JP4402565B2 (en) * 2004-10-28 2010-01-20 富士通株式会社 Virtual storage management program, method and apparatus
JP2006134208A (en) * 2004-11-09 2006-05-25 Fujitsu Ltd Storage virtualization device
US7694298B2 (en) * 2004-12-10 2010-04-06 Intel Corporation Method and apparatus for providing virtual server blades

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6075938A (en) * 1997-06-10 2000-06-13 The Board Of Trustees Of The Leland Stanford Junior University Virtual machine monitors for scalable multiprocessors
US6374266B1 (en) * 1998-07-28 2002-04-16 Ralph Shnelvar Method and apparatus for storing information in a data processing system
US6389433B1 (en) * 1999-07-16 2002-05-14 Microsoft Corporation Method and system for automatically merging files into a single instance store
US6789156B1 (en) * 2001-05-22 2004-09-07 Vmware, Inc. Content-based, transparent sharing of memory units
US20070050423A1 (en) * 2005-08-30 2007-03-01 Scentric, Inc. Intelligent general duplicate management system

Also Published As

Publication number Publication date
EP2186015A2 (en) 2010-05-19
CN101809559A (en) 2010-08-18
WO2009033074A3 (en) 2009-05-14
WO2009033074A2 (en) 2009-03-12
CN101809559B (en) 2013-10-16
CN102880626B (en) 2016-02-10
CN102880626A (en) 2013-01-16

Similar Documents

Publication Publication Date Title
GB2447532B (en) Devices and methods for use in construction
EP2652625A4 (en) Data deduplication in a virtualization environment
EP2480974A4 (en) Distributed content storage and retrieval
EP2332024A4 (en) Using physical objects in conjunction with an interactive surface
GB201303047D0 (en) Sequential access storage and data de-duplication
EP2238535A4 (en) Virtual computing management systems and methods
ZA201103573B (en) Card reading shoe with card stop feature and systems utilizing the same
EP2153608A4 (en) Determination of compression state information for use in interactive compression
EP2231037A4 (en) Retrieval systems and methods for use thereof
EP2340491A4 (en) Direct-attached/network-attached storage device
EP2281268A4 (en) Composite assets for use in multiple simulation environments
EP2286344A4 (en) Ranking and prioritizing point in time snapshots
EP2286343A4 (en) Resilient data storage in the presence of replication faults and rolling disasters
EP2084663A4 (en) Order fulfillment and content management systems and methods
EP2210177A4 (en) Statistical applications in oltp environment
GB201214631D0 (en) Retrieval and display or related content using text stream data feeds
EP2375427A4 (en) Storage element and storage device
PL2235013T3 (en) Substituted tetrahydroimidazopyridine compounds and the use thereof in pharmaceuticals
GB201019584D0 (en) Systems and methods for supoorting pre-boot log in
EP2272132A4 (en) Improvements in computer room security
GB0714920D0 (en) Improvements in and relating to vapour compression systems
EP2353104A4 (en) Modeling party identities in computer storage systems
PL2250179T3 (en) Lecithin based composition and its use in food
EP2216721A4 (en) Data storage system and data storage program
GB0903427D0 (en) Fluid compositions and methods for the use thereof

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100225

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: YUEH, JEDIDIAH

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20150331

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/06 20060101ALI20150325BHEP

Ipc: G06F 17/30 20060101AFI20150325BHEP

Ipc: H04L 29/08 20060101ALI20150325BHEP

Ipc: G06F 9/455 20060101ALI20150325BHEP

17Q First examination report despatched

Effective date: 20180613

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20200716