EP0958537A1 - Methode de partage de donnees dans un systeme informatique heterogene et systeme informatique avec partage des donnees - Google Patents

Methode de partage de donnees dans un systeme informatique heterogene et systeme informatique avec partage des donnees

Info

Publication number
EP0958537A1
EP0958537A1 EP97903549A EP97903549A EP0958537A1 EP 0958537 A1 EP0958537 A1 EP 0958537A1 EP 97903549 A EP97903549 A EP 97903549A EP 97903549 A EP97903549 A EP 97903549A EP 0958537 A1 EP0958537 A1 EP 0958537A1
Authority
EP
European Patent Office
Prior art keywords
data
dom
mass storage
interface
computer system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP97903549A
Other languages
German (de)
English (en)
Inventor
Tsvi Misinai
Michael Rothschild
Shmuel Alazraki
Arie Kremer
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Newframe Corp Ltd
Original Assignee
Newframe Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Newframe Corp Ltd filed Critical Newframe Corp Ltd
Publication of EP0958537A1 publication Critical patent/EP0958537A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/52—Program synchronisation; Mutual exclusion, e.g. by means of semaphores
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/256—Integrating or interfacing systems involving database management systems in federated or virtual databases

Definitions

  • the present invention relates to a method of sharing data between computer units of a heterogeneous computer system, i.e. between computers that use different central processing units (CPU's), different storage, architectures, different controller interfaces and/or different access methods.
  • the invention also relates to a heterogeneous computer system with shared data and, therefore, to the implementation of the method, especially implementation of a single database management system for different computer types or computer units.
  • Computer systems or computer types utilize different storage architectures, different access methods and different controller interfaces so that they cannot access data from another computer system or type although such a capability is clearly needed and would be a significant advantage.
  • the differences in storage architecture, access methods or controller interfaces have prevented effective sharing of data or common use of the same copy of the data.
  • the principal object of the present invention to provide an improved method of sharing data between computer types of a heterogeneous computer system whereby drawbacks of earlier systems are obviated.
  • Another object of the invention is to provide a heterogeneous computer system or architecture capable of sharing data so that practically any computer type can be involved in the heterogeneous system and can access data of the storage.
  • Still another object of this invention is to provide a heterogeneous computer system comprised of a plurality of computer types which enables each computer type to look at the shared data in a completely different way, for example, Sybase on one machine and DB2 on another machine sharing data from a common storage.
  • the method of the invention of sharing data between a first computer system operating with one application running therein and having a first disk organization method DOM 1 and a second computer system operating with an application running therein and having a second disk organization method DOM 2 and sharing a mass storage through a mass storage controller communicating with the mass storage with a third disk organization method DOM 3, comprises the steps of:
  • interfaces Both in the case already described and in cases to be described, we have referred to interfaces with the understanding that any one of them can, in turn, be any number of physical interfaces, that the "one" or “other” interface can be the same interface or group of interfaces or can even alternate among a number of interfaces which is larger than two.
  • the method of sharing data between heterogeneous computer systems in which a first computer system operating with one application running therein and having a first disk organization method DOM 1 and a second computer system operating with an application running therein and having a second disk organization method DOM 2 and sharing a mass storage through a mass storage controller communicating with the mass storage with a third disk organization method DOM 3, comprises the steps of:
  • controller is used in this document in its most general sense, to represent the whole combination of hardware and software elements that connect the disk drive to the computer system. Such a combination may include an adapter, a telecommunication line, connecting cables, an intermediate computer, an "ordinary" control unit etc. Such a controller supports as a minimum, the connection of one disk drive to one computer system, but it may also support the connection of several disk drives to one computer system, several computer systems to one disk drive, several computer systems to several disk drives, several computer systems to several controllers or several controllers to one or several disk drives.
  • Main Storage Volatile storage that resides in the computer system running the application program. It's the most accessible and the most expensive kind of storage.
  • Volatile storage that resides in the computer system running the application or in the controller. Accessing it takes longer than accessing the main storage, but not as much as accessing the secondary storage.
  • Direct Access Storage that resides on an external device (like a disk). It's not volatile and accessing it may take much longer than accessing any other type of storage.
  • the protocol used for the communication between the controller and its environment (computers and mass storage) .
  • the equipment used to connect a computer to a controller or a controller to a device The equipment used to connect a computer to a controller or a controller to a device.
  • the way data is organized on the disk.
  • FBA Fixed Block Architecture
  • CKD Counter, Key and Data
  • Data can be shared in several ways, not all of which are necessarily supported in every case, the level of support depending upon the degree of implementation of the heterogeneous locking mechanism.
  • accessing the data requires the ability to find its location on the secondary storage device, read the data from that location and translate it to its local representation.
  • heterogeneous computer system refers to a system which consists of two or more computer types (each of which may have multiple machines networked together — possibly by being connected to a set of common controllers — or a single machine and each of which can be referred to as a computer system) , and a common data storage facility, it will be understood that each of the machines and each of the computer types or computer systems forming part of the heterogeneous computer system may have a local storage or memory as well.
  • the improved heterogeneous computer system or architecture with data sharing of the invention can comprise: a first computer system operating with one application running therein and having a first disk organization method DOM 1 and a first interface; a second computer system operating with an application running therein and having a second disk organization method DOM 2 , and a second interface; a mass storage shared with the first and second computer systems; a mass storage controller communicating with the mass storage and connected to the first and second interfaces and having a third disk organization method DOM 3 ; an emulator in the second computer system translating data communicated from the application running therein into DOM 2 data compatible with the second disk organization method at the second interface and reconstructing DOM 2 data received at the second interface compatible with the application running in the second computer system; means for communicating DOM 2 data between the second interface and the mass storage controller; a first emulator of the mass storage controller translating DOM 2 data received from the second interface into DOM 3 data compatible with the mass storage at a third interface of the mass storage controller and reconstructing DOM 3 data received at the third interface from the mass storage
  • One of the computer types or systems can be a mainframe computer system while the other computer types or system can utilize one or more UNIX machines while the mass storage can be operated as a database storage.
  • data locking operational from at least one of the computer systems can be applied in the mass storage. If desired, only one of the computer systems may be enabled to write shared data into the mass storage or only one type of computer or a single machine may be enabled to write shared data into the system.
  • the mass storage can have or can be a shared cache memory and the mass storage control unit can have a shared locking program.
  • Uses of the invention can include: accessing an IBM mainframe DB2 database from a UNIX environment or a fast download program that runs in the UNIX environment and derives an Oracle fast load compatible file from DB2 on the mainframe.
  • FIG. 1 is a block diagram illustrating a heterogeneous system with sharing of storage in accordance with the invention and representing a generic system;
  • FIG. 2 is a block diagram of one specific example of such a system
  • FIG. 3 is a block diagram of an example of the way space management is shared in existing hardware without achieving data sharing
  • FIG. 4 is a block diagram of still another heterogeneous computer system sharing data between two different types of computers, each represented by one computer and wherein, as in FIG. 1, Cl represents the controller interface and DOM represents the respective disk organization method;
  • FIG. 5 is a block diagram of still a further heterogeneous computer system utilizing two different types of machines as an example of the generic structure of FIG. 1;
  • FIG. 6 is a diagram of an algorithm for use with the system of FIG. 5.
  • FIG. 1 the relationship between two different computer types and the shared data storage utilizing the existing controller interfaces will be detailed generically with respect to FIG. 1 and by way of example of how the generic system can be specifically applied with respect to FIGS. 2 to 5, FIG. 6 showing an algorithm.
  • two computer systems 10 and 20 with respective applications share a secondary storage system represented generically at 30.
  • one computer type 10 may involve a UNIX machine or a network of UNIX machines while the other computer type 20 may represent an IBM Mainframe.
  • the mass storage 30 may be a storage unit of the Symmetrix type manufactured by EMC.
  • FIG. 2 therefore, a specific situation is shown where DB2 data is shared between the IBM Mainframe and the UNIX environment.
  • the system utilizes the UNIX system 10 and the IBM Mainframe 20 in combination with the EMC Symmetrix 30 while a different relationship is established between the files or data bases in storage and the treatment thereof by the secondary storage controller and there is no data sharing.
  • FIG. 4 represents a general application of the system for two computer systems 10, 20 utilizing a mass storage 30 with a mass storage controller 40 and the secondary storage 60. While two types of computers have been shown for the mass storage 30, in practice any number of computer types may be used and any one of the computer types or systems can comprise any number of machines.
  • the UNIX machine 10 and the IBM Mainframe 20 are connected to the shared data system 30 but here a mechanism for translation has been added to the UNIX environment enabling UNIX applications to share data with the Mainframe applications.
  • FIG. 6 shows how an SQL request is handled in the system of FIG. 5 and this algorithm can describe the way every SQL request originating in any computer system is handled in the invention, any differences between the computer systems only influencing how the work is divided between the computer system and the controller.
  • FIG. 1 depicts a small environment for practicing the present invention.
  • Two applications (1) residing on two different types of computer systems (2) that use different controller interfaces and different disk organization methods on their connections (3) to the controller (4) that connects to the secondary storage device (6) through still another controller interface and disk organization method (5) .
  • the controller (4) and the secondary storage device (6) are optionally packaged in the same box (46) .
  • FIG. 2 describes a specific environment that conforms to the general description in FIG. 1.
  • one of the computer systems is an IBM Mainframe and the other is a UNIX machine; applications running on both of these computer systems need to access DB2 data residing on a SCSI disk array managed by EMC's Symmetrix controller.
  • the mainframe uses the ESCON interface to the controller and assumes a CKD organization of the disks; the UNIX machine uses SCSI interface and assumes that the disk is organized in FBA.
  • FIG. 3 describes how, in the previous example, a disk controller is shared using an emulator (7) that is embedded in the Symmetrix controller.
  • CKD I/O requests coming from the mainframes application through the ESCON interface are translated by this emulator to FBA requests that implement a CKD representation on FBA, and sent to the disk drive through a SCSI interface; responses coming from the disk drive through the SCSI interface are used to create the implied CKD responses which are sent to the Mainframe's application through the ESCON interface.
  • This architecture does not provide data sharing since it contains no means for the UNIX system to deal with the CKD control data.
  • FIG. 4 shows how the generalization form shared storage management to shared data is achieved.
  • Computer systems of type 1 use Cl 1 as a controller interface and DOM 1 as a disk organization method; this happens to be exactly what the application running on this computer expects and therefore, the first (and only) emulation that translates this data is the one residing in the controller, translating it between DOM 1 and DOM 3 which is the DOM used by the disk array.
  • Computer systems of type 2 use Cl 2 and DOM 2 as their way to communicate with the data. Since this is not the way the specific application running in this computer system needs, an emulator (9) is used to translate the data between DOM 1 which is sent and received (10) by the application and DOM 2 which is used on the way to the controller.
  • Emulators (8) are also used in the secondary storage controller in order to translate between the organization methods used on the computer side of the controller and the one that is used on its device side.
  • Data that is created in the type 2 computer system may be thus transformed by two emulators (identity emulators which do nothing are a special case) .
  • the requests are first transformed from their DOM 1 representation, to a DOM 2 representation that is attributed the same semantics; next this representation is further replaced by a DOM 3 representation.
  • FIG. 5 is an example of the principles that are described in FIG. 4.
  • FIG. 6 illustrates the general flow of control and data, associated with a single SQL request in the system described in FIG. 5.
  • the DB2 DBMS (above the dashed line) translates the SQL request into a series of CKD requests.
  • the CKD requests are transmitted to the Symmetrix machine (below the dashed line) .
  • the Symmetrix machine translates these requests into equivalent FBA requests and communicates them to its embedded SCSI disks.
  • DB2 uses fixed block sizes
  • the translation of its I/O requests from CKD to FBA is straight forward; in more complicated situations, where variable block sizes are used, the Symmetrix machine uses a table it maintains internally in order to connect a key of the CKD to its byte address on the FBA device.
  • a general SQL driver like Dharma/SQL Access or Sapiens/LDB or IBM/DataJoiner or Informix/Enterprise Gateway or MDI/OmniSQL is used to break the SQL request into atoms that are supported by the emulator.
  • the emulator (on the UNIX machine) translates these atoms into CKD requests and then transforms these CKD requests into a series of FBA requests.
  • FBA requests when transmitted over the SCSI interface of the UNIX machine to the Symmetrix, can be used by it to create the appropriate FBA requests to be addressed to its internal disks.
  • the SCSI/FBA requests are only used to carry the meaning of the request to the Symmetrix which then uses its internal tables to build the final FBA requests.
  • the shared locking mechanism's preferred embodiment is the one described in U.S. Patent 5,339,427 although different mechanisms could also be used. Where desired data encryption and data compression can be used in any data-flow direction.
  • DB2 has been mentioned as a data base which is shared in the embodiments described above, other data bases or data collection forms can be used as well. These include IMS, ADABAS and VSAM.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Multi Processors (AREA)

Abstract

Par systèmes informatiques hétérogènes, on entend des systèmes informatiques possédant différentes architectures de mémorisation, des systèmes informatiques ayant différentes unités centrales de traitement (UCT), des systèmes informatiques fonctionnant selon différentes techniques d'organisation de disque et différentes techniques d'accès, des systèmes informatiques utilisant différentes interfaces d'unités de contrôle, etc. Le concept de partage de données, sous-entend que chacun de ces systèmes informatiques peut avoir accès à des données de manière indépendante sans recourir aux services d'un autre système et qu'un exemplaire unique des données est conservé, par opposition aux données reproduites utilisées, et ce, dans certains cas afin de satisfaire aux mêmes besoins. Chaque système possède un accès direct aux données partagées et ce, par le biais d'émulateurs permettant à des applications présentes dans chaque système d'utiliser les interfaces désirées pour des données, camouflées sous la forme d'interfaces locales ordinaires. L'obtention d'accès à une base de données DB2 de macro-ordinateur IBM à partir d'un environnement UNIX est un exemple typique d'utilisation de cette invention et l'accès à cette base de données par le biais d'une interface du type Oracle dans l'environnement UNIX en constitue un cas spécifique. Une autre volet de l'invention peut consister en un programme de téléchargement rapide dérivant une fichier de téléchargement Oracle rapide compatible d'une DB2.
EP97903549A 1997-02-07 1997-02-07 Methode de partage de donnees dans un systeme informatique heterogene et systeme informatique avec partage des donnees Withdrawn EP0958537A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB1997/000220 WO1998035291A1 (fr) 1997-02-07 1997-02-07 Methode de partage de donnees dans un systeme informatique heterogene et systeme informatique avec partage des donnees

Publications (1)

Publication Number Publication Date
EP0958537A1 true EP0958537A1 (fr) 1999-11-24

Family

ID=11004534

Family Applications (1)

Application Number Title Priority Date Filing Date
EP97903549A Withdrawn EP0958537A1 (fr) 1997-02-07 1997-02-07 Methode de partage de donnees dans un systeme informatique heterogene et systeme informatique avec partage des donnees

Country Status (3)

Country Link
EP (1) EP0958537A1 (fr)
JP (1) JP2001511923A (fr)
WO (1) WO1998035291A1 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6999945B1 (en) * 1998-01-29 2006-02-14 Automated Business Companies Multiple customer and multiple location PC service provider system
JP2001297026A (ja) * 2000-04-11 2001-10-26 Hitachi Ltd 複数のデータベースマネージメントシステムを有する計算機システム
US7660845B2 (en) * 2003-08-01 2010-02-09 Sentillion, Inc. Methods and apparatus for verifying context participants in a context management system in a networked environment
US20050192962A1 (en) * 2004-02-26 2005-09-01 Patricia Furrer Apparatus, system, method for enabling web-applications to access enterprise managed data
DE112008002634T5 (de) 2007-09-27 2011-01-13 Hilton, Ronald N., Holladay Gerät, System und Verfahren zur systemübergreifenden Proxy-basierten Aufgabenentlastung
JP2009223512A (ja) * 2008-03-14 2009-10-01 Toshiba Corp 情報処理システム及びその制御方法
CN103810164A (zh) * 2012-11-06 2014-05-21 镇江华扬信息科技有限公司 一种基于sybase中间件实现异构数据库连接方法
JP5674974B2 (ja) * 2013-07-08 2015-02-25 株式会社エクサ 圧縮データ処理プログラム、圧縮データ編集プログラム

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03265945A (ja) * 1990-03-15 1991-11-27 Nec Corp 異種オペレーティングシステム間のデータ共有方式
TW226047B (fr) * 1990-03-27 1994-07-01 Ibm
US5339427A (en) * 1992-03-30 1994-08-16 International Business Machines Corporation Method and apparatus for distributed locking of shared data, employing a central coupling facility
US5983012A (en) * 1993-09-28 1999-11-09 Bull Hn Information Systems Inc. Executing programs of a first system on a second system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO9835291A1 *

Also Published As

Publication number Publication date
JP2001511923A (ja) 2001-08-14
WO1998035291A1 (fr) 1998-08-13

Similar Documents

Publication Publication Date Title
US5758125A (en) Method of sharing data in a heterogeneous computer system
EP0720091B1 (fr) Gestion de jetons à plusieurs niveaux pour des systèmes de fichiers distribués
US7007024B2 (en) Hashing objects into multiple directories for better concurrency and manageability
US8150811B1 (en) Parallel migration of data between systems
JP3600293B2 (ja) データベース・アクセス効率の向上方法及びシステム
US6453354B1 (en) File server system using connection-oriented protocol and sharing data sets among data movers
US6973455B1 (en) File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator
US7120631B1 (en) File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator
US6324581B1 (en) File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems
KR101137213B1 (ko) 데이타베이스의 복구 유닛을 위한 시스템 및 방법
US7921080B2 (en) System and method for a backup parallel server data storage system
US5913227A (en) Agent-implemented locking mechanism
US7412451B2 (en) Method for persisting a schedule and database schema
US5692174A (en) Query parallelism in a shared data DBMS system
US5692182A (en) Bufferpool coherency for identifying and retrieving versions of workfile data using a producing DBMS and a consuming DBMS
US7099900B1 (en) Mapping driver for use in data backup systems
EP1091305B1 (fr) Procédé d'extension d'une base de données
US7624170B2 (en) Integrated storage appliance
US7065541B2 (en) Database migration
US20040078654A1 (en) Hybrid quorum/primary-backup fault-tolerance model
US20030105852A1 (en) Integrated storage appliance
US8239402B1 (en) Standard file system access to data that is initially stored and accessed via a proprietary interface
WO2008143855A2 (fr) Dispositifs de stockage rattachés à un réseau
US8762434B1 (en) Aliasing of exported paths in a storage system
US10628391B1 (en) Method and system for reducing metadata overhead in a two-tier storage architecture

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19990907

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): DE FR GB IE IT

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20060901