MX2015010491A - Enlaces de tabla hive. - Google Patents

Enlaces de tabla hive.

Info

Publication number
MX2015010491A
MX2015010491A MX2015010491A MX2015010491A MX2015010491A MX 2015010491 A MX2015010491 A MX 2015010491A MX 2015010491 A MX2015010491 A MX 2015010491A MX 2015010491 A MX2015010491 A MX 2015010491A MX 2015010491 A MX2015010491 A MX 2015010491A
Authority
MX
Mexico
Prior art keywords
partitions
virtual data
links
metadata
warehouses
Prior art date
Application number
MX2015010491A
Other languages
English (en)
Other versions
MX362650B (es
Inventor
Namit Jain
Raghotham Sathyanarayana Murthy
Sambavi Muthukrishnan
Bhushan Mandhani
Original Assignee
Facebook Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Inc filed Critical Facebook Inc
Publication of MX2015010491A publication Critical patent/MX2015010491A/es
Publication of MX362650B publication Critical patent/MX362650B/es

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/256Integrating or interfacing systems involving database management systems in federated or virtual databases
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/972Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Se proporcionan un sistema y un método para almacenes virtuales de datos que tienen capacidades de enlace de tabla. En particular, algunas modalidades incluyen una pluralidad de almacenes virtuales de datos construidos sobre un centro de datos que ejecuta Apache Hive. Cada almacén virtual de datos puede modelarse como una base de datos y maneja datos en formas de tablas de base de datos. El almacén virtual de datos puede incluir enlaces que imparten tablas desde otros almacenes virtuales de datos como referencia. Cada enlace puede contener metadatos de división para las divisiones de tablas por fechas de la tabla fuente y metadatos de retención para declarar el período de tiempo de retención necesario para las divisiones de la tabla fuente. Los enlaces pueden ser dinámicos y se actualizan cuando la tabla fuente correspondiente recibe nuevas divisiones o deja caer divisiones. Cuando un almacén virtual de datos migra a otro centro de datos, el sistema puede retener las divisiones de tabla necesarias para permanecer en el centro de datos actual con base en los metadatos de división y los metadatos de retención de los enlaces.
MX2015010491A 2013-02-13 2014-01-17 Enlaces de tabla hive. MX362650B (es)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/766,512 US10339157B2 (en) 2013-02-13 2013-02-13 Hive table links
PCT/US2014/012123 WO2014126678A1 (en) 2013-02-13 2014-01-17 Hive table links

Publications (2)

Publication Number Publication Date
MX2015010491A true MX2015010491A (es) 2016-05-05
MX362650B MX362650B (es) 2019-01-30

Family

ID=51298191

Family Applications (1)

Application Number Title Priority Date Filing Date
MX2015010491A MX362650B (es) 2013-02-13 2014-01-17 Enlaces de tabla hive.

Country Status (10)

Country Link
US (1) US10339157B2 (es)
JP (1) JP6321046B2 (es)
KR (1) KR101908553B1 (es)
CN (1) CN105144159B (es)
AU (2) AU2014216727A1 (es)
BR (1) BR112015019512A2 (es)
CA (1) CA2900498C (es)
IL (1) IL240497B (es)
MX (1) MX362650B (es)
WO (1) WO2014126678A1 (es)

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9335897B2 (en) 2013-08-08 2016-05-10 Palantir Technologies Inc. Long click display of a context menu
US9690671B2 (en) 2013-11-01 2017-06-27 Cloudera, Inc. Manifest-based snapshots in distributed computing environments
US10356032B2 (en) 2013-12-26 2019-07-16 Palantir Technologies Inc. System and method for detecting confidential information emails
US9338013B2 (en) 2013-12-30 2016-05-10 Palantir Technologies Inc. Verifiable redactable audit log
US8832832B1 (en) 2014-01-03 2014-09-09 Palantir Technologies Inc. IP reputation
US10366102B2 (en) 2014-02-19 2019-07-30 Snowflake Inc. Resource management systems and methods
US10521455B2 (en) * 2014-03-18 2019-12-31 Nanobi Data And Analytics Private Limited System and method for a neural metadata framework
US9535974B1 (en) 2014-06-30 2017-01-03 Palantir Technologies Inc. Systems and methods for identifying key phrase clusters within documents
US9619557B2 (en) 2014-06-30 2017-04-11 Palantir Technologies, Inc. Systems and methods for key phrase characterization of documents
US9256664B2 (en) 2014-07-03 2016-02-09 Palantir Technologies Inc. System and method for news events detection and visualization
US9419992B2 (en) 2014-08-13 2016-08-16 Palantir Technologies Inc. Unwanted tunneling alert system
US9043894B1 (en) 2014-11-06 2015-05-26 Palantir Technologies Inc. Malicious software detection in a computing system
US9467455B2 (en) 2014-12-29 2016-10-11 Palantir Technologies Inc. Systems for network risk assessment including processing of user access rights associated with a network of devices
US9648036B2 (en) 2014-12-29 2017-05-09 Palantir Technologies Inc. Systems for network risk assessment including processing of user access rights associated with a network of devices
US9407652B1 (en) 2015-06-26 2016-08-02 Palantir Technologies Inc. Network anomaly detection
US9456000B1 (en) 2015-08-06 2016-09-27 Palantir Technologies Inc. Systems, methods, user interfaces, and computer-readable media for investigating potential malicious communications
US9537880B1 (en) 2015-08-19 2017-01-03 Palantir Technologies Inc. Anomalous network monitoring, user behavior detection and database system
US9984428B2 (en) * 2015-09-04 2018-05-29 Palantir Technologies Inc. Systems and methods for structuring data from unstructured electronic data files
US10044745B1 (en) 2015-10-12 2018-08-07 Palantir Technologies, Inc. Systems for computer network security risk assessment including user compromise analysis associated with a network of devices
US9888039B2 (en) 2015-12-28 2018-02-06 Palantir Technologies Inc. Network-based permissioning system
US9916465B1 (en) 2015-12-29 2018-03-13 Palantir Technologies Inc. Systems and methods for automatic and customizable data minimization of electronic data stores
US10476975B2 (en) 2015-12-31 2019-11-12 Palantir Technologies Inc. Building a user profile data repository
CN106997368A (zh) * 2016-01-26 2017-08-01 中兴通讯股份有限公司 一种数据仓库中的数据保护方法及装置
US10498711B1 (en) 2016-05-20 2019-12-03 Palantir Technologies Inc. Providing a booting key to a remote system
US10084802B1 (en) 2016-06-21 2018-09-25 Palantir Technologies Inc. Supervisory control and data acquisition
US10291637B1 (en) 2016-07-05 2019-05-14 Palantir Technologies Inc. Network anomaly detection and profiling
US10698927B1 (en) 2016-08-30 2020-06-30 Palantir Technologies Inc. Multiple sensor session and log information compression and correlation system
US10728262B1 (en) 2016-12-21 2020-07-28 Palantir Technologies Inc. Context-aware network-based malicious activity warning systems
US10754872B2 (en) 2016-12-28 2020-08-25 Palantir Technologies Inc. Automatically executing tasks and configuring access control lists in a data transformation system
US10721262B2 (en) 2016-12-28 2020-07-21 Palantir Technologies Inc. Resource-centric network cyber attack warning system
US10592681B2 (en) * 2017-01-10 2020-03-17 Snowflake Inc. Data sharing in a multi-tenant database system
US10027551B1 (en) 2017-06-29 2018-07-17 Palantir Technologies, Inc. Access controls through node-based effective policy identifiers
US10963465B1 (en) 2017-08-25 2021-03-30 Palantir Technologies Inc. Rapid importation of data including temporally tracked object recognition
US10984427B1 (en) 2017-09-13 2021-04-20 Palantir Technologies Inc. Approaches for analyzing entity relationships
GB201716170D0 (en) 2017-10-04 2017-11-15 Palantir Technologies Inc Controlling user creation of data resources on a data processing platform
US10079832B1 (en) 2017-10-18 2018-09-18 Palantir Technologies Inc. Controlling user creation of data resources on a data processing platform
US10250401B1 (en) 2017-11-29 2019-04-02 Palantir Technologies Inc. Systems and methods for providing category-sensitive chat channels
US11133925B2 (en) 2017-12-07 2021-09-28 Palantir Technologies Inc. Selective access to encrypted logs
US10142349B1 (en) 2018-02-22 2018-11-27 Palantir Technologies Inc. Verifying network-based permissioning rights
KR102113680B1 (ko) * 2018-03-09 2020-05-20 (주)이지서티 빅 데이터 비식별화 처리 시스템 및 방법
US10878051B1 (en) 2018-03-30 2020-12-29 Palantir Technologies Inc. Mapping device identifiers
US10255415B1 (en) 2018-04-03 2019-04-09 Palantir Technologies Inc. Controlling access to computer resources
CN110414257A (zh) * 2018-04-26 2019-11-05 中移(苏州)软件技术有限公司 一种数据访问方法及服务器
US10949400B2 (en) 2018-05-09 2021-03-16 Palantir Technologies Inc. Systems and methods for tamper-resistant activity logging
US11244063B2 (en) 2018-06-11 2022-02-08 Palantir Technologies Inc. Row-level and column-level policy service
CN109669946B (zh) * 2018-12-14 2021-11-16 中南设计集团(武汉)工程技术研究院有限公司 一种基于海量用户的复杂权限体系数据隔离系统及方法
US11526464B2 (en) * 2018-12-21 2022-12-13 Dropbox, Inc. Scaling HDFS for hive
EP3694173B1 (en) 2019-02-08 2022-09-21 Palantir Technologies Inc. Isolating applications associated with multiple tenants within a computing platform
CN110163002B (zh) * 2019-05-29 2023-06-13 上海有谱网络科技有限公司 一种SaaS软件租户数据隔离的方法
US20200379994A1 (en) * 2019-05-31 2020-12-03 Snowflake Inc. Sharing Materialized Views In Multiple Tenant Database Systems
CN110399749B (zh) * 2019-08-05 2021-04-23 杭州安恒信息技术股份有限公司 数据资产管理方法及系统
US11704441B2 (en) 2019-09-03 2023-07-18 Palantir Technologies Inc. Charter-based access controls for managing computer resources
EP3796165A1 (en) 2019-09-18 2021-03-24 Palantir Technologies Inc. Systems and methods for autoscaling instance groups of computing platforms
JP7455267B1 (ja) 2022-10-28 2024-03-25 Dowaエレクトロニクス株式会社 紫外線発光素子及びその製造方法
CN116401231B (zh) * 2023-03-20 2024-04-26 一临云(深圳)科技有限公司 数据源管理方法、设备及存储介质

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5675785A (en) 1994-10-04 1997-10-07 Hewlett-Packard Company Data warehouse which is accessed by a user using a schema of virtual tables
JP4406944B2 (ja) 1998-11-11 2010-02-03 株式会社日立製作所 計算機システム及び問合せに対する処理分散システム
US20020133368A1 (en) 1999-10-28 2002-09-19 David Strutt Data warehouse model and methodology
US6823391B1 (en) 2000-10-04 2004-11-23 Microsoft Corporation Routing client requests to back-end servers
US6671689B2 (en) 2001-01-19 2003-12-30 Ncr Corporation Data warehouse portal
US20020099563A1 (en) 2001-01-19 2002-07-25 Michael Adendorff Data warehouse system
WO2003036520A1 (en) 2001-10-23 2003-05-01 Visto Corporation System and method for merging remote and local data in a single user interface
US7370366B2 (en) 2001-11-16 2008-05-06 International Business Machines Corporation Data management system and method
US7305432B2 (en) 2002-10-23 2007-12-04 Aol Llc Privacy preferences roaming and enforcement
JP3702268B2 (ja) 2002-11-29 2005-10-05 株式会社東芝 情報検索システム、情報検索方法およびプログラム
US20040210452A1 (en) 2003-01-14 2004-10-21 Aboujaoude Roger B. Method and system for unifying and sharing of business systems
US7284010B2 (en) 2003-10-23 2007-10-16 Microsoft Corporation System and method for storing and retrieving a field of a user defined type outside of a database store in which the type is defined
US20050149496A1 (en) 2003-12-22 2005-07-07 Verity, Inc. System and method for dynamic context-sensitive federated search of multiple information repositories
WO2005092032A2 (en) * 2004-03-22 2005-10-06 Sliccware Corporation Secure virtual data warehousing system and method
US8271428B2 (en) 2004-05-20 2012-09-18 International Business Machines Corporation Method and system for creating and loading data warehouse from semi-structured document
US8341345B2 (en) * 2005-08-08 2012-12-25 International Business Machines Corporation System and method for providing content based anticipative storage management
WO2007030796A2 (en) 2005-09-09 2007-03-15 Salesforce.Com, Inc. Systems and methods for exporting, publishing, browsing and installing on-demand applications in a multi-tenant database environment
CN100570635C (zh) 2005-11-02 2009-12-16 浙江大学 分布式知识管理集成系统及其集成方法
US20110004622A1 (en) 2007-10-17 2011-01-06 Blazent, Inc. Method and apparatus for gathering and organizing information pertaining to an entity
JP2009146350A (ja) 2007-12-18 2009-07-02 Mitsubishi Electric Corp サービス管理装置及びデータアクセス制御装置及びデータ検索方法
US8321438B1 (en) 2008-06-18 2012-11-27 Bank Of America Corporation Integration layer for a data repository
WO2009155741A1 (en) 2008-06-23 2009-12-30 Shanghai Hewlett-Packard Co., Ltd Spatial querying in a data warehouse
CN101620609B (zh) * 2008-06-30 2012-03-21 国际商业机器公司 多租户数据存储和访问方法和装置
JP5200721B2 (ja) 2008-07-16 2013-06-05 富士通株式会社 制御方法、制御装置、及びプログラム
JP5500859B2 (ja) 2009-04-16 2014-05-21 株式会社日立製作所 環境関連情報集計分析システム。
US8392969B1 (en) * 2009-06-17 2013-03-05 Intuit Inc. Method and apparatus for hosting multiple tenants in the same database securely and with a variety of access modes
US20140112319A1 (en) * 2012-10-18 2014-04-24 Deep River Ventures, Llc Methods, Systems, and Computer Program Products for Constraining a Data Exchange Requested in a Communication
US8468120B2 (en) * 2010-08-24 2013-06-18 International Business Machines Corporation Systems and methods for tracking and reporting provenance of data used in a massively distributed analytics cloud
US8775425B2 (en) * 2010-08-24 2014-07-08 International Business Machines Corporation Systems and methods for massive structured data management over cloud aware distributed file system
US8751432B2 (en) * 2010-09-02 2014-06-10 Anker Berg-Sonne Automated facilities management system
US8769704B2 (en) 2010-09-10 2014-07-01 Salesforce.Com, Inc. Method and system for managing and monitoring of a multi-tenant system
US8949939B2 (en) 2010-10-13 2015-02-03 Salesforce.Com, Inc. Methods and systems for provisioning access to customer organization data in a multi-tenant system
US8732606B2 (en) * 2010-10-25 2014-05-20 Salesforce.Com, Inc. Computer implemented methods and apparatus for dynamic windowing in user interfaces
US8429117B2 (en) 2010-12-28 2013-04-23 Hewlett-Packard Development Company, L.P. Data loading method for a data warehouse
US8775486B2 (en) * 2011-04-04 2014-07-08 Symantec Corporation Global indexing within an enterprise object store file system
US8769622B2 (en) 2011-06-30 2014-07-01 International Business Machines Corporation Authentication and authorization methods for cloud computing security
US8615503B2 (en) * 2011-07-01 2013-12-24 International Business Machines Corporation Method for attaching partition online to range partitioned table
US20130179894A1 (en) * 2012-01-09 2013-07-11 Microsoft Corporation Platform as a service job scheduling
US9355060B1 (en) * 2012-12-14 2016-05-31 Amazon Technologies, Inc. Storage service lifecycle policy transition management
US9417917B1 (en) * 2012-12-14 2016-08-16 Amazon Technologies, Inc. Equitable resource allocation for storage object deletion

Also Published As

Publication number Publication date
US10339157B2 (en) 2019-07-02
CA2900498C (en) 2019-11-26
WO2014126678A1 (en) 2014-08-21
BR112015019512A2 (pt) 2017-07-18
JP6321046B2 (ja) 2018-05-09
MX362650B (es) 2019-01-30
JP2016511899A (ja) 2016-04-21
CA2900498A1 (en) 2014-08-21
AU2018282321A1 (en) 2019-01-17
IL240497A0 (en) 2015-09-24
US20140229422A1 (en) 2014-08-14
CN105144159B (zh) 2018-12-14
KR20150119108A (ko) 2015-10-23
KR101908553B1 (ko) 2018-10-16
AU2014216727A1 (en) 2015-08-27
CN105144159A (zh) 2015-12-09
IL240497B (en) 2021-12-01

Similar Documents

Publication Publication Date Title
MX362650B (es) Enlaces de tabla hive.
Lautenschlager et al. Icews event aggregations
WO2016029018A3 (en) Executing constant time relational queries against structured and semi-structured data
BR112015015911A2 (pt) modificação de consultas de busca estruturadas em redes sociais em linha direta
WO2013163644A3 (en) Updating a search index used to facilitate application searches
MY165932A (en) Partition management in a partitioned, scalable, and available structured storage
MX2020003722A (es) Predicción de peso en planos desiguales adaptativa.
EP4340331A3 (en) Replicated database distribution for workload balancing after cluster reconfiguration
BR112015029306A2 (pt) fragmentação de banco de dados com camada de atualização
BR112017008938A2 (pt) protease inteína-modificada, cassete de expressão, composição, produto de cuidados domésticos, método de regular a atividade de protease e método de armazenar uma protease em uma mistura
BR112016006284A2 (pt) método para conduzir evolução direcionada, produto de programa de computador, e, sistema de computador
WO2016099902A3 (en) Efficiently providing virtual machine reference points
SG10201803837VA (en) Blockchain system and data managing method using blockchain
WO2014036282A3 (en) System and process of associating import and/or export data with a corporate identifier
WO2013040463A3 (en) System and method for supporting a server-side event model in a distributed data grid
Zhao et al. Hopf bifurcation and harvesting control of a bioeconomic plankton model with delay and diffusion terms
BR112016023925A2 (pt) sistema, método e programa de computador para lidar com a interação de robô humanoide com humano
WO2014131042A3 (en) Ranking media content sources
MX2016012377A (es) Un metodo para proporcionar elasticidad en la virtualizacion de la red de transporte.
WO2014064053A3 (en) Healthcare system and method
BR112017019029A2 (pt) sistema que facilita a produção e edição de episódios de tratamento agrupados em eventos de tratamento, e sistema que facilita a criação e edição de episódios de tratamento
CL2019000956A1 (es) Método y sistema para almacenar y acceder a datos de bioinformática.
AR095134A1 (es) Dispositivo informático, sistema y método relacionado con gráficos y tarjetas de actividad
CN104871153B8 (zh) 用于分布式大规模并行处理数据库的方法和系统
WO2014022086A3 (en) Note atlas

Legal Events

Date Code Title Description
FG Grant or registration