ES2628455T8 - Procesamiento paralelo de consultas continuas sobre flujos de datos - Google Patents

Procesamiento paralelo de consultas continuas sobre flujos de datos Download PDF

Info

Publication number
ES2628455T8
ES2628455T8 ES11729557.6T ES11729557T ES2628455T8 ES 2628455 T8 ES2628455 T8 ES 2628455T8 ES 11729557 T ES11729557 T ES 11729557T ES 2628455 T8 ES2628455 T8 ES 2628455T8
Authority
ES
Spain
Prior art keywords
parallel processing
data flows
continuous queries
queries
continuous
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
ES11729557.6T
Other languages
English (en)
Other versions
ES2628455T3 (es
Inventor
Ricardo JIMÉNEZ PERIS
Marta PATIÑO MARTÍNEZ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universidad Politecnica de Madrid
Original Assignee
Universidad Politecnica de Madrid
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universidad Politecnica de Madrid filed Critical Universidad Politecnica de Madrid
Application granted granted Critical
Publication of ES2628455T3 publication Critical patent/ES2628455T3/es
Publication of ES2628455T8 publication Critical patent/ES2628455T8/es
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24532—Query optimisation of parallel queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5066—Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system
    • G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
ES11729557.6T 2010-06-18 2011-06-17 Procesamiento paralelo de consultas continuas sobre flujos de datos Active ES2628455T3 (es)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US35635310P 2010-06-18 2010-06-18
US356353P 2010-06-18
US201113112628 2011-05-20
US13/112,628 US20110314019A1 (en) 2010-06-18 2011-05-20 Parallel processing of continuous queries on data streams
PCT/EP2011/003011 WO2011157442A1 (en) 2010-06-18 2011-06-17 Parallel processing of continuous queries on data streams

Publications (2)

Publication Number Publication Date
ES2628455T3 ES2628455T3 (es) 2017-08-02
ES2628455T8 true ES2628455T8 (es) 2017-08-18

Family

ID=44627949

Family Applications (1)

Application Number Title Priority Date Filing Date
ES11729557.6T Active ES2628455T3 (es) 2010-06-18 2011-06-17 Procesamiento paralelo de consultas continuas sobre flujos de datos

Country Status (4)

Country Link
US (2) US20110314019A1 (es)
EP (1) EP2583175B1 (es)
ES (1) ES2628455T3 (es)
WO (1) WO2011157442A1 (es)

Families Citing this family (93)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9305238B2 (en) 2008-08-29 2016-04-05 Oracle International Corporation Framework for supporting regular expression-based pattern matching in data streams
US8935293B2 (en) 2009-03-02 2015-01-13 Oracle International Corporation Framework for dynamically generating tuple and page classes
US9430494B2 (en) 2009-12-28 2016-08-30 Oracle International Corporation Spatial data cartridge for event processing systems
US8959106B2 (en) 2009-12-28 2015-02-17 Oracle International Corporation Class loading using java data cartridges
US9305057B2 (en) 2009-12-28 2016-04-05 Oracle International Corporation Extensible indexing framework using data cartridges
US9495427B2 (en) 2010-06-04 2016-11-15 Yale University Processing of data using a database system in communication with a data processing framework
US8935232B2 (en) 2010-06-04 2015-01-13 Yale University Query execution systems and methods
US9336263B2 (en) 2010-06-04 2016-05-10 Yale University Data loading systems and methods
US8886631B2 (en) * 2010-06-04 2014-11-11 Yale University Query execution systems and methods
US20110314019A1 (en) 2010-06-18 2011-12-22 Universidad Politecnica De Madrid Parallel processing of continuous queries on data streams
US8713049B2 (en) 2010-09-17 2014-04-29 Oracle International Corporation Support for a parameterized query/view in complex event processing
US9189280B2 (en) 2010-11-18 2015-11-17 Oracle International Corporation Tracking large numbers of moving objects in an event processing system
US8990416B2 (en) 2011-05-06 2015-03-24 Oracle International Corporation Support for a new insert stream (ISTREAM) operation in complex event processing (CEP)
US9329975B2 (en) 2011-07-07 2016-05-03 Oracle International Corporation Continuous query language (CQL) debugger in complex event processing (CEP)
US9396157B2 (en) * 2011-08-26 2016-07-19 International Business Machines Corporation Stream application performance monitoring metrics
US8880493B2 (en) * 2011-09-28 2014-11-04 Hewlett-Packard Development Company, L.P. Multi-streams analytics
WO2013145310A1 (ja) * 2012-03-30 2013-10-03 富士通株式会社 データストリームの並列処理プログラム、方法、及びシステム
US8768929B2 (en) 2012-06-14 2014-07-01 International Business Machines Corporation Clustering streaming graphs
US9589036B2 (en) * 2012-08-01 2017-03-07 Oracle International Corporation Query-level access to external petabyte-scale distributed file systems
US8869122B2 (en) * 2012-08-30 2014-10-21 Sybase, Inc. Extensible executable modeling
US20140082013A1 (en) * 2012-09-20 2014-03-20 Sap Ag Query templates for queries in data stream management systems
US9563663B2 (en) 2012-09-28 2017-02-07 Oracle International Corporation Fast path evaluation of Boolean predicates
US9805095B2 (en) 2012-09-28 2017-10-31 Oracle International Corporation State initialization for continuous queries over archived views
US9158795B2 (en) * 2012-09-28 2015-10-13 International Business Machines Corporation Compile-time grouping of tuples in a streaming application
DE112012006928T5 (de) * 2012-10-18 2015-06-11 Hewlett-Packard Development Company, L.P. Kommunikation von Tupeln in einer Nachricht
US9497250B2 (en) 2012-10-29 2016-11-15 International Business Machines Corporation Runtime grouping of tuples in a streaming application
US10956422B2 (en) 2012-12-05 2021-03-23 Oracle International Corporation Integrating event processing with map-reduce
US9098587B2 (en) 2013-01-15 2015-08-04 Oracle International Corporation Variable duration non-event pattern matching
US10298444B2 (en) * 2013-01-15 2019-05-21 Oracle International Corporation Variable duration windows on continuous data streams
US9047249B2 (en) 2013-02-19 2015-06-02 Oracle International Corporation Handling faults in a continuous event processing (CEP) system
US9390135B2 (en) 2013-02-19 2016-07-12 Oracle International Corporation Executing continuous event processing (CEP) queries in parallel
US9992269B1 (en) * 2013-02-25 2018-06-05 EMC IP Holding Company LLC Distributed complex event processing
US9910896B2 (en) 2013-03-15 2018-03-06 Cisco Technology, Inc. Suspending and resuming continuous queries over data streams
US9690829B2 (en) * 2013-04-15 2017-06-27 Vmware, Inc. Dynamic load balancing during distributed query processing using query operator motion
US9418113B2 (en) 2013-05-30 2016-08-16 Oracle International Corporation Value based windows on relations in continuous data streams
EP3029581B1 (en) * 2013-07-30 2019-10-09 Fujitsu Limited Processing program, processing system, and processing method
EP3044678A1 (en) * 2013-09-13 2016-07-20 Hewlett Packard Enterprise Development LP Failure recovery of a task state in batch-based stream processing
US9515965B2 (en) * 2013-09-18 2016-12-06 International Business Machines Corporation Managing data paths in an operator graph
US9313134B2 (en) 2013-10-15 2016-04-12 Cisco Technology, Inc. Leveraging hardware accelerators for scalable distributed stream processing in a network environment
US9298485B2 (en) * 2013-11-19 2016-03-29 International Business Machines Corporation Maintaining virtual machines for cloud-based operators in a streaming application in a ready state
US9934279B2 (en) 2013-12-05 2018-04-03 Oracle International Corporation Pattern matching across multiple input data streams
US20160253219A1 (en) * 2013-12-13 2016-09-01 Hewlett Packard Enterprise Development Lp Data stream processing based on a boundary parameter
US9405854B2 (en) 2013-12-16 2016-08-02 Sybase, Inc. Event stream processing partitioning
US9558225B2 (en) 2013-12-16 2017-01-31 Sybase, Inc. Event stream processor
US9697262B2 (en) 2013-12-17 2017-07-04 Microsoft Technology Licensing, Llc Analytical data processing engine
US9313110B2 (en) 2014-01-22 2016-04-12 International Business Machines Corporation Managing processing branches in an operator graph
US9679012B1 (en) * 2014-02-28 2017-06-13 Pivotal Software, Inc. Parallel streaming of external data
US20150248462A1 (en) * 2014-02-28 2015-09-03 Alcatel Lucent Dynamically improving streaming query performance based on collected measurement data
US9684666B1 (en) * 2014-02-28 2017-06-20 Pivotal Software, Inc. Parallel streaming of external data
US9684671B1 (en) * 2014-02-28 2017-06-20 Pivotal Software, Inc. Parallel streaming of external data
US9705778B2 (en) * 2014-03-06 2017-07-11 International Business Machines Corporation Deploying operators of a streaming application based on physical location attributes of a virtual machine
US9244978B2 (en) 2014-06-11 2016-01-26 Oracle International Corporation Custom partitioning of a data stream
US9712645B2 (en) 2014-06-26 2017-07-18 Oracle International Corporation Embedded event processing
US9460235B2 (en) * 2014-06-30 2016-10-04 International Business Machines Corporation Supplementing a tuple with a derived value
US9641580B2 (en) 2014-07-01 2017-05-02 Microsoft Technology Licensing, Llc Distributed stream processing in the cloud
US9438676B2 (en) 2014-07-25 2016-09-06 Cisco Technology, Inc. Speculative data processing of streaming data
US9959301B2 (en) * 2014-07-25 2018-05-01 Cisco Technology, Inc. Distributing and processing streams over one or more networks for on-the-fly schema evolution
US10235436B2 (en) 2014-08-29 2019-03-19 Microsoft Technology Licensing, Llc Event stream transformations
US9886486B2 (en) 2014-09-24 2018-02-06 Oracle International Corporation Enriching events with dynamically typed big data for event processing
US10120907B2 (en) 2014-09-24 2018-11-06 Oracle International Corporation Scaling event processing using distributed flows and map-reduce operations
US20160188376A1 (en) * 2014-12-26 2016-06-30 Universidad De Santiago De Chile Push/Pull Parallelization for Elasticity and Load Balance in Distributed Stream Processing Engines
US10325212B1 (en) 2015-03-24 2019-06-18 InsideView Technologies, Inc. Predictive intelligent softbots on the cloud
US10083215B2 (en) * 2015-04-06 2018-09-25 International Business Machines Corporation Model-based design for transforming data
US9836495B2 (en) 2015-05-14 2017-12-05 Illumon Llc Computer assisted completion of hyperlink command segments
US9967160B2 (en) * 2015-05-21 2018-05-08 International Business Machines Corporation Rerouting data of a streaming application
US9652295B2 (en) * 2015-06-26 2017-05-16 International Business Machines Corporation Runtime fusion of operators based on processing element workload threshold and programming instruction compatibility
WO2017018901A1 (en) 2015-07-24 2017-02-02 Oracle International Corporation Visually exploring and analyzing event streams
EP3128423A1 (en) * 2015-08-06 2017-02-08 Hewlett-Packard Enterprise Development LP Distributed event processing
US20170063952A1 (en) * 2015-08-21 2017-03-02 International Business Machines Corporation Moving a portion of a streaming application to a public cloud based on sensitive data
US9699148B2 (en) * 2015-09-10 2017-07-04 International Business Machines Corporation Moving a portion of a streaming application to a public cloud based on sensitive data
US10614063B2 (en) * 2015-10-01 2020-04-07 Microsoft Technology Licensing, Llc. Streaming records from parallel batched database access
US10303695B2 (en) 2015-10-21 2019-05-28 Oracle International Corporation Query decomposition for scalability of continuous query processing
US9674230B1 (en) * 2016-02-23 2017-06-06 International Business Machines Corporation Export operator for a streaming application that exports from multiple operators on multiple parallel connections
US10599478B1 (en) 2016-03-29 2020-03-24 Amazon Technologies, Inc. Automated reconfiguration of real time data stream processing
US10896178B2 (en) 2016-03-30 2021-01-19 Microsoft Technology Licensing, Llc High performance query processing and data analytics
US10178161B2 (en) 2016-05-11 2019-01-08 Microsoft Technology Licensing, Llc Digital signal processing over data streams
CN107729135B (zh) * 2016-08-11 2021-03-16 创新先进技术有限公司 按序进行并行数据处理的方法和装置
US10713247B2 (en) * 2017-03-31 2020-07-14 Amazon Technologies, Inc. Executing queries for structured data and not-structured data
US10810210B2 (en) 2017-05-12 2020-10-20 Battelle Memorial Institute Performance and usability enhancements for continuous subgraph matching queries on graph-structured data
US10198469B1 (en) 2017-08-24 2019-02-05 Deephaven Data Labs Llc Computer data system data source refreshing using an update propagation graph having a merged join listener
US10902000B2 (en) 2017-09-29 2021-01-26 Oracle International Corporation Heartbeat propagation in a distributed stream processing system
US10938561B2 (en) * 2018-06-21 2021-03-02 International Business Machines Corporation Tuple level security for streams processing
US11146467B2 (en) 2018-08-30 2021-10-12 Streamworx.Ai Inc. Systems, methods and computer program products for scalable, low-latency processing of streaming data
CN112445834B (zh) * 2019-08-30 2025-02-21 阿里巴巴集团控股有限公司 分布式查询系统和查询方法、设备及存储介质
US11086879B2 (en) 2019-10-02 2021-08-10 Servicenow, Inc. Pipelineable and parallelizable streaming parsers for querying structured data-interchange information
CN111459962B (zh) * 2020-04-02 2023-11-21 中电工业互联网有限公司 一种基于生产流程的订单拆分合并处理方法及装置
US11640402B2 (en) 2020-07-22 2023-05-02 International Business Machines Corporation Load balancing in streams parallel regions
US11442943B1 (en) * 2020-08-31 2022-09-13 Amazon Technologies, Inc. Error-causing record isolation for data stream processing
US11550505B1 (en) 2020-09-01 2023-01-10 Amazon Technologies, Inc. Intra-shard parallelization of data stream processing using virtual shards
CN113434541B (zh) * 2021-06-23 2025-01-24 北京金山云网络技术有限公司 查询结果的发送方法、装置、存储介质和电子装置
US11593367B1 (en) 2021-09-29 2023-02-28 Amazon Technologies, Inc. Selecting between hydration-based scanning and stateless scale-out scanning to improve query performance
US12111829B2 (en) 2022-04-29 2024-10-08 Microsoft Technology Licensing, Llc. Instruction level parallelism in a declarative graph query language
US12099525B2 (en) * 2022-12-20 2024-09-24 Databricks, Inc. State rebalancing in structured streaming

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6339772B1 (en) * 1999-07-06 2002-01-15 Compaq Computer Corporation System and method for performing database operations on a continuous stream of tuples
US8126870B2 (en) * 2005-03-28 2012-02-28 Sybase, Inc. System and methodology for parallel query optimization using semantic-based partitioning
US7676461B2 (en) * 2007-07-18 2010-03-09 Microsoft Corporation Implementation of stream algebra over class instances
US8209664B2 (en) * 2009-03-18 2012-06-26 Microsoft Corporation High level programming extensions for distributed data parallel processing
US8479216B2 (en) * 2009-08-18 2013-07-02 International Business Machines Corporation Method for decentralized load distribution in an event-driven system using localized migration between physically connected nodes and load exchange protocol preventing simultaneous migration of plurality of tasks to or from a same node
US20110131198A1 (en) * 2009-11-30 2011-06-02 Theodore Johnson Method and apparatus for providing a filter join on data streams
US8290939B2 (en) * 2010-06-04 2012-10-16 International Busines Machines Corporation Visualizing query results in stream processing systems
US20110314019A1 (en) 2010-06-18 2011-12-22 Universidad Politecnica De Madrid Parallel processing of continuous queries on data streams
US8260803B2 (en) * 2010-09-23 2012-09-04 Hewlett-Packard Development Company, L.P. System and method for data stream processing
WO2012050582A1 (en) * 2010-10-14 2012-04-19 Hewlett-Packard Development Company, L.P. Continuous querying of a data stream

Also Published As

Publication number Publication date
ES2628455T3 (es) 2017-08-02
US20130204896A1 (en) 2013-08-08
US10095745B2 (en) 2018-10-09
US20130346446A9 (en) 2013-12-26
WO2011157442A1 (en) 2011-12-22
EP2583175A1 (en) 2013-04-24
EP2583175B1 (en) 2017-04-12
US20110314019A1 (en) 2011-12-22

Similar Documents

Publication Publication Date Title
ES2628455T8 (es) Procesamiento paralelo de consultas continuas sobre flujos de datos
HRP20181470T1 (hr) Uređaj za intrapredikciju
EP2610908A4 (en) Cooling device
EP2629637A4 (en) Shin guard sleeve
PL2614063T3 (pl) Podstawione imidazopirydazyny
EP2685494A4 (en) COOLER
DK2658573T3 (da) Ekspressionssystemer
DK2540234T3 (da) Patellaresektionsføring med lokaliseringskendetegn
BR112014011318A2 (pt) empresa de computação
DK2532215T3 (da) Blandet-vand-baseret datacenterkøling
EP2600014A4 (en) TERMINAL
DK2733304T3 (da) Indstrømningsanordning
IL232874A0 (en) Optical detector unit
IT1399763B1 (it) Dispositivo di allineamento bramme
ES1074161Y (es) Lavabo
BR112013009461A2 (pt) inibidores de polimerase vitais
SMT201400194B (it) Complesso di flurano
BR112014003677A2 (pt) dispositivo de resfriamento
FI20116202L (fi) Jäähdytyselementti
EP2600232A4 (en) INFORMATION PROCESSING DEVICE
DE112011100090A5 (de) Brillenbügel
FI9342U1 (fi) Jäähdytysjärjestelmä
ES1073816Y (es) Termometro
FI9248U1 (fi) Jäähdytin
FI20105326A0 (fi) Tievalaisimen jäähdytysjärjestely