EP3583777A4 - Verfahren und technische ausrüstung zur videoverarbeitung - Google Patents

Verfahren und technische ausrüstung zur videoverarbeitung Download PDF

Info

Publication number
EP3583777A4
EP3583777A4 EP18754044.8A EP18754044A EP3583777A4 EP 3583777 A4 EP3583777 A4 EP 3583777A4 EP 18754044 A EP18754044 A EP 18754044A EP 3583777 A4 EP3583777 A4 EP 3583777A4
Authority
EP
European Patent Office
Prior art keywords
procedures
video processing
technical equipment
equipment
technical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18754044.8A
Other languages
English (en)
French (fr)
Other versions
EP3583777A1 (de
Inventor
Francesco Cricri
Emre Baris Aksu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of EP3583777A1 publication Critical patent/EP3583777A1/de
Publication of EP3583777A4 publication Critical patent/EP3583777A4/de
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60General implementation details not specific to a particular type of compression
    • H03M7/6064Selection of Compressor
    • H03M7/6082Selection strategies
    • H03M7/6094Selection strategies according to reasons other than compression rate or data type
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • G06N3/0455Auto-encoder networks; Encoder-decoder networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0475Generative networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/0895Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/094Adversarial learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16Vocoder architecture
    • G10L19/18Vocoders using multiple modes
    • G10L19/22Mode decision, i.e. based on audio signal content versus external parameters
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03MCODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Molecular Biology (AREA)
  • Software Systems (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
EP18754044.8A 2017-02-16 2018-01-23 Verfahren und technische ausrüstung zur videoverarbeitung Pending EP3583777A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FI20175136 2017-02-16
PCT/FI2018/050049 WO2018150083A1 (en) 2017-02-16 2018-01-23 A method and technical equipment for video processing

Publications (2)

Publication Number Publication Date
EP3583777A1 EP3583777A1 (de) 2019-12-25
EP3583777A4 true EP3583777A4 (de) 2020-12-23

Family

ID=63169186

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18754044.8A Pending EP3583777A4 (de) 2017-02-16 2018-01-23 Verfahren und technische ausrüstung zur videoverarbeitung

Country Status (2)

Country Link
EP (1) EP3583777A4 (de)
WO (1) WO2018150083A1 (de)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11657264B2 (en) 2018-04-09 2023-05-23 Nokia Technologies Oy Content-specific neural network distribution
US11516521B2 (en) 2018-07-30 2022-11-29 Koninklijke Kpn N.V. Generating composite video stream for display in VR
CN111179212B (zh) * 2018-11-10 2023-05-23 杭州凝眸智能科技有限公司 集成蒸馏策略和反卷积的微小目标检测片上实现方法
US11924442B2 (en) 2018-11-20 2024-03-05 Koninklijke Kpn N.V. Generating and displaying a video stream by omitting or replacing an occluded part
US10904637B2 (en) * 2018-12-17 2021-01-26 Qualcomm Incorporated Embedded rendering engine for media data
US11831867B2 (en) 2019-02-15 2023-11-28 Nokia Technologies Oy Apparatus, a method and a computer program for video coding and decoding
WO2020187587A1 (en) * 2019-03-15 2020-09-24 Dolby International Ab Method and apparatus for updating a neural network
WO2020255367A1 (ja) * 2019-06-21 2020-12-24 日本電信電話株式会社 符号化装置、符号化方法及びプログラム
US11928587B2 (en) 2019-08-14 2024-03-12 Google Llc Base station-user equipment messaging regarding deep neural networks
KR20260038953A (ko) 2019-08-14 2026-03-19 구글 엘엘씨 신경망 형성 구성 통신
EP3808024B1 (de) 2019-09-04 2022-03-16 Google LLC Feedback zur konfiguration einer neuronalen netzformation für drahtlose kommunikation
CN114631336B (zh) 2019-10-31 2024-05-21 谷歌有限责任公司 确定用于网络切片的机器学习架构
US11886991B2 (en) 2019-11-27 2024-01-30 Google Llc Machine-learning architectures for broadcast and multicast communications
US11689940B2 (en) 2019-12-13 2023-06-27 Google Llc Machine-learning architectures for simultaneous connection to multiple carriers
KR102423977B1 (ko) * 2019-12-27 2022-07-22 삼성전자 주식회사 인공신경망 기반의 음성 신호 송수신 방법 및 장치
US12243281B2 (en) 2020-03-03 2025-03-04 Telefonaktiebolaget Lm Ericsson (Publ) System, an arrangement, a computer software module arrangement, a circuitry arrangement and a method for improved image processing utilizing two entities
US11663472B2 (en) 2020-06-29 2023-05-30 Google Llc Deep neural network processing for a user equipment-coordination set
US11622117B2 (en) * 2020-07-21 2023-04-04 Tencent America LLC Method and apparatus for rate-adaptive neural image compression with adversarial generators
EP3975452A1 (de) * 2020-09-24 2022-03-30 ATLAS ELEKTRONIK GmbH Wasserschallempfänger und system zur übertragung von bilddaten unter verwendung eines wasserschallsignals
US11445198B2 (en) * 2020-09-29 2022-09-13 Tencent America LLC Multi-quality video super resolution with micro-structured masks
CN112561799A (zh) * 2020-12-21 2021-03-26 江西师范大学 一种红外图像超分辨率重建方法
JP7685064B2 (ja) * 2021-09-22 2025-05-28 株式会社国際電気 通信機器及びデータ通信方法
WO2023056364A1 (en) * 2021-09-29 2023-04-06 Bytedance Inc. Method, device, and medium for video processing
CN114095033B (zh) * 2021-11-16 2024-05-14 上海交通大学 基于上下文的图卷积的目标交互关系语义无损压缩系统及方法
WO2023172593A1 (en) * 2022-03-08 2023-09-14 Op Solutions, Llc Systems and methods for coding and decoding image data using general adversarial models

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8019171B2 (en) * 2006-04-19 2011-09-13 Microsoft Corporation Vision-based compression
US8223837B2 (en) * 2007-09-07 2012-07-17 Microsoft Corporation Learning-based image compression
JP6067563B2 (ja) * 2010-09-10 2017-01-25 トムソン ライセンシングThomson Licensing ブロックに基づいたミクスドレゾリューションのデータプルーニングを使用した映像符号化

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
No further relevant documents disclosed *

Also Published As

Publication number Publication date
WO2018150083A1 (en) 2018-08-23
EP3583777A1 (de) 2019-12-25

Similar Documents

Publication Publication Date Title
EP3583777A4 (de) Verfahren und technische ausrüstung zur videoverarbeitung
EP3704634C0 (de) Systeme und verfahren zur bildverarbeitung
EP3635621A4 (de) System und verfahren zur bildanonymisierung
EP3638096A4 (de) Verfahren und systeme zur oct-geführten glaukomchirurgie
EP3777140A4 (de) Verfahren und vorrichtung zur videocodierung
EP3720392C0 (de) Systeme und verfahren zur multiplanaren orthopädischen ausrichtung
EP3791494A4 (de) Verfahren und vorrichtung zur videocodierung
EP3881533A4 (de) Verfahren und vorrichtung zur videocodierung
EP3443685C0 (de) System und verfahren zur strahlverwaltung
EP4242828C0 (de) Audiovorrichtung und verfahren zur audioverarbeitung
EP3906692A4 (de) Verfahren und vorrichtung zur videocodierung
EP3662584A4 (de) Verfahren und vorrichtungen zur referenzsignalkonfiguration
EP4254988C0 (de) Vorrichtung und verfahren für bildschirmbezogene audioobjekt-neuabbildung
EP3640333A4 (de) System und verfahren zur geneditierung
EP3466077A4 (de) Verfahren und vorrichtung zur bildkomprimierung
EP3803782A4 (de) Systeme und verfahren zur bildverarbeitung
EP3791590C0 (de) Verfahren und vorrichtung zur videokodierung
EP3482569A4 (de) Verfahren und systeme zur videoüberwachung
EP3733842A4 (de) System und verfahren zur genomeditierung
EP3625761A4 (de) Systeme und verfahren zur bildverarbeitung
EP3422939A4 (de) Verfahren und system zur bildgebung
DE112018000912A5 (de) Verfahren und Vorrichtung zur Beatmung
EP3657729A4 (de) Verfahren zur informationsüberprüfung und entsprechende ausrüstung
EP3831069A4 (de) Verfahren und vorrichtung zur videokodierung
EP3692496A4 (de) Systeme und verfahren zur bildverarbeitung

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190916

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04N0019170000

Ipc: H04N0019850000

A4 Supplementary search report drawn up and despatched

Effective date: 20201119

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/132 20140101ALI20201113BHEP

Ipc: G06N 3/08 20060101ALI20201113BHEP

Ipc: H04N 19/46 20140101ALI20201113BHEP

Ipc: H04N 19/17 20140101ALI20201113BHEP

Ipc: H03M 7/30 20060101ALI20201113BHEP

Ipc: G06T 7/10 20170101ALI20201113BHEP

Ipc: H04N 19/593 20140101ALI20201113BHEP

Ipc: G06T 5/00 20060101ALI20201113BHEP

Ipc: G10L 19/04 20130101ALI20201113BHEP

Ipc: G06T 9/00 20060101ALI20201113BHEP

Ipc: G06N 3/04 20060101ALI20201113BHEP

Ipc: H04N 19/85 20140101AFI20201113BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230217