EP3777195A4 - An apparatus, a method and a computer program for running a neural network - Google Patents

An apparatus, a method and a computer program for running a neural network Download PDF

Info

Publication number
EP3777195A4
EP3777195A4 EP19784529.0A EP19784529A EP3777195A4 EP 3777195 A4 EP3777195 A4 EP 3777195A4 EP 19784529 A EP19784529 A EP 19784529A EP 3777195 A4 EP3777195 A4 EP 3777195A4
Authority
EP
European Patent Office
Prior art keywords
running
computer program
neural network
neural
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19784529.0A
Other languages
German (de)
French (fr)
Other versions
EP3777195A1 (en
Inventor
Francesco Cricri
Miska Hannuksela
Jani Lainema
Caglar AYTEKIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of EP3777195A1 publication Critical patent/EP3777195A1/en
Publication of EP3777195A4 publication Critical patent/EP3777195A4/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637—Control signals issued by the client directed to the server or network components
    • H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Databases & Information Systems (AREA)
  • Neurology (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
EP19784529.0A 2018-04-09 2019-04-03 An apparatus, a method and a computer program for running a neural network Pending EP3777195A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FI20185334 2018-04-09
PCT/FI2019/050269 WO2019197715A1 (en) 2018-04-09 2019-04-03 An apparatus, a method and a computer program for running a neural network

Publications (2)

Publication Number Publication Date
EP3777195A1 EP3777195A1 (en) 2021-02-17
EP3777195A4 true EP3777195A4 (en) 2022-05-11

Family

ID=68162831

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19784529.0A Pending EP3777195A4 (en) 2018-04-09 2019-04-03 An apparatus, a method and a computer program for running a neural network

Country Status (2)

Country Link
EP (1) EP3777195A4 (en)
WO (1) WO2019197715A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112839345B (en) * 2019-11-25 2022-06-14 华为技术有限公司 Network parameter configuration method and device
CN112929703A (en) * 2019-12-06 2021-06-08 上海海思技术有限公司 Method and device for processing code stream data
CN113132765A (en) * 2020-01-16 2021-07-16 北京达佳互联信息技术有限公司 Code rate decision model training method and device, electronic equipment and storage medium
US11949858B2 (en) * 2020-06-08 2024-04-02 Qualcomm Incorporated Video throughput improvement using long term referencing, deep learning, and load balancing
CN114339262B (en) * 2020-09-30 2023-02-14 华为技术有限公司 Entropy encoding/decoding method and device
KR102899905B1 (en) * 2020-10-07 2025-12-18 삼성전자주식회사 Training method for inference using artificial neural network, inference method using artificial neural network, and inference apparatus thereof
DE102021204289A1 (en) 2021-04-29 2022-11-03 Robert Bosch Gesellschaft mit beschränkter Haftung Volume-saving transmission and storage of sensor data
US12395606B2 (en) * 2021-07-15 2025-08-19 Lg Electronics Inc. A/V reception apparatus and wireless display system
EP4181511A3 (en) * 2021-11-15 2023-07-26 Nokia Technologies Oy Decoder-side fine-tuning of neural networks for video coding for machines
US12321870B2 (en) * 2021-12-01 2025-06-03 Nokia Technologies Oy Apparatus method and computer program product for probability model overfitting
CN116264606B (en) * 2021-12-14 2026-02-24 戴尔产品有限公司 Method, apparatus and computer program product for processing video
CN117440185A (en) * 2022-07-14 2024-01-23 杭州海康威视数字技术股份有限公司 An image decoding and encoding method, device and equipment based on neural network
CN115689819B (en) * 2022-09-23 2023-06-30 河北东来工程技术服务有限公司 Ship emergency training method, system, device and readable storage medium
CN115633189B (en) * 2022-10-10 2026-03-03 南开大学 On-line teaching text video superdivision method based on SVC and edge calculation
EP4387227A1 (en) * 2022-12-16 2024-06-19 Koninklijke Philips N.V. Encoding and decoding video signals
CN116129308A (en) * 2022-12-30 2023-05-16 中国电信股份有限公司 A video quality enhancement method, device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017158363A1 (en) * 2016-03-18 2017-09-21 Magic Pony Technology Limited Generative methods of super resolution
US20170347110A1 (en) * 2015-02-19 2017-11-30 Magic Pony Technology Limited Online Training of Hierarchical Algorithms
EP3298783A1 (en) * 2016-04-15 2018-03-28 Magic Pony Technology Limited Motion compensation using temporal picture interpolation

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7457359B2 (en) * 2001-09-26 2008-11-25 Mabey Danny L Systems, devices and methods for securely distributing highly-compressed multimedia content
CN105100823B (en) * 2015-09-01 2019-03-12 京东方科技集团股份有限公司 A kind of processing method, device, encoder and decoder for adaptive media service
WO2017178827A1 (en) * 2016-04-15 2017-10-19 Magic Pony Technology Limited In-loop post filtering for video encoding and decoding

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170347110A1 (en) * 2015-02-19 2017-11-30 Magic Pony Technology Limited Online Training of Hierarchical Algorithms
WO2017158363A1 (en) * 2016-03-18 2017-09-21 Magic Pony Technology Limited Generative methods of super resolution
EP3298783A1 (en) * 2016-04-15 2018-03-28 Magic Pony Technology Limited Motion compensation using temporal picture interpolation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Advances in Databases and Information Systems", vol. 8692, 1 January 2014, SPRINGER INTERNATIONAL PUBLISHING, Cham, ISBN: 978-3-319-10403-4, article CHAO DONG ET AL: "Learning a Deep Convolutional Network for Image Super-Resolution", pages: 184 - 199, XP055545078, 032682, DOI: 10.1007/978-3-319-10593-2_13 *
LIXIN FAN ET AL: "Modification and extension to use cases & features for Neural Network Representations", 122. MPEG MEETING; 16-4-2018 - 20-4-2018; SAN DIEGO; (MOTION PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. m42563, 11 April 2018 (2018-04-11), XP030070902 *
See also references of WO2019197715A1 *

Also Published As

Publication number Publication date
EP3777195A1 (en) 2021-02-17
WO2019197715A1 (en) 2019-10-17

Similar Documents

Publication Publication Date Title
EP3777185A4 (en) An apparatus, a method and a computer program for volumetric video
SG11202103094WA (en) Apparatus, method and computer program for connection management
EP3977364A4 (en) Method and processing device for training a neural network
EP3759925A4 (en) An apparatus, a method and a computer program for volumetric video
EP4014474A4 (en) Apparatus, method, and computer program
EP3769270A4 (en) A method, an apparatus and a computer program product for an interpretable neural network representation
EP3646593A4 (en) An apparatus, a method and a computer program for omnidirectional video
EP3649776A4 (en) An apparatus, a method and a computer program for omnidirectional video
EP3912106A4 (en) Apparatus and a method for neural network compression
EP3818502A4 (en) A method, an apparatus and a computer program product for image compression
EP4042775A4 (en) Apparatus, method, and computer program
GB201900884D0 (en) Apparatus, method and computer program
GB201914309D0 (en) Apparatus, method and computer program
EP3804334A4 (en) An apparatus, a method and a computer program for volumetric video
SG11202101842RA (en) An apparatus, computer program and method
EP3597567A4 (en) Accumulation management apparatus, accumulation management method, and program
SG11202009997QA (en) Method, system, and computer program product for authenticating a device
EP4278696A4 (en) Method, apparatus and computer program
GB201818313D0 (en) A method, apparatus and computer program for image processing
GB201916259D0 (en) Apparatus, method and computer program
GB201916012D0 (en) Apparatus, method, and computer program
SG11202101848WA (en) An apparatus, computer program and method
EP3950537A4 (en) Maintenance method, maintenance server, and program
EP3857948A4 (en) Method, apparatus and computer program product
EP3698332A4 (en) An apparatus, a method and a computer program for volumetric video

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201109

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220413

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/234 20110101ALI20220407BHEP

Ipc: H04N 19/82 20140101ALI20220407BHEP

Ipc: H04N 19/154 20140101ALI20220407BHEP

Ipc: H04N 19/117 20140101ALI20220407BHEP

Ipc: G06N 3/08 20060101ALI20220407BHEP

Ipc: G06N 3/063 20060101ALI20220407BHEP

Ipc: G06N 3/04 20060101ALI20220407BHEP

Ipc: G06T 5/00 20060101ALI20220407BHEP

Ipc: G06T 3/40 20060101ALI20220407BHEP

Ipc: H04N 21/6377 20110101ALI20220407BHEP

Ipc: H04N 21/2662 20110101ALI20220407BHEP

Ipc: H04N 21/2343 20110101ALI20220407BHEP

Ipc: H04N 19/187 20140101ALI20220407BHEP

Ipc: H04N 19/164 20140101ALI20220407BHEP

Ipc: H04N 19/85 20140101AFI20220407BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240701