PH12023550209A1 - Activation function design in neural network-based filtering process for video coding - Google Patents

Activation function design in neural network-based filtering process for video coding

Info

Publication number
PH12023550209A1
PH12023550209A1 PH1/2023/550209A PH12023550209A PH12023550209A1 PH 12023550209 A1 PH12023550209 A1 PH 12023550209A1 PH 12023550209 A PH12023550209 A PH 12023550209A PH 12023550209 A1 PH12023550209 A1 PH 12023550209A1
Authority
PH
Philippines
Prior art keywords
neural network
activation function
video coding
filtering process
based filtering
Prior art date
Application number
PH1/2023/550209A
Other languages
English (en)
Inventor
Jianle Chen
Marta Karczewicz
Hongtao Wang
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of PH12023550209A1 publication Critical patent/PH12023550209A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/002—Image coding using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Picture Signal Circuits (AREA)
PH1/2023/550209A 2020-09-30 2021-09-30 Activation function design in neural network-based filtering process for video coding PH12023550209A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063085936P 2020-09-30 2020-09-30
US17/489,459 US11647212B2 (en) 2020-09-30 2021-09-29 Activation function design in neural network-based filtering process for video coding
PCT/US2021/052950 WO2022072684A1 (en) 2020-09-30 2021-09-30 Activation function design in neural network-based filtering process for video coding

Publications (1)

Publication Number Publication Date
PH12023550209A1 true PH12023550209A1 (en) 2024-06-24

Family

ID=80821961

Family Applications (1)

Application Number Title Priority Date Filing Date
PH1/2023/550209A PH12023550209A1 (en) 2020-09-30 2021-09-30 Activation function design in neural network-based filtering process for video coding

Country Status (7)

Country Link
US (2) US11647212B2 (2)
EP (1) EP4222954A1 (2)
JP (1) JP7787883B2 (2)
KR (1) KR20230078658A (2)
CN (1) CN116325729B (2)
PH (1) PH12023550209A1 (2)
WO (1) WO2022072684A1 (2)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11647212B2 (en) 2020-09-30 2023-05-09 Qualcomm Incorporated Activation function design in neural network-based filtering process for video coding
US20220321919A1 (en) * 2021-03-23 2022-10-06 Sharp Kabushiki Kaisha Systems and methods for signaling neural network-based in-loop filter parameter information in video coding
US12167047B2 (en) * 2022-01-13 2024-12-10 Tencent America LLC Neural network-based deblocking filters
US12556718B2 (en) * 2022-12-29 2026-02-17 Samsung Electronics Co., Ltd. Electronic device and method with image encoding and decoding
CN116805971B (zh) * 2023-04-11 2024-07-12 腾讯科技（深圳）有限公司 图像编解码方法、装置、设备
US12542932B2 (en) * 2023-04-12 2026-02-03 Qualcomm Incorporated Neural network-based in loop filter architectures with separable convolution and multi-scale enhancement for video coding
CN119211544A (zh) * 2023-06-26 2024-12-27 腾讯科技（深圳）有限公司 基于神经网络的图像滤波及编解码方法、装置、设备、存储介质
WO2025009938A1 (ko) * 2023-07-05 2025-01-09 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 저장한 기록 매체 및 비트스트림을 전송하는 방법
WO2025217290A1 (en) * 2024-04-10 2025-10-16 Qualcomm Incorporated Improvements of resnet based in-loop filter architecture for video coding

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11113800B2 (en) * 2017-01-18 2021-09-07 Nvidia Corporation Filtering image data using a neural network
EP3451293A1 (en) * 2017-08-28 2019-03-06 Thomson Licensing Method and apparatus for filtering with multi-branch deep learning
US10284432B1 (en) * 2018-07-03 2019-05-07 Kabushiki Kaisha Ubitus Method for enhancing quality of media transmitted via network
US11025907B2 (en) * 2019-02-28 2021-06-01 Google Llc Receptive-field-conforming convolution models for video coding
US10999606B2 (en) * 2019-01-08 2021-05-04 Intel Corporation Method and system of neural network loop filtering for video coding
US12282840B2 (en) 2019-01-11 2025-04-22 Samsung Electronics Co., Ltd. Method and apparatus with neural network layer contraction
WO2020150264A1 (en) 2019-01-15 2020-07-23 Portland State University Feature pyramid warping for video frame interpolation
EP3706046A1 (en) 2019-03-04 2020-09-09 InterDigital VC Holdings, Inc. Method and device for picture encoding and decoding
WO2020187587A1 (en) * 2019-03-15 2020-09-24 Dolby International Ab Method and apparatus for updating a neural network
GB2617783B (en) 2019-03-20 2024-02-07 V Nova Int Ltd Temporal signalling for video coding technology
KR20200114436A (ko) 2019-03-28 2020-10-07 국방과학연구소 스케일러블 영상 부호화를 수행하는 장치 및 방법
US10909728B1 (en) * 2019-05-01 2021-02-02 Amazon Technologies, Inc. Learned lossy image compression codec
US11216917B2 (en) 2019-05-03 2022-01-04 Amazon Technologies, Inc. Video enhancement using a neural network
US10944996B2 (en) 2019-08-19 2021-03-09 Intel Corporation Visual quality optimized video compression
US11647212B2 (en) 2020-09-30 2023-05-09 Qualcomm Incorporated Activation function design in neural network-based filtering process for video coding

Also Published As

Publication number Publication date
US11778213B2 (en) 2023-10-03
US20230012661A1 (en) 2023-01-19
JP7787883B2 (ja) 2025-12-17
CN116325729A (zh) 2023-06-23
US20220103845A1 (en) 2022-03-31
KR20230078658A (ko) 2023-06-02
CN116325729B (zh) 2026-03-27
JP2023543762A (ja) 2023-10-18
WO2022072684A1 (en) 2022-04-07
US11647212B2 (en) 2023-05-09
EP4222954A1 (en) 2023-08-09

Similar Documents

Publication Publication Date Title
PH12023550209A1 (en) Activation function design in neural network-based filtering process for video coding
MY210145A (en) Method and apparatus for point cloud coding
EP4425918A3 (en) Method and apparatus for filtering with mode-aware deep learning
EP4373014A3 (en) Method and apparatus for random access procedure
WO2018002425A3 (en) An apparatus, a method and a computer program for video coding and decoding
MY187124A (en) Non-uniform parameter quantization for advanced coupling
MY173644A (en) Audio encoder and decoder
GB2446556A (en) Method and apparatus for encoding/decoding graphic data
MX347233B (es) Aparato y método para desvanecimiento mejorado de señal para sistemas de codificación de audio conmutados durante el ocultamiento de errores.
NZ710308A (en) Method and apparatus for controlling audio frame loss concealment
WO2019157074A3 (en) Devices, systems and methods for printing three-dimensional objects
WO2016140765A3 (en) Packet format and coding method for serial data transmission
MX389047B (es) Dispositivo de procesamiento de datos y metodo de procesamiento de datos.
MX2016010443A (es) Dispositivo de procesamiento de datos y metodo de procesamiento de datos.
ZA202103738B (en) Apparatus, method and computer program for encoding, decoding, scene processing and other procedures related to dirac based spatial audio coding using low-order, mid-order and high-order components generators
MX2020009112A (es) Proceso para reducir la endotoxina en gelatina.
MY181845A (en) Apparatus and method for improved concealment of the adaptive codebook in acelp-like concealment employing improved pulse resynchronization
MY190412A (en) Adaptive sharpening filter for predictive coding
WO2023129986A3 (en) Dynamic mesh coding with simplified topology
MX2024006723A (es) Metodo y aparato de codificacion y descodificacion de imagenes.
MX2025000587A (es) Metodo y aparato de codificacion de video que utilizan conjunto de parametros adaptativos
CN104519364A (zh) 一种视频编码方法及装置
MX2016015526A (es) Metodo, dispositivo y sistema codec.
MY206211A (en) Temporal noise shaping
EP4383715A3 (en) Restoration in video coding using filtering and sub space projection