WO2016006746A1 - Dispositif de traitement d'image de super-résolution - Google Patents

Dispositif de traitement d'image de super-résolution Download PDF

Info

Publication number
WO2016006746A1
WO2016006746A1 PCT/KR2014/006285 KR2014006285W WO2016006746A1 WO 2016006746 A1 WO2016006746 A1 WO 2016006746A1 KR 2014006285 W KR2014006285 W KR 2014006285W WO 2016006746 A1 WO2016006746 A1 WO 2016006746A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
core
stream
output
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2014/006285
Other languages
English (en)
Korean (ko)
Inventor
이상설
장성준
현상진
김제우
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Korea Electronics Technology Institute
Original Assignee
Korea Electronics Technology Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Korea Electronics Technology Institute filed Critical Korea Electronics Technology Institute
Publication of WO2016006746A1 publication Critical patent/WO2016006746A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/015—High-definition television systems

Definitions

  • the present invention relates to an apparatus for processing an ultra high resolution image, and more particularly, an ultra high resolution image processing capable of processing, compressing, and restoring multi-core based data for encoding and decoding an input ultra high resolution image in real time. It relates to a device for.
  • HD High Definition
  • the digital cinema has a 4K (4,096 ⁇ 2,096) resolution
  • the ultra-high definition TV has an 8K (7,680 ⁇ 4,320) resolution.
  • Viewers who watch these 8K-class ultra-high resolution videos can view the images more realistically and realistically, so that both video producers and consumers can have a positive effect.
  • the frame buffer needed to process the image input from the frame buffer must be continuously buffered until one image is processed. That is, the structure of the frame buffer currently used mainly requires that the image is stored in the buffer for a time until the completion of one frame compression and reconstruction to process the image of the input frame.
  • the frame buffer size increases and the image processing time is delayed, thereby causing a high occupancy time of the image stored in the frame buffer.
  • an object of the present invention in view of the above-described point is to provide an apparatus for processing ultra-high resolution images for compressing and reconstructing an ultra-high resolution image in real time.
  • another object of the present invention is to provide an apparatus for processing ultra-high resolution image to be compressed and reconstructed in real time through a multi-core based structure when processing the ultra-high resolution image.
  • An apparatus for image processing according to a preferred embodiment of the present invention for achieving the above object is a stream for dividing the source image into at least two cores, and generates and outputs a stream for each divided core image Generation unit;
  • An encoder having at least two multi-core processing units for compressing at least two divided image cores, and receiving and compressing a core image stream output through the stream generating unit from each of the multi-core processing units;
  • a first-in first-out (FIFO) unit for receiving a compressed core image output through the encoder and performing first-in first-out on the compressed core image.
  • the encoder comprises: at least one buffer for temporarily storing a core stream for the divided core image; At least one predictor for motion compensation in a corresponding partition; And at least one image compressor which performs compression on each core image whose motion is compensated through the predictor.
  • the stream generation unit is provided in front of an input / output terminal of an image and generates a stream according to the ITU-R standard according to an interface representing a cable and a terminal for transmitting an image. Characterized in that provided with.
  • the stream generation unit divides the HD image into 16 core images, and generates and outputs 16 divided core image streams. It is done.
  • an apparatus for image processing comprising: a buffer configured to store at least two inputted and compressed core images; A distributor for distributing and outputting the core image compressed in two or more parts stored in the buffer; A decoder for decoding each compressed core image output through the distributor and outputting the compressed core image in the form of an output stream; When the output stream output through the decoder is input, it characterized in that it comprises a stream generating unit for sequentially outputting the output stream for each core image to be a video image.
  • the decoder comprises: at least one reconstruction unit for decoding the compressed core image input through the distributor; And at least one output stream generator for outputting the decoded core image output through the at least one reconstruction unit as an output stream.
  • compression and reconstruction may be performed on a multi-core basis instead of a single core.
  • the usage of the frame buffer can be reduced.
  • the raw image to be compressed may be buffered in a small frame buffer size in comparison with a single core to perform real-time processing.
  • FIG. 1 is a block diagram illustrating an apparatus for ultra-high resolution image processing according to an embodiment of the present invention
  • FIG. 2 is a block diagram illustrating a detailed internal configuration of an encoder in an apparatus for processing ultra high resolution images according to an embodiment of the present invention
  • FIG. 3 is a block diagram for explaining a detailed internal configuration of a decoder in an apparatus for ultra-high resolution image processing according to an embodiment of the present invention.
  • FIG. 4 is an exemplary diagram illustrating a source image divided into a multi-core form in order to explain an embodiment of the present invention.
  • multi-core format real-time compression and reconstruction for compressing an image of 60 frames or more in real time during compression of input image data is performed.
  • FIG. 1 is a block diagram illustrating an apparatus for processing ultra high resolution images according to an exemplary embodiment of the present invention.
  • an apparatus 100 for image processing includes an encoder 200 and a decoder 300.
  • the encoder 200 performs compression on the input source image and outputs the compressed image.
  • the encoding unit 200 according to the present invention divides the input source image into at least two cores, compresses each of the divided cores through an SDI interface having a parallel processing structure, and outputs the same.
  • the SDI interface serves as a multi-core processor for processing a multi-core image.
  • the encoder 200 is configured to include a stream generator 210, an encoder 220, and a FIFO unit 230.
  • the stream generator 210 splits the source image into at least two cores.
  • an original image having an ultra high resolution is divided into at least two core images. This image segmentation will be described with reference to FIG. 4.
  • an original image may be divided into four UHD (3840x2160), which may be divided into 16 HD-class images (1920x1080).
  • the size of the 8K image or more size may be applied to the structure that is divided into more cores. That is, the core image divided into four is Qa, Qb, Qc, and Qd, and the core image divided into sixteen is divided into core 0 (core0), core1 (core1), which are divided from each of Qa, Qb, Qc, and Qd. It will be core2 and core3.
  • the stream generator 210 generates and outputs a stream for each core image divided with respect to the original image as described above.
  • the stream generator 210 is provided in front of an input / output terminal of an image, and may be provided according to the ITU-R standard according to a type of an interface representing a cable and a terminal for transmitting an image.
  • ITU-R International Telecommunication Union
  • BT.1120 a standard for SDI input, is used to handle this. If the interface is changed due to HDMI input, the BT is placed in front of the input / output terminal of the video. .1120 Apply stream generator (ITU-R standard) to input or output.
  • the encoder 220 includes at least two or more multicore processors for compressing at least two image cores divided into at least two cores, and receives a core image stream output through the stream generator 210 into each of the multicore processors. Output after compressing.
  • multicore processors for compressing at least two image cores divided into at least two cores, and receives a core image stream output through the stream generator 210 into each of the multicore processors. Output after compressing.
  • FIG. 2 is a block diagram illustrating a detailed internal configuration of an encoder in an apparatus for processing ultra high resolution images according to an embodiment of the present invention.
  • the encoder 220 includes a buffer memory 20, 21, 22,..., 23, a prediction unit 30, 31, 32,..., 33, and an image compressor. Processors 40, 41, 42, ..., 43 are included.
  • the buffer 20, the predictor 30, and the image compressor 40 have one single core structure, and the single core structure is formed in parallel with the number of cores obtained by dividing the original image, as shown in FIG. Will be
  • the buffers 20, 21, 22, ..., 23 temporarily store core streams for the divided core images.
  • Prediction units 30, 31, 32,..., 33 perform motion compensation on the split core image.
  • An image encoding unit 40, 41, 42, ..., 43 performs compression on each core image that is motion-compensated through the prediction units 30, 31, 32, ..., 33. .
  • the first-in first-out (FIFO) unit 230 receives the compressed core image output through the encoder 220 and processes the first-in first-out on the compressed core image.
  • the decoding unit 300 decodes the input compressed image.
  • the decoding unit 300 includes a buffer BUF 310, a memory controller 320, a decoder 330, and a stream generator 340.
  • the buffer memory 310 stores a core image which is divided and compressed into at least two input signals.
  • the memory controller 320 distributes and outputs the core image compressed into two or more parts stored in the buffer 310.
  • the decoder 330 decodes each compressed core image output through the distributor 320 and outputs the compressed core image in the form of an output stream.
  • a detailed internal configuration of the decoder 330 according to the present invention will be described in detail with reference to FIG. 3.
  • FIG. 3 is a block diagram illustrating a detailed internal configuration of a decoder in an apparatus for processing ultra high resolution images according to an embodiment of the present invention.
  • the decoder 330 may decode the decoding processors 50, 51, 52,..., 53 and the output stream generators 60, 61, 62,. It is configured to include.
  • the decoding processors 50, 51, 52,..., 53 decode the compressed core image input through the distributor 320.
  • the output stream generator 60, 61, 62,..., 63 outputs the decoded core image output through the at least one restoration unit 50, 51, 52,..., 53 as an output stream.
  • the stream generator 340 sequentially outputs an output stream for each core image to be one video image.
  • the structure for processing a single core includes an encoder 220 and a FIFO unit 230 including a stream generator 210, a buffer 20, a predictor 30, and an image compressor 40.
  • Decoder including an encoder 200, a buffer 310, a divider 320, a restorer 50, a decoder 330 composed of an output stream generator 60 and a stream generator 340 including a; 330 can be viewed and processed as one set, and a structure capable of storing or acquiring the processed data to the FIFO unit 230 when each core is required by providing the FIFO unit 230. to be.
  • the single core structure configured as described above processes data based on HD-class video in the SDI interface, which is a current input / output type, and when processing 8K video with a single core in an apparatus for processing ultra-high resolution images according to the present invention.
  • a separate process is required to combine the images from each of the 16 SDI interfaces.
  • the multi-core processing unit is configured in parallel in each encoder 220, and the reconstruction unit and the output stream generator are configured in parallel in order to process each divided compressed core image in the decoder 330.
  • the compression rate may be improved.
  • the encoding unit 220 has a configuration of a compression codec that supports a variable parallel processing structure.
  • the UHD (4K) system can be applied to a movie theater that outputs images horizontally in the case of placing eight images horizontally.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un dispositif de traitement d'image de super-résolution. La présente invention consiste à pourvoir à un dispositif de traitement d'image, qui comprend : une unité de génération de flux destinée à diviser une image source en au moins deux noyaux et à générer et à délivrer un flux pour chacune des images de noyau divisées ; un codeur pourvu d'au moins deux unités de traitement de multi-noyaux traitant par compression les au moins deux noyaux d'image divisée et recevant, en provenance de chacune des unités de traitement de multi-noyaux, un flux d'image de noyau délivré par l'intermédiaire de l'unité de génération de flux pour délivrer le flux d'image de noyau après sa compression ; et une unité de premier entré, premier sorti (FIFO) destinée à recevoir les images de noyau compressées délivrées par le codeur et le traitement FIFO des images de noyau compressées.
PCT/KR2014/006285 2014-07-11 2014-07-11 Dispositif de traitement d'image de super-résolution Ceased WO2016006746A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2014-0087333 2014-07-11
KR1020140087333A KR20160008011A (ko) 2014-07-11 2014-07-11 초고해상도 영상 처리를 위한 장치

Publications (1)

Publication Number Publication Date
WO2016006746A1 true WO2016006746A1 (fr) 2016-01-14

Family

ID=55064367

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/006285 Ceased WO2016006746A1 (fr) 2014-07-11 2014-07-11 Dispositif de traitement d'image de super-résolution

Country Status (2)

Country Link
KR (1) KR20160008011A (fr)
WO (1) WO2016006746A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110754093A (zh) * 2018-05-21 2020-02-04 Gdf实验室株式会社 基于人工智能影像学习平台的视频点播服务系统

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180085917A (ko) * 2017-01-20 2018-07-30 전자부품연구원 초고해상도 영상 및 자막의 실시간 합성을 위한 시스템 및 방법
KR20220078258A (ko) * 2020-12-03 2022-06-10 주식회사 선테크 초고해상도 스트리밍 영상 처리 시스템 및 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120019751A (ko) * 2010-08-26 2012-03-07 에이스텔 주식회사 초고화질 영상을 위한 실시간 3ｄ 포맷팅 모듈 및 이를 이용한 실시간 3ｄ 포맷팅 시스템
KR20130043054A (ko) * 2011-10-19 2013-04-29 한국전자통신연구원 영상 분할을 이용한 영상 처리 방법 및 장치
US20130132510A1 (en) * 2011-11-23 2013-05-23 Bluespace Corporation Video processing device, video server, client device, and video client-server system with low latency thereof
KR101347956B1 (ko) * 2013-07-29 2014-01-10 주식회사 리버스톤미디어 초고화질 영상의 병렬처리에 의한 스트림 변환 및 복원 시스템 그리고 이를 이용한 초고화질 영상의 스트림 변환 및 복원 방법
US20140168512A1 (en) * 2011-07-26 2014-06-19 Lg Electronics Inc. Apparatus for transmitting video stream, apparatus for receiving video stream, method for transmitting video stream, and method for receiving video stream

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120019751A (ko) * 2010-08-26 2012-03-07 에이스텔 주식회사 초고화질 영상을 위한 실시간 3ｄ 포맷팅 모듈 및 이를 이용한 실시간 3ｄ 포맷팅 시스템
US20140168512A1 (en) * 2011-07-26 2014-06-19 Lg Electronics Inc. Apparatus for transmitting video stream, apparatus for receiving video stream, method for transmitting video stream, and method for receiving video stream
KR20130043054A (ko) * 2011-10-19 2013-04-29 한국전자통신연구원 영상 분할을 이용한 영상 처리 방법 및 장치
US20130132510A1 (en) * 2011-11-23 2013-05-23 Bluespace Corporation Video processing device, video server, client device, and video client-server system with low latency thereof
KR101347956B1 (ko) * 2013-07-29 2014-01-10 주식회사 리버스톤미디어 초고화질 영상의 병렬처리에 의한 스트림 변환 및 복원 시스템 그리고 이를 이용한 초고화질 영상의 스트림 변환 및 복원 방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110754093A (zh) * 2018-05-21 2020-02-04 Gdf实验室株式会社 基于人工智能影像学习平台的视频点播服务系统

Also Published As

Publication number Publication date
KR20160008011A (ko) 2016-01-21

Similar Documents

Publication Publication Date Title
US10080019B2 (en) Parallel encoding for wireless displays
WO2020189817A1 (fr) Procédé et système de décodage distribué d'image divisée pour diffusion en continu à base de tuiles
CN106992959A (zh) 一种3d全景音视频直播系统及音视频采集方法
US8111932B2 (en) Digital image decoder with integrated concurrent image prescaler
US9601156B2 (en) Input/output system for editing and playing ultra-high definition image
US20210392352A1 (en) Method and system of multi-layer video coding
CN102780881A (zh) 编解码器、编解码系统及方法、传送适配器和成像装置
US12113994B2 (en) Video decoder chipset
US20180376181A1 (en) Networked video communication applicable to gigabit ethernet
CN109891887B (zh) 解耦视频系数的规范和实现数据路径交织的转换缓冲器
WO2016006746A1 (fr) Dispositif de traitement d'image de super-résolution
EP3931793B1 (fr) Approche de filtrage à mémoire efficace pour codage d'image et de vidéo
US10484714B2 (en) Codec for multi-camera compression
KR100970992B1 (ko) 그래픽스 가속을 통한 고화질 영상의 스테레오스코픽 다중화 및 저비율 압축 전송 장치 및 그 방법과 그 프로그램 소스를 저장한 기록매체
US11930290B2 (en) Panoramic picture in picture video
Kim et al. A real-time MPEG encoder using a programmable processor
Sugito et al. UHD-2/8K 120-Hz Realtime Video Codec
Nakamura et al. Low delay 4K 120fps HEVC decoder with parallel processing architecture
CN112470473B (zh) 图像处理装置以及图像处理方法
US20230028326A1 (en) Image coding method based on partial entry point-associated information in video or image coding system
US20170127014A1 (en) Upgraded image streaming to legacy and upgraded displays
Moon et al. Software-based encoder for UHD digital signage system
KR20160034638A (ko) 영상 감시를 위한 영상 처리방법 및 장치
Alvarez-Mesa et al. Advanced Video Compression and Rendering for Highly Immersive 8K+ Applications
KR100623710B1 (ko) 하드웨어 리소스를 공유하여 복수의 동영상 콘텐츠를처리하는 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14897335

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14897335

Country of ref document: EP

Kind code of ref document: A1