201218770 六、發明說明： 【發明所屬之技術領域】 本揭示内容是有關於視訊監控，且特別是有關於一種 具有多重串流的視訊監控系統與方法。 【先前技術】 一直以來，人身與財產的安全都是社會中的重要課 通’近來，各種安全監視糸統已經逐漸普及。其中，由於 • 安裝容易及晝質清晰等優點’透過網路傳輸的視訊操取裝 置已成為安全監控系統的主流，例如：網路監控攝影機(JP Camera)。隨著電子技術的發展，提供更高的解析度也成為 IP Camera廠商的趨勢。一般來說，視訊操取裝置配合相對 應的視訊監控裝置即形成一監控系統，例如：網路錄影監 控系統(Network video recorder，NVR)。目前一組 NVR 系統 中’便可以對應裝设§午多部具有百萬晝素(Mega pixel)影像 解析度的IP Camera。 • 一般來說，nvr的系統端（如視訊監控裝置）除了將視 訊擷取裝置(如IP Camera)傳過來的資料進行各種應用操作 或處理，例如.儲存影像資訊、根據使用者需求預覽即時 畫面、在視訊監控裝置端進行視訊資料的重播（playback)或 進行影像即時判別（如動作偵測、人臉偵測）等等。其中進 ' 行影像即時判別時，則須進一步將視訊擷取裝置傳過來的 • 視訊壓縮格式（MPEG4或H.264)之串流(stream)先行解碼以 取得影像原始資料(RAW data)。 這些動作都會增加視訊監控裝置的視訊解碼（dec〇der) 201218770 單兀(如解碼晶片、運算晶片或處理 視訊擷取裳置傳送的視訊解析度愈高、c尤其當 訊壓縮程度愈大時，視訊監控裝置 ^質愈高、視 也相對提高。 、、、早70的運算負載 常見的問題就是視訊解碼單元效能不 致實際接收影像資料品料低、倾料^貞载過高導 介面反應變慢。較嚴重的情況就是，視訊故2系統操作 接收資料可能發生缺漏而不完整，# 揽工、置上不僅 性能也大受影響，例如發生停頓或當機情 1者介面的操作 【發明内容】 為了解決上述問題，本發明提出—種 控機制，其中每一組視訊#|取裝置 相異的多個影像串流，而視訊監控裝置 :。 =態地選擇所需的串流，以達到最 系二包一態樣是在提供一種多串流視訊 等影像串以7產生複數個影像串流，該 每-視訊操取裝置形^的=像規格。視訊監控裝置與 用操作時，根據通祕接，當視訊監控裝置執行應 視 的影像規格選二施:j像其中影像串流之間相異 像解析度、影像品質以及影像幢率所組 201218770 成之一群組中至少一種影像規格。 根據本發明内容之另一實施例，其中應用操作選自多 分割顯示、局部放大顯示、影像重播、動態偵測、影像攝 錄、遠端傳送所組成之一群組中至少一種應用操作。其中 當視訊監控裝置執行遠端傳送時，視訊監控裝置另與一終 端裝置形成通訊連接，視訊監控裝置進一步根據終端裝置 之影像需求自等影像串流中選擇至少一種影像串流，並轉 送至終端裝置。 根據本發明内容之又一實施例，其中視訊監控裝置自 * 每一視訊擷取裝置的該等影像串流選擇並接收其中至少兩 種影像串流，其包含高規格之一第一影像串流以及低規格 之一第二影像串流，該視訊監控裝置分別對該第一影像串 流執行一第一應用操作並對該第二影像串流執行一第二應 用操作。 本發明内容之另一態樣在於提供一種視訊監控裝置， 其包含通訊模組、處理模組以及判斷單元。通訊模組用以 與至少一視訊擷取裝置形成通訊連接，其中每一視訊擷取 • 裝置用以同時產生複數個影像串流，且影像串流分別具有 相異的一影像規格。處理模組用以執行應用操作。判斷單 元根據應用操作之影像需求控制通訊模組自每一視訊擷取 裝置的影像串流中選擇並接收至少一種影像串流。 根據本發明内容之一實施例，視訊監控裝置更包含解 碼單元，用以對影像串流進行解碼，其中該影像需求與解 碼單元之解碼處理能力或解碼負載狀態有關。 根據本發明内容之另一實施例，視訊監控裝置更包含 顯示模組，用以顯示影像串流，其中影像需求與顯示模組 201218770 之顯示尺寸大小或顯示解析度有關。 根據本發明内容之又一實施例，視訊監控裝置更包含 儲存模組，用以儲存影像串流，其中影像需求與儲存模組 之儲存容量大小或寫入速率有關。 根據本發明内容之再一實施例，其中影像串流之間相 異的影像規格選自影像解析度、影像品質以及影像幀率所 組成之一群組中至少一種影像規格。 根據本發明内容之再一實施例，其中應用操作選自多 分割顯示、局部放大顯示、影像重播、動態偵測、影像攝 * 錄、遠端傳送所組成之一群組中至少一種應用操作。其中 當視訊監控裝置執行遠端傳送時，視訊監控裝置透過通訊 模組另與一終端裝置形成通訊連接，判斷單元進一步根據 終端裝置之影像需求自該等影像串流中選擇至少一種影像 串流，並轉送至終端裝置。 根據本發明内容之再一實施例，其中視訊監控裝置自 每一視訊擷取裝置的該等影像串流選擇並接收其中至少兩 種影像串流，其包含高規格之一第一影像串流以及低規格 • 之一第二影像串流，該視訊監控裝置分別對該第一影像串 流執行一第一應用操作並對該第二影像串流執行一第二應 用操作。 本發明内容之另一態樣在於提供一種多串流視訊傳輸 方法，包含下列步驟：於一視訊監控裝置與至少一視訊擷 取裝置之間建立通訊連接；每一視訊擷取裝置用以同時產 生複數個影像串流，該等影像串流分別具有相異的一影像 規格；該視訊監控裝置分析該等影像串流之該等影像規 格；該視訊監控裝置執行一應用操作；以及，根據該應用 201218770 操作之一影像需求，該視訊監控裝置自每一該視訊擷取裝 置的該等影像串流中選擇並接收至少一種影像串流。 根據本發明内容之一實施例，多串流視訊傳輸方法更 包含下列步驟：該視訊監控裝置對該等影像串流進行解 碼，其中該影像需求與該視訊監控裝置之一解碼處理能力 或一解碼負載狀態有關。 根據本發明内容之另一實施例，多串流視訊傳輸方法 更包含下列步驟：顯示該等影像串流於該視訊監控裝置 上，其中該影像需求與該視訊監控裝置之一顯示尺寸大小 或一顯示解析度有關。 根據本發明内容之又一實施例，多串流視訊傳輸方法 更包含下列步驟：儲存該等影像串流於該視訊監控裝置 中，其中該影像需求與該視訊監控裝置之一儲存容量大小 或一寫入速率有關。 根據本發明内容之再一實施例，其中該等影像串流之 間相異的該影像規格選自一影像解析度、一影像品質、以 及一影像幀率所組成之一群組中至少一種影像規格。 根據本發明内容之再一實施例，其中該應用操作選自 一多分割顯示、一局部放大顯示、一影像重播、一動態/[貞 測、一影像攝錄、一遠端傳送所組成之一群組中至少一種 應用操作。 根據本發明内容之再一實施例，其中該視訊監控裝置 自每一該視訊擷取裝置接收該等影像串流之步驟中，進一 步包含下列步驟：該視訊監控裝置自每一該視訊擷取裝置 的該等影像串流中選擇並接收其中至少兩種影像串流，其 包含高規格之一第一影像串流以及低規格之一第二影像串 201218770 應用操作；以及，對該 第一影像串流執行 流；對該第一影像串流執行—第一 第一應用操作 【實施方式】 本發明利用视訊梅 ，度、影像品質 =多二不同影像規格(影 此可對應不同的應 縮二或痛貞率)的串流，藉 ，串流’達到最高的:二控裝置選擇適當 可用於基礎影像分析及快速預覽，二二解析度的串 到儲存媒體中’以備之後影像重播使：解串流儲存 伺服盗端(視訊監控裝置)的運 ：：低監控 用操作之影像需^=二= 流，而非總是選用固定影像規格的衫像串 流視訊系統如下所述。 〜像串K細的多串 鲁 π參閱第1圖’其繪示根據本發明之—實施例中一種 夕串流視訊系、统⑽的示意圖。如第1圖所示，多串流視 訊系統100包含多組視訊摘取裝置（此例中為視訊操取裝置 H、視机摘取裝置120b及視訊擷取裝置i2〇c)以及視訊 監控裝置140，視訊監控裝£ 14〇彳分別與視訊操取裝置 120a〜120c形成通訊連接，例如透過有線/無線網際網路、 有線/無線區域網路以及實體線路直接連接等。於此例中， 視訊監控裝置140主要透過網際網路2〇〇與視訊擷取裝置 120a〜120c形成通訊連接。實際應用中，多串流視訊系統 1〇〇可具有更多組的視訊擷取裝置，本發明並不以三組為 201218770 早期，傳統的類比攝影機有QVGA規格的320* 240像 素(p1Xel)、CIF 規格的 352*288 像素、VGA 規格的 64〇*48〇 像素等各種影像輸出規格。然而，近來市面上新式的視訊 擷取裝置（如網路監控攝影機Ip Camera)的影像規格已逐漸 提升，舉例來說，可能支援1280*96〇像素、^004200、 2曰〇48*1536像素、256(m92G像素甚至更高的解析度。也就 是說，目前視訊擷取裝置所傳送的影像晝面大多已是數百 萬像素以上的解析度。 一般來說，多串流視訊系統1〇()中的多組視訊擷取裝 置120a〜1施可分佈於各個角落，並將回傳的影像整合顯 不於伺服器端的視訊監控裝置刚上。視訊監控裝置14〇 可對回傳的影像資料進行進—步的分析、重播、放大或儲 存等。 —須特別注意的是，本發明的多串流視訊系統100中， 母-視訊擷取裝置（120a〜120c)可同時產生多個影像規格相 異的影像串流。 舉例來說，如第1圖所示，視訊擷取裝置120a產生三 組衫像串 '流Stl〜st3，其中影像串流stl的影像解析度 (職1Uti〇n)為1600*删，影像串流st2的影像解析度為 64〇 =0 且影像鴨率（frame rate)為 6〇 frames/sec (㈣影 像串流St3的影像解析度為040*480且影像幀率為24 fps ; 視°扎擁取袭置12Gb產生兩組影像串流st4〜st5，影像串流 辦的影像解析度為128〇*難影像串流w的影像解析 度為72〇*48〇 ;視訊擷取裝i 120c產生兩組影像串流 洲〜st7，影像串流⑽的影像解析度為256Q*192()，影 机St7的影像解析度為1280*1024。 201218770 於上述例子中，每一祝訊搁取裝置（120a〜12〇c)可同時 產生影像串流之間影像規格的相異係主要以影像解析度為 例，然而本發明並不以此為限’本發明中所謂影像規格可 選自影像解析度、影像品質（video quality)以及影像鳩率 (frame rate)中至少一種。也就是說，視訊擷取裝置產生不 同的影像串流之間亦可為同樣的640*480影像解析度但具 分別具有不同的影像幀率，如60 fps、40 fps及24 fps，例 如上述例子中的影像串流st2與影像串流st3的影像解析度 皆為640*480但影像幀率分別為60 fps與24fps。 ® 另一方面，部份影像串流之間可具有不同的影像品 質。此處所謂的影像品質實際應用中可由影像的壓縮比 (compression rate)、色深（color depth)、峰值信噪比（Peak Signal to Noise Ratio, PSNR)或其他具相等性的影像參數來 決定。 請一併參閱第2圖，其繪示根據本發明之一實施例中 視§fl監控裝置140的功能方塊圖。視訊監控敦置“ο包含 通§fl模組142、處理模組144、判斷單元146、解碼單元147、 • 顯示模組I48以及儲存模組149。 其中，視訊監控裝置140可透過通訊模組142連接上 網際網路200’進而與視訊擷取裝置12〇a〜12〇c形成通訊 接。 。 般而5，視3凡擁取裳置120透過網路傳送影像資訊 (影像串流stl〜St7)至視訊監控裝置140時，大多會先將原 始資料(RAW data)進行一定程度的編碼，例如内容加密或 資料壓縮等，解碼單元147用以對影像串流(sU〜st7)進行解 碼。通常愈高解析度、愈高品質、或愈複雜編碼的串流， 201218770 所需的解碼時間愈長， 造成較沉重的解巧㈣/要較佳的解竭處理能力，且 致上與影像的總像素大小成正比。然而；= 碼時間大 ，裝置12G只需要快速_覽影像。於==解t訊 -M7可為獨立的解碼晶 際應用中，解碼單元147 tie 士 +並不以此為限。實 -處理器當中’或以軟體方、實^^_144可整合於同 模組M4加以執行。方式實現解碼卓凡147並由處理201218770 VI. Description of the Invention: [Technical Field of the Invention] The present disclosure relates to video surveillance, and more particularly to a video surveillance system and method having multiple streams. [Prior Art] The safety of people and property has always been an important lesson in society. Recently, various security surveillance systems have become popular. Among them, because of the advantages of easy installation and clear quality, the video processing device transmitted through the network has become the mainstream of the security monitoring system, for example, the JP Camera. With the development of electronic technology, providing higher resolution has become a trend of IP Camera manufacturers. Generally, the video manipulation device cooperates with the corresponding video monitoring device to form a monitoring system, such as a network video recorder (NVR). At present, a set of NVR systems can be equipped with multiple IP cameras with mega-pixel resolution. • In general, the nvr system (such as a video surveillance device) performs various application operations or processing on data transmitted from a video capture device (such as an IP camera), such as storing image information and previewing the instant image according to user needs. Playback of video data or instant image discrimination (such as motion detection, face detection) on the video surveillance device. In the case of immediate image discrimination, the stream of the video compression format (MPEG4 or H.264) transmitted by the video capture device must be further decoded to obtain the RAW data. These actions will increase the video decoding (CCD) of the video surveillance device. The higher the resolution of the video, such as decoding the chip, computing the chip, or processing the video capture, the higher the compression, especially when the compression is greater. The video surveillance device is higher in quality and higher in viewing. The common problem of the computing load of the early 70 is that the video decoding unit performance is not practical, the image data is low, and the high-level interface response is slow. The more serious situation is that the video system 2 operation operation receiving data may be missing and not complete, # 揽 、 置 置 置 置 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 不仅 或In order to solve the above problem, the present invention proposes a seed control mechanism in which each group of video cameras uses a plurality of video streams that are different from each other, and the video monitoring device selects the desired stream to achieve the most A two-package mode is to provide a multi-stream video and other video strings to generate a plurality of video streams, and the video-monitoring device has the image format. When the operation and the operation are performed, according to the secret connection, when the video surveillance device performs the image specification to be viewed, the image is selected according to the image resolution, image quality and image building rate of the image stream. At least one image specification in a group. According to another embodiment of the present invention, the application operation is selected from the group consisting of multi-segment display, partial enlargement display, image replay, motion detection, image recording, and remote transmission. At least one application operation in the group, wherein when the video monitoring device performs the remote transmission, the video monitoring device further forms a communication connection with a terminal device, and the video monitoring device further selects at least one of the equal video streams according to the image requirement of the terminal device. The video stream is streamed and forwarded to the terminal device. According to still another embodiment of the present invention, the video monitoring device selects and receives at least two video streams from the video streams of each video capture device. The first image stream of one of the high specifications and the second image stream of the low specification are included, and the video monitoring device respectively The first image stream performs a first application operation and performs a second application operation on the second image stream. Another aspect of the present disclosure is to provide a video monitoring device, which includes a communication module and a processing module. And a judging unit, wherein the communication module is configured to form a communication connection with at least one video capture device, wherein each video capture device is configured to generate a plurality of video streams at the same time, and the video streams respectively have different image specifications. The processing module is configured to perform an application operation. The determining unit selects and receives at least one video stream from the video stream of each video capturing device according to the image demand control operation of the application operation. For example, the video monitoring device further includes a decoding unit for decoding the video stream, wherein the image requirement is related to a decoding processing capability or a decoding load state of the decoding unit. According to another embodiment of the present invention, the video monitoring device further includes a display module for displaying the video stream, wherein the image requirement is related to the display size or the display resolution of the display module 201218770. According to still another embodiment of the present invention, the video monitoring device further includes a storage module for storing the video stream, wherein the image requirement is related to a storage capacity size or a writing rate of the storage module. According to still another embodiment of the present invention, the image size different between the video streams is selected from at least one image specification of one of a group consisting of image resolution, image quality, and image frame rate. According to still another embodiment of the present invention, the application operation is selected from the group consisting of: a multi-segment display, a partial enlargement display, a video replay, a motion detection, an image capture, and a remote transmission. When the video monitoring device performs the remote transmission, the video monitoring device forms a communication connection with a terminal device through the communication module, and the determining unit further selects at least one video stream from the image streams according to the image requirements of the terminal device. And transferred to the terminal device. According to still another embodiment of the present invention, the video monitoring device selects and receives at least two video streams from the video streams of each video capture device, and includes one of the high-standard first video streams and Low specification • A second video stream, the video monitoring device respectively performing a first application operation on the first video stream and performing a second application operation on the second video stream. Another aspect of the present invention provides a multi-stream video transmission method, including the steps of: establishing a communication connection between a video monitoring device and at least one video capturing device; each video capturing device is configured to generate simultaneously a plurality of image streams each having a different image specification; the video monitoring device analyzing the image specifications of the image streams; the video monitoring device performing an application operation; and, according to the application 201218770 operates an image request that selects and receives at least one video stream from the video streams of each of the video capture devices. According to an embodiment of the present invention, the multi-stream video transmission method further includes the following steps: the video monitoring device decodes the video stream, wherein the image request and one of the video monitoring devices decode processing capability or decode The load status is related. According to another embodiment of the present invention, the multi-stream video transmission method further includes the steps of: displaying the video stream on the video monitoring device, wherein the image requirement and one of the video monitoring devices display a size or a Display resolution is related. According to still another embodiment of the present invention, the multi-stream video transmission method further includes the steps of: storing the video stream in the video monitoring device, wherein the image demand and the video monitoring device are one of a storage capacity or a The write rate is related. According to still another embodiment of the present disclosure, the image specification that is different between the image streams is selected from at least one of a group of image resolution, an image quality, and an image frame rate. specification. According to still another embodiment of the present invention, the application operation is selected from the group consisting of: a multi-segment display, a partial zoom display, an image replay, a dynamic/[detection, an image recording, and a remote transmission. At least one application operation in the group. According to still another embodiment of the present invention, the video monitoring device receives the video stream from each of the video capturing devices, and further includes the following steps: the video monitoring device from each of the video capturing devices Selecting and receiving at least two types of video streams in the video stream, including one of the high-standard first video stream and one of the low-standard second image string 201218770 application operations; and, the first video string Flow execution flow; execution of the first image stream - first first application operation [Embodiment] The present invention utilizes video plum, image quality, and image quality = two different image specifications (this can correspond to different shrinkage Or the flow rate of the pain rate, borrowing, streaming 'to the highest: the second control device can be selected for basic image analysis and quick preview, the two-two resolution string to the storage medium' for later image replay: De-streaming storage of server thief (video surveillance device):: The image of low-monitoring operation needs ^=2 = stream, instead of always using a fixed-image size shirt-like video system Below. A plurality of strings like the string K are π. Referring to Fig. 1 which is a schematic diagram of a system of video streams (10) according to the present invention. As shown in FIG. 1, the multi-stream video system 100 includes a plurality of sets of video capture devices (in this example, a video capture device H, a video capture device 120b, and a video capture device i2〇c) and a video monitoring device. 140, the video monitoring device 14 14 respectively forms a communication connection with the video manipulation devices 120a to 120c, for example, through a wired/wireless internet network, a wired/wireless area network, and a physical line direct connection. In this example, the video monitoring device 140 forms a communication connection with the video capturing devices 120a-120c mainly through the Internet. In practical applications, the multi-stream video system 1 can have more sets of video capture devices. The present invention does not use three groups as early 201218770. The conventional analog camera has a QVGA specification of 320*240 pixels (p1Xel). Various image output specifications such as 352*288 pixels for CIF specifications and 64〇*48 pixels for VGA specifications. However, the image specifications of new video capture devices (such as Internet surveillance cameras Ip Camera) have recently increased, for example, may support 1280*96 pixels, ^004200, 2曰〇48*1536 pixels, 256 (m92G pixels or even higher resolution. That is to say, most of the images transmitted by video capture devices are already more than megapixels. Generally speaking, multi-stream video system 1〇 ( The plurality of sets of video capture devices 120a~1 can be distributed in various corners, and the returned images can be integrated on the video monitoring device of the server. The video monitoring device 14 can transmit back the image data. Perform further analysis, replay, enlargement or storage, etc. - It should be particularly noted that in the multi-stream video system 100 of the present invention, the mother-video capture devices (120a-120c) can simultaneously generate multiple image specifications. For example, as shown in FIG. 1, the video capturing device 120a generates three sets of shirt strings 'streams St1 to st3, wherein the image resolution of the video stream st1 is 1 Uti〇n. For 1600* deletion, video stream st The image resolution of 2 is 64〇=0 and the frame rate of the image is 6〇frames/sec. ((4) The image resolution of the video stream St3 is 040*480 and the image frame rate is 24 fps; The attack image set 12Gb produces two sets of video streams st4~st5, the image resolution of the video stream is 128〇*, the image resolution of the difficult image stream w is 72〇*48〇; the video capture device i 120c generates two The image resolution is __7, the image resolution of the video stream (10) is 256Q*192(), and the image resolution of the camera St7 is 1280*1024. 201218770 In the above example, each of the wishing devices (120a) ～12〇c) The difference between the image specifications of the video stream can be generated at the same time. The image resolution is mainly taken as an example. However, the present invention is not limited thereto. The image specification in the present invention may be selected from image resolution, At least one of video quality and frame rate. That is to say, the video capture device can generate different video streams with the same 640*480 image resolution but differently. Image frame rate, such as 60 fps, 40 fps, and 24 fps, such as the above example The video stream st2 and the video stream st3 have an image resolution of 640*480 but the image frame rates are 60 fps and 24 fps respectively. On the other hand, some video streams can have different image qualities. The so-called image quality practical application can be determined by the compression ratio, color depth, Peak Signal to Noise Ratio (PSNR) or other image parameters of the image. Please refer to FIG. 2, which is a functional block diagram of the monitoring device 140 according to an embodiment of the present invention. The video surveillance device 142 includes a modulo module 142, a processing module 144, a determination unit 146, a decoding unit 147, a display module I48, and a storage module 149. The video monitoring device 140 can pass through the communication module 142. Connected to the Internet 200' to form a communication connection with the video capture devices 12〇a~12〇c.. Generally, the video is transmitted through the network (image stream stl~St7) When the video monitoring device 140 is used, the original data (RAW data) is first encoded to a certain extent, such as content encryption or data compression, and the decoding unit 147 is used to decode the video stream (sU to st7). The higher the resolution, the higher the quality, or the more complex the encoded stream, the longer the decoding time required for 201218770, resulting in a heavier solution (4) / better decommissioning ability, and the total image and image The pixel size is proportional. However, the code time is large, and the device 12G only needs to quickly view the image. In the == solution t-M7 can be used in the independent decoding inter-crystal application, the decoding unit 147 Tie + does not Limit. In the real-processor Body side, a solid _ ^^ 144 may be implemented on the same integrated module M4. Manner by the decoding process 147 Zhuo
而處理模組144可為主要的運算與資料處理中心 ，應用中處理模組144可為處理器、處理晶片或系統單晶 片（system on a chip，soc)等，處理模組144可根據使用 的指令執行各種應用操作。 舉例來說，當視訊監控裝置140的處理模組144可根 據使用者指令執行多分割顯示（丨*2、2*2、4*4等分割晝 面）、局部放大顯示（針對指定區域放大或針對臉部放大）、 影像重播(playback)、動態偵測(m〇ti〇n detecti〇n)、影像攝 錄(recording)、运端傳送等應用操作。 根據不同的應用操作，視訊監控裝置14〇中的處理模 組144可相對應處理影音串流並傳送至相對應的其他模組 或元件。例如，顯示模組148用以顯示影像串流（單一顯示、 分割顯示、局部放大顯示等等）；而儲存模組149則用以儲 存影像串流，用於影像攝錄建檔或日後影像重播之用。 目前視訊監控震置14〇上的顯示模組148之解析度可 能為1600*1200。因此，視訊監控裝置14〇以多影像分割 顯示時’則可依據顯示模組148具有之複數個分割視窗的 解析度大小而接收大於或等於該分割視窗的解析度之影像 12 201218770 度顯示在顯示模組148上就可以看到 = Γ 2*2分割視窗同時顯示四組視訊擷取裝 : 依據每一個分割視窗僅須_*6〇〇以 度’接收隨00以上解析度之四組視訊擷取裝 置之串&即可，並不m最高的影像解析度，又例如 顯示模組⑷冑5個分割視窗’且其中！個分割視窗之解 析度大於其他4個分賴窗，則亦依據各分割視窗之解析 度以分別接收大於或等於各分龍窗之解析度的影像串流 此外’：般常見的影像分析演算法，如動態偵測等， 亦不需要太而的解析度。因此，通常高解析度的影像只有 在影像重播(playWk)、生物特徵辨識（人臉辨識或虹膜辨 視）、局部細微特徵的時候才會有其好處。 因此，本發明的判斷單元146根據應用操作之影像需 求控制通訊模組142自每一視訊擷取裝置（12〇a〜12〇c)的多 個影像串流中選擇並接收至少一種影像串流。於此例中， 判斷^元146可為獨立的解碼晶片，但本發明並不以此為 限。貫際應用中，判斷單元146亦可與處理模組丨44可整 • 合於同一處理器當中，或以軟體方式實現判斷單元140並 由處理模組144加以執行。 其中，判斷單元146根據影像需求的判斷標準，以下 舉幾個例子加以說明： ⑴使用者僅需要概略的預覽(preview)各視訊擷取裝 置120a〜120c的晝面時，且顯示模組148上每一分割晝面 僅需400*300的解析度時： 判斷單元146選擇並接收視訊擷取裝置i2〇a的影像串 流st3(640*480, 24fps)、視訊擷取裝置120b的影像串流 13 201218770 st5(720*480)以及視訊擷取裝置120c的影像串流 st7(1280*1024)。 (2) 使用者僅需要概略的預覽(preview)各視訊擷取裝 置120a〜120c的晝面時，且顯示模組148上每一分割畫面 僅需800*600的解析度時： 影像串流的解析度應至少大於顯示模組148上分割畫 面的解析度，此時判斷單元146可選擇並接收視訊擷取裝 置120a的影像串流stl(1600*1200)、視訊擷取裝置120b 的影像串流st4(1280*1024)以及視訊擷取裝置120c的影像 • Φ 流 st7(1280*1024)。 (3) 若須局部放大視訊擷取裝置120a的晝面時： 判斷單元146則可切換為選擇視訊擷取裝置i2〇a的影 像串流 stl(1600*1200)。 (4) 若僅為進行晝面内容是否變化的影像分析，判斷 單元146可選用視訊擷取裝置120a的影像串流st2(640*480, 60fps)、視訊擷取裝置i2〇b的影像串流st5(720*480)以及 視訊擷取裝置120c的影像串流st7(128〇*i〇24)，其中影像 鲁串流st2具有較咼的影像巾貞率有利於動態彳貞測。 上述判斷單元146判斷影像需求的例子主要考量到顯 示模組148的顯示及其分割視窗的尺寸大小或顯示解析 度，然而本發明並不以此為限。 於其他實施例中’判斷單元146判斷應用操作的影像 需求亦可進-步考量到解碼單元147之解碼處理能力或解 碼負載狀態、或是儲存模組148之儲存容量大小或寫 率。此外，判斷單元146亦不限制自單-視訊擷取裝置 ⑽a、mw)只選擇單一的影像串流，亦可同時選 201218770 擇兩個以上的影音串流。以下舉一例加以說明： (5)假設，平時僅需要概略的預覽（preview)各視訊擷 取裝置120a〜120c的晝面時並將晝面儲存下來，以備日後 影像重播，且使用者希望影像重播時能有最佳的影像作為 防盜或緝兇用途： ’The processing module 144 can be a main computing and data processing center. The processing module 144 can be a processor, a processing chip, or a system on a chip (soc). The processing module 144 can be used according to the usage. The instructions perform various application operations. For example, when the processing module 144 of the video monitoring device 140 can perform multi-segment display according to user instructions (丨*2, 2*2, 4*4, etc.), partial enlargement display (for a specified area, or For face enlargement, image playback, motion detection (m〇ti〇n detecti〇n), video recording (recording), transport transmission and other application operations. Depending on the application operation, the processing module 144 in the video monitoring device 14 can process the video stream and transmit it to the corresponding other modules or components. For example, the display module 148 is used to display video streams (single display, split display, partial enlarged display, etc.), and the storage module 149 is used to store video streams for image recording or future image replay. Use. At present, the resolution of the display module 148 on the video monitor may be 1600*1200. Therefore, when the video monitoring device 14 is divided into multiple images, the image can be received according to the resolution of the plurality of divided windows of the display module 148. The image is displayed at a display level greater than or equal to the resolution of the divided window. Module 148 can see = Γ 2 * 2 split window simultaneously display four sets of video capture: According to each split window only _ * 6 〇〇 to 'receive four sets of video with 00 or more resolution 撷Take the device string & can not, m is the highest image resolution, for example, display module (4) 胄 5 split windows 'and among them! The resolution of the split window is larger than the other four partition windows, and the image stream of greater than or equal to the resolution of each split window is separately received according to the resolution of each split window. For example, motion detection does not require too much resolution. Therefore, usually high-resolution images have their advantages only when image replay (playWk), biometrics (face recognition or iris recognition), and local subtle features. Therefore, the determining unit 146 of the present invention selects and receives at least one video stream from the plurality of video streams of each of the video capturing devices (12〇a to 12〇c) according to the image demand control communication module 142 of the application operation. . In this example, the determination unit 146 can be an independent decoder chip, but the invention is not limited thereto. In the continuous application, the determining unit 146 may be integrated with the processing module 丨 44 in the same processor, or implemented in a software manner by the determining unit 140 and executed by the processing module 144. The determining unit 146 is based on the criteria for determining the image demand, and is described below by way of example: (1) The user only needs to preview the facets of the video capturing devices 120a to 120c in a rough manner, and the display module 148 When only 400*300 resolution is required for each divided surface: the determining unit 146 selects and receives the video stream st3 (640*480, 24fps) of the video capturing device i2〇a and the video stream of the video capturing device 120b. 13 201218770 st5 (720 * 480) and the video stream st7 (1280 * 1024) of the video capture device 120c. (2) When the user only needs to preview the facets of the video capture devices 120a to 120c in a rough manner, and the resolution of each divided screen on the display module 148 is only 800*600: The resolution should be at least greater than the resolution of the split screen on the display module 148. At this time, the determining unit 146 can select and receive the video stream traces of the video capture device 120a (1600*1200) and the video stream of the video capture device 120b. St4 (1280*1024) and the image of the video capture device 120c • Φ stream st7 (1280*1024). (3) If the face of the video capture device 120a is to be partially enlarged: the determination unit 146 can be switched to select the image stream st1 (1600*1200) of the video capture device i2〇a. (4) If only the image analysis of whether the content of the face is changed, the determining unit 146 may select the video stream st2 (640*480, 60 fps) of the video capturing device 120a and the video stream of the video capturing device i2〇b. St5 (720*480) and the video stream st7 (128〇*i〇24) of the video capture device 120c, wherein the image stream stream st2 has a relatively low image frame rate, which is favorable for dynamic guessing. The example in which the determining unit 146 determines the image demand mainly considers the display of the display module 148 and the size or display resolution of the split window, but the invention is not limited thereto. In other embodiments, the determining unit 146 determines that the image demand of the application operation can further measure the decoding processing capability or the decoding load state of the decoding unit 147, or the storage capacity size or write rate of the storage module 148. In addition, the judging unit 146 does not limit the selection of a single video stream from the single-video capture device (10) a, mw), and may select two or more video streams at the same time. The following is an example: (5) It is assumed that only the preview of each of the video capture devices 120a to 120c is required to be previewed and the video is stored for later playback, and the user desires the image. The best image can be used as an anti-theft or sinister use during replay: '
判斷單元146自視訊擷取裝置12〇a同時接收兩相異影 像串流(stl與st3)、自視訊擷取裝置12〇b同時接收兩相= 影像串流(st4與st5)以及自視訊擷取装置12〇c同時接收兩 相異影像串流(st6與st7)e其中，高規格之影像串流(su， st6)不經過解碼單元147的解碼，視訊監控裝置便逕自將高 規格之影像串流(stl，st4, st6)直接儲存於儲存模組I"中门。 而低規格之影像串流（st3，st5，st7)則分別解碼單元丨47解 並顯示於顯示模組148上。當需要進行影像重播時，方由 儲存模組148中讀出指定時段的高規格之影像串浐（Μ〗 =交由解碼單元147解碼。如此一來，便可兼:影:重 播需求時的晝面清晰程度；且於一般晝面預覽時，又 輕元147的負擔，使視訊監控裝置i4G顯示切換及 才呆作的流暢性得以提高。 ▲視訊監控裝置14G可根據使用者操作執行遠端傳 功能，當執行遠端傳送時，視訊監控裝置l4〇可將收 影像串流轉送到其他終端裝置(如手機、PDA、 ’ 電腦或其他各種使用者指定的電子裝置）上，視訊龄控 14〇可透過通訊模組142另與另一終端裝置（未給ϋ =接’判斷單元146進-步根據終端裝置之; ^大^處理器能力等）自影像串流中選擇適當的影像串 机，並轉运至終端裝置4中選擇影像串流的作法可參考 15 201218770 先前的實施例，在此不另贅述。 請參閱第3圖，其繪示根據本發明之另一實施例中一 種多串流視訊傳輸方法的方法流程圖。其中，此實施例中 的多串流視訊傳輸方法可配合多串流視訊系統使用，多串 流視訊系統包含視訊監控裝置與至少一視訊擷取裝置，有 關多串流視訊系統的硬體架構與内部細節可參考本發明先 前實施例相關段落的說明。 如第3圖所示，本發明的多串流視訊傳輸方法手先執 行步驟S100，於一視訊監控裝置與至少一視訊擷取裝置之 B 間建立通訊連接。接著，執行步驟S102，每一視訊擷取裝 置用以同時產生複數個影像串流，該等影像串流分別具有 相異的一影像規格，其影像規格可選自影像解析度、影像 品質、以及影像幀率中至少一種。 接著，執行步驟S104，視訊監控裝置分析該等影像串 流之該等影像規格。接著，執行步驟S106，根據使用者需 要，由視訊監控裝置執行特定的應用操作，其中應用操作 選自多分割顯示、局部放大顯示、影像重播、動態偵測、 • 影像攝錄、遠端傳送其中至少一種影像串流。 接著，執行步驟S108，根據應用操作之影像需求，視 訊監控裝置自每一視訊擷取裝置的該等影像串流中選擇並 接收至少一種影像串流。其中，應用操作之影像需求可能 與視訊監控裝置之解碼處理能力、解碼負載狀態、顯示尺 寸大小、顯示解析度、儲存容量大小或寫入速率等各種因 素中至少一種有關。 根據本發明内容之再一實施例，其中該應用操作選自 一多分割顯示、一局部放大顯示、一影像重播、一動態偵 16 201218770 測、一影像攝錄、一遠端傳送所組成之一群組中至少一種 應用操作。 此外，視訊監控裝置自每一該視訊擷取裝置接收該等 影像串流的步驟S108中，視訊監控裝置可能自每一視訊擷 取裝置選擇並接收其中兩種影像串流，其中包含高規格之 影像串流以及低規格之影像串流。接著，視訊監控裝置可 分別對高、低規格影像串流執行不同的應用操作。 綜上所述，本發明利用視訊擷取裝置提供多個不同影 像規格（影像解析度、影像品質、影像壓縮比或影像幀率） • 的串流，藉此可對應不同的應用操作需求，由視訊監控裝 置選擇適當的影音串流，達到最高的處理效率。 .雖然本揭示内容已以實施方式揭露如上，然其並非用 以限定本揭示内容，任何熟習此技藝者，在不脫離本揭示 内容之精神和範圍内，當可作各種之更動與潤飾，因此本 揭示内容之保護範圍當視後附之申請專利範圍所界定者為 準。The judging unit 146 receives the two-phase video stream (stl and st3) from the video capturing device 12a, and simultaneously receives two phases = video stream (st4 and st5) and the video channel from the video capturing device 12〇b. The device 12 〇c simultaneously receives the two-phase video stream (st6 and st7) e. The high-standard video stream (su, st6) is not decoded by the decoding unit 147, and the video monitoring device is capable of high-definition video. The stream (stl, st4, st6) is stored directly in the storage module I" The low-standard video streams (st3, st5, st7) are respectively decoded by the decoding unit 47 and displayed on the display module 148. When image replay is required, the high-definition video string of the specified time period is read out by the storage module 148 (Μ〗 = is decoded by the decoding unit 147. Thus, the video can be combined with: shadow: when replaying the demand The degree of clarity of the face is clear; and when the preview is normal, the burden of the light element 147 is increased, so that the smoothness of the video monitoring device i4G display switching and staying is improved. ▲ The video monitoring device 14G can perform the remote operation according to the user operation. The function of transmitting, when performing remote transmission, the video monitoring device can transfer the received video stream to other terminal devices (such as mobile phones, PDAs, 'computers or other electronic devices designated by various users), and the video age control 14 〇, through the communication module 142 and another terminal device (not given ϋ = connection judgment unit 146 further according to the terminal device; ^ large processor capability, etc.) select an appropriate video stringer from the video stream For the method of selecting the video stream in the terminal device 4, refer to the previous embodiment of 201218770, which will not be further described herein. Please refer to FIG. 3, which illustrates a multi-layer according to another embodiment of the present invention. A flow chart of a method for streaming video transmission, wherein the multi-stream video transmission method in this embodiment can be used with a multi-stream video system, and the multi-stream video system includes a video monitoring device and at least one video capturing device. For the hardware architecture and internal details of the multi-stream video system, reference may be made to the description of the related paragraphs of the previous embodiment of the present invention. As shown in FIG. 3, the multi-stream video transmission method of the present invention first performs step S100 in a video monitoring device. And establishing a communication connection with the B of the at least one video capture device. Then, in step S102, each video capture device is configured to generate a plurality of video streams at the same time, and the video streams respectively have different image specifications. The image specification may be selected from at least one of image resolution, image quality, and image frame rate. Then, in step S104, the video monitoring device analyzes the image specifications of the video streams. Then, step S106 is performed, according to the use. It is required that the video monitoring device performs a specific application operation, wherein the application operation is selected from a multi-segment display and a local The display, the video replay, the motion detection, the video recording, and the remote transmission of at least one of the video streams. Then, in step S108, the video monitoring device uses the video capture device from each video capture device according to the image requirements of the application operation. Selecting and receiving at least one video stream in the video stream, wherein the image demand of the application operation may be related to a decoding processing capability, a decoding load state, a display size, a display resolution, a storage capacity, or a write rate of the video monitoring device. According to still another embodiment of the present invention, the application operation is selected from the group consisting of: a multi-segment display, a partial zoom display, an image replay, a dynamic detection 16 201218770 measurement, an image recording, At least one application operation in a group consisting of a remote transmission. In addition, in step S108, in which the video monitoring device receives the video streams from each of the video capturing devices, the video monitoring device may select and receive two types of video streams from each of the video capturing devices, including high specifications. Video streaming and low-profile video streaming. Then, the video monitoring device can perform different application operations on the high and low specification video streams respectively. In summary, the present invention utilizes a video capture device to provide a plurality of streams of different image specifications (image resolution, image quality, image compression ratio, or image frame rate), thereby corresponding to different application operation requirements. The video surveillance device selects the appropriate video stream to achieve the highest processing efficiency. Although the disclosure has been disclosed in the above embodiments, it is not intended to limit the disclosure, and thus, various modifications and refinements may be made without departing from the spirit and scope of the disclosure. The scope of the disclosure is defined by the scope of the appended claims.
17 201218770 【圖式簡單說明】 為讓本揭示内容之上述和其他目的、特徵、優點與實 施例能更明顯易懂，所附圖式之說明如下： 第1圖繪示根據本發明之一實施例中一種多串流視訊 糸統的不意圖， 第2圖，其繪示根據本發明之一實施例中視訊監控裝 置的功能方塊圖，以及 第3圖繪示根據本發明之另一實施例中一種多串流視 φ 訊傳輸方法的方法流程圖。 【主要元件符號說明】 100 ·多串流視訊糸統 120a :視訊擷取裝置 120b :視訊擷取裝置 120c :視訊擷取裝置 140 ： 視訊監控裝置 200 :網際網路 stl : 影像串流 st2 :影像串流 st3 ' 影像串流 st4 :影像串流 st5 : 影像串流 st6 :影像串流 st7 ·· 影像串流 142 :通訊模組 144 處理模組 146 :判斷單元 147 解碼單元 148 :顯示模組 149 儲存模組 S100 :步驟 S102 :步驟 S104 :步驟 S106 :步驟 S108 :步驟 18BRIEF DESCRIPTION OF THE DRAWINGS [0009] The above and other objects, features, advantages and embodiments of the present disclosure will become more apparent and understood. In the example, a multi-stream video system is not intended, FIG. 2 is a functional block diagram of a video monitoring device according to an embodiment of the present invention, and FIG. 3 is a view showing another embodiment according to the present invention. A flow chart of a method for multi-streaming φ transmission method. [Main component symbol description] 100 · Multi-stream video system 120a: Video capture device 120b: Video capture device 120c: Video capture device 140: Video surveillance device 200: Internet sttl: Video stream st2: Image Streaming st3' video stream st4: video stream st5: video stream st6: video stream st7 · video stream 142: communication module 144 processing module 146: judging unit 147 decoding unit 148: display module 149 The storage module S100: step S102: step S104: step S106: step S108: step 18