WO2016173279A1 - 一种图像延迟的检测方法和系统 - Google Patents

一种图像延迟的检测方法和系统 Download PDF

Info

Publication number
WO2016173279A1
WO2016173279A1 PCT/CN2015/098330 CN2015098330W WO2016173279A1 WO 2016173279 A1 WO2016173279 A1 WO 2016173279A1 CN 2015098330 W CN2015098330 W CN 2015098330W WO 2016173279 A1 WO2016173279 A1 WO 2016173279A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
delay
time
image frame
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/098330
Other languages
English (en)
French (fr)
Inventor
郭斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to EP15890653.7A priority Critical patent/EP3291551B1/en
Priority to US15/564,069 priority patent/US10305613B2/en
Publication of WO2016173279A1 publication Critical patent/WO2016173279A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B17/00—Monitoring; Testing
    • H04B17/30—Monitoring; Testing of propagation channels
    • H04B17/309—Measuring or estimating channel quality parameters
    • H04B17/364—Delay profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04J—MULTIPLEX COMMUNICATION
    • H04J3/00—Time-division multiplex systems
    • H04J3/02—Details
    • H04J3/06—Synchronising arrangements
    • H04J3/0635—Clock or time synchronisation in a network
    • H04J3/0638—Clock or time synchronisation among nodes; Internode synchronisation
    • H04J3/0658—Clock or time synchronisation among packet nodes
    • H04J3/0661—Clock or time synchronisation among packet nodes using timestamps
    • H04J3/0667—Bidirectional timestamps, e.g. NTP or PTP for compensation of clock drift and for compensation of propagation delays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/04—Diagnosis, testing or measuring for television systems or their details for receivers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof
    • H04N5/95—Time-base error compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the present application relates to the field of video surveillance, and in particular, to a method and system for detecting image delay in video surveillance.
  • Image delay is an important parameter in the field of video surveillance. The smaller the image delay, the better the overall video surveillance performance such as camera transmission and back-end processing in video surveillance, and the image delay can reflect the real-time display of the image. Therefore, how to accurately measure (or detect) the image delay in the video surveillance environment is particularly important, which helps to further improve the video surveillance environment and shorten the image delay as much as possible.
  • image delay The currently used method of measuring camera delay (hereinafter referred to as image delay) is:
  • a timer on the computer (which typically has a precision of milliseconds) and set up the camera to align with the timer interface on the computer display.
  • a screen capture operation is performed on the computer, and the difference between the time of the timer and the time of the preview screen of the client is calculated according to the screenshot screen of the camera, and the difference is an image delay in the general sense of the video surveillance field.
  • the biggest disadvantage of this method is that it requires manual manual operation for screen capture, which is cumbersome and time consuming, and the final screen capture step is susceptible to the screen refresh rate of the computer, which may cause errors of the order of ⁇ 10ms.
  • a display with a refresh rate of 60 at a certain moment, the number on the timer should be updated, and at this time the camera is taking a screen shot, and because of the screen refresh problem, it needs to wait for 16.6ms before performing the refresh, thus causing a 16.6ms error, which makes The camera delay produces a larger error.
  • the frame image is played and displayed.
  • the data reception buffer and the decoded playback buffer are performed. It is especially important to find a specific frame data in the data and play buffer queue (the frame data records the acquisition time at that time) to calculate the delay. Make this parameter as accurate as possible.
  • the camera and the computer as the playback display have their own system time. Due to the display frequency of the computer, if the brush is used at this time, the time taken by the camera to take a screenshot from the computer is not accurate, resulting in the delay. The time is not accurate.
  • the composition of the image delay includes or at least includes at least: the time of image acquisition, the time of image encoding, the time of compressed data transmission, the time when the compressed data is parsed and decoded, and the time when the image data is displayed. Wait.
  • the image delay in the video surveillance field is defined as the time difference from the start of the camera to the display of the playback display (client/terminal, server, etc.) for the same frame (ie, image).
  • the display is completed on the display end.
  • the data receiving buffer and the decoded play buffer are performed, that is, the delay is caused in reality.
  • the factors are far more complicated than the factors in the above literature that only the message transmission delay is. Therefore, the method proposed in this document cannot detect the delay of the camera.
  • the purpose of the present application is to provide a method and system for detecting image delay, which overcomes the defect that the image delay can only be obtained by manual operation in the field of video surveillance, and solves the problem of automatically detecting image delay, and further, automatically detecting On the basis of this, it can overcome the defects of large errors caused by manual detection, and solve the problem of high-precision automatic detection of image delay.
  • the present application provides a method for detecting an image delay, including: displaying the image frame according to any image frame in the transmitted data stream and a data packet corresponding to image delay detection of the image frame. And parsing the data packet; obtaining the detected image according to a global time T of acquiring a reference of the image frame of the image frame obtained by parsing the data packet and a current display time T display of the image frame The image of the frame is delayed by T delay .
  • an image delay detecting system including an image acquiring device, an image processing device, and a communication line connecting the two; wherein the image processing device transmits the data stream according to the image capturing device via the communication line a data packet of any one of the image frames and the image delay detection corresponding to the image frame, displaying the image frame and parsing the data packet, and then collecting the image according to the image frame obtained by parsing the data packet a global time T of the reference of the frame and a current display time T display of the image frame, obtaining an image delay T delay of the detected image frame; and an image acquiring device according to the image frame sent by the image processing device The image is delayed in detecting the message, the image frame is acquired, and the global time T of the reference of the acquired image frame is determined.
  • the application also provides an application for performing the detection method of the image delay at runtime.
  • the application also provides a storage medium for storing an application for performing the detection method of the image delay.
  • the time data in the data related to the delay detection is determined based on the time of the last playback display end of the image, and the data related to the delay detection is encapsulated with the encoded data of the detected image frame.
  • the time of acquiring the image such as by taking a screen capture
  • the acquisition time is not affected by the frequency refresh of the image frame display end, the playback display end, and the acquisition acquisition system time.
  • FIG. 1-1, 1-2 are structural block diagrams of an embodiment of an image delay detecting system according to the present application.
  • FIG. 2 is a timing diagram of an embodiment of a system in accordance with the present application.
  • FIG. 3 is a flow chart of an embodiment of a method for detecting image delay according to the present application.
  • FIG. 4 is a flow chart of an embodiment of generating a data packet corresponding to an image frame in the image delay detecting method according to the present application.
  • FIG. 1-1 and 1-2 are block diagrams showing an embodiment of an image delay detecting system of the present application.
  • FIG. 1 An embodiment of the image delay detecting system of the present application shown in FIG. 1 will be described below.
  • the image delay detection system includes at least one or more image acquisition devices 1, one or more image processing devices 2, and the image acquisition device 1 and the image processing device 2 transmit images through a network.
  • the image acquisition device 1 acquires an image that is a real-time image that the camera captures (eg, captures) while monitoring.
  • the camera can be a network camera or a combination of an analog camera and an encoder.
  • the image processing device 2 may be any image that can be displayed by the image acquisition device 1 and transmitted through a network (for example, wired or wireless various communication networks).
  • the image processing apparatus 2 may be a client computer, various terminal devices capable of image display or playback, and/or various servers capable of image display or playback.
  • the image delay is defined as the time difference from the image acquisition device 1 to the completion of the display of the image processing device 2 for the same frame image.
  • the image acquisition device 1 acquires an image and transmits it to the image processing device 2 for display, the image acquisition device 1 starts acquiring one frame of image to the image processing device 2 and displays the time difference of the frame image as a delay for the frame image. .
  • FIG. 2 is a timing diagram of an embodiment of a system in accordance with the present application.
  • the image acquisition device 1 (eg, a camera) adds a communication interface that supports messages of a certain format.
  • the image processing apparatus 2 for example, a client computer also has a communication interface supporting messages of the format.
  • the communication interface and message can be existing communication interfaces and message formats known to support image data transmission.
  • the packet format includes, but is not limited to, an IP packet format, a TCP packet format, a UDP packet format, and the like.
  • the image acquisition device 1 and the image processing device 2 perform connection transmission image data through a communication network, and transmit and receive messages through the communication interface.
  • the image processing device 2 transmits a packet detecting the delay to the image acquisition device 1 according to the message format of the newly added communication interface of the image acquisition device 1, and the message includes: the ID of the current detection.
  • the number for example, GUID
  • the communication address of the image processing apparatus 2 (for example, if the communication system is Ethernet, the communication address of the image processing apparatus 2 may be the IP address of the apparatus), and the global time of the image processing apparatus 2 at this time is T d (year, month, and day) Hours, minutes and seconds).
  • T d year, month, and day
  • the GUID Globally Unique Indenfier
  • This uniqueness can be implemented by the GUID, but it is not limited to the implementation method of the GUID, that is, it can also be designed by itself.
  • the image acquisition device 1 After receiving the message of the detection delay sent by the image processing device 2, the image acquisition device 1 records the global time t d (year, month, day, minute, minute, and second millisecond) of the image acquisition device 1 at this time, and the current detection. The ID number, the communication address of the image processing apparatus 2, and the global time T d at which the detection is initiated. At this time, the image acquisition device 1 and the image processing device 2 implement a handshake. However, the image acquisition device 1 does not immediately return a message to the image processing device 2, but waits for the time at which the image acquisition device 1 itself starts acquiring the next frame image data.
  • t d year, month, day, minute, minute, and second millisecond
  • the image acquisition device 1 When the image acquisition device 1 starts the acquisition of the next frame image, the time t c (year, month, day, minute, minute, and second millisecond) at which the image acquisition is started is recorded.
  • the message is sent to the image processing apparatus 2 that initiates the detection, and the message includes the previously received detected ID number, that is, the image acquisition apparatus 1 processes the corresponding image.
  • the device 2 issues an acquisition notification message.
  • the acquired frame image is encoded for data transmission.
  • the image processing device 2 receives the acquisition notification message of the image acquired by the image acquisition device 1, and records the time T c (year, month, day, minute, minute, and second millisecond) at this time.
  • the global time T d of the message detecting device 2 may be received at the end of the image processing device 2 or at the end of the image capturing device 1 or at the intermediate end according to the image processing device 2, and the image acquiring device 1 receives the time. own global time t d, the image acquiring means detects a packet start delay after the acquisition time of the first frame image of the handshake t c 2 and the image processing apparatus 1 receives the image acquisition device for collecting the notification message frame image The time T c of the text time calculates a one-way delay T latency of communication existing between the image acquisition device 1 and the image processing device 2.
  • T latency ((T c - T d ) - (t c - t d ))/2.
  • the result of the formula (1) is very close to the result of the one-way delay measurement method of the document, but in actual operation, the magnitude of the one-way delay is relative to the value of the image delay defined in the present application. It is very small and can be ignored.
  • the global time at which the processing device 2 is based is T d +(t c -t d ).
  • the image acquisition device 1 acquires the previously received detected ID number and the global time T d +(t c -t d ) of the acquired image based on the time of the image processing device 2, and the acquired information.
  • the encoded data of the frame image is mixed by a certain encapsulation format to form a data packet for delay detection of the image of the frame image, and is transmitted or stored.
  • the package may be an existing image encoding data, ID data, time data, etc., and various existing package formats allow the packaging of private data under its standard framework.
  • the image processing device 2 can preview the video image of the image capturing device 1 using software capable of previewing the image capturing device 1, such as media playing software or the like. Therefore, when the image processing apparatus 2 receives the media stream data from the image acquisition apparatus 1 (data transmission and reception data as shown in FIG. 2), and performs parsing, decoding, and display, the data with the detection delay is parsed. data pack.
  • the data buffer when the transmitted data is received, the data buffer may be parsed and decoded, and there may be a display buffer when the display is ready for display after decoding.
  • the global time of the reference image of the captured image when the frame data image is parsed is collected from the data packet.
  • T T d +(t c -t d ), and the global time T display of the image processing apparatus 2 at this time is recorded.
  • the delay T delay of the frame image is calculated, for example, according to formula (2):
  • T delay T display - (T d + (t c - t d )).
  • the value of the delay Tdelay of the frame image may be fed back by the image processing apparatus 2 through the media playing software or other program software for statistical or display.
  • the image processing apparatus 2 can embed or transmit the delayed value to other program software through some software programs, perform statistics, storage, transmission (eg, to the corresponding image acquisition apparatus 1), or display delay, etc. .
  • the displayed image also displays the calculated delay Tdelay of the image.
  • the delay Tdela of the image can be counted multiple times, and the average value of the Tdelay can be obtained, thereby obtaining more statistical significance or more accurate. More accurate image delay detection value.
  • FIG. 3 is a flow chart of an embodiment of a method of detecting image delay according to the present application.
  • the implementation of the present application is further described below in conjunction with an embodiment of the image delay detecting method of the present application shown in FIG.
  • the method of the present application also corresponds to the processing implemented by the aforementioned system.
  • step S101 displaying the image frame and parsing the data packet according to any image frame in the transmitted data stream and a data packet corresponding to the image delay detection of the image frame.
  • the image processing device 2 obtains a media data stream from the image acquisition device 1 (eg, a camera) for parsing, decoding, and displaying, in the data stream.
  • An image frame has a corresponding data packet for detecting the delay of the image of the frame.
  • the acquisition time T is a global time (as described in the foregoing system) of the acquired image based on the time of the image processing device 2 when the image acquisition device 1 acquires the image frame.
  • the image processing apparatus 2 displays the image frame, its display time T display is recorded, and the data packet is parsed to obtain the acquisition time T of the image frame.
  • the acquisition time T is made such that the acquisition time T is not affected by the frequency refresh.
  • FIG. 4 is a flow chart of an embodiment of generating a data packet corresponding to an image frame in the image delay detecting method according to the present application.
  • step S201 according to the received message of the detected image delay, the identification information in the message, the time of the detection indicated by the message, and the time of recording the message delayed by the detection image are recorded. .
  • an image acquisition device eg, camera
  • the image processing apparatus e.g., client computer
  • the communication interface and message can be existing communication interfaces and message formats known to support image data transmission.
  • the packet format also includes, but is not limited to, an IP packet format, a TCP packet format, a UDP packet format, and the like.
  • the image acquisition device 1 and the image processing device 2 perform connection transmission image data through a communication network, and transmit and receive messages through the communication interface.
  • the image processing device 2 sends a message for detecting an image delay to the image acquisition device 1 according to the message format of the newly added communication interface of the image acquisition device 1.
  • the message includes: the ID of the current detection. No. (for example, GUID), the ID number is used to uniquely mark the image delay detection, that is, the identification information identifying the detection; the communication address of the image processing apparatus 2 (for example, if the communication system is Ethernet, the image processing apparatus
  • the communication address of 2 may be the IP address of the device, that is, the identification information of the device that sends the message requesting the detection of the image delay; the global time T d (year, month, day, minute, minute, and second millisecond) of the image processing device 2, That is, the time at which the detection of the device that issued the message begins.
  • the image acquisition device 1 records various identification information indicated in the message, the global time of the sender, such as the image processing device 2, and the time at which the message was received by itself.
  • the acquisition time t c of the image frame may be recorded according to the time t d of the message delayed by the detection image; wherein the acquisition time t c of the image frame is later than the received delay of the detection image. Time t d .
  • the image acquisition device 1 records the acquisition time t c of the image frame based on the time t d of the message delayed by the detected image.
  • step S202 according to the packet of the detected image delay, when the image frame is started to be acquired, the time for starting to acquire the image frame is recorded, and the time when the image frame is started to be collected is sent according to the identification information to represent the collected image.
  • the acquisition notification message at the beginning of the frame.
  • the report that the detection image is delayed may be received.
  • the time of the text, the time when the image frame is started to be collected, and the time when the acquisition notification message is received analyzes the one-way delay in the communication to determine whether the size is negligible.
  • the time t c (year, month, day, minute, minute, and second millisecond) at which the image is started to be acquired is recorded, and at the same time, according to the recorded communication address of the image processing device 2 And sending the message to the image processing apparatus 2 that initiates the detection, and the message includes the ID number of the previously received detection, that is, the image acquisition apparatus 1 sends an acquisition notification message to the corresponding image processing apparatus 2.
  • the acquired frame image is encoded for data transmission.
  • the image processing apparatus 2 can receive the acquisition notification message indicating the start of the acquisition image frame and record the time T c when the reception notification message is received.
  • the image acquisition apparatus 1 receives own global time detection delay times of the packets acquired t d
  • the image detecting transmission 2 according to the image processing apparatus latency packets apparatus 1 after the handshake starts acquisition time of the image t c
  • the image processing apparatus 2 receives the image acquisition apparatus 1 acquired time acquisition notification message of the frame image T c, calculating the image acquiring apparatus and the image processing apparatus 12 of the
  • the one-way delay T latency ((T c - T d ) - (t c - t d )) / 2 of the communication that exists.
  • the T latency results calculated by the algorithm in the literature of "a one-way delay measurement method" are very close, but in practice, the size of the one-way delay is relative to the image delay defined in the present application. The value is very small and can be ignored.
  • step S203 according to the time detected by the image detecting packets delay T d, the detection of the received image packet delay time t d, the start image frame acquisition time t c, benchmarking The global time T.
  • the global time of the reference can also be determined by combining the one-way communication delay obtained by the analysis.
  • the global time at which the acquisition time T of the image acquisition device 1 is constructed with the time of the image processing device 2 is not affected by the brushing of the image processing device 2, so that the obtained image acquisition device 1 Image delay is more accurate.
  • T T d + (t c - t d ) + T latency .
  • T T d + (t c - t d ).
  • a private data packet is formed according to one of the global time T of the reference and the identification information in the packet delayed by the detection image, and is encapsulated with the collected encoded data of the image frame. Installed to detect an image delay of the image frame when the image frame is displayed.
  • the identifier information in the packet includes a corresponding detected ID number, an address on the side of the sent packet, and the like.
  • the identification information encapsulated in the data packet here is one of the ID numbers.
  • the global time T of the reference and the identification information in the message delayed by the detection image are used as the private data of the collected image frame, and the encoded data is formed by the image format after the image frame is formed. For transfer or storage. One way, it can be transmitted to the end of the message that sends the detected image delay. For example, when playing a media data stream, the image stream has the image frame, and the private data parsed at the same time as the image frame is displayed, and the current display time of the frame is recorded, thereby calculating the delay of the image frame.
  • One of the identification information in the message detecting the image delay indicates an identification information in the message in which the image delay is detected.
  • the image acquisition device 1 sets the ID number of the previously received delay detection and the global time T d +(t c -t d ) of the acquired image based on the time of the image processing device 2
  • the two pieces of information, and the encoded data of the captured frame image are mixed by a certain encapsulation format to form a data packet for delay detection of the image of the frame image, for transmission or storage.
  • the package may be an existing image encoding data, ID data, time data, etc., and various existing package formats allow the packaging of private data under its standard framework.
  • step S102 obtaining the detected image of the image frame according to the global time T of the reference of the image frame of the image frame obtained by parsing the data packet and the current display time T display of the image frame. Delay T delay .
  • the acquisition time T in the data packet corresponding to the parsed image frame is compared with the current time T display of the image processing device 2 displaying the image frame, and the detected image frame is obtained.
  • the image delay T delay T display - (T d + (t c - t d )).
  • the image processing apparatus 2 can preview the video image of the image acquisition apparatus 1 using software capable of previewing the image acquisition apparatus 1, such as media playback software or the like. Therefore, when the image processing apparatus 2 receives the media stream data from the image acquisition apparatus 1 (data transmission and reception data as shown in FIG. 2), and performs parsing, decoding, and display, the data with the detection delay is parsed. data pack.
  • the data buffer when the transmitted data is received, the data buffer may be parsed and decoded, and there may be a display buffer when the display is ready for display after decoding.
  • the global time T d of the captured image when the frame data image is parsed from the data packet for acquisition is performed. + (t c -t d) i.e. global reference time T, the overall recording time is displayed when the image processing apparatus 2 corresponding to the image frame T display.
  • the image processing device 2 records the time T display displayed on the image processing device 2, and displays the difference between the time T display of the image frame and the acquisition time T of the image frame as the detection.
  • the value of the delay Tdelay of the frame image may be fed back by the image processing apparatus 2 through the media playing software or other program software for statistical or display.
  • the image processing apparatus 2 can embed or transmit the delayed value to other program software through some software programs, perform statistics, storage, transmission (eg, to the corresponding image acquisition apparatus 1), or display delay, etc. .
  • the displayed image also displays the calculated delay Tdelay of the image.
  • step S103 repeating the display image frames of steps S101 and S102 and detecting the image delay of the image frame according to the parsing of the data packets of the image frame, and detecting the image delay of one or more image frames, and then counting The analysis results in the average image delay.
  • the foregoing steps may be repeated for the plurality of image frames, and the average value of the image delays of the obtained plurality of image frames is used as the image delay of the image acquiring device.
  • the delay detection is identified by the set delay detection data, and the automatic delay detection can be performed on the playback display end, that is, the image processing device 2, and the acquisition time T is based on the image for detecting and image acquisition requirements.
  • the time of the processing device 2 is not affected by the brushing of the image processing device 2 itself, so that the resulting image delay is more accurate.
  • the image capturing device 1 is a camera 3, wherein the camera may be a network camera or a combination of a camera and an encoder, and the image processing device 2 is a client computer 4.
  • the two are connected by a communication network.
  • This application example describes the process from the start of the delay detection to the display of the image and the calculation of the delay.
  • Step S1 It is a handshake process, that is, the client computer 4 sends a delay detection message to the camera 3 at the time T d thereon, and the delay detection message includes the time T d ;
  • the ID of the delay detection is further included to uniquely identify the delay detection and the communication address of the client computer 4.
  • the camera 3 receives the delay detection message sent by the client computer 4 at the time t d thereon, and records the time T d when the client computer 4 initiates the delay detection, or even the ID of the delay detection, the client.
  • the delay detection message is the same as the message for detecting the delay.
  • Step S2 The camera 3 collects the image frame, and records the time t c on which the image is collected, and sends an image collection notification to the client computer 4 according to the recorded communication address of the client computer 4, and the client computer 4 is The time T c thereon receives the image collection notification;
  • the above image collection notification is the same as the above-mentioned collection notification message.
  • Step S3 The camera 3 performs image acquisition, and encodes the delayed detection data, such as the image acquisition time T and the corresponding image frame, and the delayed detection data may further include the communication address of the client computer 4, and the delay Detected ID;
  • Step S4 the encoded image frame is transmitted from the camera 3 to the client computer 4;
  • T latency ((T c - T d ) - (t c - t d ))/2.
  • the value of T latency is small and negligible, so it can be determined that the acquisition time T is T d +(t c -t d ), so that the acquisition time T is not swiped by the client computer 4
  • the effect of the image of the resulting camera 3 is more accurate.
  • steps S5 and S6 have a certain buffer, such as data buffer S51, display buffer S61, etc., in receiving data into the analysis decoded data and analyzing the decoded data into the display image.
  • a certain buffer such as data buffer S51, display buffer S61, etc.
  • Step S7 The decoded image frame is displayed on the client computer 4, and the display time T display on the client computer 4 is recorded, and the time delay of the camera is obtained by the time difference between the T display and the acquisition time T.
  • the time delay detection data is set in the acquired image frame, and the time for acquiring the image frame is based on the time of the image processing device, so that there is no need to manually operate the time of acquiring the image, such as by taking a screen capture, etc.
  • the acquisition time is not affected by the frequency refresh of the image processing device, and there is no error in the delay detection method and system provided by the present application.
  • the camera repeats the above steps for multiple image frames, and the average of the image delays of the obtained multiple image frames is used as the image delay of the camera, so that the delay of the camera can be further improved. To be accurate.
  • the embodiment of the present application provides an application program for performing the image delay detection method provided by the embodiment of the present application at runtime.
  • the method for detecting image delay includes:
  • the global time T of the reference for collecting the image frame may include:
  • the time t c at which the image frame is started to be acquired is recorded according to the packet of the detected image delay, and the time t c at which the image frame is started to be acquired is sent according to the identification information, and the collection notification message indicating the start of the collected image frame is sent;
  • the global time T of the reference is determined according to the time T d of the detection in the message detecting the delayed image, the time t d of the message receiving the detected image delay, and the acquisition time t c of the image frame.
  • the global time T of the reference is T d +(t c -t d ).
  • the global time T of the reference may further include:
  • the one-way delay T latency is determined according to the time T d of the detection, the time t d of the message receiving the detected image delay, the acquisition time t c of the image frame, and the time T c of receiving the image frame. .
  • the global time T of the reference is a one-way delay T latency + T d + (t c -t d ),among them,
  • T latency ((T c - T d ) - (t c - t d ))/2.
  • the global time T of the reference of the image frame collected by the image frame obtained by parsing the data packet is And the current display time T display of the image frame, and the obtained image delay T delay of the image frame is obtained, which may include:
  • the global time T of the reference is T d +(t c -t d )+T latency or T is T d +(t c -t d );
  • T latency is a one-way delay in communication transmission.
  • the method for detecting an image delay performed by the application program may further include:
  • the embodiment of the present application provides a storage medium for storing an application for performing an image delay detection method provided by an embodiment of the present application.
  • the method for detecting image delay may include:
  • the global time T of the reference for collecting the image frame may include:
  • the time t c at which the image frame is started to be acquired is recorded according to the packet of the detected image delay, and the time t c at which the image frame is started to be collected is sent according to the identification information, and the collection notification message indicating the start of the collected image frame is sent;
  • the global time T of the reference is determined according to the time T d of the detection in the message detecting the delayed image, the time t d of the message receiving the detected image delay, and the acquisition time t c of the image frame.
  • the global time T of the reference is T d +(t c ⁇ t d ).
  • the global time T of the reference may further include:
  • the one-way delay T latency is determined according to the time T d of the detection, the time t d of the message receiving the detected image delay, the acquisition time t c of the image frame, and the time T c of receiving the image frame. .
  • the global time T of the reference is a one-way delay T latency + T d + (t c -t d ), where,
  • T latency ((T c - T d ) - (t c - t d ))/2.
  • the reference to the image frame obtained by parsing the data packet is used to collect a reference of the image frame.
  • the global time T and the current display time T display of the image frame are obtained, and the detected image delay T delay of the image frame is obtained, which may include:
  • the global time T of the reference is T d +(t c -t d )+T latency or T is T d +(t c -t d );
  • T latency is a one-way delay in communication transmission.
  • the method for detecting an image delay performed by the application stored by the storage medium may further include:
  • the concepts defining the same letter are described as the same thing, and the detections mentioned in the present invention are all delay detection, and the images mentioned in the present invention.
  • the delay is the image delay.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本申请公开了一种图像延时的检测方法和系统，所述方法包括：根据传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包；根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay。本申请通过在图像帧中标识延时检测数据，并且采集时间以显示装置的时间为基准，这样能够提供无需人工操作，而自动、准确的测量方法和系统，对摄像机的延时进行精确的测量。

Description

一种图像延迟的检测方法和系统
本申请要求于2015年4月30日提交中国专利局、申请号为201510218171.6发明名称为“一种图像延迟的检测方法和系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及视频监控领域，特别涉及一种视频监控中图像延时的检测方法和系统。
背景技术
在视频监控领域中，往往会涉及到摄像机对图像的采集、处理(如压缩、编码等)、信号的传输，播放显示端对图像的解析(如解码、解压缩等)、显示等等。然而由于设备、传输线路(如网络)的不稳定等问题，导致采集的图像在最后显示时出现延时，即非完全同步实时采集即显示。
图像延时是视频监控领域中的重要参数，图像延时越小，表明视频监控中摄像机的传输、后端处理等整个视频监控性能越优，图像延时能够体现图像的实时显示情况。因而，如何准确地测量(或检测)视频监控环境中的图像延时显得尤为重要，其有助于进一步改进视频监控环境，尽可能地缩短图像延时。
目前常用的测量摄像机延时(下面称为图像延时)的方法是：
首先，在电脑上运行计时器(其精度一般为毫秒)，架设摄像机对准电脑显示器上的计时器界面。其次，在运行计时器的电脑上，运行可预览摄像机的客户端软件。最后，对电脑进行截屏操作，根据摄像机的截屏画面，计算计时器的时间与客户端预览画面的时间的差值，该差值即为视频监控领域一般意义上的图像延时。
然而,该方法最大的缺点在于：需要人工手动操作进行截屏，操作繁琐、费时，而且最后进行的截屏步骤易受电脑屏幕刷新率的影响，会产生高达～10ms量级的误差。比如,刷新率为60的显示器，在某一时刻，计时器上的数字本应该更新，而此时摄像机正在进行截屏，又由于屏幕刷新的问题，需要等待16.6ms以后才执行刷新，这样就造成了16.6ms的误差，而该误差又使 得摄像机延迟产生更大误差。
另外，对于一帧图像数据，在采集、编码压缩和传输之后，将该帧图像进行播放显示。通常情况下，都会进行数据接收缓冲以及解码后的播放缓冲，在数据和播放缓冲队列中找到特定的一帧数据(该帧数据记录了当时的采集时间)来计算延迟就显得尤为重要，而且要尽可能使该参数精确。然而摄像机和作为播放显示端的电脑上都有其各自的系统时间，由于电脑的显示频率问题，此时若进行刷时，也会使得摄像机从电脑中截屏所获取的时间不准，导致得到的延时不准确。
因此，如何准确地、自动地测量出摄像机的延时是本领域技术人员急需要解决的问题。
另外，现有技术“一种单向延迟的测量方法”的文献中，提出了从源端点发送报文给目标端点，然后目标端点立即返回报文给源端点的方案，计算报文在两个端点之间的往返时间，然后除以2，获得单向的延迟时间。而该方法中仅仅考虑了报文数据传输的延迟，除去报文中用于记录源、目的端点地址信息和时间信息之外，数据包携带的数据格式和内容对结果无任何影响，两个端点之间的报文发送、接收都是同步进行，不需要在端点进行等待。本领域技术人员知晓，图像延时的组成至少包括或者说影响因素至少包括：图像采集的时间、图像编码的时间、压缩数据传输的时间、压缩数据进行解析解码的时间、图像数据进行显示的时间等。视频监控领域的图像延时定义为对于同一帧画面(即图像)，从摄像机端开始采集到播放显示端(客户端/终端、服务器端等)显示完毕的时间差。而对于摄像机中一帧画面的数据，在采集、编码压缩和传输之后，在播放显示端显示完毕，一般情况下，都会进行数据接收缓冲以及解码后的播放缓冲，也就是说现实中导致延时的因素远比上述文献中只有报文传输延时的因素要复杂，因此该文献中提出的方法无法对摄像机的延时进行检测。
因此，有必要提供一种无需人工操作，能够自动、进而更准确的测量图像延时的方法和系统。
发明内容
本申请的目的是提供一种图像延迟的检测方法以及系统，克服现有视频监控领域中只能依赖人工操作获取图像延时的缺陷，解决自动检测获得图像延时的问题，进而，在自动检测的基础上还可以克服人工检测产生较大误差的缺陷，解决高精度自动检测图像延时的问题。
为解决上述问题，本申请一方面提供一种图像延迟的检测方法，包括：根据传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包；根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay。
本申请的另一方面提供一种图像延迟的检测系统，包括图像获取装置，图像处理装置，和连接二者的通信线路；其中，图像处理装置，根据图像获取装置经通信线路传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包，然后，根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay；图像获取装置，根据所述图像处理装置发送的对图像帧的图像延时检测的报文，采集图像帧，并确定采集的所述图像帧的基准的全局时间T。
本申请的还提供一种应用程序，所述应用程序用于在运行时执行所述图像延时的检测方法。
本申请的还提供一种存储介质，所述存储介质用于存储应用程序，所述应用程序用于执行所述图像延时的检测方法。
根据本申请的方案，以图像最后的播放显示端的时间为基准确定该延时检测相关的数据中的时间数据，并将与延时检测相关的数据与被检测的图像帧的编码数据封装在一起，这样，既无需人工来操作如通过截屏等方式获取采集图像的时间，也不会使得采集时间受图像帧播放显示端的频率刷新、播放显示端和采集获取端系统时间不同等的影响，本申请所提供的方法和系统检测后得到的延时结果不存在误差，使得所对图像延时的更精确。
附图说明
图1-1、1-2是根据本申请的图像延时的检测系统的一实施例的结构框图；
图2是根据本申请的系统的一实施例的时序图；
图3是根据本申请的图像延时的检测方法的一实施例的流程图；
图4是根据本申请的图像延时的检测方法中生成图像帧对应的数据包的一实施例流程图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚明了，下面结合具体实施方式并参照附图，对本申请进一步详细说明。应该理解，这些描述只是示例性的，而并非要限制本申请的范围。此外，在以下说明中，省略了对公知结构和技术的描述，以避免不必要地混淆本申请的概念。
图1-1、1-2是本申请的图像延时的检测系统的一实施例的结构框图。
下面结合图1所示本申请的图像延时的检测系统的实施例进行说明。
其中，该图像延时的检测系统中至少包括：一个或多个图像获取装置1，一个或多个图像处理装置2，图像获取装置1和图像处理装置2通过网络来传输图像。
在一个实施方式中，该图像获取装置1(例如：视频监控领域中的摄像机)，其获取的图像是摄像机在监控时采集(如：拍摄)的实时图像。进一步，该摄像机可以是网络摄像机，或者是模拟摄像机与编码器的组合。下面将以网络摄像机为例进行描述。而图像处理装置2可以是任意的可以显示图像获取装置1获取并通过网络(例如：有线或无线的各种通信网络)传输来的图像。图像处理装置2可以是客户端电脑、各种能进行图像显示或播放的终端设备和/或各种能进行图像显示或播放的服务器等。其中，该图像延时定义为对于同一帧图像，从图像获取装置1开始采集到图像处理装置2显示完毕的时间差。
进一步，图像获取装置1获取图像并传输至图像处理装置2中显示时，从图像获取装置1开始采集一帧图像到图像处理装置2上显示完毕该帧图像的时间差作为对于该帧图像的延时。
图2是根据本申请的系统的一实施例的时序图。
下面结合图2所示的本申请的系统检测延时的一实施例的时序图进行具体的说明。
(A)图像获取装置1(如：摄像机)增加通信接口，所述通信接口支持一定格式的报文。而同时，图像处理装置2(如：客户端电脑)也具有支持该格式的报文的通信接口。通信接口和报文可以为现有的已知可支持图像数据传输的通信接口和报文格式。所述报文格式包括但不限于IP报文格式、TCP报文格式、UDP报文格式等等。图像获取装置1和图像处理装置2通过通信网络进行连接传输图像数据，通过该通信接口发送和接收报文。
(B)图像处理装置2根据图像获取装置1的该新增的通信接口的报文格式，向图像获取装置1发送检测延时的报文，该报文中，包括了：本次检测的ID号(例如GUID)，该ID号用以唯一标记此次图像延时检测。图像处理装置2的通信地址(例如：若通信系统是以太网，则图像处理装置2的通信地址可以是该装置的IP地址)，图像处理装置2此时的全局时间为Td(年月日时分秒毫秒)。这里，GUID(Globally Unique Indenfier，全局唯一标识符)唯一表示本次检测的ID号。这种唯一性可以用GUID的实现方法，但不限于GUID的实现方法，即也可以自行设计一种方法来实现。
(C)图像获取装置1接收到图像处理装置2发送来的该检测延时的报文后，记录此时图像获取装置1的全局时间td(年月日时分秒毫秒)、该本次检测的ID号、图像处理装置2的通信地址及其发起检测时的全局时间Td。此时，图像获取装置1与图像处理装置2实现握手。但图像获取装置1并不立即返回报文给图像处理装置2，而是等待图像获取装置1自身开始采集下一帧图像数据的时刻。
(D)当图像获取装置1开始该下一帧图像的采集时，记录开始采集图像的时间tc(年月日时分秒毫秒)。同时，根据记录的图像处理装置2的通信地址，发送报文给发起检测的该图像处理装置2，该报文中包括之前接收到的检测的ID号，即图像获取装置1向对应的图像处理装置2发出采集通知报文。并且，对采集的该帧图像进行编码以便进行数据传输。而该图像处理装置2接收到图像获取装置1采集图像的该采集通知报文后，记录此时的时间Tc(年月日时分秒毫秒)。
(E)可以在图像处理装置2一端或在图像获取装置1一端或者一中间端，根据图像处理装置2发送检测延时的报文时自身的全局时间Td、图像获取装置1收到该次检测延时的报文时自身的全局时间td、图像获取装置1在握手后开始采集第一帧图像的时间tc以及图像处理装置2接收到图像获取装置1采集该帧图像的采集通知报文时的时间Tc，计算图像获取装置1与图像处理装置2之间存在的通信的单向延时Tlatency。
例如，通过公式(1)计算：
Tlatency＝((Tc-Td)-(tc-td))/2。      (1)
例如，通过“一种单向延迟的测量方法”的文献中的算法计算得出。
该公式(1)得出的结果与该文献的单向延迟的测量方法得出的结果非常接近，但在实际操作中，该单向延迟的大小相对于本申请中定义的图像延时的值来说非常小，可以忽略不计。
(F)图像获取装置1在采集图像的时候，以图像处理装置2的时间为基准的采集图像的全局时间Td+(tc-td)+Tlatency，忽略掉Tlatency即对应的图像处理装置2的时间为基准的全局时间为Td+(tc-td)。图像获取装置1将之前收到的检测的ID号、与以该图像处理装置2的时间为基准的采集图像的全局时间Td+(tc-td)这两个信息，以及采集到的该帧图像进行编码后的编码数据，通过一定的封装格式混合起来形成对该帧图像的图像延时检测的数据包，进行传输或存储。该封装可以是现有的图像编码数据、ID数据、时间数据等的封装方式，各种已有的封装格式都允许在其标准框架之下的私有数据的封装。
(G)其中，图像处理装置2可以使用能预览图像获取装置1的软件，如媒体播放软件等，预览图像获取装置1的视频图像。因而，当图像处理装置2接收到来自图像获取装置1的媒体流数据(如图2所示数据传输、接收数据)，并进行解析、解码、显示的同时，解析带有检测延时的数据的数据包。
其中，在接收到传输来的数据时，还可能存在数据缓冲后才进行解析、解码，解码完后准备显示时还可能存在显示缓冲。
而在显示完一帧图像后，如果该帧图像带有对应的延时检测的数据的数据包，则从该数据包中解析出该帧数据图像进行采集时的该采集图像的基准的全局时间T＝Td+(tc-td)，记录此时图像处理装置2的全局时间Tdisplay。该帧 图像的延时Tdelay例如根据公式(2)计算为：
Tdelay＝Tdisplay-(Td+(tc-td))。      (2)
并且，还可以由该图像处理装置2将该帧图像的延时Tdelay的值通过该媒体播放软件、或其他程序软件反馈以统计或显示。具体地，该图像处理装置2可以通过某些软件程序将该延时的值嵌入或传送给其他程序软件，进行统计、存储、传送(如传给相应的图像获取装置1)或者显示延时等。例如图2所示，一边显示图像还同时显示计算出的该图像的延时Tdelay。
(H)进一步，若重复前面的时序(A)-(G)，可以统计多次的图像的延时Tdelay，进而获得该Tdelay的平均值，从而得到更具有统计意义或者说更精确、更准确的图像延时检测值。
图3是根据本申请的图像延时的检测方法的一实施例的流程图。
下面进一步结合图3所示本申请的图像延时的检测方法的一实施例，描述本申请的实现。本申请的方法与前述系统实现的处理也相对应。
在步骤S101：根据传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包。
在一个实施例中，可以是当图像处理装置2(如：客户端电脑)获得来自图像获取装置1(如：摄像机)的媒体数据流，进行解析、解码和显示过程中，该数据流中的一图像帧存在对应的检测该帧图像延时的数据包。该数据包中包括相关的延时检测数据，例如包括：该图像帧的采集时间T＝Td+(tc-td)。该采集时间T是该图像获取装置1在采集该图像帧时，以该图像处理装置2的时间为基准的采集图像的全局时间(如前述系统的描述)。在该图像处理装置2显示该图像帧时，记录其显示时间Tdisplay，同时解析该数据包获得该图像帧的采集时间T。
由于该时间T不是采用图像获取装置1上的时间，而是以图像处理装置2上的时间为基准来表征采集时间T，使得采集时间T不受频率刷新的影响。
图4是根据本申请的图像延时的检测方法中生成图像帧对应的数据包的一实施例流程图。
下面结合图4所示本申请的图像延时的检测方法中生成图像帧对应的数据包的一实施例流程图，说明数据包中，得到所述采集时间T的一个实施方 式。
在步骤S201，根据接收的检测图像延时的报文，记录所述报文中的标识信息和该报文指示的此次检测的时间、以及记录接收到该检测图像延时的报文的时间。
在一个实施方式中，图像获取装置(如：摄像机)1增加通信接口，所述通信接口支持一定格式的报文。而同时，图像处理装置(如：客户端电脑)2也具有支持该格式的报文的通信接口。通信接口和报文可以为现有的已知可支持图像数据传输的通信接口和报文格式。所述报文格式同样包括但不限于IP报文格式、TCP报文格式、UDP报文格式等等。图像获取装置1和图像处理装置2通过通信网络进行连接传输图像数据，通过该通信接口发送和接收报文。
其中，图像处理装置2根据图像获取装置1的该新增的通信接口的报文格式，向图像获取装置1发送检测图像延时的报文，该报文中，包括了：本次检测的ID号(例如GUID)，该ID号用以唯一标记此次图像延时检测，即标识此次检测的标识信息；图像处理装置2的通信地址(例如：若通信系统是以太网，则图像处理装置2的通信地址可以是该装置的IP地址)，即标识发送该报文要求检测图像延时的装置的标识信息；图像处理装置2此时的全局时间Td(年月日时分秒毫秒)，即发出该报文的该装置的此次检测开始的时间。并且，图像获取装置1收到该报文后，记录下该报文中指示的各种标识信息、发送方如图像处理装置2当时的全局时间，还记录下自己接收该报文的时间。
这样，可以根据该检测图像延时的报文的时间td为基准，记录图像帧的采集时间tc；其中，图像帧的采集时间tc晚于接收到的该检测图像延时的报文的时间td。
具体地，图像获取装置1根据该检测图像延时的报文的时间td为基准，记录图像帧的采集时间tc。
在步骤S202，根据该检测图像延时的报文，在开始采集图像帧时，记录所述开始采集图像帧的时间，并将所述开始采集图像帧的时间根据所述标识信息发送表示采集图像帧开始的采集通知报文。
进一步，还可以依据所述此次检测的时间、接收到该检测图像延时的报 文的时间、开始采集图像帧的时间、接收到该采集通知报文的时间分析通信中的单向延时，以确定其大小是否可以忽略不计。
在一个实施方式中，当图像获取装置1开始该下一帧图像的采集时，记录开始采集图像的时间tc(年月日时分秒毫秒)，同时，根据记录的图像处理装置2的通信地址，发送报文给发起检测的该图像处理装置2，该报文中包括之前接收到的检测的ID号，即图像获取装置1向对应的图像处理装置2发出采集通知报文。并且，对采集的该帧图像进行编码以便进行数据传输。由此，图像处理装置2可以收到表示采集图像帧开始的该采集通知报文并在收到该采集通知报文后记录收到时的时间Tc。
进一步，可以分析出，根据图像处理装置2发送检测延时的报文时自身的全局时间Td、图像获取装置1收到该次检测延时的报文时自身的全局时间td、图像获取装置1在握手后开始采集图像的时间tc、以及图像处理装置2接收到图像获取装置1采集该帧图像的采集通知报文时的时间Tc，计算图像获取装置1与图像处理装置2之间存在的通信的单向延时Tlatency＝((Tc-Td)-(tc-td))/2。而同样由“一种单向延迟的测量方法”的文献中的算法计算得出的Tlatency结果非常接近，但在实际操作中，该单向延迟的大小相对于本申请中定义的图像延时的值来说非常小，可以忽略不计。
在步骤S203，根据所述检测图像延时的报文中的此次检测的时间Td、接收到该检测图像延时的报文的时间td、开始采集图像帧的时间tc，确定基准的全局时间T。
进一步，还可以结合分析得到的通信单向延时来确定基准的全局时间。
在一个实施方式中，这样图像获取装置1的采集时间T以图像处理装置2的时间构建基准的全局时间，不会受图像处理装置2的刷屏的影响，使得所得到的图像获取装置1的图像延迟更加准确。
例如：T＝Td+(tc-td)+Tlatency。
由于Tlatency值很小可以忽略不计，优化后的基准全局时间T可以是T＝Td+(tc-td)。
在步骤S204，根据所述基准的全局时间T、所述检测图像延时的报文中的标识信息之一，形成私有数据包，与采集到的该图像帧的编码数据一起封 装，以在显示该图像帧时检测到该图像帧的图像延时。
其中，该报文中的标识信息包括对应的检测的ID号、发送报文一侧的地址等。而此处一并封装到数据包中的标识信息则是其中之一的该ID号。
其中，所述基准的全局时间T、所述检测图像延时的报文中的标识信息之一，作为采集的该图像帧的私有数据，在图像帧形成编码数据后，通过一定封装格式混合起来，以便进行传输或存储。一种方式，可以传输到发送检测图像延时的报文的一端显示。如播放媒体数据流时，该数据流中有该图像帧，显示该图像帧的同时解析得到的该私有数据，并记录此帧当前显示时间，从而计算出该图像帧的延时。
检测图像延时的报文中的标识信息之一表示检测图像延时的报文中的一个标识信息。
在一个实施方式中，图像获取装置1将之前收到的延时检测的ID号、与以该图像处理装置2的时间为基准的采集图像的全局时间Td+(tc-td)这两个信息，以及采集到的该帧图像进行编码后的编码数据，通过一定的封装格式混合起来形成对该帧图像的图像延时检测的数据包，进行传输或存储。该封装可以是现有的图像编码数据、ID数据、时间数据等的封装方式，各种已有的封装格式都允许在其标准框架之下的私有数据的封装。
在步骤S102：根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay。
在一个实施方式中，根据解析后的该图像帧对应的该数据包中的采集时间T与当前该图像处理装置2在显示该图像帧的时间Tdisplay进行计算，获得检测到的该图像帧的图像延时Tdelay＝Tdisplay-(Td+(tc-td))。
具体如：图像处理装置2可以使用能预览图像获取装置1的软件，如媒体播放软件等，预览图像获取装置1的视频图像。因而，当图像处理装置2接收到来自图像获取装置1的媒体流数据(如图2所示数据传输、接收数据)，并进行解析、解码、显示的同时，解析带有检测延时的数据的数据包。
其中，在接收到传输来的数据时，还可能存在数据缓冲后才进行解析、解码，解码完后准备显示时还可能存在显示缓冲。
而在显示完一帧图像后，如果该帧图像带有对应的延时检测的数据的数据包，则从该数据包中解析出该帧数据图像进行采集时的该采集图像的全局时间Td+(tc-td)即基准的全局时间T，记录此时显示对应的图像帧时的图像处理装置2的全局时间Tdisplay。
因而，所述图像处理装置2记录所述图像帧在图像处理装置2上显示的时间Tdisplay，显示所述图像帧的时间Tdisplay与所述图像帧的采集时间T的差值为所述检测到的对应该图像帧的图像延时。该帧图像的延时Tdelay为：Tdelay＝Tdisplay-(Td+(tc-td))。
并且，还可以由该图像处理装置2将该帧图像的延时Tdelay的值通过该媒体播放软件、或其他程序软件反馈以统计或显示。具体地，该图像处理装置2可以通过某些软件程序将该延时的值嵌入或传送给其他程序软件，进行统计、存储、传送(如传给相应的图像获取装置1)或者显示延时等。例如图2所示，一边显示图像还同时显示计算出的该图像的延时Tdelay。
在步骤S103：重复步骤S101和步骤S102的显示图像帧并根据图像帧的数据包的解析，检测得到图像帧的图像延时，并对一个或多个图像帧的图像延时进行检测后，统计分析得到平均图像延时的检测结果。
其中，可以对多个图像帧重复进行前面的步骤，将得到的多个图像帧的图像延时的平均值作为所述图像获取装置的图像延时。
这样既通过设定的延时检测数据来标识延时检测，能够在播放显示端即图像处理装置2一端执行自动的延时检测，同时，采集时间T的依据是发出检测和图像采集要求的图像处理装置2的时间，则不会受该图像处理装置2本身的刷屏的影响，使得所得到的图像延时更加准确。
下面结合图1-2、2描述一个本申请的方案的具体应用实例。此处，图像获取装置1是摄像机3，其中该摄像机可以是网络摄像机，也可以是摄像机和编码器的组合，图像处理装置2是客户端电脑4。二者通过通信网络相连。该应用实例描述了从开始延时检测到显示图像，并计算延时的过程。
步骤S1：其为握手的过程，即客户端电脑4在其上的时刻Td发送延时检测消息至摄像机3，延时检测消息中包括时刻Td；
进一步，还包括此次延时检测的ID，用以唯一标识该次延时检测、客户 端电脑4的通信地址。摄像机3在其上的时刻td接收到客户端电脑4发送的延时检测消息，并且要记录客户端电脑4发起延时检测时的时间Td、甚至该次延时检测的ID、客户端电脑4的通信地址。
这里，所说的延时检测消息与上述检测延时的报文相同。
步骤S2：摄像机3进行采集图像帧，并且记录其上的开始采集图像的时间tc，根据记录的客户端电脑4的通信地址，将图像采集通知发送给客户端电脑4，客户端电脑4在其上的时刻Tc接收到图像采集通知；
这里，上述图像采集通知与上述采集通知报文相同。
步骤S3：摄像机3进行图像采集，并且将延时检测数据如图像采集时间T等数据与采集的相应的图像帧进行编码，延时检测数据中还可以包括客户端电脑4的通信地址，延时检测的ID；
步骤S4:编码后的图像帧从摄像机3传输至客户端电脑4；
步骤S5和步骤S6分别为客户端电脑4上的接收图像帧，解析解码图像帧，得到其中的采集时间T；其中采集时间T为单向延时Tlatency与Td+(tc-td)这一时间之和，其中Tlatency＝((Tc-Td)-(tc-td))/2。但是在本申请中，Tlatency的值很小，可以忽略不计，因此可以确定采集时间T为Td+(tc-td),这样,采集时间T不会受客户端电脑4的刷屏的影响，使得所得到的摄像机3的图像延时更加准确。
并且，步骤S5、S6在接收数据到解析解码数据中和解析解码数据到显示图像中，有一定的缓冲，如数据缓冲S51、显示缓冲S61等。
步骤S7：客户端电脑4上显示出解码后的图像帧，并且记录其上的显示时刻Tdisplay，并通过Tdisplay与采集时间T的时间差获得摄像机的延时。
根据本申请，将延时检测数据设置在采集的图像帧中，并且采集图像帧的时间是基于图像处理装置的时间的，这样既无需人工来操作如通过截屏等方式获取采集图像的时间，也不会使得采集时间受图像处理装置频率刷新的影响，本申请所提供的延时检测方法和系统不存在误差。
同样的，在另外的实施例中，摄像机对多个图像帧重复进行上述步骤，将得到的多个图像帧的图像延时的平均值作为摄像机的图像延时，这样可以使得摄像机的延时更为准确。
本申请实施例提供了一种应用程序，该应用程序用于在运行时执行本申请实施例提供的图像延时的检测方法。其中，图像延时的检测方法，包括：
根据传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包；
根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay。
本申请的一种具体实现方式中，上述应用程序运行时所执行的图像延时的检测方法中，所述采集所述图像帧的基准的全局时间T，可以包括：
根据接收的检测图像延时的报文，记录所述报文中的标识信息和该报文指示的此次检测的时间Td、以及记录接收到该检测图像延时的报文的时间td；以根据该检测图像延时的报文的时间td为基准，记录图像帧的采集时间tc；其中，所述图像帧的采集时间tc晚于所述接收到的该检测图像延时的报文的时间td；
根据该检测图像延时的报文，记录开始采集图像帧的时间tc，并将所述开始采集图像帧的时间tc根据所述标识信息发送表示采集图像帧开始的采集通知报文；
根据所述检测图像延时的报文中的此次检测的时间Td、接收到该检测图像延时的报文的时间td、图像帧的采集时间tc，确定基准的全局时间T。
本申请的一种具体实现方式中，上述应用程序运行时所执行的图像延时的检测方法中，所述基准的全局时间T为Td+(tc-td)。
本申请的一种具体实现方式中，上述应用程序运行时所执行的图像延时的检测方法中，所述的所述基准的全局时间T还可以包括：
通信传输中的单向延时Tlatency；其中，
该单向延时Tlatency根据此次检测的时间Td、接收到该检测图像延时的报文的时间td、图像帧的采集时间tc以及接收到该图像帧的时间Tc进行确定。
本申请的一种具体实现方式中，上述应用程序运行时所执行的图像延时的检测方法中，所述基准的全局时间T为单向延时Tlatency+Td+(tc-td)，其中，
所述单向延时Tlatency＝((Tc-Td)-(tc-td))/2。
本申请的一种具体实现方式中，上述应用程序运行时所执行的图像延时的检测方法中，根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay，可以包括：
检测所述图像帧的图像延时Tdelay＝Tdisplay-T；其中，
所述基准的全局时间T为Td+(tc-td)+Tlatency或者T为Td+(tc-td)；
其中，Tlatency为通信传输中的单向延时。
本申请的一种具体实现方式中，上述应用程序运行时所执行的图像延时的检测方法中，还可以包括：
重复显示所述图像帧并解析所述数据包、获得检测到的所述图像帧的图像延时Tdelay的步骤，对一个或多个图像帧的图像延时进行检测后，得到图像延时的平均值。
本申请实施例提供了一种存储介质，用于存储应用程序，该应用程序用于执行本申请实施例提供的图像延时的检测方法。其中，图像延时的检测方法，可以包括：
根据传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包；
根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay。
在本申请的一种具体实现方式中，上述存储介质存储的应用程序所执行的图像延时的检测方法中，所述采集所述图像帧的基准的全局时间T，可以包括：
根据接收的检测图像延时的报文，记录所述报文中的标识信息和该报文指示的此次检测的时间Td、以及记录接收到该检测图像延时的报文的时间td；以根据该检测图像延时的报文的时间td为基准，记录图像帧的采集时间tc；其中，所述图像帧的采集时间tc晚于所述接收到的该检测图像延时的报文的时间td；
根据该检测图像延时的报文，记录开始采集图像帧的时间tc，并将所述 开始采集图像帧的时间tc根据所述标识信息发送表示采集图像帧开始的采集通知报文；
根据所述检测图像延时的报文中的此次检测的时间Td、接收到该检测图像延时的报文的时间td、图像帧的采集时间tc，确定基准的全局时间T。
在本申请的一种具体实现方式中，上述存储介质存储的应用程序所执行的图像延时的检测方法中，所述基准的全局时间T为Td+(tc-td)。
在本申请的一种具体实现方式中，上述存储介质存储的应用程序所执行的图像延时的检测方法中，所述的所述基准的全局时间T还可以包括：
通信传输中的单向延时Tlatency；其中，
该单向延时Tlatency根据此次检测的时间Td、接收到该检测图像延时的报文的时间td、图像帧的采集时间tc以及接收到该图像帧的时间Tc进行确定。
在本申请的一种具体实现方式中，上述存储介质存储的应用程序所执行的图像延时的检测方法中，所述基准的全局时间T为单向延时Tlatency+Td+(tc-td)，其中，
所述单向延时Tlatency＝((Tc-Td)-(tc-td))/2。
在本申请的一种具体实现方式中，上述存储介质存储的应用程序所执行的图像延时的检测方法中，根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay，可以包括：
检测所述图像帧的图像延时Tdelay＝Tdisplay-T；其中，
所述基准的全局时间T为Td+(tc-td)+Tlatency或者T为Td+(tc-td)；
其中，Tlatency为通信传输中的单向延时。
在本申请的一种具体实现方式中，上述存储介质存储的应用程序所执行的图像延时的检测方法中，还可以包括：
重复显示所述图像帧并解析所述数据包、获得检测到的所述图像帧的图像延时Tdelay的步骤，对一个或多个图像帧的图像延时进行检测后，得到图像延时的平均值。
需要说明的是，本发明的各个实施例中，定义字母相同的概念描述的为同一事物，本发明中提到的检测均为延时检测，并且在本发明中提到的图像 延迟即为图像延时。
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
本领域普通技术人员可以理解实现上述方法实施方式中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，所述的程序可以存储于计算机可读取存储介质中，这里所称得的存储介质，如：ROM/RAM、磁碟、光盘等。
应当理解的是，本申请的上述具体实施方式仅仅用于示例性说明或解释本申请的原理，而不构成对本申请的限制。因此，在不偏离本申请的精神和范围的情况下所做的任何修改、等同替换、改进等，均应包含在本申请的保护范围之内。此外，本申请所附权利要求旨在涵盖落入所附权利要求范围和边界、或者这种范围和边界的等同形式内的全部变化和修改例。

Claims (15)

  1. 一种图像延时的检测方法，其特征在于，包括：
    根据传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包；
    根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay。
  2. 根据权利要求1所述的方法，其特征在于，所述采集所述图像帧的基准的全局时间T，包括：
    根据接收的检测图像延时的报文，记录所述报文中的标识信息和该报文指示的此次检测的时间Td、以及记录接收到该检测图像延时的报文的时间td；以所述接收到该检测图像延时的报文的时间td为基准，记录图像帧的采集时间tc；其中，所述图像帧的采集时间tc晚于所述接收到的该检测图像延时的报文的时间td；
    根据该检测图像延时的报文，记录开始采集图像帧的时间tc，并将所述开始采集图像帧的时间tc根据所述标识信息发送表示采集图像帧开始的采集通知报文；
    根据所述检测图像延时的报文中的此次检测的时间Td、接收到该检测图像延时的报文的时间td、图像帧的采集时间tc，确定基准的全局时间T。
  3. 根据权利要求2所述的方法，其中,所述基准的全局时间T为Td+(tc-td)。
  4. 根据权利要求2所述的方法，其特征在于，所述的所述基准的全局时间T还包括：
    通信传输中的单向延时Tlatency；其中，
    该单向延时Tlatency根据此次检测的时间Td、接收到该检测图像延时的报文的时间td、图像帧的采集时间tc以及接收到该图像帧的时间Tc进行确定。
  5. 根据权利要求4所述的方法，其特征在于，所述基准的全局时间T为单向延时Tlatency+Td+(tc-td)，其中，
    所述单向延时Tlatency＝((Tc-Td)-(tc-td))/2。
  6. 根据权利要求3或5所述的方法，其特征在于，根据解析所述数据包 获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay，包括：
    检测所述图像帧的图像延时Tdelay＝Tdisplay-T；其中，
    所述基准的全局时间T为Td+(tc-td)+Tlatency或者T为Td+(tc-td)；
    其中，Tlatency为通信传输中的单向延时。
  7. 根据权利要求1所述的方法，其特征在于，还包括：
    重复显示所述图像帧并解析所述数据包、获得检测到的所述图像帧的图像延时Tdelay的步骤，对一个或多个图像帧的图像延时进行检测后，得到图像延时的平均值。
  8. 一种图像延时的检测系统，其特征在于，包括：图像获取装置，图像处理装置，和连接二者的通信线路；其中，
    图像处理装置，根据图像获取装置经通信线路传输来的数据流中任一图像帧及对应该图像帧的图像延时检测的数据包，显示所述图像帧并解析所述数据包，然后，根据解析所述数据包获得的所述图像帧的采集所述图像帧的基准的全局时间T以及所述图像帧当前的显示时间Tdisplay，获得检测到的所述图像帧的图像延时Tdelay；
    图像获取装置，根据所述图像处理装置发送的对图像帧的图像延时检测的报文，采集图像帧，并确定采集的所述图像帧的基准的全局时间T。
  9. 根据权利要求8所述的系统，其特征在于，图像获取装置还包括：
    根据接收的所述图像处理装置发送的对图像帧的图像延时检测的报文，记录所述报文中的标识信息和该报文指示的此次检测的时间Td、以及记录接收到该检测图像延时的报文的时间td；
    根据该检测图像延时的报文，记录开始采集图像帧的时间tc，并将所述开始采集图像帧的时间tc根据所述标识信息发送表示采集图像帧开始的采集通知报文给对应的该图像处理装置；
    根据所述检测图像延时的报文中的此次检测的时间Td、接收到该检测图像延时的报文的时间td、开始采集图像帧的时间tc，确定基准的全局时间T；
    根据所述基准的全局时间T、所述检测图像延时的报文中的标识信息之一，形成数据包，与采集到的该图像帧的编码数据一起封装并发送给对应的图像 处理装置。
  10. 根据权利要求9所述的系统，其特征在于，图像处理装置还包括：
    检测所述图像帧的图像延时Tdelay＝Tdisplay-T；其中，
    所述基准的全局时间T为Td+(tc-td)+Tlatency或者T为Td+(tc-td)；其中，
    Tlatency为图像获取装置和图像处理装置之间的通信传输中存在的单向延时。
  11. 根据权利要求8所述的系统，其特征在于，所述数据包，至少包括信息：所述标识信息中的指示本次延时检测的ID号，以及所述基准的全局时间T。
  12. 根据权利要求8所述的系统，其特征在于，还包括：
    图像处理装置多次向图像获取装置发送进行图像延时检测的报文；
    图像获取装置对应接收的所述多次报文进行多个图像帧的采集和确定相应图像帧的基准的全局时间T，并形成数据包与相应的图像帧的编码数据进行封装，传输到对应的图像处理装置；
    图像处理装置解析显示的多个图像帧的数据包获得多个基准的全局时间T，并结合显示的多个图像帧的显示时间Tdisplay检测出多个图像帧的图像延时Tdelay，以多个图像帧的图像延时Tdelay的平均值作为检测的图像延时结果。
  13. 根据权利要求8-12之一所述的系统，其特征在于，还包括：
    所述图像处理装置为客户端电脑，所述图像获取装置为摄像机；其中，
    摄像机中增加支持一定格式报文的通信接口，所述客户端电脑具有支持所述格式报文的通信接口；
    所述客户端电脑根据摄像机的所述通信接口的报文格式，向摄像机发送图像帧的图像延时检测的报文。
  14. 一种应用程序，其特征在于，所述应用程序用于在运行时执行权利要求1-7任一项所述的图像延时的检测方法。
  15. 一种存储介质，其特征在于，所述存储介质用于存储应用程序，所述应用程序用于执行权利要求1-7任一项所述的图像延时的检测方法。
PCT/CN2015/098330 2015-04-30 2015-12-22 一种图像延迟的检测方法和系统 Ceased WO2016173279A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP15890653.7A EP3291551B1 (en) 2015-04-30 2015-12-22 Image delay detection method and system
US15/564,069 US10305613B2 (en) 2015-04-30 2015-12-22 Method and system for detecting image delay

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510218171.6 2015-04-30
CN201510218171.6A CN106210708B (zh) 2015-04-30 2015-04-30 一种图像延迟的检测方法和系统

Publications (1)

Publication Number Publication Date
WO2016173279A1 true WO2016173279A1 (zh) 2016-11-03

Family

ID=57198891

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/098330 Ceased WO2016173279A1 (zh) 2015-04-30 2015-12-22 一种图像延迟的检测方法和系统

Country Status (4)

Country Link
US (1) US10305613B2 (zh)
EP (1) EP3291551B1 (zh)
CN (1) CN106210708B (zh)
WO (1) WO2016173279A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114071132A (zh) * 2022-01-11 2022-02-18 浙江华睿科技股份有限公司 一种信息延时的检测方法、装置、设备及可读存储介质

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791815A (zh) * 2016-12-26 2017-05-31 百度在线网络技术（北京）有限公司 用于确定图像的采集时间的方法和装置
CN107094249A (zh) * 2017-03-31 2017-08-25 腾讯科技（上海）有限公司 一种测试摄像头延时的方法及装置
CN107566827B (zh) * 2017-07-28 2019-06-04 腾讯科技（上海）有限公司 拍摄延迟计算方法、装置及设备
JP6933545B2 (ja) * 2017-10-04 2021-09-08 株式会社小松製作所 作業車両、制御装置、および作業車両の制御方法
CN107564445A (zh) * 2017-10-10 2018-01-09 京东方科技集团股份有限公司 显示器的测试方法及系统
CN107734285A (zh) * 2017-10-25 2018-02-23 北京奇艺世纪科技有限公司 一种画面时延计算系统、方法及装置
CN108234997B (zh) * 2017-12-12 2019-11-26 北京百度网讯科技有限公司 直播视频的时延测量方法、设备、系统及计算机可读介质
CN108174229B (zh) * 2017-12-29 2021-02-12 北京奇虎科技有限公司 直播延时的确定方法和装置
CN110099299A (zh) * 2018-01-30 2019-08-06 腾讯科技（深圳）有限公司 视频帧参数获取方法、获取装置及计算机可读存储介质
USD896862S1 (en) 2018-03-27 2020-09-22 Tusimple, Inc. Camera
USD895713S1 (en) * 2018-09-28 2020-09-08 Flir Systems Ab Camera
WO2020174994A1 (ja) * 2019-02-26 2020-09-03 パナソニックＩｐマネジメント株式会社 カメラ映像伝送再生システム、それを構成するカメラおよびビューア
CN111953958B (zh) * 2019-05-16 2022-08-02 阿里巴巴集团控股有限公司 时延测量方法、设备、系统及存储介质
CN112083246A (zh) * 2020-09-11 2020-12-15 四川长虹教育科技有限公司 一种触摸显示设备系统延时测量装置及方法
CN112532961A (zh) * 2020-12-04 2021-03-19 上海影创信息科技有限公司 Vr眼镜的延时检测安全提示方法和系统及其vr眼镜
CN113891065B (zh) * 2021-09-09 2023-11-28 武汉中海庭数据技术有限公司 一种单帧图像传输延时测量方法和系统
CN114257772B (zh) * 2021-11-26 2024-09-10 苏州华兴源创科技股份有限公司 数据传输的调整方法、装置、计算机设备及可读存储介质
CN114915776A (zh) * 2021-12-07 2022-08-16 天翼数字生活科技有限公司 一种用于检测网络摄像头传输性能的方法和系统
US11736662B1 (en) * 2022-02-13 2023-08-22 Oran Gilad Systems and methods for precision downstream synchronization of content
CN115022204B (zh) * 2022-05-26 2023-12-05 阿里巴巴（中国）有限公司 Rtc的传输时延检测方法、装置以及设备
CN115348441A (zh) * 2022-08-16 2022-11-15 中国电信股份有限公司 时延测量方法、系统、装置、设备及存储介质
CN116233410A (zh) * 2022-12-31 2023-06-06 郑州精益达汽车零部件有限公司 一种摄像头图像延时检测方法
CN117376549A (zh) * 2023-11-08 2024-01-09 东风商用车有限公司 一种图像采集系统延时的测试方法、装置、设备及介质
CN119574066B (zh) * 2025-02-08 2025-05-30 富赛汽车电子有限公司 一种车载显示设备的测试方法及相关设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996011550A1 (en) * 1994-10-11 1996-04-18 Pixel Instruments Corporation Delay detector apparatus and method for plural image sequences
CN1980405A (zh) * 2005-12-08 2007-06-13 中兴通讯股份有限公司 一种测试图像时延的系统和方法
CN101668223A (zh) * 2009-09-07 2010-03-10 航天恒星科技有限公司 一种测量图像传输时延的方法
JP2012175271A (ja) * 2011-02-18 2012-09-10 Canon Inc 画像処理装置および画像処理方法
CN103813161A (zh) * 2012-11-12 2014-05-21 腾讯科技（深圳）有限公司 延时测试方法和装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4237549B2 (ja) * 2003-05-29 2009-03-11 株式会社日立国際電気 循環記録装置
CN100426758C (zh) * 2005-01-27 2008-10-15 华为技术有限公司 一种单向延迟的测量方法
JP4766128B2 (ja) * 2009-02-27 2011-09-07 ソニー株式会社 スレーブ装置、スレーブ装置の時刻同期化方法および電子機器システム
JP5774314B2 (ja) * 2011-01-05 2015-09-09 任天堂株式会社 遅延測定システムおよび遅延測定方法
JP5697743B2 (ja) * 2011-03-09 2015-04-08 日立マクセル株式会社 映像送信装置、映像送信方法、映像受信装置、および映像受信方法
WO2011100906A2 (zh) * 2011-04-11 2011-08-25 华为技术有限公司 模拟现网包时延抖动方法和装置
CN109068154B (zh) 2011-09-23 2021-01-26 韩国电子通信研究院 传送媒体数据的方法以及接收媒体数据的方法
CN102655585B (zh) * 2012-04-16 2015-07-15 中国联合网络通信集团有限公司 视频会议系统及其时延测试方法、装置和系统
CN203135907U (zh) * 2013-01-31 2013-08-14 福建省电力有限公司 时间质量监测系统
EP2800331B1 (en) 2013-05-03 2019-08-14 BlackBerry Limited Input lag estimation for wi-fi display sinks
CN104348692A (zh) * 2013-07-23 2015-02-11 深圳市信桥科技有限公司 数据采集和控制设备基于以太网的同步并发板间通信方法
CN104135359B (zh) * 2014-07-22 2017-12-12 南京磐能电力科技股份有限公司 一种硬实时级联式多节点同步采样和数据传输方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996011550A1 (en) * 1994-10-11 1996-04-18 Pixel Instruments Corporation Delay detector apparatus and method for plural image sequences
CN1980405A (zh) * 2005-12-08 2007-06-13 中兴通讯股份有限公司 一种测试图像时延的系统和方法
CN101668223A (zh) * 2009-09-07 2010-03-10 航天恒星科技有限公司 一种测量图像传输时延的方法
JP2012175271A (ja) * 2011-02-18 2012-09-10 Canon Inc 画像処理装置および画像処理方法
CN103813161A (zh) * 2012-11-12 2014-05-21 腾讯科技（深圳）有限公司 延时测试方法和装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114071132A (zh) * 2022-01-11 2022-02-18 浙江华睿科技股份有限公司 一种信息延时的检测方法、装置、设备及可读存储介质

Also Published As

Publication number Publication date
US20180097573A1 (en) 2018-04-05
US10305613B2 (en) 2019-05-28
EP3291551B1 (en) 2020-06-24
EP3291551A4 (en) 2018-12-05
EP3291551A1 (en) 2018-03-07
CN106210708A (zh) 2016-12-07
CN106210708B (zh) 2019-02-01

Similar Documents

Publication Publication Date Title
WO2016173279A1 (zh) 一种图像延迟的检测方法和系统
CN108234997B (zh) 直播视频的时延测量方法、设备、系统及计算机可读介质
CN101516017B (zh) 一种会话类业务视频传输时延的测量方法、装置和系统
US7864695B2 (en) Traffic load density measuring system, traffic load density measuring method, transmitter, receiver, and recording medium
CN112437242B (zh) 用于处理媒体信号的方法和装置
CN109889398B (zh) 一种检测媒体流业务质量的方法及装置、设备、存储介质
CN106371998A (zh) 移动应用的测试系统及方法
JP6574031B2 (ja) モバイル映像通話品質測定方法およびシステム
WO2018166162A1 (zh) 一种音视频直播中检测客户端播放状态的系统及方法
TW201511539A (zh) 用以處理動作視訊之方法及裝置
WO2023024469A1 (zh) 视频质量问题确定方法、装置、存储介质及程序产品
CN115883859A (zh) 多媒体数据处理方法、电子设备及存储介质
CN111629264A (zh) 一种基于web的分离式前端图像渲染方法
US20200366967A1 (en) Method and system for monitoring quality of streaming media
JP4966779B2 (ja) ネットワーク遅延計測方法及び通信システム
CN103457793B (zh) 一种组播时延测量方法、设备及系统
CN108111365A (zh) 一种时延测量处理方法及系统
CN103442216A (zh) 监控视频时间的校准装置及其校准方法
WO2014036877A1 (zh) 视频播放系统及方法
CN104020375B (zh) 一种用于检测智能变电站合并单元时间参数的装置和方法
CN115801636A (zh) 一种延时计算方法、设备及计算机可读存储介质
CN114390346B (zh) Rtsp转rtmp协议的媒体资源处理方法及装置
CN203909182U (zh) 一种用于检测智能变电站合并单元时间参数的装置
CN101369975A (zh) 一种时延丢包的检测方法及系统
CN115883420A (zh) 交互式系统中时延统计方法及系统、存储介质、电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15890653

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2015890653

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 15564069

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE