WO2023280206A1 - Systems and methods for camera synchronization - Google Patents
Systems and methods for camera synchronization Download PDFInfo
- Publication number
- WO2023280206A1 WO2023280206A1 PCT/CN2022/104126 CN2022104126W WO2023280206A1 WO 2023280206 A1 WO2023280206 A1 WO 2023280206A1 CN 2022104126 W CN2022104126 W CN 2022104126W WO 2023280206 A1 WO2023280206 A1 WO 2023280206A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- camera
- frequency
- time
- difference
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/025—Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
- H04N7/035—Circuits for the digital non-picture data signal, e.g. for slicing of the data signal, for regeneration of the data-clock signal, for error detection or correction of the data signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/06—Generation of synchronising signals
- H04N5/067—Arrangements or circuits at the transmitter end
- H04N5/073—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
- H04N5/0733—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations for distributing synchronisation pulses to different TV cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
- H04N7/52—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal
- H04N7/54—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal the signals being synchronous
- H04N7/56—Synchronising systems therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/02—Details
- H04J3/06—Synchronising arrangements
- H04J3/0635—Clock or time synchronisation in a network
- H04J3/0638—Clock or time synchronisation among nodes; Internode synchronisation
- H04J3/0658—Clock or time synchronisation among packet nodes
- H04J3/0661—Clock or time synchronisation among packet nodes using timestamps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronisation processes, e.g. processing of PCR [Programme Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4223—Cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
Definitions
- the present disclosure generally relates to communication technologies, and in particular, to systems and methods for camera synchronization.
- a system for camera synchronization may be provided.
- the system may include at least one storage medium including a set of instructions, and at least one processor in communication with the at least one storage medium.
- the at least one processor may be directed to cause the system to perform operations.
- the operations may include determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera.
- the operations may also include synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference.
- the operations may further include directing the first camera and the second camera to execute camera operations under synchronized frequency.
- the determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera may include determining a first time of the first camera sending a message and a second time of the second camera receiving the message, determining a third time of the first camera sending a message and a fourth time of the second camera receiving the message, and determining the frequency difference based on the first time, the second time, the third time, and the fourth time.
- a format of the message at least may include camera ID.
- the first time or the third time may be a time point of the first camera sending a first camera ID of the first camera.
- the second time or the fourth time may be a time point of the second camera receiving the first camera ID.
- the synchronizing a second frequency of the second camera to a first frequency of the first camera based on the frequency difference may include synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference and a preset dividing frequency.
- the synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference and a preset dividing frequency may include dividing the second frequency of the second camera to the preset dividing frequency based on a target frequency dividing coefficient of the second camera, and multiplying the preset dividing frequency to the first frequency of the first camera.
- the determining the target frequency dividing coefficient may include determining a base frequency dividing coefficient based on the first frequency and the preset dividing frequency, determining a difference ratio based on a difference value between the first frequency and the second frequency, determining a supplementary frequency dividing coefficient based on the base frequency dividing coefficient and the difference ratio, and determining the target frequency dividing coefficient based on the base frequency dividing coefficient and the supplementary frequency dividing coefficient.
- the operations may further include determining a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency, and synchronizing the second time of the second camera to the first time of the first camera based on the time difference.
- the determining the time difference between the first time of the first camera and the second time of the second camera under the synchronized frequency may include determining a fifth time of the second camera sending a message and a sixth time of the first camera receiving the message, determining a seventh time of the first camera sending a message and an eighth time of the second camera receiving the message, and determining the time difference based on the fifth time, the sixth time, the seventh time, and the eighth time.
- the operations may further include receiving a trigger instruction.
- the operations may also include detecting a current time of the first camera and a current time of the second camera based on the trigger instruction.
- the operations may also include determining whether the current time of the first camera and the current time of the second camera satisfy a preset condition.
- the operations may include directing the first camera and the second camera to execute the camera operations.
- the first camera may be connected to the second camera via a camera pin, a bus, or a network interface.
- a method for camera synchronization may be provided.
- the method may include determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera.
- the method may also include synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference.
- the method may further include directing the first camera and the second camera to execute camera operations under synchronized frequency.
- a non-transitory computer readable medium may include at least one set of instructions. When executed by one or more processors of a computing device, the at least one set of instructions may cause the computing device to perform a method.
- the method may include determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera.
- the method may also include synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference.
- the method may further include directing the first camera and the second camera to execute camera operations under synchronized frequency.
- FIG. 1 is a schematic diagram illustrating an exemplary camera synchronization system according to some embodiments of the present disclosure
- FIG. 2 is a schematic diagram illustrating exemplary hardware and/or software components of an exemplary computing device according to some embodiments of the present disclosure
- FIG. 3 is a schematic diagram illustrating an exemplary multi-camera device according to some embodiments of the present disclosure
- FIG. 4 is a block diagram illustrating an exemplary processing device according to some embodiments of the present disclosure.
- FIG. 5A is a flowchart illustrating an exemplary process for camera synchronization according to some embodiments of the present disclosure
- FIG. 5B is a schematic diagram illustrating an exemplary process for camera synchronization according to some embodiments of the present disclosure
- FIG. 6 is a schematic diagram illustrating an exemplary process for determining frequency difference according to some embodiments of the present disclosure
- FIG. 7 is a schematic diagram illustrating an exemplary process for frequency synchronization according to some embodiments of the present disclosure.
- FIG. 8 is a flowchart illustrating an exemplary process for determining a target frequency dividing coefficient according to some embodiments of the present disclosure
- FIG. 9 is a schematic diagram illustrating an exemplary process for determining time difference according to some embodiments of the present disclosure.
- FIG. 10 is a schematic diagram illustrating an exemplary process for time synchronization according to some embodiments of the present disclosure.
- FIG. 11 is a schematic diagram illustrating an exemplary format of a message according to some embodiments of the present disclosure.
- FIG. 12 is a flowchart illustrating an exemplary process for camera trigger according to some embodiments of the present disclosure.
- system, ” “engine, ” “unit, ” “module, ” and/or “block” used herein are one method to distinguish different components, elements, parts, sections, or assemblies of different levels in ascending order. However, the terms may be displaced by other expressions if they may achieve the same purpose.
- the flowcharts used in the present disclosure illustrate operations that systems implement according to some embodiments of the present disclosure. It is to be expressly understood, the operations of the flowcharts may be implemented not in order. Conversely, the operations may be implemented in an inverted order, or simultaneously. Moreover, one or more other operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.
- An aspect of the present disclosure relates to systems and methods for camera synchronization.
- the systems may determine a frequency difference between a first frequency of a first camera and a second frequency of a second camera.
- the systems may also synchronize the second frequency of the second camera to the first frequency of the first camera based on the frequency difference. Further, the systems may direct the first camera and the second camera to execute camera operations under synchronized frequency.
- the systems may also determine a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency, and synchronize the second time of the second camera to the first time of the first camera based on the time difference.
- frequency synchronization and/or time synchronization among a plurality of cameras can be achieved, so that timestamps of data frames output by the plurality of cameras can be completely synchronized with internal data, thereby achieving accurate and efficient cooperation among the plurality of cameras.
- FIG. 1 is a schematic diagram illustrating an exemplary camera synchronization system according to some embodiments of the present disclosure.
- the camera synchronization system 100 may include a multi-camera device 110, a processing device 120, and a storage device 130.
- the multi-camera device 110, the processing device 120, and/or the storage device 130 may be connected to and/or communicate with each other via a wireless connection (e.g., a network) , a wired connection, or a combination thereof.
- the connection between the components in the camera synchronization system 100 may be variable.
- the multi-camera device 110 may be connected to the processing device 120 directly as illustrated in FIG. 1 or through a network.
- the storage device 130 may be connected to the processing device 120 directly as illustrated in FIG. 1 or through a network.
- the multi-camera device 110 may be configured to capture images or videos.
- the multi-camera device 110 may include a plurality of cameras.
- the plurality of cameras may be directed to execute camera operations synchronously.
- Exemplary cameras may include a gun camera, a dome camera, an integrated camera, a monocular camera, a binocular camera, a multi-view camera, a visible light camera, a thermal imaging camera, or the like, or any combination thereof.
- the multi-camera device 110 may transmit the captured images or videos to one or more components (e.g., the processing device 120, the storage device 130) of the camera synchronization system 100.
- the processing device 120 may process data and/or information obtained from one or more components (e.g., the multi-camera device 110 and/or the storage device 130) of the camera synchronization system 100. For example, the processing device 120 may synchronize frequencies and/or times of the cameras of the multi-camera device. Further, the systems may direct the cameras to execute camera operations under synchronized frequency and/or synchronized time. As another example, the processing device 120 may determine a target frequency dividing coefficient and execute frequency synchronization based on the target frequency dividing coefficient. In some embodiments, the processing device 120 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, the processing device 120 may be local or remote.
- the processing device 120 may be synchronize frequencies and/or times of the cameras of the multi-camera device. Further, the systems may direct the cameras to execute camera operations under synchronized frequency and/or synchronized time. As another example, the processing device 120 may determine a target frequency dividing coefficient and execute frequency synchronization
- the processing device 120 may access information and/or data stored in the multi-camera device 110 and/or the storage device 130.
- the processing device 120 may be implemented on a cloud platform.
- the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or any combination thereof.
- the processing device 120 may be implemented by a computing device 200 illustrated in FIG. 2.
- the storage device 130 may store data/information obtained from the multi-camera device 110 and/or any other component of the camera synchronization system 100.
- the storage device 130 may include a mass storage, a removable storage, a volatile read-and-write memory, a read-only memory (ROM) , or the like, or any combination thereof.
- the mass storage may include a magnetic disk, an optical disk, a solid-state drive, etc.
- the removable storage may include a flash drive, a floppy disk, an optical disk, a memory card, a zip disk, a magnetic tape, etc.
- the storage device 130 may store one or more programs and/or instructions to perform exemplary methods described in the present disclosure.
- the storage device 130 may be communicated with one or more other components (e.g., the multi-camera device 110, the processing device 120) of the camera synchronization system 100.
- One or more components of the camera synchronization system 100 may access the data or instructions stored in the storage device 130.
- the storage device 130 may be part of the processing device 120.
- the camera synchronization system 100 may further include a network.
- the network may facilitate exchange of information and/or data for the camera synchronization system 100.
- one or more components e.g., the multi-camera device 110, the processing device 120, the storage device 130
- the network may be any type of wired or wireless network, or combination thereof.
- the camera synchronization system 100 may further a terminal device.
- the terminal device may be configured to receive information and/or data from the multi-camera device 110, the processing device 120, and/or the storage device 130.
- the terminal device may receive the captured images or videos from the multi-camera device 110.
- the terminal device may process information and/or data received from the multi-camera device 110, the processing device 120, and/or the storage device 130.
- the terminal device may provide a user interface via which a user may view information and/or input data and/or instructions to the camera synchronization system 100.
- the terminal device may include a mobile phone, a computer, a wearable device, or the like, or any combination thereof.
- the terminal device may include a display that can display information in a human-readable form, such as text, image, audio, video, graph, animation, or the like, or any combination thereof.
- the display of the terminal device may include a cathode ray tube (CRT) display, a liquid crystal display (LCD) , a light-emitting diode (LED) display, a plasma display panel (PDP) , a three-dimensional (3D) display, or the like, or a combination thereof.
- CTR cathode ray tube
- LCD liquid crystal display
- LED light-emitting diode
- PDP plasma display panel
- 3D three-dimensional
- FIG. 2 is a schematic diagram illustrating exemplary hardware and/or software components of an exemplary computing device according to some embodiments of the present disclosure.
- the processing device 120 may be implemented on the computing device 200 and configured to perform functions of the processing device 120 disclosed in this disclosure.
- the computing device 200 may be used to implement any component of the camera synchronization system 100 as described herein.
- the processing device 120 may be implemented on the computing device 200, via its hardware, software program, firmware, or a combination thereof.
- the computer functions relating to camera synchronization as described herein may be implemented in a distributed fashion on a number of similar platforms to distribute the processing load.
- the computing device 200 may include COM ports 250 connected to and from a network connected thereto to facilitate data communications.
- the computing device 200 may also include a processor (e.g., a processor 220) , in the form of one or more processors (e.g., logic circuits) , for executing program instructions.
- the processor 220 may include interface circuits and processing circuits therein.
- the interface circuits may be configured to receive electronic signals from a bus 210, wherein the electronic signals encode structured data and/or instructions for the processing circuits to process.
- the processing circuits may conduct logic calculations, and then determine a conclusion, a result, and/or an instruction encoded as electronic signals. Then the interface circuits may send out the electronic signals from the processing circuits via the bus 210.
- the computing device 200 may further include program storage and data storage of different forms including, for example, a disk 270, a read-only memory (ROM) 230, or a random-access memory (RAM) 240, for storing various data files to be processed and/or transmitted by the computing device 200.
- the computing device 200 may also include program instructions stored in the ROM 230, RAM 240, and/or another type of non-transitory storage medium to be executed by the processor 220.
- the methods and/or processes of the present disclosure may be implemented as the program instructions.
- the computing device 200 may also include an I/O component 260, supporting input/output between the computing device 200 and other components.
- the computing device 200 may also receive programming and data via network communications.
- Only one processor is illustrated in FIG. 2. Multiple processors 220 are also contemplated; thus, operations and/or method steps performed by one processor 220 as described in the present disclosure may also be jointly or separately performed by the multiple processors.
- FIG. 3 is a schematic diagram illustrating an exemplary multi-camera device according to some embodiments of the present disclosure.
- the multi-camera device 300 may include a first camera 310, a second camera 320-1, a second camera 320-2, a second camera 320-3, ....
- the multi-camera device 110 may be in a one-master-multi-slave mode.
- the first camera 310 may be designated as the master device
- the second camera 320 e.g., the second camera 320-1, the second camera 320-2, the second camera 320-3 may be designated as the slave device.
- the first camera 310 may be in communication with the second camera 320 via a camera pin, a bus (e.g., I2C bus) , a network interface, or the like, or a combination thereof.
- the first camera 310 and the second camera 320 may interact via message. More descriptions regarding the message may be found elsewhere in the present disclosure, for example, FIG. 11 and relevant descriptions thereof.
- FIG. 4 is a block diagram illustrating an exemplary processing device according to some embodiments of the present disclosure.
- the processing device 400 may include a frequency determination module 410, a frequency synchronization module 420, and a trigger module 430.
- the frequency determination module 410 may be used to determine a frequency difference between a first frequency of a first camera and a second frequency of a second camera. More descriptions regarding the frequency determination module 410 may be found elsewhere in the present disclosure, for example, operation 510 and relevant descriptions thereof.
- the frequency synchronization module 420 may be used to synchronize the second frequency of the second camera to the first frequency of the first camera based on the frequency difference. More descriptions regarding the frequency synchronization module 420 may be found elsewhere in the present disclosure, for example, operation 520 and relevant descriptions thereof.
- the trigger module 430 may be used to direct the first camera and the second camera to execute camera operations under synchronized frequency. More descriptions regarding the trigger module 430 may be found elsewhere in the present disclosure, for example, operation 530 and relevant descriptions thereof.
- the processing device 120 may further include a time determination module 440 and a time synchronization module 450.
- the time determination module 440 may be used to determine a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency. More descriptions regarding the time determination module 440 may be found elsewhere in the present disclosure, for example, operation 540 and relevant descriptions thereof.
- the time synchronization module 450 may be used to synchronize the second time of the second camera to the first time of the first camera based on the time difference. More descriptions regarding the time synchronization module 450 may be found elsewhere in the present disclosure, for example, operation 550 and relevant descriptions thereof.
- the modules in the processing device 120 may be connected to or communicate with each other via a wired connection or a wireless connection.
- the wired connection may include a metal cable, an optical cable, a hybrid cable, or the like, or any combination thereof.
- the wireless connection may include a Local Area Network (LAN) , a Wide Area Network (WAN) , a Bluetooth, a ZigBee, a Near Field Communication (NFC) , or the like, or any combination thereof.
- LAN Local Area Network
- WAN Wide Area Network
- Bluetooth a ZigBee
- NFC Near Field Communication
- the time determination module 440 and the time synchronization module 450 may be unnecessary.
- two or more of the modules may be combined as a single module, and any one of the modules may be divided into two or more units.
- the frequency determination module 410 and the time determination module 440 may be combined as a single module which may both determine the frequency difference and the time difference between the first camera and the second camera.
- the processing device 120 may include one or more additional modules.
- the processing device 120 may also include a transmission module (not shown) configured to transmit signals (e.g., electrical signals, electromagnetic signals) to one or more components (e.g., the multi-camera device 110, the storage device 130) of the camera synchronization system 100.
- the processing device 120 may include a storage module (not shown) used to store information and/or data (e.g., the frequency difference, the time difference, the camera ID) associated with camera synchronization.
- FIG. 5A is a flowchart illustrating an exemplary process for camera synchronization according to some embodiments of the present disclosure.
- process 500 may be executed by the camera synchronization system 100.
- the process 500 may be implemented as a set of instructions (e.g., an application) stored in a storage device (e.g., the storage device 130) .
- the processing device 120 e.g., the processor 220 of the computing device 200 and/or one or more modules illustrated in FIG. 4) may execute the set of instructions and may accordingly be directed to perform the process 500.
- the operations of the illustrated process presented below are intended to be illustrative. In some embodiments, the process 500 may be accomplished with one or more additional operations not described and/or without one or more of the operations discussed. Additionally, the order of the operations of process 500 illustrated in FIG. 5A and described below is not intended to be limiting.
- the processing device 120 may determine a frequency difference between a first frequency of a first camera (e.g., the first camera 310) and a second frequency of a second camera (e.g., the second camera 320) .
- the first frequency may be a local clock frequency of the first camera; the second frequency may be a local clock frequency of the second camera.
- the processing device 120 may determine frequency difference (s) among the different cameras and perform a frequency synchronization.
- the first camera and the second camera may interact with each other via a message. Accordingly, the processing device 120 may determine the frequency difference between the first camera and the second camera based on a sending time and/or a receiving time of the message.
- a form of the frequency difference between the first camera and the second camera may include a frequency ratio, a frequency difference value, or the like, or any combination thereof.
- the frequency difference between the first camera and the second camera may be represented as a numerical value, a vector, a matrix, a determinant, or the like, or a combination thereof.
- the processing device 120 may determine a first time (e.g., t 1 shown in FIG. 6) of the first camera sending a message (can be referred to as a “first message” ) and a second time (e.g., t 2 shown in FIG. 6) of the second camera receiving the message.
- the processing device 120 may also determine a third time (e.g., t 3 shown in FIG. 6) of the first camera sending a message (can be referred to as a “second message” ) and a fourth time (e.g., t 4 shown in FIG. 6) of the second camera receiving the message.
- the processing device 120 may further determine the frequency difference between the first camera and the second camera based on the first time, the second time, the third time, and the fourth time.
- the processing device 120 may determine the frequency difference according to the following Equation (1) :
- ratio refers to the frequency difference (frequency ratio) .
- the first message and the second message may be the same or different.
- the first camera may send more than two (e.g., 3, 5, 10) messages to the second camera.
- the first camera may send a plurality of messages consecutively to the second camera.
- the processing device 120 may determine a time t 2n+1 of the first camera sending the message and a time t 2n+2 of the second camera receiving the message, respectively.
- the processing device 120 may further determine the frequency difference between the first camera and the second camera based on the sending times and receiving times of the plurality of messages.
- the processing device 120 may determine the frequency difference according to the following Equation (2) :
- n refers to a count of the plurality of messages and ⁇ T refers to a time interval for sending the plurality of messages.
- the time interval ⁇ T may be a system default value or set by a user.
- the time interval ⁇ T may be 5 milliseconds, 20 milliseconds, 1 second, etc.
- the frequency difference between the first camera and the second camera can be determined more accurately.
- a format of the message may at least include a camera ID. Accordingly, the time sending and/or receiving the message may be determined based on the camera ID.
- the camera ID may include a camera number, a serial number, an International Mobile Equipment Identity, or the like, or any combination thereof.
- the first time or the third time may be a time point of the first camera sending a first camera ID of the first camera
- the second time or the fourth time may be a time point of the second camera receiving the first camera ID. More descriptions regarding the format of the message may be found elsewhere in the present disclosure, for example, FIG. 11 and relevant descriptions thereof.
- the processing device 120 may synchronize the second frequency of the second camera to the first frequency of the first camera based on the frequency difference.
- the processing device 120 may adjust the second frequency of the second camera to the first frequency of the first camera based on the frequency difference. For example, the processing device 120 may adjust the second frequency of the second camera to the first frequency of the first camera according to the following Equation (3) :
- f osys refers to the first frequency (also referred to as a “target frequency” )
- f ose refers to the second frequency
- Ratio refers to the frequency difference
- the processing device 120 may divide the second frequency of the second camera to a preset dividing frequency, and multiply the preset dividing frequency to the first frequency of the first camera. For example, as shown in FIG. 7, the processing device 120 may input the frequency difference and the second frequency to a frequency divider and divide the second frequency to the preset dividing frequency through the frequency divider. Then the processing device 120 may input the preset dividing frequency to a phase-locked loop to multiply the preset dividing frequency to the first frequency.
- the processing device 120 may divide the second frequency of the second camera to the preset dividing frequency based on a target frequency dividing coefficient, and then multiply the preset dividing frequency to the first frequency.
- the processing device 120 may use a high-order overflow manner (e.g., a 14-bit high-order overflow manner) to divide the second frequency to the preset dividing frequency. More descriptions regarding determining the target frequency dividing coefficient may be found elsewhere in the present disclosure, for example, FIG. 8 and relevant descriptions thereof.
- the preset dividing frequency may be a frequency that is lower than the first frequency and that is divisible by the first frequency. For example, it is assumed that the first frequency is 100MHz, the preset dividing frequency may be 10MHz, 20MHz, 25Mhz, 50MHz, etc. In some embodiments, the preset dividing frequency may be a system default value or set by a user.
- the processing device 120 may direct the first camera and the second camera to execute camera operations under synchronized frequency.
- the processing device 120 may control the first camera and the second camera to execute the camera operations (e.g., exposure, photography, shooting) under synchronized frequency. Since the first camera and the second camera work at the same frequency, the first camera and the second camera can achieve accurate cooperation with each other. More descriptions regarding executing the camera operations may be found elsewhere in the present disclosure, for example, FIG. 12 and relevant descriptions thereof.
- the processing device 120 may also execute a time synchronization between the first camera and the second camera to further enhance the accuracy of the cooperation.
- the processing device 120 may determine a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency.
- the first camera and the second camera may interact with each other via a message. Accordingly, the processing device 120 may determine the time difference between the first camera and the second camera based on the sending time and/or the receiving time of the message.
- a form of the time difference between the first camera and the second camera may include a time ratio, a time difference value, or the like, or any combination thereof.
- the time difference between the first camera and the second camera may be represented as a numerical value, a vector, a matrix, a determinant, or the like, or any combination thereof.
- the processing device 120 may determine a fifth time (e.g., s 1 shown in FIG. 9) of the second camera sending a message (can be referred to as a “third message” ) and a sixth time (e.g., s 2 shown in FIG. 9) of the first camera receiving the message.
- the processing device 120 may also determine a seventh time (e.g., s 3 shown in FIG. 9) of the first camera sending a message (can be referred to as a “fourth message” ) and an eighth time (e.g., s 4 shown in FIG. 9) of the second camera receiving the message.
- the processing device 120 may further determine the time difference between the first camera and the second camera based on the fifth time, the sixth time, the seventh time, and the eighth time.
- the processing device 120 may determine the time difference according to the following Equation (4) :
- d refers to the time difference (time difference value) .
- the processing device 120 may synchronize the second time of the second camera to the first time of the first camera based on the time difference.
- the processing device 120 may modify the second time of the second camera to the first time of the first camera based on the time difference to achieve the time synchronization between the first camera and the second camera. For example, as shown in FIG. 10, the processing device 120 may determine a time adjustment amount for the second camera based on the time difference and accumulate the time adjustment amount to a system time adjustment module of the second camera, thereby modifying the second time of the second camera to the first time.
- the processing device 120 may control the first camera and the second camera to execute the camera operations. Since the first camera and the second camera work at the same frequency and the same time, the synchronization of the operations of the first camera and the second camera can be strictly and accurately guaranteed, thereby ensuring accurate cooperation between the first camera and the second camera. More descriptions regarding executing the camera operations may be found elsewhere in the present disclosure, for example, FIG. 12 and relevant descriptions thereof.
- one or more other optional operations may be added elsewhere in the process 500.
- the processing device 120 may store information and/or data (e.g., the camera ID, the frequency difference, the time difference) associated with the camera synchronization in a storage device (e.g., the storage device 130) disclosed elsewhere in the present disclosure.
- the camera e.g., the first camera or the second camera
- the transmitting operation the camera (e.g., the first camera or the second camera) may transmit the time sending or receiving a message to the processing device 120.
- operation 510 and operation 540 may be combined into a single operation in which the processing device 120 may determine the frequency difference and the time difference between the first camera and the second camera.
- operation 540 and operation 550 may be unnecessary.
- FIG. 5B is a schematic diagram illustrating an exemplary process for camera synchronization according to some embodiments of the present disclosure.
- the first camera and the second camera may interact with each other by sending a message and/or receiving a message.
- the processing device 120 may determine the frequency difference and the time difference between the first camera and the second camera based on a first time (also referred to as a “local current time” ) of the first camera and a second time (also referred to as a “local current time” ) of the second camera when sending and/or receiving the message.
- the processing device 120 may further perform the frequency synchronization and the time synchronization between the first camera and the second camera based on the frequency difference and the time difference.
- FIG. 8 is a flowchart illustrating an exemplary process for determining a target frequency dividing coefficient according to some embodiments of the present disclosure.
- process 800 may be executed by the camera synchronization system 100.
- the process 800 may be implemented as a set of instructions (e.g., an application) stored in a storage device (e.g., the storage device 130) .
- the processing device 120 e.g., the processor 220 of the computing device 200 and/or the frequency synchronization module 420
- the set of instructions may accordingly be directed to perform the process 800.
- the operations of the illustrated process presented below are intended to be illustrative.
- the process 800 may be accomplished with one or more additional operations not described and/or without one or more of the operations discussed. Additionally, the order of the operations of process 800 illustrated in FIG. 8 and described below is not intended to be limiting.
- the processing device e.g., the frequency synchronization module 420 may determine a base frequency dividing coefficient based on the first frequency and the preset dividing frequency.
- the processing device 120 may determine the base frequency dividing coefficient based on a ratio of the first frequency to the preset dividing frequency. For example, it is assumed that the first frequency is 100 MHz and the preset dividing frequency is 25 MHz, the base frequency dividing coefficient may be 4. As another example, it is assumed that the first frequency is 200 MHz and the preset dividing frequency is 20 MHz, the base frequency dividing coefficient may be 10.
- the processing device 120 may use a high-order overflow manner (e.g., a 14-bit high-order overflow manner) to divide the second frequency of the second camera to the preset dividing frequency.
- a high-order overflow manner e.g., a 14-bit high-order overflow manner
- the base frequency dividing coefficient also can be expressed as “OSC_BASE”
- OSC_BASE the base frequency dividing coefficient
- the processing device 120 may determine a difference ratio based on a difference value between the first frequency and the second frequency.
- the processing device 120 may determine the difference ratio based on a ratio of the difference value between the first frequency and the second frequency to the first frequency. For example, it is assumed that the first frequency is 100 MHz and the second frequency is 99 MHz, the difference ratio may be 0.01. As another example, it is assumed that the first frequency is 200 MHz and the second frequency is 212 MHz, the difference ratio may be 0.06.
- the difference ratio may be a positive value or a negative value.
- the difference ratio may be a positive value.
- the difference ratio may be a negative value.
- the processing device 120 may determine a supplementary frequency dividing coefficient based on the base frequency dividing coefficient and the difference ratio.
- the processing device 120 may determine the supplementary frequency dividing coefficient based on a product of the base frequency dividing coefficient and the difference ratio. For example, it is assumed that the base frequency dividing coefficient is 4 and the difference ratio is 0.01, the supplementary frequency dividing coefficient may be 0.04. As another example, it is assumed that the base frequency dividing coefficient is 10 and the difference ratio is 0.06, the supplementary frequency dividing coefficient may be 0.6.
- the processing device 120 may determine the supplementary frequency dividing coefficient (also can be expressed as “nanoseconds” ) based on a product of the difference ratio and the base frequency dividing coefficient (e.g., the “OSC_BASE” ) .
- the processing device 120 may determine the target frequency dividing coefficient based on the base frequency dividing coefficient and the supplementary frequency dividing coefficient.
- the processing device 120 may determine the target frequency dividing coefficient based on a difference or a sum of the base frequency dividing coefficient and the supplementary frequency dividing coefficient. In some embodiments, if the first frequency is greater than the second frequency, the target frequency dividing coefficient may be determined based on the difference between the base frequency dividing coefficient and the supplementary frequency dividing coefficient. In some embodiments, if the first frequency is less than the second frequency, the target frequency dividing coefficient may be determined based on the sum of the base frequency dividing coefficient and the supplementary frequency dividing coefficient. In some embodiments, if the difference ratio is a negative value, the target frequency dividing coefficient may be determined based on the difference between the base frequency dividing coefficient and the supplementary frequency dividing coefficient.
- the base frequency dividing coefficient is 4 and the supplementary frequency dividing coefficient is 0.04, the target frequency dividing coefficient may be 3.96.
- the target frequency dividing coefficient may be 10.6.
- the processing device 120 may add the frequency difference between the first camera and the second camera and the target frequency dividing coefficient to the frequency divider of the second camera.
- the frequency divider may divide the second frequency (e.g., 99MHz) of the second camera to the preset dividing frequency (e.g., 25 MHz) .
- the phase-locked loop module may multiply the preset dividing frequency to the first frequency (e.g., 100MHz) of the first camera to realize the frequency synchronization between the second camera and the first camera.
- the processing device 120 may determine a modification efficient (or a supplementary coefficient) per unit (e.g., a modification efficient per millisecond, can be expressed as “frac_ns” ) . Further, the processing device 120 may divide the second frequency of the second camera to the preset dividing frequency based on the base frequency dividing coefficient, the supplementary frequency dividing coefficient, and the modification efficient per unit. For example, the processing device 120 may add the base frequency dividing coefficient, the supplementary frequency dividing coefficient, and the modification efficient per unit to the frequency divider, and an overflow bit of the frequency divider may be determined as the preset dividing frequency.
- frac_ns a modification efficient per millisecond
- the processing device 120 may determine a count of clock cycles per unit (e.g., per millisecond) of the first frequency and a count of clock cycles per unit (e.g., per millisecond) of the second frequency, and determine the modification efficient per unit based on a difference between the two.
- the base frequency dividing coefficient (e.g., the “OSC_BASE” ) is 4096
- the supplementary frequency dividing coefficient e.g., the “nanoseconds”
- the frequency dividing process can be performed through a high-order overflow frequency dividing manner, and the supplementary frequency dividing coefficient is increased or decreased based on the base frequency dividing coefficient, accordingly, an accurate and convenient frequency dividing operation can be achieved, so that the accurate frequency synchronization can be realized.
- FIG. 11 is a schematic diagram illustrating an exemplary format of a message according to some embodiments of the present disclosure.
- the format of the message 1100 may include a header, a type, a camera ID, content section (data content of the message) , and a check code.
- the header may include a source port number, a destination port number, a length, or the like, or any combination thereof.
- the type may indicate a type of a data packet.
- An exemplary type may include a broadcast message (e.g., denoted by 0xFF) , device synchronization (e.g., denoted by 0x01) , device response (e.g., denoted by 0x02) , time setting (e.g., denoted by 0x03) , etc.
- the data content of the message may include a timestamp, a control instruction, data, or the like, or any combination thereof.
- the check code may be used to determine correctness of the data content of the message.
- the check code may be a parity check, a Hemming code, a CRC cyclic redundancy check code, or the like, or a combination thereof.
- a local time e.g., the first time
- a data receiver e.g., the second camera
- a synchronization data parsing unit of the second camera may parse the received first message.
- the second camera may obtain the local time t 2 (the second time) through a local time unit and send the local time t 2 to the processing device 120. Then the second camera may check the message after receiving the whole first message. If the check is verified, a time extraction unit of the first camera may extract the local time t 1 (the first time) of the first camera sending the first message and send the local time t 1 to the processing device 120.
- the synchronization data parsing unit of the second camera may parse the received second message.
- the second camera may obtain the local time t 4 (the fourth time) through the local time unit and send the local time t 4 to the processing device 120. Then the second camera may check the second message after receiving the whole second message. If the check is verified, the time extraction unit of the first camera may extract the local time t 3 (the third time) of the first camera sending the second message and send the local time t 3 to the processing device 120.
- the processing device 120 may determine the frequency difference between the first camera and the second camera according to the Equation (1) based on the first time, the second time, the third time, and the fourth time.
- the second camera may send a third message (e.g., a synchronization message) to the first camera at the local time s 1 (the fifth time) .
- the synchronization data parsing unit of the first camera may parse the received third message.
- the first camera may obtain the local time s 2 (the sixth time) through a local time unit and send the local time s 2 to the processing device 120. Further, the first camera may send a fourth message to the second camera at the local time s 3 (the seventh time) of the first camera.
- the second camera may parse the received fourth message.
- the second camera may obtain the local time s 4 (the eighth time) and send the local time s4 to the processing device 120.
- the processing device 120 may determine the time difference according to the Equation (4) based on the fifth time, the sixth time, the seventh time, and the eighth time.
- FIG. 12 is a flowchart illustrating an exemplary process for camera trigger according to some embodiments of the present disclosure.
- process 1200 may be executed by the camera synchronization system 100.
- the process 1200 may be implemented as a set of instructions (e.g., an application) stored in a storage device (e.g., the storage device 130) .
- the processing device 120 e.g., the processor 220 of the computing device 200 and/or the trigger module 430
- the set of instructions may accordingly be directed to perform the process 1200.
- the operations of the illustrated process presented below are intended to be illustrative.
- the process 1200 may be accomplished with one or more additional operations not described and/or without one or more of the operations discussed. Additionally, the order of the operations of process 1200 illustrated in FIG. 12 and described below is not intended to be limiting.
- the processing device 120 may receive a trigger instruction.
- the trigger instruction may be used to instruct the camera to start or perform a corresponding operation.
- the trigger instruction may be a trigger instruction that is automatically sent when a trigger condition (e.g., a preset exposure time point, a preset capture time point) is satisfied as set by the system.
- a trigger condition e.g., a preset exposure time point, a preset capture time point
- the trigger instruction may be a manually issued trigger instruction by the user.
- the trigger instruction may be a trigger instruction sent by a superior device or an external device.
- the processing device 120 may detect a current time of the first camera and a current time of the second camera based on the trigger instruction.
- the processing device 120 may instruct the first camera and the second camera to detect a respective current local time, respectively.
- the processing device 120 may determine whether the current time of the first camera and the current time of the second camera satisfy a preset condition.
- the preset condition may be whether the current time of the first camera is the same as the current time of the second camera. In some embodiments, the preset condition may be whether the current time of the first camera and the current time of the second camera are a preset time point indicated in the trigger instruction (e.g., a preset exposure time point, a preset capture time point) . In some embodiments, the preset condition may also include whether a clock frequency of the first camera and a clock frequency of the second camera have been synchronized.
- the processing device 120 in response to a determination that the current time of the first camera and the current time of the second camera satisfy the preset condition, the processing device 120 (e.g., the trigger module 430) may direct the first camera and the second camera to execute the camera operations.
- the camera operations may include, for example, exposure, photography, shooting, or the like, or any combination thereof. Since the frequencies and the times of the first camera and the second camera are synchronized, the synchronous trigger of the cameras can be executed by means of time detection to realize the cooperation between the first camera and the second camera.
- the processing device 120 in response to a determination that the current time of the first camera and the current time of the second camera do not satisfy the preset condition, the processing device 120 (e.g., the trigger module 430) may issue a prompt (e.g., a voice prompt, a text prompt, an image prompt) or perform a next round of detection after a preset time interval until the current time of the first camera and the current time of the second camera satisfy the preset condition.
- a prompt e.g., a voice prompt, a text prompt, an image prompt
- numbers describing the number of ingredients and attributes are used. It should be understood that such numbers used for the description of the embodiments use the modifier "about” , “approximately” , or “substantially” in some examples. Unless otherwise stated, “about” , “approximately” , or “substantially” indicates that the number is allowed to vary by ⁇ 20%.
- the numerical parameters used in the description and claims are approximate values, and the approximate values may be changed according to the required characteristics of individual embodiments. In some embodiments, the numerical parameters should consider the prescribed effective digits and adopt the method of general digit retention. Although the numerical ranges and parameters used to confirm the breadth of the range in some embodiments of the present disclosure are approximate values, in specific embodiments, settings of such numerical values are as accurate as possible within a feasible range.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Studio Devices (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
- Electric Clocks (AREA)
Abstract
Description
Claims (21)
- A system, comprising:at least one storage medium including a set of instructions; andat least one processor in communication with the at least one storage medium, wherein when executing the set of instructions, the at least one processor is directed to cause the system to perform operations including:determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera;synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference; anddirecting the first camera and the second camera to execute camera operations under synchronized frequency.
- The system of claim 1, wherein the determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera includes:determining a first time of the first camera sending a message and a second time of the second camera receiving the message;determining a third time of the first camera sending a message and a fourth time of the second camera receiving the message; anddetermining the frequency difference based on the first time, the second time, the third time, and the fourth time.
- The system of claim 2, wherein a format of the message at least includes camera ID, whereinthe first time or the third time is a time point of the first camera sending a first camera ID of the first camera, andthe second time or the fourth time is a time point of the second camera receiving the first camera ID.
- The system of claim 1, wherein the synchronizing a second frequency of the second camera to a first frequency of the first camera based on the frequency difference includes:synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference and a preset dividing frequency.
- The system of claim 4, wherein the synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference and a preset dividing frequency includes:dividing the second frequency of the second camera to the preset dividing frequency based on a target frequency dividing coefficient of the second camera; andmultiplying the preset dividing frequency to the first frequency of the first camera.
- The system of claim 5, wherein the determining the target frequency dividing coefficient includes:determining a base frequency dividing coefficient based on the first frequency and the preset dividing frequency;determining a difference ratio based on a difference value between the first frequency and the second frequency;determining a supplementary frequency dividing coefficient based on the base frequency dividing coefficient and the difference ratio; anddetermining the target frequency dividing coefficient based on the base frequency dividing coefficient and the supplementary frequency dividing coefficient.
- The system of claim 1, the operations further including:determining a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency; andsynchronizing the second time of the second camera to the first time of the first camera based on the time difference.
- The system of claim 7, wherein the determining a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency includes:determining a fifth time of the second camera sending a message and a sixth time of the first camera receiving the message;determining a seventh time of the first camera sending a message and an eighth time of the second camera receiving the message; anddetermining the time difference based on the fifth time, the sixth time, the seventh time, and the eighth time.
- The system of claim 7, the operations further including:receiving a trigger instruction;detecting a current time of the first camera and a current time of the second camera based on the trigger instruction;determining whether the current time of the first camera and the current time of the second camera satisfy a preset condition; andin response to a determination that the current time of the first camera and the current time of the second camera satisfy the preset condition, directing the first camera and the second camera to execute the camera operations.
- The system of claim 1, wherein the first camera is connected to the second camera via a camera pin, a bus, or a network interface.
- A method, comprising:determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera;synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference; anddirecting the first camera and the second camera to execute camera operations under synchronized frequency.
- The method of claim 11, wherein the determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera includes:determining a first time of the first camera sending a message and a second time of the second camera receiving the message;determining a third time of the first camera sending a message and a fourth time of the second camera receiving the message; anddetermining the frequency difference based on the first time, the second time, the third time, and the fourth time.
- The method of claim 12, wherein a format of the message at least includes camera ID, whereinthe first time or the third time is a time point of the first camera sending a first camera ID of the first camera, andthe second time or the fourth time is a time point of the second camera receiving the first camera ID.
- The method of claim 11, wherein the synchronizing a second frequency of the second camera to a first frequency of the first camera based on the frequency difference includes:synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference and a preset dividing frequency.
- The method of claim 14, wherein the synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference and a preset dividing frequency includes:dividing the second frequency of the second camera to the preset dividing frequency based on a target frequency dividing coefficient of the second camera; andmultiplying the preset dividing frequency to the first frequency of the first camera.
- The method of claim 15, wherein the determining the target frequency dividing coefficient includes:determining a base frequency dividing coefficient based on the first frequency and the preset dividing frequency;determining a difference ratio based on a difference value between the first frequency and the second frequency;determining a supplementary frequency dividing coefficient based on the base frequency dividing coefficient and the difference ratio; anddetermining the target frequency dividing coefficient based on the base frequency dividing coefficient and the supplementary frequency dividing coefficient.
- The method of claim 11, the operations further including:determining a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency; andsynchronizing the second time of the second camera to the first time of the first camera based on the time difference.
- The method of claim 17, wherein the determining a time difference between a first time of the first camera and a second time of the second camera under the synchronized frequency includes:determining a fifth time of the second camera sending a message and a sixth time of the first camera receiving the message;determining a seventh time of the first camera sending a message and an eighth time of the second camera receiving the message; anddetermining the time difference based on the fifth time, the sixth time, the seventh time, and the eighth time.
- The method of claim 17, the operations further including:receiving a trigger instruction;detecting a current time of the first camera and a current time of the second camera based on the trigger instruction;determining whether the current time of the first camera and the current time of the second camera satisfy a preset condition; andin response to a determination that the current time of the first camera and the current time of the second camera satisfy the preset condition, directing the first camera and the second camera to execute the camera operations.
- The method of claim 11, wherein the first camera is connected to the second camera via a camera pin, a bus, or a network interface.
- A non-transitory computer readable medium, comprising at least one set of instructions, wherein when executed by one or more processors of a computing device, the at least one set of instructions causes the computing device to perform a method, the method comprising:determining a frequency difference between a first frequency of a first camera and a second frequency of a second camera;synchronizing the second frequency of the second camera to the first frequency of the first camera based on the frequency difference; anddirecting the first camera and the second camera to execute camera operations under synchronized frequency.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020247003799A KR102880046B1 (en) | 2021-07-08 | 2022-07-06 | Systems and methods for camera synchronization |
| JP2024500378A JP7806208B2 (en) | 2021-07-08 | 2022-07-06 | Systems and methods for camera synchronization |
| EP22836952.6A EP4348887A4 (en) | 2021-07-08 | 2022-07-06 | Systems and methods for camera synchronization |
| US18/406,267 US12621407B2 (en) | 2021-07-08 | 2024-01-08 | Systems and methods for camera synchronization |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110769848.0A CN113225152B (en) | 2021-07-08 | 2021-07-08 | A method, apparatus and computer readable medium for camera synchronization |
| CN202110769848.0 | 2021-07-08 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/406,267 Continuation US12621407B2 (en) | 2021-07-08 | 2024-01-08 | Systems and methods for camera synchronization |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023280206A1 true WO2023280206A1 (en) | 2023-01-12 |
Family
ID=77081162
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/104126 Ceased WO2023280206A1 (en) | 2021-07-08 | 2022-07-06 | Systems and methods for camera synchronization |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US12621407B2 (en) |
| EP (1) | EP4348887A4 (en) |
| JP (1) | JP7806208B2 (en) |
| KR (1) | KR102880046B1 (en) |
| CN (1) | CN113225152B (en) |
| WO (1) | WO2023280206A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4468139A1 (en) * | 2023-05-23 | 2024-11-27 | Horizon Journey (Hangzhou) Technology Co., Ltd. | Method and apparatus for synchronizing images from multiple channels, and electronic device |
| US12621407B2 (en) | 2021-07-08 | 2026-05-05 | Zhejiang Huaray Technology Co., Ltd. | Systems and methods for camera synchronization |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113821074B (en) | 2021-09-06 | 2023-09-08 | 北京车和家信息技术有限公司 | Time synchronization method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120249806A1 (en) * | 2011-03-31 | 2012-10-04 | Gong Michelle X | Collaborative image control |
| CN109586691A (en) * | 2018-11-19 | 2019-04-05 | 珠海市杰理科技股份有限公司 | Clock correcting method, device, system, storage medium and computer equipment |
| US20190289172A1 (en) * | 2018-03-13 | 2019-09-19 | Lyft, Inc. | Systems and methods for synchronizing sensor capture |
| CN110996011A (en) * | 2019-12-20 | 2020-04-10 | 易思维(杭州)科技有限公司 | Multi-camera synchronous triggering system |
| US20200396392A1 (en) * | 2019-06-12 | 2020-12-17 | Robert Mark Griswold | Time synchronized cameras for multi-camera event videos |
| CN113055117A (en) * | 2021-04-25 | 2021-06-29 | 电子科技大学 | Clock synchronization device and method of wireless distributed network |
| CN113225152A (en) * | 2021-07-08 | 2021-08-06 | 浙江华睿科技股份有限公司 | Method and device for synchronizing cameras and computer readable medium |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3369982B2 (en) * | 1998-10-30 | 2003-01-20 | 日本電気株式会社 | Clock phase synchronization circuit |
| JP3787498B2 (en) * | 2001-02-13 | 2006-06-21 | キヤノン株式会社 | Imaging apparatus and imaging system |
| JP4827611B2 (en) * | 2006-05-23 | 2011-11-30 | ローム株式会社 | Serial interface device, image forming device |
| CN101729180A (en) * | 2008-10-21 | 2010-06-09 | 华为技术有限公司 | Method and system for synchronizing precision clocks, and precision clock frequency/time synchronizing device |
| US8717433B2 (en) * | 2011-04-11 | 2014-05-06 | Gentex Corporation | Image synchronization for a multiple imager system and method thereof |
| CN102404105A (en) * | 2011-12-14 | 2012-04-04 | 盛科网络(苏州)有限公司 | Device and method for realizing time synchronization on Ethernet switch |
| JP2014003407A (en) * | 2012-06-16 | 2014-01-09 | Sony Corp | Communication device, communication system and communication control method, and program |
| JP6060953B2 (en) * | 2014-09-24 | 2017-01-18 | カシオ計算機株式会社 | Synchronous shooting system, operation terminal, synchronous shooting method and program |
| US9819875B2 (en) | 2015-03-02 | 2017-11-14 | Intel Corporation | Multi-camera sync pulse synchronization |
| CN107231533B (en) | 2017-06-12 | 2019-12-13 | 深圳市瑞立视多媒体科技有限公司 | A synchronous exposure method, device and terminal equipment |
| US11323594B2 (en) | 2017-06-12 | 2022-05-03 | Shenzhen Realis Multimedia Technology Co., Ltd | Method, apparatus and terminal device for synchronous exposure |
| CN107425851B (en) * | 2017-08-09 | 2021-08-06 | 京东方科技集团股份有限公司 | Frequency compensator, electronic device and frequency compensation method |
| CN110567453B (en) * | 2019-08-21 | 2021-05-25 | 北京理工大学 | Bionic eye multi-channel IMU and camera hardware time synchronization method and device |
| CN111130676B (en) * | 2019-12-02 | 2022-06-28 | 上海赫千电子科技有限公司 | A time synchronization correction method and device applied to a master clock and a slave clock |
| CN212013044U (en) * | 2020-06-29 | 2020-11-24 | 深圳市深谷微电子科技有限公司 | Universal serial bus audio equipment synchronous clock system |
| CN111556226A (en) * | 2020-07-13 | 2020-08-18 | 深圳市智绘科技有限公司 | Camera system |
-
2021
- 2021-07-08 CN CN202110769848.0A patent/CN113225152B/en active Active
-
2022
- 2022-07-06 KR KR1020247003799A patent/KR102880046B1/en active Active
- 2022-07-06 WO PCT/CN2022/104126 patent/WO2023280206A1/en not_active Ceased
- 2022-07-06 JP JP2024500378A patent/JP7806208B2/en active Active
- 2022-07-06 EP EP22836952.6A patent/EP4348887A4/en active Pending
-
2024
- 2024-01-08 US US18/406,267 patent/US12621407B2/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120249806A1 (en) * | 2011-03-31 | 2012-10-04 | Gong Michelle X | Collaborative image control |
| US20190289172A1 (en) * | 2018-03-13 | 2019-09-19 | Lyft, Inc. | Systems and methods for synchronizing sensor capture |
| CN109586691A (en) * | 2018-11-19 | 2019-04-05 | 珠海市杰理科技股份有限公司 | Clock correcting method, device, system, storage medium and computer equipment |
| US20200396392A1 (en) * | 2019-06-12 | 2020-12-17 | Robert Mark Griswold | Time synchronized cameras for multi-camera event videos |
| CN110996011A (en) * | 2019-12-20 | 2020-04-10 | 易思维(杭州)科技有限公司 | Multi-camera synchronous triggering system |
| CN113055117A (en) * | 2021-04-25 | 2021-06-29 | 电子科技大学 | Clock synchronization device and method of wireless distributed network |
| CN113225152A (en) * | 2021-07-08 | 2021-08-06 | 浙江华睿科技股份有限公司 | Method and device for synchronizing cameras and computer readable medium |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4348887A4 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12621407B2 (en) | 2021-07-08 | 2026-05-05 | Zhejiang Huaray Technology Co., Ltd. | Systems and methods for camera synchronization |
| EP4468139A1 (en) * | 2023-05-23 | 2024-11-27 | Horizon Journey (Hangzhou) Technology Co., Ltd. | Method and apparatus for synchronizing images from multiple channels, and electronic device |
| JP2024169342A (en) * | 2023-05-23 | 2024-12-05 | 地平▲線▼征程(杭州)科技有限公司 | Method, device and electronic device for synchronizing multi-channel images |
| JP7763521B2 (en) | 2023-05-23 | 2025-11-04 | 地平▲線▼征程(杭州)科技有限公司 | Method, device and electronic equipment for synchronizing multi-channel images |
| US12483672B2 (en) | 2023-05-23 | 2025-11-25 | Horizon Journey (Hangzhou) Technology Co., Ltd. | Method for synchronizing images from multiple channels, and electronic device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113225152A (en) | 2021-08-06 |
| US12621407B2 (en) | 2026-05-05 |
| KR20240028492A (en) | 2024-03-05 |
| JP7806208B2 (en) | 2026-01-26 |
| EP4348887A1 (en) | 2024-04-10 |
| CN113225152B (en) | 2021-10-15 |
| KR102880046B1 (en) | 2025-11-03 |
| EP4348887A4 (en) | 2024-10-23 |
| JP2024529305A (en) | 2024-08-06 |
| US20240146870A1 (en) | 2024-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12621407B2 (en) | Systems and methods for camera synchronization | |
| CN110505466B (en) | Image processing method, device, electronic equipment, storage medium and system | |
| JP6401716B2 (en) | Synchronous signal processing method and apparatus for stereoscopic display of splice screen, splice screen | |
| US10951804B2 (en) | Photographing synchronization method and apparatus | |
| CN112153306B (en) | Image acquisition system, method, device, electronic device and wearable device | |
| CN110399110A (en) | Multi-screen synchronous display methods and system, display equipment and storage medium | |
| CN104506888B (en) | Clock synchronization apparatus, method and system | |
| EP2959600A1 (en) | Time synchronous pluggable transceiver | |
| CN119071463B (en) | Virtual shooting method and device | |
| CN108702719A (en) | Time synchronization method, system and the unmanned plane of unmanned plane | |
| EP2533542B1 (en) | Imaging device and imaging method | |
| CN114040090A (en) | Method, device, equipment, storage medium, acquisition part and system for synchronizing virtuality and reality | |
| CN105791694B (en) | Imaging control device, fill-flash device and fill-flash control system | |
| CN106534814B (en) | A kind of method and apparatus that dual camera picture quality is synchronous | |
| CN114830027A (en) | Imaging system, control method, and program | |
| CN111102689A (en) | Method and device for adjusting clock synchronization | |
| CN105138285B (en) | Sharing method, device and the equipment of photographed data | |
| CN109842791B (en) | Image processing method and device | |
| CN117499712B (en) | Synchronization methods, systems and electronic devices | |
| CN213403304U (en) | Binocular 3D camera and mobile device thereof | |
| CN222215748U (en) | Clock synchronization device and network clock card | |
| CN103684731B (en) | Method for synchronizing time | |
| CN111629150A (en) | Method and system for realizing multi-device photographing time synchronization through Wifi | |
| CN116193044B (en) | Method, device, equipment and medium for synchronously displaying multiple image frames | |
| CN111447436B (en) | Video signal stability detection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22836952 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2024500378 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202417001104 Country of ref document: IN Ref document number: 2022836952 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 20247003799 Country of ref document: KR Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 1020247003799 Country of ref document: KR |
|
| ENP | Entry into the national phase |
Ref document number: 2022836952 Country of ref document: EP Effective date: 20240105 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |