WO2023221969A1 - 3d图片拍摄方法和3d拍摄系统 - Google Patents

3d图片拍摄方法和3d拍摄系统 Download PDF

Info

Publication number
WO2023221969A1
WO2023221969A1 PCT/CN2023/094471 CN2023094471W WO2023221969A1 WO 2023221969 A1 WO2023221969 A1 WO 2023221969A1 CN 2023094471 W CN2023094471 W CN 2023094471W WO 2023221969 A1 WO2023221969 A1 WO 2023221969A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
view
target
camera
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/094471
Other languages
English (en)
French (fr)
Inventor
贺曙
徐万良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guang Dong Future Technology Co Ltd
Original Assignee
Guang Dong Future Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guang Dong Future Technology Co Ltd filed Critical Guang Dong Future Technology Co Ltd
Priority to KR1020247042236A priority Critical patent/KR20250044193A/ko
Priority to EP23806921.5A priority patent/EP4529158A4/en
Publication of WO2023221969A1 publication Critical patent/WO2023221969A1/zh
Priority to US18/953,200 priority patent/US20250078398A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/221—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using the relative movement between cameras and objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
    • H04N13/264—Image signal generators with monoscopic-to-stereoscopic image conversion using the relative movement of objects in two video frames or fields
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes

Definitions

  • the present application relates to the field of three-dimensional image display, and in particular, to a 3D picture shooting method and a 3D shooting system.
  • the 3D camera used to shoot movies is a shooting device composed of two cameras combined vertically. This equipment is huge, too heavy, and difficult to move. In order to adjust the angle and position of the two camera units, it is often necessary to adjust the angle and position of the two camera units.
  • the structure is relatively complex, which virtually increases the cost of production and use. The price is relatively expensive and difficult to be accepted by ordinary consumers.
  • This application provides a 3D picture shooting method and a 3D shooting system for achieving stereoscopic shooting more simply and at low cost.
  • a second aspect of the embodiment of the present application provides a 3D shooting system.
  • the 3D shooting system includes a mobile device with a camera and a target peripheral.
  • the target peripheral is installed on the mobile device and includes: the camera for shooting calibration. board, and obtain a first left view and a first right view through the lens of the target peripheral; a calibration unit configured to perform a calibration operation on the mobile device according to the first left view and the first right view;
  • the camera is also used to capture the target scene to obtain a second left view and a second right view;
  • a splicing unit is used to splice the second left view and the second right view to obtain a 3D picture.
  • a third aspect of the present application provides a server, which includes at least one connected processor, memory and transceiver, wherein the memory is used to store program codes, and the processor is used to call the program in the memory. code to execute the steps of the 3D picture capturing method described in the second aspect.
  • a target peripheral is installed on the mobile device; the calibration plate is photographed through the camera, and the first left view is obtained through the lens of the target peripheral and a first right view; performing a calibration operation on the mobile device according to the first left view and the first right view; photographing the target scene through the camera to obtain a second left view and a second right view; according to the The second left view and the second right view are spliced to obtain a 3D picture.
  • peripherals ordinary mobile devices with cameras can perform 3D stereoscopic shooting.
  • the peripherals are easy to install and do not require modifications to the mobile devices themselves. Combined with the algorithms provided in the embodiments of this application, it can be simple and low-cost. Realize stereoscopic shooting at low cost.
  • Figure 1 is a schematic flowchart of a 3D picture shooting method provided by an embodiment of the present application
  • Figure 1B is a schematic coordinate diagram of a possible left block provided by an embodiment of the present application.
  • Figure 2 is a schematic diagram of the virtual structure of the 3D shooting system provided by the embodiment of the present application.
  • Figure 3 is a schematic diagram of the hardware structure of a server provided by an embodiment of the present application.
  • Figure 1 is a schematic flow chart of a 3D picture shooting method provided by an embodiment of the present application, including:
  • Embodiments of the present application are applied to mobile devices with cameras, and target peripherals are installed on the mobile devices.
  • calibration needs to be performed after the target peripherals are installed.
  • the calibration board is photographed through the camera.
  • the calibration board can be a checkerboard calibration board, a dot calibration board, etc.
  • the embodiment of the present application takes the calibration board as a checkerboard as an example.
  • a left image and a right image are generated; for better calibration, it is necessary to ensure that both the left image and the right image can completely capture the calibration plate, and allow the calibration plate to occupy as much space as possible More picture areas, so after obtaining the left image and the right image, determine whether the left image and the right image are completely photographed to the calibration plate, and the calibration plate occupies the left image and the Whether the proportions of the right images are both greater than a preset value; if so, use the left image and the right image as the first left view and the first right view.
  • Figure 1A is a possible generated picture of the first left view and the first right view, that is, the camera captures the same calibration plate. Since the lens of the target peripheral device will refract, the left and right views will be generated. Three stereoscopic images with parallax, namely the first left view and the first right view.
  • a left corner point and a right corner point are respectively detected on the first left view and the first right view, and the left corner point and the right corner point are respectively detected.
  • the number of points is M*N; divide the area where the left corner point is located according to the LA method to obtain the left block set and determine the target left block, and divide the area where the right corner point is located to obtain the right block set and determine
  • the target right block is the block closest to the square in the set of left blocks, and the target right block is The right block gathers the blocks closest to the square; the optimal length is determined according to the target left block and the target right block to calibrate the mobile device.
  • the DI is used to represent the length difference between two adjacent sides of each left block
  • the first left block is concentrated in the left block any block.
  • the left block corresponding to the minimum length difference is determined to be the target left block.
  • FIG. 1B is a schematic coordinate diagram of the first left block provided by an embodiment of the present application.
  • the target right block is determined in the same way, and details will not be repeated here.
  • the calibration board is used as a checkerboard as an example.
  • the image blocks segmented after taking photos and refraction are deformed and have distortion. Therefore, two adjacent blocks in the left block set and the right block set are respectively determined.
  • the target left square and the target right square with the smallest side length difference are the target left square and the target right square that are closest to a square.
  • the target left block and the target right block After determining the target left block and the target right block, determine the optimal length according to the target left block and the target right block. Specifically, calculate the first average side length of the target left block and the The second average side length of the target right square. It should be noted that the method of calculating the first average side length of the target left block is:
  • the target block for calibration After determining the optimal length, define the target block for calibration.
  • perspective transformation is performed to obtain the transformed coordinates of each block PTL (x, y), where PTL (x, y) is a square, that is, the calibration process is realized.
  • the target scene is captured by the camera to obtain the second left view and the second right view, and the final 3D picture is obtained based on the second left view and the second right view.
  • the left transformation points are spliced to obtain a left transformation graph
  • the right transformation points are spliced to obtain a right transformation graph
  • the left transformation points are spliced to obtain a right transformation graph
  • the transformation map and the right transformation map are spliced to obtain the 3D picture.
  • ordinary mobile devices equipped with the camera can perform 3D stereoscopic shooting by installing the peripheral device.
  • the peripheral device is convenient and simple to install, and there is no need to modify the mobile device itself.
  • the algorithm provided by the embodiments of this application can realize stereoscopic shooting simply and at low cost.
  • FIG. 2 is a schematic virtual structural diagram of a 3D shooting system provided by an embodiment of the present application.
  • the 3D shooting system 200 includes a mobile device with a camera 201 and a target peripheral 202.
  • the target peripheral 202 is installed on
  • the mobile devices include:
  • the camera 201 is used to photograph the calibration plate and obtain the first left view and the first right view through the lens of the target peripheral;
  • Calibration unit 203 configured to perform calibration operations on the mobile device according to the first left view and the first right view;
  • the camera 201 is also used to capture the target scene to obtain a second left view and a second right view;
  • the splicing unit 204 is used to splice the second left view and the second right view to obtain a 3D picture.
  • the calibration unit 203 is specifically configured to: detect left corner points and right corner points respectively on the first left view and the first right view, and the number of the left corner points and the right corner points. are all M*N; divide the area where the left corner point is located to obtain the left block set and determine the target left block, and divide the area where the right corner point is located to obtain the right block set and determine the target right block, and the target
  • the left block is the block closest to a square in the left block set
  • the target right block is the block closest to a square in the right block set
  • the optimal length is determined based on the target left block and the target right block to The mobile device is calibrated.
  • the calibration unit is specifically configured to: divide the area where the left corner point is located into (M-1)*(N-1) left blocks, and determine the coordinates of each left block; according to The coordinates of each left block determine the length difference between two adjacent sides of each left block, and the length difference is not less than 0; determine the left block corresponding to the minimum length difference as the target Mark the left square.
  • ; wherein, the DI is used to represent the length difference between the two adjacent sides of each left block, and the coordinates of the first left block are LA(x,y) (P(x,y),P(x+1,y),P(x,y+1),P(x+1,y+1)), 0 ⁇ x ⁇ M , 0 ⁇ y ⁇ N, the first left block is any block in the set of left blocks.
  • the calibration unit is specifically configured to: calculate the first average side length of the target left block and the second average side length of the target right block; combine the first average side length and the second The smaller of the average side lengths is used as the optimal length.
  • the splicing unit is specifically configured to: segment the second left view and the second right view according to LA(x, y) to obtain the left original point and the right original point respectively;
  • the left original point and each right original point are subjected to perspective transformation to obtain each left transformation point corresponding to each left original point and each right transformation point corresponding to each right original point;
  • the left transformation map is obtained by splicing, and the right transformation map is obtained by splicing the right transformation points;
  • the 3D picture is obtained by splicing the left transformation map and the right transformation map.
  • the processor 301 can perform the above-mentioned operations performed by the 3D picture shooting method to implement the 3D picture shooting method.
  • the implementation principles and technical effects are similar and will not be described again here.
  • Embodiments of the present application also provide a computer-readable medium that includes computer-executable instructions that enable the server to execute the 3D picture shooting method described in the above-mentioned embodiments.
  • the implementation principles and technical effects are similar and will not be used here. Again.
  • the present application can be implemented by software plus necessary general hardware. Of course, it can also be implemented by dedicated hardware including dedicated integrated circuits, dedicated CPUs, dedicated memories, Special components, etc. to achieve. In general, all functions performed by computer programs can be easily implemented with corresponding hardware. Moreover, the specific hardware structures used to implement the same function can also be diverse, such as analog circuits, digital circuits or special-purpose circuits. circuit etc. However, for this application, software program implementation is a better implementation in most cases. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or that contributes to the existing technology.
  • the computer software product is stored in a readable storage medium, such as a computer floppy disk. , U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc., including several instructions to make a computer device (which can be Personal computer, server, or network device, etc.) executes the methods described in various embodiments of this application.
  • a computer device which can be Personal computer, server, or network device, etc.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
  • wired such as coaxial cable, optical fiber, digital subscriber line (DSL)
  • wireless such as infrared, wireless, microwave, etc.
  • the computer-readable storage medium may be a computer capable of storing Any available media or data storage devices such as servers, data centers, etc. that contain one or more available media integrations.
  • the available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)

Abstract

本申请提供一种3D图片拍摄方法和3D拍摄系统，用于更加简便低成本的实现立体拍摄。所述3D图片拍摄方法应用于具有摄像头的移动设备，所述移动设备上安装有目标外设，包括：通过所述摄像头拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；通过所述摄像头拍摄目标场景以得到第二左视图和第二右视图；根据所述第二左视图和所述第二右视图拼接得到3D图片。

Description

3D图片拍摄方法和3D拍摄系统 技术领域
本申请涉及三维图像显示领域，尤其涉及一种3D图片拍摄方法和3D拍摄系统。
背景技术
随着数码影像输入输出设备的日益普及，数码立体图像得到了很大的发展。现有技术中，要得到立体数码图像的方法有两种，一种是通过专业的3D数码相机拍摄得到，这种3D数码相机最大的改变是，将采集到的两块CCD传感器上的同步图像信号合并，并即时处理成高质量的影像。但是此种数码相机通用性不强，不适合各种条件和各种用途拍摄；另一种是通过两台普通的数码相机或摄影机对同一物体进行不同角度的拍摄，来达到3D摄影的目的；但是，现阶段两台相机平行拍摄时，镜头间轴距由于相机体积所限不可能过小，这就造成了近景不能拍摄或立体效果很差而引起头晕、恶心、以及眼部极度不适，而用于拍摄电影的3D摄像机是由两个摄像机以垂直方式组合在一起而成的拍摄装置，这种设备体积巨大，过于沉重，不利于移动，为了可调整两个摄像单元的角度和位置，往往结构比较复杂，无形中增加了生产和使用的成本，价格较为昂贵，难以被普通的消费者所接受。
因此，如何提供让立体图像的拍摄更加简便且成本被更多人接受，是本领域技术人员亟需解决的问题。
发明内容
本申请提供一种3D图片拍摄方法和3D拍摄系统，用于更加简便低成本的实现立体拍摄。
本申请实施例第一方面提供一种3D图片拍摄方法，包括：在所述移动设备上安装目标外设；通过所述摄像头拍摄标定板，并经由所 述目标外设的镜片得到第一左视图和第一右视图；根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；通过所述摄像头拍摄目标场景以得到第二左视图和第二右视图；根据所述第二左视图和所述第二右视图拼接得到3D图片。
本申请实施例第二方面提供3D拍摄系统，所述3D拍摄系统包括具有摄像头的移动设备和目标外设，所述目标外设安装于所述移动设备，包括：所述摄像头，用于拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；校准单元，用于根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；所述摄像头还用于拍摄目标场景以得到第二左视图和第二右视图；拼接单元，用于根据所述第二左视图和所述第二右视图拼接得到3D图片。
本发明本申请第三方面提供了一种服务器，其包括至少一个连接的处理器、存储器和收发器，其中，所述存储器用于存储程序代码，所述处理器用于调用所述存储器中的程序代码来执行上述第二方面所述的3D图片拍摄方法的步骤。
综上所述，可以看出，本申请提供的实施例中，在所述移动设备上安装目标外设；通过所述摄像头拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；通过所述摄像头拍摄目标场景以得到第二左视图和第二右视图；根据所述第二左视图和所述第二右视图拼接得到3D图片。可知，通过安装外设的形式让普通带有摄像头的移动设备可以进行3D立体拍摄，该外设安装方便简单，无需对移动设备本身进行改动，再结合本申请实施例提供的算法，可简便低成本的实现立体拍摄。
附图说明
图1为本申请实施例提供的3D图片拍摄方法的流程示意图；
图1A为本申请实施例提供的一种可能的标定板拍摄示意图；
图1B为本申请实施例提供的一种可能的左方块的坐标示意图；
图2为本申请实施例提供的3D拍摄系统的虚拟结构示意图；
图3为本申请实施例提供的服务器的硬件结构示意图。
具体实施方式
请参阅图1，图1为本申请实施例提供的3D图片拍摄方法的流程示意图，包括：
101、通过所述摄像头拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；
本申请实施例应用于具有摄像头的移动设备，所述移动设备上安装有目标外设，为保证3D图片的拍摄效果，在安装了目标外设后，需进行校准。
先通过所述摄像头拍摄标定板，其中，所述标定板可为棋盘格标定板、圆点标定板等，本申请实施例为便于描述，以所述标定板为棋盘格为例进行说明。经由所述目标外设的镜片折射，生成左图像和右图像；为了更好的校准，需保证左图像和右图像均能完整拍摄到所述标定板，且尽可能的让所述标定板占据更多的图片区域，因此在得到所述左图像和所述右图像后，判断所述左图像和所述右图像是否完整拍摄到所述标定板，且所述标定板占据所述左图像和所述右图像的比例是否均大于预设值；若是，则将所述左图像和所述右图像作为所述第一左视图和所述第一右视图。请参阅图1A，为一种可能的第一左视图和第一右视图的生成图片，即所述摄像头拍摄的是同一张标定板，由于所述目标外设的镜片会折射，会生成左右两个具有视差的立体图像，即所述第一左视图和所述第一右视图。
102、根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；
在生成所述第一左视图和所述第一右视图后，在所述第一左视图和所述第一右视图上分别检测左角点和右角点，所述左角点和所述右角点的个数均为M*N个；将所述左角点所在区域按照LA方式进行分割得到左方块集并确定目标左方块，并将所述右角点所在区域进行分割得到右方块集并确定目标右方块，所述目标左方块为所述左方块集中最接近正方形的方块，所述目标右方块为 所述右方块集中最接近正方形的方块；根据所述目标左方块和所述目标右方块确定最优长度，以对所述移动设备进行校准。
其中，所述将所述左角点所在区域进行分割得到所述左方块集并确定所述目标左方块包括：将所述左角点所在区域分割成(M-1)*(N-1)个所述左方块，并确定所述各左方块的坐标；根据所述各左方块的坐标确定所述各左方块相邻两条边的长度差，所述长度差不小于0，具体地，通过以下公式计算第一左方块相邻两条边的长度差：DI＝||P(x,y)-P(x+1,y)|-|P(x,y)-P(x,y+1)||；
其中，所述DI用于表示所述各左方块相邻两条边的长度差，所述第一左方块的坐标为LA(x,y)＝(P(x,y)，P(x+1,y)，P(x,y+1)，P(x+1,y+1))，0＜x＜M，0＜y＜N，所述第一左方块为所述左方块集中的任一方块。在得到所述左方块集中的各方块相邻两条边的长度差后，确定最小长度差对应的左方块为所述目标左方块。请参阅图1B，为本申请实施例提供的一种所述第一左方块的坐标示意图。
同理，以同样的方式确定所述目标右方块，具体此处不再赘述。
即本申请中以所述标定板为棋盘格进行举例，在经过拍照折射后分割出来的图像块是变形的，存在畸变，故分别确定所述左方块集和所述右方块集中相邻两条边长度差最小的目标左方块和目标右方块，即最接近正方形的目标左方块和目标右方块。
在确定所述目标左方块和所述目标右方块后，根据所述目标左方块和所述目标右方块确定最优长度，具体地，计算所述目标左方块的第一平均边长和所述目标右方块的第二平均边长。需要说明的是，计算所述目标左方块的第一平均边长的方式为：
L0＝(|P(x1,y1)-P(x1+1,y1)|+|P(x1,1、y1)-P(x1,y1+1)|+|P(x1+1,y1+1)-P(x1+1,y1)|+|P(x1+1,y1+1)-P(x1,y1+1)|)/4，其中所述目标左方块的坐标为(P(x1,y1)，P(x1+1,y1)，P(x1,y1+1)，P(x1+1,y1+1)，同理，也可以计算出所述目标右方块的第二平均边长。
再将所述第一平均边长和所述第二平均边长中较小的边长作 为所述最优长度。确定所述最优长度后，定义校准的目标块，本申请中，将P1块设置为所述目标块，所述PI块的坐标为P1＝[[0,0],[L,0],[0,L],[L,L]]。根据所述P1块为目标进行透视变换得到变换后的各块PTL(x,y)的坐标，其中PTL(x,y)为正方形，即实现了校准过程。
103、通过所述摄像头拍摄目标场景以得到第二左视图和第二右视图；
在校准完成后，通过所述摄像头拍摄目标场景，得到所述第二左视图和所述第二右视图，再根据所述第二左视图和所述第二右视图得到最终的3D图片。
104、根据所述第二左视图和所述第二右视图拼接得到3D图片。
对所述第二左视图和所述第二右视图按照上述LA方式进行分割，分别得到左原始点和右原始点；对所述各左原始点和所述各右原始点进行透视变换，分别得到所述各左原始点对应的各左变换点，其中，对所述各左原始点进行透视变换得到所述各左原始点对应的所述各左变换点和所述各右原始点对应的所述各右变换，所谓透视变换(perspective transformation)的本质是将图像投影到一个新的视平面，即为空间远近的视觉传达，远的小，近的大，具体过程可以为将一个二维坐标系转换为三维坐标系，然后把三维坐标系投影到新的二维坐标系，该过程是一个非线性变换过程。基于透视变换为现有技术中很常见的数据处理方式，具体本申请不再赘述。
在得到所述各左变换点和所述各右变换点后，将所述各左变换点进行拼接得到左变换图，且将所述各右变换点进行拼接得到右变换图；将所述左变换图和所述右变换图拼接得到所述3D图片。
本申请实施例中，通过安装所述外设的形式让普通带有所述摄像头的移动设备可以进行3D立体拍摄，所述外设安装方便简单，无需对所述移动设备本身进行改动，再结合本申请实施例提供的算法，可简便低成本的实现立体拍摄。
上面从3D图片拍摄方法的角度对本申请实施例进行说明，下 面从3D拍摄系统的角度对本申请实施例进行说明。
请参阅图2，图2为本申请实施例提供的3D拍摄系统的虚拟结构示意图，所述3D拍摄系统200包括具有摄像头201的移动设备，及目标外设202，所述目标外设202安装于所述移动设备，包括：
所述摄像头201，用于拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；
校准单元203，用于根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；
所述摄像头201还用于拍摄目标场景以得到第二左视图和第二右视图；
拼接单元204，用于根据所述第二左视图和所述第二右视图拼接得到3D图片。
可选的，所述摄像头201具体用于：通过所述摄像头拍摄所述标定板；经由所述目标外设的镜片折射，生成左图像和右图像；判断所述左图像和所述右图像是否完整拍摄到所述标定板，且所述标定板占据所述左图像和所述右图像的比例是否均大于预设值；若是，则将所述左图像和所述右图像作为所述第一左视图和所述第一右视图。
可选的，所述校准单元203具体用于：在所述第一左视图和所述第一右视图上分别检测左角点和右角点，所述左角点和所述右角点的个数均为M*N个；将所述左角点所在区域进行分割得到左方块集并确定目标左方块，并将所述右角点所在区域进行分割得到右方块集并确定目标右方块，所述目标左方块为所述左方块集中最接近正方形的方块，所述目标右方块为所述右方块集中最接近正方形的方块；根据所述目标左方块和所述目标右方块确定最优长度，以对所述移动设备进行校准。
可选的，所述校准单元具体用于：将所述左角点所在区域分割成(M-1)*(N-1)个所述左方块，并确定所述各左方块的坐标；根据所述各左方块的坐标确定所述各左方块相邻两条边的长度差，所述长度差不小于0；确定最小长度差对应的左方块为所述目 标左方块。
可选的，所述校准单元具体用于：通过以下公式计算第一左方块相邻两条边的长度差：DI＝||P(x,y)-P(x+1,y)|-|P(x,y)-P(x,y+1)||；其中，所述DI用于表示所述各左方块相邻两条边的长度差，所述第一左方块的坐标为LA(x,y)＝(P(x,y)，P(x+1,y)，P(x,y+1)，P(x+1,y+1))，0＜x＜M，0＜y＜N，所述第一左方块为所述左方块集中的任一方块。
可选的，所述校准单元具体用于：计算所述目标左方块的第一平均边长和所述目标右方块的第二平均边长；将所述第一平均边长和所述第二平均边长中较小的边长作为所述最优长度。
可选的，所述拼接单元具体用于：对所述第二左视图和所述第二右视图按照LA(x,y)进行分割，分别得到左原始点和右原始点；对所述各左原始点和所述各右原始点进行透视变换，分别得到所述各左原始点对应的各左变换点，和所述各右原始点对应的各右变换点；将所述各左变换点进行拼接得到左变换图，且将所述各右变换点进行拼接得到右变换图；将所述左变换图和所述右变换图拼接得到所述3D图片。
图3为本申请服务器的硬件结构示意图，如图3所示，本实施例的服务器300包括至少一个处理器301，至少一个网络接口304或者其他用户接口303，存储器305，以及至少一通信总线302。该服务器300可选的包含所述用户接口303，包括显示器，键盘或者点击设备。所述存储器305可能包含高速RAM存储器，也可能还包括非不稳定的存储器(non-volatilememory)，例如至少一个磁盘存储器。所述存储器305存储执行指令，当服务器300运行时，所述处理器301与所述存储器305之间通信，所述处理器301调用所述存储器305中存储的指令，以执行上述3D图片拍摄方法。所述操作系统306，包含各种程序，用于实现各种基础业务以及处理基于硬件的任务。
本申请实施例提供的服务器，所述处理器301可以执行上述由3D图片拍摄方法所执行的操作，以实现基于3D图片拍摄方法，其实现原理和技术效果类似，具体此处不再赘述。
本申请实施例还提供一种计算机可读介质，包含计算机执行指令，所述计算机执行指令能够使所述服务器执行上述实施例描述的3D图片拍摄方法，其实现原理和技术效果类似，此处不再赘述。
通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到本申请可借助软件加必需的通用硬件的方式来实现，当然也可以通过专用硬件包括专用集成电路、专用CPU、专用存储器、专用元器件等来实现。一般情况下，凡由计算机程序完成的功能都可以很容易地用相应的硬件来实现，而且，用来实现同一功能的具体硬件结构也可以是多种多样的，例如模拟电路、数字电路或专用电路等。但是，对本申请而言更多情况下软件程序实现是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在可读取的存储介质中，如计算机的软盘、U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。
所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存储的 任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。

Claims (9)

  1. 一种3D图片拍摄方法，所述方法应用于具有摄像头的移动设备，其特征在于，所述移动设备上安装有目标外设，包括：
    通过所述摄像头拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；
    根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；
    通过所述摄像头拍摄目标场景以得到第二左视图和第二右视图；
    根据所述第二左视图和所述第二右视图拼接得到3D图片。
  2. 根据权利要求1所述的3D图片拍摄方法，其特征在于，所述通过所述摄像头拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图包括：
    通过所述摄像头拍摄所述标定板；
    经由所述目标外设的镜片折射，生成左图像和右图像；
    判断所述左图像和所述右图像是否完整拍摄到所述标定板，且所述标定板占据所述左图像和所述右图像的比例是否均大于预设值；
    若是，则将所述左图像和所述右图像作为所述第一左视图和所述第一右视图。
  3. 根据权利要求1所述的3D图片拍摄方法，其特征在于，当所述标定板为棋盘格标定板时，所述根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作包括：
    在所述第一左视图和所述第一右视图上分别检测左角点和右角点，所述左角点和所述右角点的个数均为M*N个；
    将所述左角点所在区域进行分割得到左方块集并确定目标左方块，并将所述右角点所在区域进行分割得到右方块集并确定目标右方块，所述目标左方块为所述左方块集中最接近正方形的方块，所述目标右方块为所述右方块集中最接近正方形的方块；
    根据所述目标左方块和所述目标右方块确定最优长度，以对 所述移动设备进行校准。
  4. 根据权利要求3所述的3D图片拍摄方法，其特征在于，所述将所述左角点所在区域进行分割得到左方块集并确定目标左方块包括：
    将所述左角点所在区域按照LA方式分割成(M-1)*(N-1)个左方块，并确定各左方块的坐标；
    根据所述各左方块的坐标确定所述各左方块相邻两条边的长度差，所述长度差不小于0；
    确定最小长度差对应的左方块为所述目标左方块。
  5. 根据权利要求4所述的3D图片拍摄方法，其特征在于，所述根据所述各左方块的坐标确定所述各左方块相邻两条边的长度差包括：
    通过以下公式计算第一左方块相邻两条边的长度差：
    DI＝||P(x,y)-P(x+1,y)|-|P(x,y)-P(x,y+1)||；
    其中，所述DI用于表示所述各左方块相邻两条边的长度差，所述第一左方块的坐标为LA(x,y)＝(P(x,y)，P(x+1,y)，P(x,y+1)，P(x+1,y+1))，0＜x＜M，0＜y＜N，所述第一左方块为所述左方块集中的任一方块。
  6. 根据权利要求4所述的3D图片拍摄方法，其特征在于，所述根据所述目标左方块和所述目标右方块确定最优长度包括：
    计算所述目标左方块的第一平均边长和所述目标右方块的第二平均边长；
    将所述第一平均边长和所述第二平均边长中较小的边长作为所述最优长度。
  7. 根据权利要求5所述的3D图片拍摄方法，其特征在于，所述根据所述第二左视图和所述第二右视图拼接得到3D图片包括：
    对所述第二左视图和所述第二右视图按照所述LA方式进行分割，分别得到左原始块集和右原始块集；
    对所述各左原始块集中的块和所述各右原始块集中的块进行透视变换，分别得到所述左原始块集中的块对应的各左变换块， 和所述各右原始块集中的块对应的各右变换块；
    将所述各左变换进行拼接得到左变换图，且将所述各右变换点块进行拼接得到右变换图；
    将所述左变换图和所述右变换图拼接得到所述3D图片。
  8. 一种3D拍摄系统，其特征在于，所述3D拍摄系统包括具有摄像头的移动设备和目标外设，所述目标外设安装于所述移动设备，包括：
    所述摄像头，用于拍摄标定板，并经由所述目标外设的镜片得到第一左视图和第一右视图；
    校准单元，用于根据所述第一左视图和所述第一右视图对所述移动设备进行校准操作；
    所述摄像头还用于拍摄目标场景以得到第二左视图和第二右视图；
    拼接单元，用于根据所述第二左视图和所述第二右视图拼接得到3D图片。
  9. 一种计算机设备，其特征在于，包括：
    至少一个连接的处理器、存储器和收发器，其中，所述存储器用于存储程序代码，所述处理器用于调用所述存储器中的程序代码来执行上述权利要求5至8中任一项所述的3D图片拍摄方法。
PCT/CN2023/094471 2022-05-20 2023-05-16 3d图片拍摄方法和3d拍摄系统 Ceased WO2023221969A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020247042236A KR20250044193A (ko) 2022-05-20 2023-05-16 3d 도면 촬영 방법 및 3d 촬영 시스템
EP23806921.5A EP4529158A4 (en) 2022-05-20 2023-05-16 METHOD FOR 3D IMAGE CAPTURE AND 3D PHOTOGRAPHIC SYSTEM
US18/953,200 US20250078398A1 (en) 2022-05-20 2024-11-20 3d image capturing method, mobile device and computer device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210566934.6A CN114786001B (zh) 2022-05-20 2022-05-20 3d图片拍摄方法和3d拍摄系统
CN202210566934.6 2022-05-20

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/953,200 Continuation-In-Part US20250078398A1 (en) 2022-05-20 2024-11-20 3d image capturing method, mobile device and computer device

Publications (1)

Publication Number Publication Date
WO2023221969A1 true WO2023221969A1 (zh) 2023-11-23

Family

ID=82408701

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/094471 Ceased WO2023221969A1 (zh) 2022-05-20 2023-05-16 3d图片拍摄方法和3d拍摄系统

Country Status (5)

Country Link
US (1) US20250078398A1 (zh)
EP (1) EP4529158A4 (zh)
KR (1) KR20250044193A (zh)
CN (1) CN114786001B (zh)
WO (1) WO2023221969A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114786001B (zh) * 2022-05-20 2023-12-05 广东未来科技有限公司 3d图片拍摄方法和3d拍摄系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106954060A (zh) * 2017-05-12 2017-07-14 中国人民解放军国防科学技术大学 一种面向智能手机的立体视频生成方法及辅助拍摄装置
US20180192034A1 (en) * 2015-04-29 2018-07-05 Lucid VR, Inc. Stereoscopic 3d camera for virtual reality experience
CN108830906A (zh) * 2018-05-31 2018-11-16 福州大学 一种基于虚拟双目视觉原理的摄像机参数自动标定方法
CN113923434A (zh) * 2021-09-30 2022-01-11 深圳市创鑫未来科技有限公司 3d分光机构及3d拍摄方法
CN114786001A (zh) * 2022-05-20 2022-07-22 广东未来科技有限公司 3d图片拍摄方法和3d拍摄系统

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9001194B2 (en) * 2009-05-14 2015-04-07 Eizo Corporation Stereo image display device that is capable of making a stereo image recognized based on a right-eye image and a left-eye image
CN101710932B (zh) * 2009-12-21 2011-06-22 华为终端有限公司 图像拼接方法及装置
JP2012216981A (ja) * 2011-03-31 2012-11-08 Fujitsu Ltd ステレオカメラのキャリブレーション方法及び情報処理装置
AU2012318854B2 (en) * 2011-10-05 2016-01-28 Bitanimate, Inc. Resolution enhanced 3D video rendering systems and methods
JP2013123123A (ja) * 2011-12-09 2013-06-20 Fujitsu Ltd ステレオ画像生成装置、ステレオ画像生成方法及びステレオ画像生成用コンピュータプログラム
JP5955028B2 (ja) * 2012-02-28 2016-07-20 株式会社トプコン 画像処理装置、画像処理方法および画像処理用のプログラム
US9473760B2 (en) * 2012-08-08 2016-10-18 Makerbot Industries, Llc Displays for three-dimensional printers
US9503703B1 (en) * 2012-10-05 2016-11-22 Amazon Technologies, Inc. Approaches for rectifying stereo cameras
JP2015059988A (ja) * 2013-09-17 2015-03-30 富士通株式会社 ステレオ撮像装置及びステレオ画像生成方法
CN106556356A (zh) * 2016-12-07 2017-04-05 西安知象光电科技有限公司 一种多角度三维轮廓测量系统及测量方法
CN108259881A (zh) * 2018-01-30 2018-07-06 深圳市得色科技有限公司 基于视差估算的3d合成方法及其系统
CN111383278A (zh) * 2018-12-29 2020-07-07 Tcl集团股份有限公司 一种双摄像头的标定方法、装置及设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180192034A1 (en) * 2015-04-29 2018-07-05 Lucid VR, Inc. Stereoscopic 3d camera for virtual reality experience
CN106954060A (zh) * 2017-05-12 2017-07-14 中国人民解放军国防科学技术大学 一种面向智能手机的立体视频生成方法及辅助拍摄装置
CN108830906A (zh) * 2018-05-31 2018-11-16 福州大学 一种基于虚拟双目视觉原理的摄像机参数自动标定方法
CN113923434A (zh) * 2021-09-30 2022-01-11 深圳市创鑫未来科技有限公司 3d分光机构及3d拍摄方法
CN114786001A (zh) * 2022-05-20 2022-07-22 广东未来科技有限公司 3d图片拍摄方法和3d拍摄系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4529158A4 *

Also Published As

Publication number Publication date
CN114786001A (zh) 2022-07-22
US20250078398A1 (en) 2025-03-06
CN114786001B (zh) 2023-12-05
EP4529158A1 (en) 2025-03-26
EP4529158A4 (en) 2025-09-10
KR20250044193A (ko) 2025-03-31

Similar Documents

Publication Publication Date Title
CN108718373B (zh) 影像装置
CN101673395B (zh) 图像拼接方法及装置
CN110493525B (zh) 变焦图像确定方法及装置、存储介质、终端
CN112862897B (zh) 一种基于相位移编码圆的相机离焦状态下的快速标定方法
CN109474780B (zh) 一种用于图像处理的方法和装置
CN108257183A (zh) 一种相机镜头光轴校准方法和装置
CN106997579B (zh) 图像拼接的方法和装置
CN112634337B (zh) 一种图像处理方法及装置
KR102801383B1 (ko) 영상 복원 장치 및 방법
WO2019232793A1 (zh) 双摄像头标定方法、电子设备、计算机可读存储介质
CN110611767B (zh) 图像处理方法、装置和电子设备
CN109785390B (zh) 一种用于图像矫正的方法和装置
CN113114975B (zh) 图像拼接方法、装置、电子设备和存储介质
CN113643414A (zh) 一种三维图像生成方法、装置、电子设备及存储介质
WO2019127512A1 (zh) 拍摄设备的图像处理方法、拍摄设备及可移动平台
CN111757086A (zh) 有源双目相机、rgb-d图像确定方法及装置
CN109785225B (zh) 一种用于图像矫正的方法和装置
US20200267297A1 (en) Image processing method and apparatus
CN111432117A (zh) 图像矫正方法、装置和电子系统
US20250078398A1 (en) 3d image capturing method, mobile device and computer device
CN111835968B (zh) 图像清晰度还原方法及装置、图像拍摄方法及装置
CN115760560A (zh) 深度信息获取方法及装置、设备、存储介质
CN104935815B (zh) 拍照的方法、装置及相机和移动终端
TW201911239A (zh) 立體環景影片產生方法及裝置
CN111353945B (zh) 鱼眼图像校正方法、装置及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23806921

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023806921

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023806921

Country of ref document: EP

Effective date: 20241220

WWP Wipo information: published in national office

Ref document number: 1020247042236

Country of ref document: KR