WO2018040480A1 - 一种调整扫描状态的方法及装置 - Google Patents

一种调整扫描状态的方法及装置 Download PDF

Info

Publication number
WO2018040480A1
WO2018040480A1 PCT/CN2017/070996 CN2017070996W WO2018040480A1 WO 2018040480 A1 WO2018040480 A1 WO 2018040480A1 CN 2017070996 W CN2017070996 W CN 2017070996W WO 2018040480 A1 WO2018040480 A1 WO 2018040480A1
Authority
WO
WIPO (PCT)
Prior art keywords
real
target object
avatar
time
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/070996
Other languages
English (en)
French (fr)
Inventor
韩庆瑞
李海莉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP17844791.8A priority Critical patent/EP3493516B1/en
Priority to EP20176722.5A priority patent/EP3764630B1/en
Publication of WO2018040480A1 publication Critical patent/WO2018040480A1/zh
Priority to US16/287,286 priority patent/US11586034B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10—Scanning systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00183—Photography assistance, e.g. displaying suggestions to the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00795—Reading arrangements
    • H04N1/00798—Circuits or arrangements for the control thereof, e.g. using a programmed control device or according to a measured quantity
    • H04N1/00824—Circuits or arrangements for the control thereof, e.g. using a programmed control device or according to a measured quantity for displaying or indicating, e.g. a condition or state
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00795—Reading arrangements
    • H04N1/00827—Arrangements for reading an image from an unusual original, e.g. 3-dimensional objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/10—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces
    • H04N1/107—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces with manual scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2125—Display of information relating to the still picture recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2137—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer
    • H04N1/2141—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer in a multi-frame buffer
    • H04N1/2145—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer in a multi-frame buffer of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/215—Recording a sequence of still pictures, e.g. burst mode
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to a method and apparatus for adjusting a scan state.
  • Three-dimensional (3D) reconstruction refers to the establishment of a mathematical model suitable for computer representation and processing of three-dimensional objects. It is the basis for processing, manipulating and analyzing its properties in a computer environment. It is also the establishment of an objective world in computers. The key technology of virtual reality.
  • three-dimensional reconstruction refers to the process of reconstructing three-dimensional information from single-view or multi-view images. Since the information of a single video is incomplete, three-dimensional reconstruction requires the use of empirical knowledge. Multi-view 3D reconstruction (similar to human binocular positioning) is relatively easy. The method is to first calibrate the camera, that is, calculate the relationship between the camera's image coordinate system and the world coordinate system. Then use multiple 2D images. The information in the image reconstructs the three-dimensional information.
  • the general steps for 3D reconstruction are as follows:
  • a key frame is an image frame that participates in 3D reconstruction. Because 3D scanning will get a lot of frame data, if the scanned data is involved in 3D reconstruction, it will greatly affect the reconstruction speed. In general, several frames are selected in the scanned data for 3D reconstruction, and the selected frames are called key frames. Generally, the method of selecting key frames is divided into two types: one is selected according to time, that is, the number of fixed frames is selected; and the other is selected according to space, that is, according to the rotation angle of the interval.
  • a method in the prior art is to scan around an object to acquire key frames.
  • the scanned object completely relies on the user's subjective sensory acquisition, which often causes the captured image to be blurred and the scanning size to change greatly (the target object accounts for a large change in the overall image ratio in the acquisition sequence), and the scanned object is scanned.
  • the change of size will result in inaccurate matching of feature points, affecting the effect of 3D reconstruction; especially if the scanning process moves too fast or the distance to the target object changes greatly, the key frame acquired will be poor, thus affecting 3D reconstruction. effect.
  • the embodiments of the present invention provide a method and apparatus for prompting to adjust a scan state.
  • an embodiment of the present invention provides a method for adjusting a scan state, which is used to scan a target object to acquire a key frame of the target object, where the key frame is used to construct a 3D image of the target object;
  • the target object Determining which specific object is the target object, if it is determined that the target object is a preset target type, determining a reference scan parameter of the target object; obtaining a real-time scan parameter when the mobile terminal scans the target object; Whether the real-time scan parameter meets the reference scan parameter; if not, generates a prompt message, where the prompt message is used to prompt the user to adjust the scan status corresponding to the current scan parameter.
  • the target object may include a human face, an animal, a plant, and other static objects.
  • the specific object when determining the target object can be realized by the user inputting a corresponding setting instruction or by image recognition technology.
  • an embodiment of the present invention provides an apparatus for adjusting a scan state, which is configured to scan a target object to acquire a key frame of the target object, where the key frame is used to construct a 3D image of the target object;
  • a determining module configured to determine whether the target object is a preset target type; when determining that the target object is a preset target type, determining a reference scan parameter corresponding to the preset target type; Finding reference scan parameters corresponding to the target object in the locally stored data or the cloud data;
  • An acquiring module configured to acquire real-time scanning parameters when the mobile terminal scans the target object
  • a determining module configured to determine whether the real-time scanning parameter acquired by the acquiring module meets the reference scanning parameter determined by the determining module
  • a generating module configured to generate a prompt message when the determining module determines that the result is not met, and the prompt message is used to prompt the user to adjust the current scanning state.
  • real-time scanning parameters are acquired, reference scanning parameters are determined, and correction gestures of scanning postures are performed through deviations of real-time scanning parameters and reference scanning parameters, so as to reasonably adjust the current Scanning status such as scan distance, scan angle, and scan speed, so that better quality key frames can be obtained.
  • the scanning parameter may be a distance from the scanning device to the scanned object (ie, the target object) (referred to as a scanning distance), and a moving direction of the scanning device relative to the scanned object ( Referring to the scanning direction), the moving speed of the scanning device relative to the scanned object (referred to as the scanning speed), the ratio of the image resolution corresponding to the smallest rectangular area in which the contour of the scanned object is located in the imaging image scanned by the scanning device, and the resolution of the imaged image image.
  • each scan parameter of each target object will have an optimal parameter value or range of values, that is, reference scan parameters; this reference scan parameter is often counted through a large number of historical experience values.
  • it may be preset or flexiblely defined by the user. For example, it can be stored in advance in a local storage or a cloud server.
  • the real-time scanning distance is obtained as a real-time scanning parameter, obtained locally or acquired from the cloud server to the scanning distance empirical value; if the real-time scanning distance is determined to be greater than the scanning distance experience When the value is generated, a first prompt message is generated for prompting the user to approach the location Or the target object; or, if the real-time scan parameter is less than the scan distance experience value, generating a second prompt message for prompting the user to move away from the target object.
  • the real-time scanning distance is a real-time distance of the mobile terminal relative to the target object during a circular scan around the target object.
  • This technical implementation can be processed by the processor by calling the program instructions in the memory and processing the scan parameters collected by the data acquisition system.
  • the technical solution can prompt the user to collect clear key frames at a suitable scanning distance.
  • the real-time picture ratio when the target object is scanned is acquired as a real-time scanning parameter; and the preset picture ratio is obtained, wherein the picture ratio is the contour of the character avatar in the imaging picture. a ratio of an image resolution corresponding to the minimum rectangle to an image resolution of the imaged image; if it is determined that the ratio of the real-time image is smaller than the preset image ratio, generating a third prompt message for prompting the user to approach the target object; or, if When the real-time picture ratio is greater than the preset picture ratio, a fourth prompt message is generated for prompting the user to move away from the target object.
  • the real-time picture ratio is the ratio of the image resolution area of the smallest rectangle where the contour of the target object is located in the real-time imaging picture of the mobile terminal to the image resolution of the entire imaging picture.
  • This technical implementation can be processed by the processor by calling the program instructions in the memory and processing the scan parameters collected by the data acquisition system.
  • the technical solution can prompt the user to collect clear key frames at a suitable scanning distance.
  • the preset scan speed is determined and the real-time scan speed is obtained. If the real-time scan speed is determined to be greater than the preset scan speed, the sixth prompt message is generated to prompt the user to reduce Small scans the speed of the target object.
  • the real-time scanning speed is a real-time moving speed of the mobile terminal during the circular scanning around the target object. This technical implementation can be done by the processor.
  • the technical solution can prompt the user to move slowly to prevent the rapid scanning from causing the quality of the key frame to deteriorate.
  • a device for prompting to adjust a scan state includes: a memory, a processor, and a data acquisition system; the two are connected to each other through a bus; the memory stores program instructions, and the data acquisition system is configured to acquire image information of the outside world, Capturing real-time scan parameters of the scan target object, such as at least one of speed information, distance information, and direction information; the processor invoking the program instruction to determine whether the target object is a preset target type If the result of the determination is the preset target type, determining a reference scan parameter corresponding to the target type; determining whether the real-time scan parameter meets the reference scan parameter; if not, generating a prompt message, The prompt message is used to prompt the user to adjust the scan status corresponding to the current scan parameter.
  • the processor calls the program instructions in the memory to perform any of the above possible implementations.
  • an embodiment of the present invention provides a mobile terminal, where the mobile terminal has a corresponding function in the foregoing method.
  • This function can be implemented in hardware or in hardware by executing the corresponding software.
  • the hardware or software includes one or more modules corresponding to the functions described above.
  • an embodiment of the present invention provides a computer storage medium for storing computer software instructions used in the operation of the mobile terminal, which includes a program designed to perform the above aspects.
  • the combination between the solutions can be carried out without violating the natural laws.
  • FIG. 1 is a schematic structural diagram of an apparatus for adjusting a scanning state according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a method for adjusting a scan state according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an apparatus for adjusting a scanning state according to an embodiment of the present invention.
  • Embodiments of the present invention provide a method and apparatus for adjusting a scan state.
  • the embodiment of the present invention is mainly used in a scene in which a mobile terminal performs 3D reconstruction (referred to as reconstruction) on a single scanned object, and is used to acquire a key frame of a scanned object; in the process of reconstruction, it is usually required to perform a target object that is photographed and photographed.
  • reconstruction 3D reconstruction
  • the scan is to capture or continuously shoot the target object.
  • the ideal scanning method is to surround a circular scan.
  • the trajectory of the circular scan is allowed to have a certain operational error, and an ellipse or an approximate circle may appear. Other scan track patterns of the shape.
  • the invention utilizes the mobile terminal to acquire real-time scanning parameters; when detecting that the real-time scanning parameters do not meet the preset scanning parameters, the user is prompted to adjust the scanning state in real time to obtain an ideal key frame.
  • a mobile terminal (also referred to as a scanning device or a scanning terminal, a mobile device, etc.) is required for acquiring a key frame, and may be an intelligent terminal or a specific image capturing system;
  • FIG. 1 is a schematic structural diagram of an apparatus for adjusting a scanning state; the mobile terminal includes at least:
  • the data acquisition system 11 includes a plurality of sensors, such as an array camera, a gyroscope, an accelerometer, and/or other sensors having specific functions (such as a distance measuring sensor, a speed measuring sensor), etc.; and can acquire and acquire external information, including The external color image, the attitude information of the terminal (the distance from the scanning device to the scanned object, the moving direction of the scanning device relative to the scanned object (ie, the target object), the moving speed of the scanning device relative to the scanned object, and the like);
  • a more versatile data acquisition system can contain small processing units and memory units in addition to sensors.
  • the memory 12 is used to store programs and various data, and mainly stores software units such as operating systems, applications, and function instructions, or a subset thereof, or an extended set thereof.
  • Non-volatile random access memory a storage, providing the processor 13 with hardware, software and data resources in the management computing processing device, supporting the control software and the application;
  • the processor 13 is configured to generate a corresponding operation control signal, send the corresponding component to the computing processing device, read and process the data in the software, and in particular, read and process the data and the program in the memory 12 to make each of the components
  • the function module performs the corresponding function, thereby controlling the corresponding component to act according to the requirements of the instruction. Therefore, the processor 13 can call the partial program instructions in the memory 12 to perform arithmetic processing on the information collected by the data acquisition system 11 to complete the technical solution mentioned in the present invention and an alternative solution; the bus 14, the hardware unit. 11-13 can communicate via bus 14 electrical connections.
  • the mobile terminal may further include an antenna system 15 for transmitting and receiving wireless communication signals to implement wireless communication with the mobile communication network;
  • the mobile communication network includes one or more of the following: a GSM network, a CDMA network, and a 3G network. , FDMA, TDMA, PDC, TACS, AMPS, WCDMA, TDSCDMA, WIFI, and LTE networks.
  • the mobile terminal may further include other hardware structures such as a Wifi connection module, a display screen, and an audio component;
  • a method for adjusting a scan state is applied to a ring scan target object of a mobile terminal to acquire a key frame of the target object; the specific implementation manner is as follows:
  • the target object is an object object that acquires a key frame, that is, a scanned object, and scan parameters that generally affect the quality of the key frame include a scan distance, a scan direction, a scan speed, and the like of the mobile terminal relative to the target object when the target object is scanned;
  • the optimal distance empirical value may be a specific value, or may be a value interval with a reasonable deviation; the optimal distance empirical value may be preset or may be flexibly defined by the user.
  • the target object may include a human face, an animal, a plant, and other static objects. For convenience of description, in the following embodiments, the corresponding method is described with the target object as the character avatar.
  • the mobile terminal is a device for scanning a character avatar.
  • the reference scan parameters corresponding to the avatar of the avatar are pre-stored in the device, and may be acquired by a processor of the mobile terminal.
  • the pre-stored reference scan parameters can be preset by the user.
  • the mobile terminal can be used to scan a large number of objects. Therefore, when scanning an object, the mobile terminal needs to determine what type of object is being scanned, that is, whether the target object is a preset target. Type; for example, whether it is a person, a cat, or a table; this can be achieved by the user inputting a corresponding setting instruction or by a mature image recognition technology, or by the user inputting a clear object category.
  • the processor may call the data acquisition system or the local memory or access the preset data in the cloud server to find out whether the empirical value of the scan parameter corresponding to the character avatar is available.
  • the above experience value may also be pre-stored in the data collection system, or may exist on the cloud server, or may exist on the local memory and be called by the processor.
  • the scanning parameter is the scanning distance
  • it may first determine whether there is a scanning distance empirical value corresponding to the character avatar; the scanning distance empirical value of the character avatar may be 40-50 cm.
  • the scanning distance refers to the distance of the mobile terminal relative to the avatar of the person in the process of performing circular scanning around the avatar of the character.
  • the preset picture ratio corresponding to the character avatar can be obtained, and is usually a specific value or a value sub-interval between 40% and 80%.
  • the aspect ratio is a ratio of an image resolution corresponding to a minimum rectangle in which the outline of the person's avatar is located in the image frame scanned by the mobile terminal to an image resolution of the imaged image; specifically, the image obtained by the scan has an image resolution size, For example, the image resolution of the entire imaging picture is 1920*1080, and the image contains the character avatar to be reconstructed.
  • the smallest rectangle surrounded by the outline of the character avatar can be used to mark the head region in the image.
  • the image resolution corresponding to the rectangle (such as 1200*800) accounts for the ratio of the image resolution of the imaged image of 1920*1080, that is, the aspect ratio of the image.
  • the aspect ratio is scanned for the mobile terminal itself, and is not directly related to the display. Therefore, the preset screen scale can be used as a reference when scanning an image.
  • the data acquisition system of the mobile terminal collects data and sends the data to the processor for subsequent processing.
  • the data acquisition system of the mobile terminal may include: an array camera, a gyroscope, an accelerometer, and other sensors having specific functions (such as a distance measuring sensor and a speed measuring sensor).
  • the array camera can acquire external color images; the gyroscope, the accelerometer, and other sensors having specific functions can acquire the scanning distance information of the mobile terminal, the scanning angle information of the mobile terminal, the scanning speed information of the mobile terminal, and the scanning direction information of the mobile terminal. Wait.
  • the collection of these data is an existing mature technology and will not be described and enumerated in detail in this application.
  • the real-time scanning distance is a real-time distance of the mobile terminal relative to the character avatar during the circular scanning around the character avatar;
  • the real-time image ratio is the minimum rectangular image resolution area where the character avatar contour is located in the real-time imaging image of the mobile terminal.
  • the real-time scanning speed is the real-time moving speed of the mobile terminal during the circular scanning around the character avatar.
  • the processor compares the real-time scan parameters in S2 with the corresponding reference scan parameters in S1 to determine whether the reference scan parameters are met. If it is met, no adjustment prompt will be made. If it is not, then S4 will be executed.
  • S4 Generate a prompt message, and the prompt message is used to prompt the user to adjust the current scan state.
  • the processor determines that the real-time scan distance is greater than the scan distance experience value, generating a prompt message to prompt the user to bring the mobile terminal closer to the character avatar; if the processor determines that the real-time scan distance is less than the scan distance experience value, generating a prompt message To prompt the user to move the mobile terminal away from the character avatar.
  • This kind of hint can better get key frames with clear and good proportions.
  • the processor determines that the real-time picture ratio of the character avatar during the scanning process is smaller than the preset picture ratio, generating a prompt message to prompt the user to bring the mobile terminal closer to the character avatar; if the processor determines the real-time of the scanned object If the aspect ratio is greater than the preset aspect ratio, a prompt message is generated to prompt the user to move the mobile terminal away from the scanned object.
  • This kind of hint can better get key frames with clear and good proportions.
  • a prompt message is generated to prompt the user to reduce the speed at which the mobile terminal scans the target object.
  • the real-time scanning speed can be instantaneous linear velocity or instantaneous angular velocity, and the linear velocity or angular velocity calculation depends on
  • the coordinates of the support are centered on the character's avatar, and the distance from the mobile terminal to the character's avatar is approximately the radius.
  • the real-time scanning speed is greater than the first arc per second, the user is prompted to slow down the acquisition speed so that the collected key frames have a good definition.
  • the typical value of the first radian is 1.5 radians; the first radian is a statistical historical experience value, which can be preset by the user. This prompt can avoid unclear pictures caused by fast scanning.
  • the processor 13 can perform a certain calculation process on the real-time scan parameters acquired by the sensor by calling a program or an instruction stored in the memory 12 to execute the method and the equivalent method mentioned in the foregoing method embodiments.
  • the type of the object to be photographed is determined, the corresponding reference scan parameter is obtained according to the type of the object to be photographed, the real-time scan parameter of the mobile terminal is determined, and the deviation is generated by the deviation of the real-time scan parameter and the reference scan parameter.
  • the current scanning parameters such as real-time scanning distance, real-time picture ratio, real-time scanning speed, etc.
  • FIG. 3 shows an apparatus for adjusting a scanning state in an embodiment of the present invention.
  • the device may be an intelligent terminal for scanning and acquiring a key frame of a target object around a target object, where a key frame is used to construct the target object. 3D image.
  • the device 200 includes:
  • the determining module 201 is configured to determine a reference scan parameter of the target object.
  • the acquiring module can be implemented by a processor, and can call data in a local memory or a cloud server; or can be implemented by a processor or a data collecting system, for example, the processor determines whether the target object is a pre-recorded image through a real-time shooting image collected by the data collecting system. Set the target object. If the target object can obtain the reference scan parameters by calling data in the local storage or cloud server.
  • the obtaining module 202 is configured to acquire real-time scanning parameters when the mobile terminal scans the target object.
  • the acquisition module can be implemented by a data acquisition system, such as an array camera, a gyroscope, an accelerometer, and at least one of a specific function sensor such as a distance measuring sensor and a speed measuring sensor.
  • the determining module 203 is configured to determine whether the real-time scanning parameter acquired by the obtaining module 202 meets the reference scanning parameter determined by the determining module 201.
  • the determining module can be implemented by a processor to perform a comparison operation.
  • the generating module 204 is configured to generate a prompt message for prompting the user to adjust the current scan state if the determining module 203 determines that the result is not met.
  • the generation module can be implemented in a processor, and the processor can be subsequently rendered through an output hardware such as a speaker or a display.
  • the determining module 201 is specifically configured to perform the method mentioned in S1 and the method that can be replaced equally; the obtaining module 202 is specifically configured to execute the method mentioned in S2 and the method that can be replaced equally; The 203 is specifically configured to perform the method mentioned in S3 and the method that can be replaced equally; the generating module 204 is specifically configured to perform the method mentioned in S4 and the method that can be equivalently replaced.
  • the above specific method embodiments and the explanations and expressions in the embodiments are also applicable to the method execution in the device.
  • an apparatus for prompting to adjust a scan state may acquire a real-time scan parameter, and the determining module is configured to determine a reference scan parameter, and the determining module determines that a deviation between the real-time scan parameter and the reference scan parameter is generated, The module generates a correction prompt message of the scanning posture according to the deviation, The current scanning distance, scanning angle, and/or scanning speed of the mobile terminal are reasonably adjusted so that a good key frame can be acquired and a corresponding 3D reconstruction can be performed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

一种调整扫描状态的方法，用于围绕目标物体扫描获取目标物体的关键帧；方法包括：移动终端判断目标物体是否为预设的目标类型；若判断目标物体是为所述预设的目标类型时，则确定与目标类型对应的参考扫描参数（S1）；获取移动终端围绕目标物体扫描时的实时扫描参数(S2)；判断实时扫描参数是否符合参考扫描参数(S3)；若不符合，则生成提示消息，提示消息用于提示用户调整当前扫描参数对应的扫描状态(S4)。通过将传感器获取的实时扫描参数与相应的最优扫描参数进行比较，可以使当前用户知道当前扫描状态是否合理，进而修正当前不正确的扫描状态，得到质量更好的关键帧。

Description

一种调整扫描状态的方法及装置 技术领域
本发明涉及通信技术领域，尤其涉及一种调整扫描状态的方法及装置。
背景技术
三维3D(three-dimensional)重建是指对三维物体建立适合计算机表示和处理的数学模型，是在计算机环境下对其进行处理、操作和分析其性质的基础，也是在计算机中建立表达客观世界的虚拟现实的关键技术。
在计算机视觉中,三维重建是指根据单视图或者多视图的图像重建三维信息的过程.由于单视频的信息不完全,因此三维重建需要利用经验知识。而多视图的三维重建(类似人的双目定位)相对比较容易,其方法是先对摄像机进行标定,即计算出摄像机的图象坐标系与世界坐标系的关系.然后利用多个二维图象中的信息重建出三维信息。一般的三维重建的步骤如下：
1)获取图像序列；
2)特征点检测与匹配；
3)计算基础矩阵；
4)相机标定；
5)恢复相机投影矩阵，计算相机外参数；
6)获取三维点云；
7)网络重建；
8)纹理映射。
将3D扫描技术应用于移动终端已经成为业界的研究热点，目前移动终端扫描物体获取关键帧的时候没有检测模块，使获取的关键帧效果不好，从而影响3D重建的效果。关键帧，是指参与3D重建的图像帧。因为3D扫描时会获取很多帧的数据，如果扫描的数据都参与3D重建，那么会大大影响重建速度。一般情况下，会在扫描的数据中选取几帧进行3D重建，选取到的这些帧称为关键帧。一般地，将选取关键帧的方法分为两种：一种是根据时间选取，即间隔固定帧数选取；一种是根据空间选取，即按照间隔的旋转角度选取。
现有技术中的方法是围绕物体扫描，获取关键帧。然而现有技术的实现过程中，扫描物体完全依靠用户主观感觉采集，这样往往会导致采集的图像模糊、扫描尺寸变化较大(在采集序列中目标物体占整体图像比例变化很大)，扫描物体尺寸的变化会导致特征点匹配不准，影响3D重建的效果；尤其扫描过程移动过快或者到目标物体的距离发生较大变化时，也会使获取的关键帧效果较差，从而影响3D重建效果。
发明内容
有鉴于此，本发明实施例提供了一种提示调整扫描状态的方法与装置。
第一方面，本发明实施例提供了一种调整扫描状态的方法，用于围绕目标物体扫描获取所述目标物体的关键帧，所述关键帧用于构建所述目标物体的3D图像；该方法包括：
判断目标物体是哪一种具体物体，若判断所述目标物体是为预设的目标类型时，则确定该目标物体的参考扫描参数；获取移动终端扫描所述目标物体时的实时扫描参数；判断所述实时扫描参数是否符合所述参考扫描参数；若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描参数对应的扫描状态。其中，目标物体可以包括人脸，动物、植物、以及其它静态物品。判断目标物体时哪一种具体物体，可以通过用户输入相应的设置指令或者通过图像识别技术来实现。
第二方面，本发明实施例提供了一种调整扫描状态的装置，用于围绕目标物体扫描获取所述目标物体的关键帧，所述关键帧用于构建所述目标物体的3D图像；该装置包括：
确定模块，用于判断所述目标物体是否为预设的目标类型；当判断出所述目标物体为预设的目标类型时，确定与所述预设的目标类型对应的参考扫描参数；可以通过在本地已经存储的数据或者云端数据中查找出目标物体对应的参考扫描参数；
获取模块，用于获取移动终端扫描所述目标物体时的实时扫描参数；
判断模块，用于判断所述获取模块获取的实时扫描参数是否符合所述确定模块确定的参考扫描参数；
生成模块，用于当所述判断模块判断结果为不符合时，生成提示消息，所述提示消息用于提示用户调整当前扫描状态。
根据本发明实施例提供的上述方法以及上述装置的技术方案，获取实时扫描参数，确定参考扫描参数，进而通过实时扫描参数和参考扫描参数的偏差进行扫描姿态的修正提示，以合理地调整当前的扫描距离、扫描角度、扫描速度等扫描状态，以便能够获取到质量更好的关键帧。
根据第一方面或第二方面，在一个可能的设计中，扫描参数可以是扫描设备到被扫描物体(即目标物体)的距离(简称扫描距离)、扫描设备相对于被扫描物体的运动方向(简称扫描方向)、扫描设备相对于被扫描物体的运动速度(简称扫描速度)、扫描设备扫描的成像画面中被扫描物体轮廓所在的最小矩形面积对应的图像分辨率与成像画面图像分辨率的比值(简称画面比例)等，每一个目标物体的每一种扫描参数都会有一个最优的参数取值或者取值范围，即参考扫描参数；这个参考扫描参数往往是通过大量的历史经验值统计得出的，在本发明实施例的实现过程中，可以是预先设置的，也可以由用户灵活定义。例如可以预先存储在本地存储器或云端服务器中。
在预先设置的参数下获得的关键帧能够具有更好的清晰度。
根据第一方面或第二方面，在一个可能的设计中，获取实时扫描距离作为实时扫描参数，从本地获取或者从云端服务器获取到扫描距离经验值；若判断实时扫描距离大于所述扫描距离经验值时，则生成第一提示消息用于提示用户靠近所 述目标物体；或者，若所述实时扫描参数小于所述扫描距离经验值时，则生成第二提示消息用于提示用户远离所述目标物体。其中，实时扫描距离为移动终端在围绕目标物体进行环形扫描的过程中相对于所述目标物体的实时距离。这个技术实现可以由处理器调用存储器中程序指令并对数据采集系统采集的扫描参数进行处理运算完成。
该技术方案可以提示用户在合适的扫描距离下采集到清晰的关键帧。
根据第一方面或第二方面，在一个可能的设计中，获取扫描目标物体时的实时画面比例作为实时扫描参数；并获取预设画面比例，其中，画面比例为成像画面中人物头像轮廓所在的最小矩形对应的图像分辨率与成像画面图像分辨率的比值；若判断实时画面比例小于所述预设画面比例时，则生成第三提示消息用于提示用户靠近所述目标物体；或者，若判断实时画面比例大于所述预设画面比例时，则生成第四提示消息用于提示用户远离所述目标物体。其中，实时画面比例为移动终端实时成像画面中目标物体轮廓所在的最小矩形的图像分辨率面积与整个成像画面图像分辨率的比值。这个技术实现可以由处理器调用存储器中程序指令并对数据采集系统采集的扫描参数进行处理运算完成。
该技术方案可以提示用户在合适的扫描距离下采集到清晰的关键帧。
根据第一方面或第二方面，在一个可能的设计中，确定预设扫描速度并获取实时扫描速度，若判断实时扫描速度大于所述预设扫描速度时，则生成第六提示消息提示用户减小扫描所述目标物体的速度。其中，实时扫描速度为移动终端在围绕目标物体进行环形扫描的过程中的实时移动速度。这个技术实现可以由处理器完成。
该技术方案可以提示用户缓慢移动进行扫描，防止快速扫描引起关键帧的质量恶化。
根据第三方面，一种提示调整扫描状态的设备，设备包括：存储器、处理器、数据采集系统；它们通过总线彼此连接通信；存储器存储程序指令，数据采集系统用于获取外界的图像信息，也能够获取扫描目标物体的实时的扫描参数，如速度信息、距离信息和方向信息中的至少一种；所述处理器调用所述程序指令用于，判断所述目标物体是否为预设的目标类型；若判断结果为所述预设的目标类型时，则确定与所述目标类型对应的参考扫描参数；判断所述实时扫描参数是否符合所述参考扫描参数；若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描参数对应的扫描状态。同时，处理器调用存储器中的程序指令，可以执行上述任意一种可能的实现方式。
第四方面，本发明实施例提供了一种移动终端，该移动终端具有实现上述方法中对应的功能。该功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。
第五方面，本发明实施例提供了一种计算机存储介质，用于储存为上述移动终端操作中所用的计算机软件指令，其包含用于执行上述方面所设计的程序。
对于上述任何一种可能的设计中的技术方案，在不违背自然规律的前提下，可以进行方案之间的组合。如：在一个可能的设计中，对于上述不同种类扫描参 数的获取、比较和生成提示消息，可以同时进行。如比较实时扫描距离和预设扫描距离的同时，也可以比较实时扫描速度和预设扫描速度。
附图说明
图1为本发明实施例中一种调整扫描状态的设备结构示意图；
图2为本发明实施例中一种调整扫描状态的方法流程图；
图3为本发明实施例中一种调整扫描状态的装置示意图。
具体实施方式
本发明实施例提供了一种调整扫描状态的方法与装置。
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分优选实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
应理解，申请文件中所出现的诸如“第一”、“第二”、“预设”“目标”之类的限定词汇，仅仅是用来方便清楚的描述，用来区别泛指，并非限定次序，也并非是专有词汇。
本发明实施例主要应用在移动终端对单个扫描物体进行3D重建(简称为重建)的场景之中，用于获取扫描物体的关键帧；重建的过程中，通常需要对被拍照取景的目标物体进行围绕扫描，扫描即对目标物体进行摄像或者连拍，理想的扫描方式为环绕一个圆形扫描，在具体实现的过程中，允许环形扫描的轨迹有一定的操作误差，可能出现椭圆形或者近似圆形的其他扫描轨迹图形。现在的移动终端在数据采集时，没有任何操作引导，只能按照用户的感知自行扫描；由于用户自我感知的误差而经常造成扫描得到的关键帧质量不好。本发明利用移动终端获取实时扫描参数；当检测到实时扫描参数不符合预设扫描参数时，提示用户实时调整扫描状态，以获取理想的关键帧。
本发明实施例中，获取关键帧需要一个移动终端(也可以称为扫描设备或扫描终端、移动设备等)，可以是一个智能终端，也可以是一个特定的图像采集系统；请参阅图1，图1为一种调整扫描状态的设备结构示意图；该移动终端至少包含了：
数据采集系统11，其中含有多种传感器，如阵列相机、陀螺仪、加速计，和/或其它具有特定功能的传感器(如：测距传感器、测速传感器)等；可以采集、获取外部信息，包括外界的彩色图像、终端的姿态信息(扫描设备到被扫描物体的距离、扫描设备相对于被扫描物体(即目标物体)的运动方向、扫描设备相对于被扫描物体的运动速度)等等信息；功能更为丰富的数据采集系统除了包含传感器之外，还可以包含一些小的处理单元和存储单元。
存储器12，用于存储程序和各种数据，主要存储操作系统、应用和功能指令等软件单元、或者他们的子集、或者他们的扩展集。还可以包括非易失性随机存取存 储器，向处理器13提供包括管理计算处理设备中的硬件、软件及数据资源，支持控制软件和应用；
处理器13，用于产生相应的操作控制信号，发给计算处理设备相应的部件，读取以及处理软件中的数据，尤其是读取和处理存储器12中的数据和程序，以使其中的各个功能模块执行相应的功能，从而控制相应的部件按指令的要求进行动作。因此处理器13可以调用存储器12中的部分程序指令对数据采集系统11采集到的信息进行运算处理，完成下述本发明所提及的技术方案以及可以等同替换的方案；总线14，上述硬件单元11-13可以通过总线14电气连接进行通信。在具体实现过程中，移动终端还可以包含天线系统15，用于收发无线通信信号实现与移动通信网络的无线通信；移动通信网络包括以下的一种或多种：GSM网络、CDMA网络、3G网络、FDMA、TDMA、PDC、TACS、AMPS、WCDMA、TDSCDMA、WIFI以及LTE网络。此外，移动终端还可以包含Wifi连接模块、显示屏、音频组件等其他硬件结构；
请参阅图2，一种调整扫描状态的方法，该方法应用于移动终端环形扫描目标物体获取所述目标物体的关键帧；具体实现方式如下所示：
S1：确定目标物体的参考扫描参数。
目标物体即获取关键帧的物体对象，也就是被扫描物体，通常影响关键帧质量的扫描参数包括移动终端围绕扫描目标物体时相对于所述目标物体的扫描距离、扫描方向和扫描速度等等；依据历史的扫描经验，对于每一种目标物体的每一种扫描参数都会有一个最优的参数取值或者取值范围。其中，最优距离经验值可以是一个具体值，也可以是一个存在合理偏差的取值区间；最优距离经验值可以是预先设置的，也可以由用户灵活定义。其中，目标物体可以包括人脸，动物、植物、以及其它静态物品。为了方便说明，以下实施例中以目标物体为人物头像进行相应的方法描述。
在一种实现场景下，该移动终端就是专门用于扫描人物头像的设备，该设备中已经预先存储好人物头像对应的各项参考扫描参数，可以由移动终端的处理器来进行获取；其中，预先存储好的各项参考扫描参数可以由用户预先设定。
在另一种实现场景下，该移动终端可以用于扫描很多物体，因此移动终端在扫描物体的时候需要判断出正在扫描的物体具体是什么类别的物体，即判断目标物体是否为预设的目标类型；例如判断是人、猫、还是桌子；这可以通过用户输入相应的设置指令或者通过成熟的图像识别技术来实现，也可以通过用户输入明确的物体类别来告知终端。若识别出物体类别人物头像后，处理器可以调用数据采集系统或本地存储器或访问云端服务器中的预设数据，来查找是否具备人物头像对应的扫描参数的经验值。对应的，上述经验值也可以预先存储在数据采集系统中，也可以存在云端服务器上，也可以存在本地存储器上，由处理器进行调用。
在具体实现过程中，如果扫描参数为扫描距离，可以先确定是否具有人物头像对应的扫描距离经验值；人物头像的扫描距离经验值可以为40-50cm。其中，扫描距离指移动终端在围绕人物头像进行环形扫描的过程中相对于人物头像的距离。
在具体实现过程中，还可以通过扫描人物头像时的实时画面比例来间接确定 最佳扫描距离。因此可以获取人物头像对应的预设画面比例，通常为40％-80％之间的某个具体值或者取值子区间。其中，画面比例为移动终端扫描的成像画面中人物头像轮廓所在的最小矩形对应的图像分辨率与成像画面图像分辨率的比值；具体地说，扫描获得的图像，有一个图像分辨率的大小，例如整个成像画面的图像分辨率是1920*1080，图像中包含有要重建的人物头像，可以用一个把该人物头像轮廓包围起来的最小矩形在该成像图像中将人头区域做标记框，这个最小矩形对应的图像分辨率(如1200*800)占成像画面的图像分辨率1920*1080的比例即画面比例。画面比例都是针对移动终端扫描到图像本身的，跟显示屏没有直接关系。因此预设画面比例可以作为扫描图像时的参照。
S2：获取移动终端扫描目标物体时的实时扫描参数。
移动终端的数据采集系统采集到数据，将数据发送到处理器进行后续处理。
其中，移动终端的数据采集系统可以包括：阵列相机、陀螺仪、加速计、和其它具有特定功能的传感器(如：测距传感器、测速传感器)等。阵列相机可以获取外界彩色图像；陀螺仪、加速计、和其它具有特定功能的传感器可以获取移动终端的扫描距离信息、移动终端的扫描角度信息、移动终端的扫描速度信息、移动终端的扫描方向信息等。这些数据的采集都是现有的成熟技术，本申请中不予以详细描述和列举。
通过数据采集系统，可以得到移动终端的实时扫描距离、实时扫描方向、实时扫描速度等信息。其中，实时扫描距离为移动终端在围绕人物头像进行环形扫描的过程中相对于所述人物头像的实时距离；实时画面比例为移动终端实时成像画面中人物头像轮廓所在的最小矩形的图像分辨率面积与成像画面图像分辨率的比值；实时扫描速度为移动终端在围绕所述人物头像进行环形扫描的过程中的实时移动速度。
S3：判断实时扫描参数是否符合参考扫描参数。
处理器将S2中的实时扫描参数与S1中对应的参考扫描参数进行比较，确定是否符合参考扫描参数。若符合则不做调整提示，如果不符合则执行S4。
S4：生成提示消息，提示消息用于提示用户调整当前扫描状态。
在一种示例中，若处理器判断实时扫描距离大于扫描距离经验值，则生成提示消息以提示用户将移动终端靠近人物头像；若处理器判断实时扫描距离小于扫描距离经验值，则生成提示消息以提示用户将移动终端远离人物头像。这种提示可以更好地获得清晰且画面比例良好的关键帧。
在另一种示例中，若处理器判断扫描过程中人物头像的实时画面比例小于预设画面比例，则生成提示消息以提示用户将所述移动终端靠近人物头像；若处理器判断扫描物体的实时画面比例大于预设画面比例，则生成提示消息以提示用户将所述移动终端远离扫描物体。这种提示可以更好地获得清晰且画面比例良好的关键帧。
在另一种示例中，若处理器判断扫描过程中移动终端的实时扫描速度大于预设扫描速度时，则生成提示消息以提示用户减小移动终端扫描所述目标物体的速度。实时扫描速度可以是瞬时线速度或者瞬时角速度，线速度或角速度计算所依 托的坐标系以人物头像为圆心，以移动终端到人物头像的距离近似为半径。例如实时扫描速度大于第一弧度每秒，则提示用户放慢采集速度，使采集到的关键帧有一个良好的清晰度。其中第一弧度的典型值为1.5弧度；第一弧度是统计出来的历史经验值，可以是由用户预先设定。这种提示可以避免快速扫描造成的画面不清晰。
综上，处理器13通过调用存储器12存储的程序或指令，可以对传感器获取到的实时扫描参数进行一定的计算处理，以执行上述方法实施例中所提到的方法以及等同方法。
通过本发明提供的方法实施例，确定被拍摄物体的类别，根据被拍摄物体的类别获取对应的参考扫描参数；确定移动终端的实时扫描参数，进而通过实时扫描参数和参考扫描参数的偏差生成调整当前不正确扫描姿态的提示，以合理地调整当前的扫描参数，如实时扫描距离、实时画面比例、实时扫描速度等，以便后续能够获取到良好的关键帧。
请参阅图3，图3本发明实施例中一种调整扫描状态的装置，该装置可以是一个智能终端，用于围绕目标物体扫描获取目标物体的关键帧，关键帧用于构建所述目标物体的3D图像。该装置200包括：
确定模块201，用于确定目标物体的参考扫描参数。该获取模块可以由处理器实现，可以调用本地存储器或云端服务器中的数据；也可以由处理器、数据采集系统混合实现，如处理器通过数据采集系统采集的实时拍摄画面确定目标物体是否是预设目标物体，若是目标物体可以通过调用本地存储器或云端服务器中的数据获取参考扫描参数。
获取模块202，用于获取移动终端扫描目标物体时的实时扫描参数。该获取模块可以通过数据采集系统来实现，如阵列相机，陀螺仪，加速计以及具有特定功能的传感器(如：测距传感器、测速传感器)中的至少一个来实现。
判断模块203，用于判断获取模块202获取的实时扫描参数是否符合确定模块201确定的参考扫描参数。该判断模块可由处理器实现，进行比较运算。
生成模块204，用于若判断模块203判断结果为不符合时，生成提示消息，提示消息用于提示用户调整当前扫描状态。该生成模块可在处理器中实现，处理器后续可以通过扬声器、显示器等输出硬件呈现。
在具体实现过程中，确定模块201具体用于执行S1中所提到的方法以及可以等同替换的方法；获取模块202具体用于执行S2中所提到的方法以及可以等同替换的方法；判断模块203具体用于执行S3中所提到的方法以及可以等同替换的方法；生成模块204具体用于执行S4中所提到的方法以及可以等同替换的方法。其中，上述具体的方法实施例以及实施例中的解释和表述也适用于装置中的方法执行。
根据本发明实施例提供的一种提示调整扫描状态的装置，获取模块可以获取实时扫描参数，确定模块用来确定参考扫描参数，判断模块若判断出实时扫描参数和参考扫描参数存在偏差，则生成模块根据偏差生成扫描姿态的修正提示消息， 以合理地调整移动终端当前的扫描距离、扫描角度、和/或扫描速度，以便后续能够获取到良好的关键帧并进行相应的3D重建。
本领域普通技术人员可知，上述方法中的全部或部分步骤可以通过程序指令相关的硬件完成，该程序可以存储于一计算机可读存储介质中。通过以上的实施方式的描述，所属领域的技术人员可以清楚地了解到本发明可以用硬件实现，或固件实现，或它们的组合方式来实现。
以上实施例仅为本发明技术方案的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围。

Claims (14)

  1. 一种调整扫描状态的方法，用于围绕目标物体扫描获取所述目标物体的关键帧，所述关键帧用于构建所述目标物体的3D图像；其特征在于，所述方法包括：
    移动终端判断所述目标物体是否为预设的目标类型；
    若判断所述目标物体是为所述预设的目标类型时，则确定与所述目标类型对应的参考扫描参数；
    获取所述移动终端围绕所述目标物体扫描时的实时扫描参数；
    判断所述实时扫描参数是否符合所述参考扫描参数；
    若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描参数对应的扫描状态。
  2. 如权利要求1所述方法，其特征在于，所述目标类型为人物头像，所述确定与所述目标类型对应的参考扫描参数包括：
    获取扫描人物头像时的扫描距离经验值作为所述参考扫描参数；
    所述获取所述移动终端围绕所述目标物体扫描时的实时扫描参数包括：
    获取移动终端扫描所述人物头像时的实时扫描距离，所述实时扫描距离为所述移动终端在围绕所述人物头像进行扫描的过程中相对于所述人物头像的实时距离；
    所述若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描状态，包括：
    若所述实时扫描距离大于所述扫描距离经验值，则生成第一提示消息，所述第一提示消息用于提示用户将所述移动终端靠近所述目标物体；或者，
    若所述实时扫描参数小于所述扫描距离经验值，则生成第二提示消息，所述第二提示消息用于提示用户将所述移动终端远离所述目标物体。
  3. 如权利要求1所述方法，其特征在于，所述目标类型为人物头像，所述确定与所述目标物体对应的参考扫描参数包括：
    获取人物头像对应的预设画面比例作为所述参考扫描参数，其中，画面比例为成像画面中人物头像轮廓所在的最小矩形对应的图像分辨率与成像画面图像分辨率的比值；
    所述获取所述移动终端围绕所述目标物体扫描时的实时扫描参数包括：
    获取移动终端扫描所述人物头像时生成的人物头像的实时画面比例，所述实时画面比例为移动终端实时成像画面中人物头像轮廓所在的最小矩形的面积对应的图像分辨率与成像画面图像分辨率的比值；
    所述若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描状态包括：
    若所述实时画面比例小于所述预设画面比例时，则生成第三提示消息，所述第三提示消息用于提示用户将所述移动终端靠近所述目标物体；或者，
    若所述实时画面比例大于所述预设画面比例时，则生成第四提示消息，所述第四提示消息用于提示用户将所述移动终端远离所述目标物体。
  4. 如权利要求1所述方法，其特征在于，所述目标类型为人物头像，所述确定与 所述目标类型对应的参考扫描参数包括：
    获取人物头像对应的预设扫描速度作为所述参考扫描参数；
    所述获取移动终端围绕所述目标物体扫描所述时的实时扫描参数包括：
    获取所述移动终端扫描所述目标物体时的实时扫描速度，所述实时扫描速度为所述移动终端在围绕所述人物头像进行扫描的过程中的实时移动速度；
    所述若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描状态，包括：
    若所述实时扫描速度大于所述预设扫描速度时，则生成第六提示消息，所述第六提示消息用于提示用户减小所述移动终端的移动速度。
  5. 一种调整扫描状态的装置，用于围绕目标物体扫描获取所述目标物体的关键帧，所述关键帧用于构建所述目标物体的3D图像；其特征在于，所述装置包括：
    确定模块，用于判断所述目标物体是否为预设的目标类型；当判断出所述目标物体为预设的目标类型时，确定与所述预设的目标类型对应的参考扫描参数；
    获取模块，用于获取所述装置围绕所述目标物体扫描时的实时扫描参数；
    判断模块，用于判断所述获取模块获取的实时扫描参数是否符合所述确定模块确定的参考扫描参数；
    生成模块，用于当所述判断模块判断结果为不符合时，生成提示消息，所述提示消息用于提示用户调整当前扫描参数对应的扫描状态。
  6. 如权利要求5所述装置，其特征在于，所述目标类型为人物头像，所述确定模块具体用于：获取扫描人物头像时的扫描距离经验值作为所述参考扫描参数；
    所述获取模块具体用于：获取所述装置扫描所述人物头像时的实时扫描距离，所述实时扫描距离为所述装置在围绕所述人物头像进行扫描的过程中相对于所述人物头像的实时距离；
    所述生成模块具体用于：若所述判断模块判断出所述实时扫描距离大于所述扫描距离经验值时，则生成第一提示消息，所述第一提示消息用于提示用户将所述装置靠近所述目标物体；或者，若所述判断模块判断出所述实时扫描距离小于所述扫描距离经验值时，则生成第二提示消息，所述第二提示消息用于提示用户将所述装置远离所述目标物体。
  7. 如权利要求5所述装置，其特征在于，所述目标类型为人物头像，
    所述确定模块具体用于：获取人物头像对应的预设画面比例作为所述参考扫描参数，其中，画面比例为成像画面中人物头像轮廓所在的最小矩形对应的图像分辨率与成像画面图像分辨率的比值；
    所述获取模块具体用于：获取所述装置扫描所述人物头像时生成的人物头像的实时画面比例，所述实时画面比例为移动终端实时成像画面中人物头像轮廓所在的最小矩形的面积对应的图像分辨率与成像画面图像分辨率的比值；
    所述生成模块具体用于：若所述判断模块判断出所述实时画面比例小于所述预设画面比例时，则生成第三提示消息，所述第三提示消息用于提示用户将所述装置靠近所述目标物体；或者，若所述判断模块判断出所述实时画面比例大于所述预设画面比例时，则生成第四提示消息，所述第四提示消息用于提示用户将所述装 置远离所述目标物体。
  8. 如权利要求5所述装置，其特征在于，所述目标类型为人物头像，
    所述确定模块具体用于：获取人物头像对应的预设扫描速度作为所述参考扫描参数；
    所述获取模块具体用于：获取所述装置扫描所述人物头像时的实时扫描速度，所述实时扫描速度为所述装置在围绕所述人物头像进行扫描的过程中的实时移动速度；
    所述生成模块具体用于：若所述判断模块判断出所述实时扫描速度大于所述预设扫描速度时，则生成第六提示消息，所述第六提示消息用于提示用户减小所述装置的移动速度。
  9. 一种移动设备，其特征在于，所述设备包括：存储器、处理器、总线、数据采集系统；所述存储器、所述处理器、所述数据采集系统通过所述总线连接通信；
    所述数据采集系统用于在所述处理器的控制下，扫描目标物体以获取关所述目标物体的关键帧，所述关键帧用于构建所述目标物体的3d图像；
    所述存储器用于存储程序指令；
    所述处理器调用所述程序指令用于，
    在所述数据采集系统扫描目标物体时，判断所述目标物体是否为预设的目标类型；
    若判断结果为所述预设的目标类型时，则确定与所述目标类型对应的参考扫描参数；通过所述数据采集系统获得扫描所述目标物体时的实时扫描参数；
    判断所述数据采集系统获取的实时扫描参数是否符合所述参考扫描参数；若不符合，则生成提示消息，所述提示消息用于提示用户调整当前扫描参数对应的扫描状态。
  10. 如权利要求9所述移动设备，其特征在于，
    所述处理器调用所述程序指令具体用于，在所述数据采集系统扫描目标物体时，判断所述数据采集系统扫描的目标物体是否为人物头像；
    若判断结果为所述目标类型为人物头像时，获取扫描人物头像时的扫描距离经验值作为所述参考扫描参数；
    通过所述数据采集系统获取移动设备扫描所述人物头像时的实时扫描距离，所述实时扫描距离为所述移动设备在围绕所述人物头像进行扫描的过程中相对于所述人物头像的实时距离；
    所述处理器判断出所述实时扫描距离大于所述扫描距离经验值，则生成第一提示消息，所述第一提示消息用于提示用户将所述移动设备靠近所述目标物体；或者，所述处理器判断出所述实时扫描参数小于所述扫描距离经验值，则生成第二提示消息，所述第二提示消息用于提示用户将所述移动设备远离所述目标物体。
  11. 如权利要求9所述移动设备，其特征在于，
    所述处理器调用所述程序指令具体用于，在所述数据采集系统扫描目标物体时，判断所述数据采集系统扫描的目标物体是否为人物头像；
    若判断结果为所述目标类型为人物头像时，获取人物头像对应的预设画面比例作为所述参考扫描参数，其中，画面比例为成像画面中人物头像轮廓所在的最小矩 形对应的图像分辨率与成像画面图像分辨率的比值；
    通过所述数据采集系统获取移动设备扫描所述人物头像时的实时画面比例，所述实时画面比例为移动设备实时成像画面中人物头像轮廓所在的最小矩形的面积对应的图像分辨率与成像画面图像分辨率的比值；
    所述处理器判断出所述实时画面比例小于所述预设画面比例时，则生成第三提示消息，所述第三提示消息用于提示用户将所述移动设备靠近所述目标物体；或者，
    所述处理器判断出所述实时画面比例大于所述预设画面比例时，则生成第四提示消息，所述第四提示消息用于提示用户将所述移动设备远离所述目标物体。
  12. 如权利要求9所述移动设备，其特征在于，
    所述处理器调用所述程序指令具体用于，在所述数据采集系统扫描目标物体时，判断所述数据采集系统扫描的目标物体是否为人物头像；
    若判断结果为所述目标类型为人物头像时，获取人物头像对应的预设扫描速度作为所述参考扫描参数；
    通过所述数据采集系统获取所述移动设备扫描所述目标物体时的实时扫描速度，所述实时扫描速度为所述移动设备在围绕所述人物头像进行扫描的过程中的实时移动速度；
    所述处理器判断出所述实时扫描速度大于所述预设扫描速度时，则生成第六提示消息，所述第六提示消息用于提示用户减小所述移动设备的移动速度。
  13. 如果权利要求9-12所述的移动设备，所述移动设备还包括天线系统、所述天线系统在处理器的控制下，收发无线通信信号实现与移动通信网络的无线通信。
  14. 如果权利要求13所述的移动设备，所述移动通信网络包括以下的一种或多种：GSM网络、CDMA网络、3G网络、FDMA、TDMA、PDC、TACS、AMPS、WCDMA、TDSCDMA、WIFI以及LTE网络。
PCT/CN2017/070996 2016-08-29 2017-01-12 一种调整扫描状态的方法及装置 Ceased WO2018040480A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP17844791.8A EP3493516B1 (en) 2016-08-29 2017-01-12 Method and device for adjusting scanning state
EP20176722.5A EP3764630B1 (en) 2016-08-29 2017-01-12 Method and apparatus for adjusting scanning status
US16/287,286 US11586034B2 (en) 2016-08-29 2019-02-27 Method and apparatus for adjusting scanning status

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610753241.2 2016-08-29
CN201610753241.2A CN106447728A (zh) 2016-08-29 2016-08-29 一种调整扫描状态的方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/287,286 Continuation US11586034B2 (en) 2016-08-29 2019-02-27 Method and apparatus for adjusting scanning status

Publications (1)

Publication Number Publication Date
WO2018040480A1 true WO2018040480A1 (zh) 2018-03-08

Family

ID=58091457

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/070996 Ceased WO2018040480A1 (zh) 2016-08-29 2017-01-12 一种调整扫描状态的方法及装置

Country Status (4)

Country Link
US (1) US11586034B2 (zh)
EP (2) EP3764630B1 (zh)
CN (2) CN112184829A (zh)
WO (1) WO2018040480A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112733579A (zh) * 2019-10-28 2021-04-30 华为技术有限公司 对象重建的方法、装置、设备及存储介质
CN112731359A (zh) * 2020-12-31 2021-04-30 无锡祥生医疗科技股份有限公司 超声探头的速度确定方法、装置及存储介质
CN116399515A (zh) * 2023-04-21 2023-07-07 苏州亚太精睿传动科技股份有限公司 一种基于机器视觉确定变速箱泄漏工况的方法及系统

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109600400A (zh) * 2017-09-29 2019-04-09 索尼公司 无线通信系统中的电子设备、方法和无线通信系统
CN108577995A (zh) * 2018-04-16 2018-09-28 苏州佳世达电通有限公司 口扫设备及其控制方法
CN109907721B (zh) * 2019-02-22 2021-04-20 苏州佳世达光电有限公司 口腔扫描设备及其建模状态提醒方法
CN116097312A (zh) 2020-08-21 2023-05-09 华为技术有限公司 用于3d重建的语义指令
CN112689060B (zh) * 2020-12-21 2023-01-20 上海联影医疗科技股份有限公司 扫描方法、装置、计算机设备和存储介质
CN113596276B (zh) * 2021-06-28 2022-09-27 展讯半导体(南京)有限公司 便携式电子设备的扫描方法及系统、电子设备及存储介质
CN114596583B (zh) * 2022-03-04 2025-08-29 浙江星链数据科技有限公司 一种手持3d扫描传感系统、方法及手持3d扫描装置
CN117481680A (zh) * 2022-07-26 2024-02-02 数坤(深圳)智能网络科技有限公司 超声影像采集方法、装置、设备及计算机可读存储介质
CN115967842B (zh) * 2022-12-21 2025-06-17 深圳软牛科技集团股份有限公司 视频seek方法、系统、视频播放服务器及存储介质
CN115767280B (zh) * 2022-12-30 2023-08-22 安徽淘云科技股份有限公司 词典笔摄像头参数调节方法、装置及词典笔
CN120614419A (zh) * 2025-08-06 2025-09-09 先临三维科技股份有限公司 扫描仪的标定控制方法、装置、介质、扫描仪及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080067251A1 (en) * 2006-09-15 2008-03-20 Keyence Corporation Method Of and System For Generating Laser Processing Data, Computer Program For Generating Laser Processing Data and Laser Marking System
US20100157280A1 (en) * 2008-12-19 2010-06-24 Ambercore Software Inc. Method and system for aligning a line scan camera with a lidar scanner for real time data fusion in three dimensions
CN103200365A (zh) * 2013-03-29 2013-07-10 东莞宇龙通信科技有限公司 一种使用移动终端进行全景拍摄的方法及移动终端
CN104168837A (zh) * 2011-10-10 2014-11-26 神经束公司 用手持图像设备对组织进行全面检查的方法、装置和系统
CN104620129A (zh) * 2012-09-14 2015-05-13 法罗技术股份有限公司 具有角扫描速度的动态调整的激光扫描仪
CN204963812U (zh) * 2015-08-25 2016-01-13 杭州思看科技有限公司 带扫描距离控制和提示功能的手持三维扫描仪

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060262112A1 (en) * 2005-05-23 2006-11-23 Carnegie Mellon University System and method for three-dimensional shape generation from partial and incomplete views, and interactive design system using same
CN101087354A (zh) 2006-06-07 2007-12-12 光宝科技股份有限公司 自动辨别待扫描物位置的扫描装置与其相关方法
JP5004726B2 (ja) * 2007-09-05 2012-08-22 キヤノン株式会社 撮像装置、レンズユニットおよび制御方法
CN101459784A (zh) * 2007-12-14 2009-06-17 上海银晨智能识别科技有限公司 一种使红外摄像装置适应光线的拍摄方法
US8830380B2 (en) * 2012-06-28 2014-09-09 International Business Machines Corporation Depth of focus in digital imaging systems
US10444845B2 (en) * 2012-12-21 2019-10-15 Qualcomm Incorporated Display of separate computer vision based pose and inertial sensor based pose
CN203616780U (zh) 2013-11-08 2014-05-28 杭州电子科技大学 一种人体三维扫描重建装置
CN104125395A (zh) * 2014-05-30 2014-10-29 深圳市中兴移动通信有限公司 一种实现自动拍摄的方法及装置
JP6162903B2 (ja) * 2014-12-15 2017-07-12 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドＳｚ Ｄｊｉ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．，Ｌｔｄ 画像処理システム、リモコン撮影モジュール、移動端末および露出情報提示方法
WO2016097940A1 (en) * 2014-12-16 2016-06-23 3Ditize Sl 3d rotational presentation generated from 2d static images
CN105069804B (zh) * 2015-08-21 2018-04-20 清华大学 基于智能手机的三维模型扫描重建方法
US9445081B1 (en) * 2015-09-25 2016-09-13 Intel Corporation Method and system of 3D image capture with dynamic cameras
JP6568448B2 (ja) * 2015-10-09 2019-08-28 キヤノン株式会社 自動焦点調節装置およびその制御方法、撮像装置
US9639943B1 (en) * 2015-12-21 2017-05-02 Intel Corporation Scanning of a handheld object for 3-dimensional reconstruction

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080067251A1 (en) * 2006-09-15 2008-03-20 Keyence Corporation Method Of and System For Generating Laser Processing Data, Computer Program For Generating Laser Processing Data and Laser Marking System
US20100157280A1 (en) * 2008-12-19 2010-06-24 Ambercore Software Inc. Method and system for aligning a line scan camera with a lidar scanner for real time data fusion in three dimensions
CN104168837A (zh) * 2011-10-10 2014-11-26 神经束公司 用手持图像设备对组织进行全面检查的方法、装置和系统
CN104620129A (zh) * 2012-09-14 2015-05-13 法罗技术股份有限公司 具有角扫描速度的动态调整的激光扫描仪
CN103200365A (zh) * 2013-03-29 2013-07-10 东莞宇龙通信科技有限公司 一种使用移动终端进行全景拍摄的方法及移动终端
CN204963812U (zh) * 2015-08-25 2016-01-13 杭州思看科技有限公司 带扫描距离控制和提示功能的手持三维扫描仪

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3493516A4 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112733579A (zh) * 2019-10-28 2021-04-30 华为技术有限公司 对象重建的方法、装置、设备及存储介质
CN112731359A (zh) * 2020-12-31 2021-04-30 无锡祥生医疗科技股份有限公司 超声探头的速度确定方法、装置及存储介质
CN112731359B (zh) * 2020-12-31 2024-04-09 无锡祥生医疗科技股份有限公司 超声探头的速度确定方法、装置及存储介质
CN116399515A (zh) * 2023-04-21 2023-07-07 苏州亚太精睿传动科技股份有限公司 一种基于机器视觉确定变速箱泄漏工况的方法及系统
CN116399515B (zh) * 2023-04-21 2024-03-15 苏州亚太精睿传动科技股份有限公司 一种基于机器视觉确定变速箱泄漏工况的方法及系统

Also Published As

Publication number Publication date
US11586034B2 (en) 2023-02-21
US20190196180A1 (en) 2019-06-27
EP3764630B1 (en) 2023-04-05
EP3493516A1 (en) 2019-06-05
EP3493516A4 (en) 2019-07-31
CN106447728A (zh) 2017-02-22
EP3493516B1 (en) 2020-07-29
EP3764630A1 (en) 2021-01-13
CN112184829A (zh) 2021-01-05

Similar Documents

Publication Publication Date Title
WO2018040480A1 (zh) 一种调整扫描状态的方法及装置
CN113973190A (zh) 视频虚拟背景图像处理方法、装置及计算机设备
CN109035394B (zh) 人脸三维模型重建方法、装置、设备、系统及移动终端
US9734594B2 (en) Producing three-dimensional representation based on images of an object
CN111345029A (zh) 一种目标追踪方法、装置、可移动平台及存储介质
WO2022105415A1 (zh) 关键帧图像的采集方法、装置、系统和三维重建方法
EP3598385B1 (en) Face deblurring method and device
CN106264537B (zh) 图像中人体姿态高度的测量系统及方法
CN108340405B (zh) 一种机器人三维扫描系统及方法
CN114640833B (zh) 投影画面调整方法、装置、电子设备和存储介质
WO2021022989A1 (zh) 标定参数的获取方法、装置、处理器及电子设备
CN107480615B (zh) 美颜处理方法、装置及移动设备
JP2014239384A (ja) 画像処理装置、画像処理方法及び画像処理プログラム
CN105072348B (zh) 一种快速对焦人脸的方法、装置及终端
CN115278184A (zh) 投影画面校正方法及装置
JP2016149678A (ja) カメラ校正ユニット、カメラ校正方法、およびカメラ校正プログラム
CN113763544B (zh) 图像确定方法、装置、电子设备和计算机可读存储介质
CN114093034B (zh) 一种步态分析方法、装置、设备及存储介质
US11166005B2 (en) Three-dimensional information acquisition system using pitching practice, and method for calculating camera parameters
CN112446251A (zh) 图像处理方法及相关装置
CN107423187A (zh) 一种屏幕监控方法、装置及系统
JP2002077941A (ja) 奥行き画像生成装置、奥行き画像生成方法およびその方法をコンピュータに実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体
US11790483B2 (en) Method, apparatus, and device for identifying human body and computer readable storage medium
JP6700539B2 (ja) 映像処理装置、映像処理方法、及び映像処理プログラム
CN112749600A (zh) 人眼位置确定方法及相关产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17844791

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017844791

Country of ref document: EP

Effective date: 20190228