WO2017000792A1 - Système et procédé de prise d'image panoramique automatique - Google Patents

Système et procédé de prise d'image panoramique automatique Download PDF

Info

Publication number
WO2017000792A1
WO2017000792A1 PCT/CN2016/086051 CN2016086051W WO2017000792A1 WO 2017000792 A1 WO2017000792 A1 WO 2017000792A1 CN 2016086051 W CN2016086051 W CN 2016086051W WO 2017000792 A1 WO2017000792 A1 WO 2017000792A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
unit
shooting
voice
panoramic photo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/086051
Other languages
English (en)
Chinese (zh)
Inventor
周勇俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yutou Technology Hangzhou Co Ltd
Original Assignee
Yutou Technology Hangzhou Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yutou Technology Hangzhou Co Ltd filed Critical Yutou Technology Hangzhou Co Ltd
Publication of WO2017000792A1 publication Critical patent/WO2017000792A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present invention relates to the field of robot technology, and in particular, to a panoramic photo automatic shooting system and method.
  • panoramic photo is to take multiple photos from left to right or right to left or from top to bottom or from bottom to top, and then stitch them into a panoramic photo like a jigsaw puzzle.
  • the drawback of this panoramic photo shooting is that multiple photos need to be manually moved horizontally or vertically, and multiple photos taken during the movement may not be on a coincident line, and a large displacement phenomenon occurs, and the final panoramic image is spliced. The expected effect is not achieved or the stitching fails.
  • An object of the present invention is to provide a panoramic photo automatic shooting system that solves the above technical problems
  • Another object of the present invention is to provide a method for automatically taking a panoramic photo to solve the above technical problems
  • Panoramic photo automatic shooting system for robot systems including,
  • a voice recognition unit configured to identify instruction information in the voice information, where the instruction information is at least Including camera instructions and shooting track information;
  • control unit coupled to the voice recognition unit, configured to receive the instruction information and generate a control signal to control a corresponding device action
  • a moving unit connected to the control unit, and moving from the starting position to the ending position from the starting position under the action of the control unit;
  • An image capturing unit is disposed on the mobile unit to move with the mobile unit, and the image capturing unit is connected to the control unit to capture an image under the action of the control unit.
  • the speech recognition unit includes
  • a voice capture unit for capturing voice information
  • a signal processing unit coupled to the voice capture unit for extracting instruction information in the voice information and/or for positioning the sound source.
  • the panoramic photo automatic photographing system of the present invention further includes an image recognizing unit connected to the image capturing unit for classifying objects in the image and extracting picture feature information of objects in the image.
  • the panoramic photo automatic photographing system of the present invention further includes a matching unit connected to the image recognizing unit, and matching the object mark information at the mark start position and the object mark information at the mark end position with the picture feature information to Re-determine the start position, end position, and shooting track of the shot.
  • the panoramic photo automatic photographing system of the present invention further includes a storage unit for storing the instruction information.
  • the present invention also provides an automatic photographing method for panoramic photos, which is used in the above-mentioned automatic photographing system for panoramic photographs, including
  • Step s11 obtaining a starting position of the shooting object, an ending position of the shooting object, and a shooting track by using the voice information sent by the sound source;
  • Step s12 the moving unit drives the image capturing unit to move from the starting position to the ending position along the shooting track, and capture a group of photos during the moving process;
  • step s13 a panoramic photo is generated according to the photo stitching.
  • step s11 is specifically as follows:
  • Step s111a receiving a voice information for taking a panoramic photo
  • Step s112a extracting instruction information included in the voice information, where the command information includes at least a photographing instruction, an initial starting position, an initial ending position, and an initial shooting trajectory;
  • Step s113a generating a control signal under the action of the instruction information to drive the moving unit to move from the initial starting position to the initial shooting position along the initial shooting position, and the image capturing unit is driven by the mobile unit Taking a first set of reference photos along a 360-degree space of the shot track;
  • Step s114a extracting picture feature information of each object in the first group of reference photos, and matching and re-determining the starting position and ending by matching the object tag information with the feature information of the object in the first group of reference photos. Location and shooting trajectory.
  • the step s11 is specifically as follows:
  • Step s111b receiving a voice message for taking a panoramic photo
  • Step s112b extracting instruction information included in the voice information, where the command information includes at least a photographing instruction and a shooting track;
  • Step s113b positioning a sound source of the voice information, and controlling the image capturing unit to face and track the movement of the sound source;
  • step s114b the image capturing unit tracks the first position to which the sound source is moved as the starting position of the shooting by the moving unit, and tracks the second position to which the sound source is moved as the ending position of the shooting.
  • the step s11 is specifically as follows:
  • Step s111c receiving a voice information for taking a panoramic photo
  • Step s112c extracting instruction information included in the voice information, where the command information includes at least a photographing instruction and a shooting track;
  • Step s113c positioning the sound source of the voice information
  • Step s114c under the control of the voice command of the sound source, the image capturing unit moves to a first position according to the set direction as a starting position of shooting; the image capturing unit continues to move to a second position as a shooting The end position.
  • the step s11 is specifically as follows:
  • Step s111d receiving a voice information for taking a panoramic photo
  • Step s112d extracting instruction information included in the voice information, where the instruction information includes at least a photographing instruction, a starting position object feature combination, an ending position object feature combination, and a shooting track;
  • Step s113d rotating the image capturing unit to acquire a set of reference photos
  • Step s114d extracting the name and picture feature information of each object in the reference photo, and matching the name and feature information of the object in the reference photo by the start position object feature combination to find the starting position
  • the end position is found by matching the end position object feature combination with the name and feature information of the object in the reference photo.
  • the present invention can automatically take a panoramic photo by issuing a command for taking a panoramic photo by a user, thereby solving the technical problem of automatically taking a panoramic photo, and letting Taking panoramic photos is even simpler, and stitched panoramas work better.
  • FIG. 1 is a schematic structural view of a system of the present invention
  • FIG. 2 is a schematic flow chart of a method according to a specific embodiment of the present invention.
  • FIG. 3 is a timing diagram of the steps of the method of the present invention.
  • FIG. 4 is a schematic flow chart of a method according to another embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a method according to another embodiment of the present invention.
  • FIG. 6 is a schematic flow chart of a method according to still another embodiment of the present invention.
  • a panoramic photo automatic shooting system for a robot system including,
  • the voice recognition unit 11 is configured to identify instruction information in the voice information, where the command information includes at least a photographing instruction and a photographing track information;
  • the control unit 12 is connected to the voice recognition unit 11 for receiving command information and generating a control signal to control the corresponding device action;
  • the mobile unit 13 is connected to the control unit 12 and moves from the starting position to the end position from the starting position under the action of the control unit 12;
  • the image capturing unit 14 is disposed on the mobile unit 13 and moves with the mobile unit 13.
  • the image capturing unit 14 is connected to the control unit 12 to capture an image under the action of the control unit 12.
  • the invention is applied to the field of robots, and uses a rotating device of the robot, that is, a moving unit 13, and an image capturing unit or a camera to take a panoramic photo, and combines object recognition and locking technology, camera taking photo technology, automatic voice recognition technology,
  • the technology of turning the rotating function of the device can automatically take a panoramic photo by the user's instruction to take a panoramic photo, which solves the technical problem of automatically taking a panoramic photo, makes the panoramic photo easier, and the stitched panoramic photo is better.
  • the speech recognition unit 11 includes
  • a voice capture unit for capturing voice information
  • the signal processing unit is coupled to the voice capture unit for extracting instruction information in the voice information and/or for positioning the sound source.
  • the panoramic photo automatic photographing system of the present invention further includes an image recognizing unit 15 connected to the image capturing unit 14 for classifying objects in the image and extracting picture feature information of the objects in the image.
  • the panoramic photo automatic photographing system of the present invention further includes a matching unit 16 connected to the image recognizing unit 15 to match the object mark information of the mark start position and the object mark information of the mark end position and the picture feature information to be newly determined.
  • the start position, end position, and shooting track of the shot is a matching unit 16 connected to the image recognizing unit 15 to match the object mark information of the mark start position and the object mark information of the mark end position and the picture feature information to be newly determined. The start position, end position, and shooting track of the shot.
  • the panoramic photo automatic photographing system of the present invention further includes a storage unit 17 for storing the command letter interest.
  • the present invention further provides a method for automatically capturing a panoramic photo, which is used in the above-mentioned panoramic photo automatic shooting system, including
  • Step s11 obtaining a starting position of the shooting object, an ending position of the shooting object, and a shooting track by using the voice information sent by the sound source;
  • Step s12 the moving unit drives the image capturing unit to move from the starting position along the shooting track to the ending position, and takes a group of photos during the moving process;
  • step s13 a panoramic photo is generated according to the photo stitching.
  • the method for automatically capturing a panoramic photo of the present invention may be as follows:
  • Step s111a receiving a voice information for taking a panoramic photo
  • Step s112a extracting instruction information included in the voice information, the command information including at least a photographing instruction, an initial starting position, an initial ending position, and an initial shooting trajectory;
  • Step s113a generating a control signal under the action of the command information to drive the moving unit to move from the initial starting position to the initial shooting position from the initial shooting position, and the image capturing unit takes the first group in the 360-degree space of the shooting track under the driving of the moving unit.
  • Step s114a extracting picture feature information of each object in the first group of reference photos, and matching and re-determining the start position and the end position and the shooting track by matching the object mark information with the feature information of the object in the first set of reference photos .
  • the user issues some voice commands for taking panoramic photos, and then extracts object information of the start position and the end position in the voice command by automatic voice recognition technology, and the shooting track (horizontal or vertical). )information.
  • the robot turns the Camera A set of reference photos is taken in a horizontal or vertical 360-degree space, and the object is classified by the object recognition image technology, and the picture feature information of each object in the reference photo is extracted.
  • the object mark information is matched with the object feature information in the reference picture, and finally the start position, the end position, and the shooting track (horizontal or vertical) of the panoramic picture are determined.
  • the robot rotates the position of the object mark information from the Camera to the start position, and according to the shooting trajectory (horizontal or vertical), starts shooting a group of photos until the position of the object mark information at the end position. Finally, this group of photos is stitched together into a panoramic photo.
  • the step s11 can be specifically as follows:
  • Step s111b receiving a voice message for taking a panoramic photo
  • Step s112b extracting instruction information included in the voice information, where the command information includes at least a photographing instruction and a shooting track;
  • Step s113b positioning the sound source of the voice information, and controlling the image capturing unit to face and track the movement of the sound source;
  • step s114b the image capturing unit tracks the first position to which the sound source is moved by the moving unit as the starting position of the shooting, and tracks the second position to which the sound source is moved as the ending position of the shooting.
  • a specific implementation is as follows:
  • the user sends a panoramic photo command to the robot, such as: "Give me a panoramic photo in horizontal or vertical direction";
  • the image capturing unit such as a photographic camera, is positioned by the rotating device and the voiceprint recognition technology to the user who issued the instruction;
  • the user moves to the starting position of the panoramic photo, and the camera captures the user to the starting position;
  • the user issues a command to record the starting position of the panoramic photo, such as: “Start shooting panorama from here Photo", extracting the initial photographing position information;
  • the user moves to the end position where the panoramic photo is taken, and the camera captures the user to the end position;
  • the user issues an end position command for recording a panoramic photo: "Come here", extracts the end position information of the terminated photograph;
  • the robot passes the start position, the end position, and shoots the track information, and the mobile camera automatically takes a panoramic photo on the same coincidence line.
  • the step s11 can be specifically as follows:
  • Step s111c receiving a voice information for taking a panoramic photo
  • Step s112c extracting instruction information included in the voice information, where the command information includes at least a photographing instruction and a shooting track;
  • Step s113c positioning the sound source of the voice information
  • Step s114c under the control of the voice command of the sound source, the image capturing unit moves to a first position according to the set direction as the starting position of the shooting; the image capturing unit continues to move to a second position as the ending position of the shooting.
  • a specific embodiment is as follows:
  • the user sends a panoramic photo command to the robot, such as: "Give me a panoramic photo in horizontal or vertical direction";
  • the shooting track is horizontal or vertical information, and the camera is positioned by the rotating device and the voiceprint recognition technology to the position of the user who issued the command;
  • a move command "Move left or right or up or down.”
  • the length of one frame of the photo is moved each time.
  • the length of the movement can be customized by the voice command.
  • a voice command is issued: “here as the starting position”, and the initial photographing position information is extracted.
  • voice command “here as the end position” extract the end position information; the robot passes the start position, the end position, shoots the track information, and the mobile camera automatically takes a panoramic photo on the same coincidence line.
  • the step s11 can be specifically as follows:
  • Step s111d receiving a voice information for taking a panoramic photo
  • Step s112d extracting instruction information included in the voice information, the command information includes at least a photographing instruction, a starting position object feature combination, an ending position object feature combination, and a shooting track;
  • Step s113d rotating the image capturing unit to acquire a set of reference photos
  • Step s114d extracting the name and picture feature information of each object in the reference photo, and matching the name of the object in the reference position with the name and feature information of the object in the reference photo to find the starting position; The combination matches the name and feature information of the object in the reference photo to find the end position.
  • the user issues a panoramic photo command to the robot, such as: "From a white chair with yellow clothes left/right/upper/lower to a brown teapot on the right/left/down/top table, take a panoramic photo. ";
  • Automatic speech recognition technology parses the starting position object feature combination: "left/right/upper/lower side yellow clothes”, “left/right/upper/lower side white chairs”, “yellow clothes on white chairs”;
  • Automatic speech recognition technology analyzes the end position object feature combination: "right/left/down/top table”, “right/left/down/top teapot”, “teapot on the table”;
  • Automatic speech recognition technology analyzes the shooting track information: horizontal/vertical direction;
  • the robot passes the start position, the end position, and shoots the track information, and the mobile camera automatically takes a panoramic photo on the same coincidence line.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Studio Devices (AREA)
  • Manipulator (AREA)

Abstract

La présente invention se rapporte au domaine technique des robots, et concerne, en particulier, un système et un procédé de prise d'image panoramique automatique. Le système de prise d'image panoramique automatique, qui est appliqué à un système de robot, comprend : une unité de reconnaissance vocale pour reconnaître des informations d'instruction dans des informations vocales, et les informations d'instruction comprenant au moins une instruction de photographie et des informations de trajectoire de photographie ; une unité de commande connectée à l'unité de reconnaissance vocale et utilisée pour recevoir les informations d'instruction et générer un signal de commande pour amener un dispositif correspondant à agir ; une unité mobile connectée à l'unité de commande et capable de se déplacer d'une position de départ à une position d'arrivée le long d'une trajectoire de photographie sous la fonction de l'unité de commande ; et une unité de capture d'image agencée sur l'unité mobile pour se déplacer conjointement avec l'unité mobile, et l'unité de capture d'image étant connectée à l'unité de commande, et capturant une image sous la fonction de l'unité de commande. La présente invention peut prendre automatiquement une image panoramique selon une instruction de prise d'image panoramique envoyée par un utilisateur, résout le problème technique de la façon de prendre automatiquement une image panoramique, et rend la prise d'image panoramique plus simple et l'effet d'une image panoramique mosaïquée meilleure.
PCT/CN2016/086051 2015-06-30 2016-06-16 Système et procédé de prise d'image panoramique automatique Ceased WO2017000792A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510385276.0 2015-06-30
CN201510385276.0A CN106331467B (zh) 2015-06-30 2015-06-30 全景照片自动拍摄系统及方法

Publications (1)

Publication Number Publication Date
WO2017000792A1 true WO2017000792A1 (fr) 2017-01-05

Family

ID=57607770

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/086051 Ceased WO2017000792A1 (fr) 2015-06-30 2016-06-16 Système et procédé de prise d'image panoramique automatique

Country Status (3)

Country Link
CN (1) CN106331467B (fr)
TW (1) TWI610570B (fr)
WO (1) WO2017000792A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114040110A (zh) * 2021-11-19 2022-02-11 北京图菱视频科技有限公司 位姿条件限制下的机器人拍照方法、装置、设备及介质

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109660723B (zh) * 2018-12-18 2021-01-08 维沃移动通信有限公司 一种全景拍摄方法及装置
CN109889725B (zh) * 2019-02-27 2021-06-04 青岛骐一企业管理有限公司 一种规避照片翻拍的系统和方法
CN115866404A (zh) * 2022-12-06 2023-03-28 深圳市友兴达精密五金有限公司 一种全景拍摄方法、系统、服务器及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090153685A1 (en) * 2007-12-18 2009-06-18 Byung-Jun Son Method for automatically photographing panoramic picture
DE202013000919U1 (de) * 2012-11-08 2013-11-13 Cityguide AG System zum automatischen Erstellen von Panoramabildern
CN203416331U (zh) * 2013-09-05 2014-01-29 田随心 一种摄像装置
CN104092932A (zh) * 2013-12-03 2014-10-08 腾讯科技（深圳）有限公司 一种声控拍摄方法及装置
CN104135619A (zh) * 2014-08-12 2014-11-05 广东欧珀移动通信有限公司 一种摄像头控制方法及装置
CN104469162A (zh) * 2014-12-23 2015-03-25 天津天地伟业数码科技有限公司 语音控制球型摄像机方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010206451A (ja) * 2009-03-03 2010-09-16 Panasonic Corp カメラ付きスピーカ、信号処理装置、およびａｖシステム
KR101723642B1 (ko) * 2011-01-31 2017-04-19 삼성전자주식회사 파노라마 이미지를 촬영하는 촬영 기기 및 그 파노라마 촬영 방법
CN103685905B (zh) * 2012-09-17 2016-12-28 联想(北京)有限公司 一种拍照方法及电子设备
CN102932595A (zh) * 2012-10-22 2013-02-13 北京小米科技有限责任公司 声控拍摄方法、装置及终端
CN103426282A (zh) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 遥控方法及终端
CN104320581A (zh) * 2014-10-28 2015-01-28 广东欧珀移动通信有限公司 一种全景拍摄的方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090153685A1 (en) * 2007-12-18 2009-06-18 Byung-Jun Son Method for automatically photographing panoramic picture
DE202013000919U1 (de) * 2012-11-08 2013-11-13 Cityguide AG System zum automatischen Erstellen von Panoramabildern
CN203416331U (zh) * 2013-09-05 2014-01-29 田随心 一种摄像装置
CN104092932A (zh) * 2013-12-03 2014-10-08 腾讯科技（深圳）有限公司 一种声控拍摄方法及装置
CN104135619A (zh) * 2014-08-12 2014-11-05 广东欧珀移动通信有限公司 一种摄像头控制方法及装置
CN104469162A (zh) * 2014-12-23 2015-03-25 天津天地伟业数码科技有限公司 语音控制球型摄像机方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114040110A (zh) * 2021-11-19 2022-02-11 北京图菱视频科技有限公司 位姿条件限制下的机器人拍照方法、装置、设备及介质

Also Published As

Publication number Publication date
CN106331467A (zh) 2017-01-11
TWI610570B (zh) 2018-01-01
TW201701645A (zh) 2017-01-01
HK1231653A1 (zh) 2017-12-22
CN106331467B (zh) 2019-08-13

Similar Documents

Publication Publication Date Title
KR102508080B1 (ko) 비디오 처리 방법, 장치 및 저장 매체
JP5276111B2 (ja) セルフ撮影の際に顔の構図を決定できるようにサポートする方法及びシステム
CN108369816B (zh) 用于从全向视频创建视频剪辑的设备和方法
CN103167230B (zh) 电子设备及其根据手势控制拍照的方法
CN100431337C (zh) 摄影装置以及自动聚焦控制方法
EP2791899B1 (fr) Procédé et appareil de ciblage de capture d'image
TWI599225B (zh) 一種通過語音指令快速定位拍照的方法及拍照系統
TWI610570B (zh) 全景照片自動拍攝系統及方法
CN105120179B (zh) 一种拍照方法和装置
CN108702458B (zh) 拍摄方法和装置
EP2753066A2 (fr) Appareil à caméra et procédé de photographie d'image
WO2015196920A1 (fr) Procédé et dispositif de prise de vues pour image dynamique
CN106774947A (zh) 一种飞行器及其控制方法
CN101378455A (zh) 根据取得的图像确定主要拍摄物的图像区域的装置及方法
WO2020233136A1 (fr) Procédé de prise de photo automatique à base de télévision, télévision et support de stockage
RU2019125375A (ru) Система и способ получения данных, регистрации и организации мультимедийной информации
WO2015131701A1 (fr) Procédé et dispositif de prise de photographie, et support de stockage informatique
CN104580874B (zh) 一种摄像设备及其实现拍照的方法
CN103220465A (zh) 一种使用手机拍照时进行精确定位人脸图像的方法、装置及移动终端
CN111698428A (zh) 一种文档拍摄的方法、装置、电子设备和存储介质
CN114449202A (zh) 一种视频会议摄像头控制方法、装置、及系统
CN103167227A (zh) 全景拍照系统及方法
CN104978389A (zh) 方法、系统、服务器和客户端
WO2022205085A1 (fr) Procédé, appareil et système de photographie vidéo
JP2018107538A (ja) 情報処理装置、情報処理装置の制御方法および制御プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16817156

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16817156

Country of ref document: EP

Kind code of ref document: A1