JP6533802B2 - Mobile system and game application - Google Patents

Description

  One aspect of the present invention relates to a mobile device such as a flightable drone and a mobile system including a remote controller capable of controlling the mobile device.

  In recent years, small flight vehicles called drone have become widespread and are being used in various fields. One use case is to mount a camera on the drone and operate the drone while checking the images taken by the camera. For example, Patent Document 1 discloses an apparatus in which a camera-mounted flying object flies above the mobile device, and the camera detects the situation around the mobile device.

JP, 2016-181119, A

  However, with a conventional drone equipped with a conventional camera, when it gets dark due to entering a dark place, the ordinary camera can not grasp the surrounding situation because the amount of light is insufficient, making it difficult to fly. There were times when

  The present invention adopts the following means in order to solve the above problems. In the following description, in order to facilitate understanding of the invention, reference numerals and the like in the drawings are appended in parentheses, but each component of the present invention is not limited to the appended ones. It should be interpreted broadly to the extent that the vendor can understand technically.

One means of the present invention is
Rotatable wings (122a, 122b, 122c, 122d),
Motors (121a, 121b, 121c, 121d) connected to the wings;
A wing drive unit (13) for driving the motor;
A camera (11) for imaging an object;
An infrared camera (12) for acquiring infrared radiation emitted from the subject;
A control unit (10) for controlling the wing drive unit;
It is a mobile device (1).

  According to the mobile device of the above configuration, by providing the infrared camera, it is possible to have a configuration capable of grasping the surrounding situation even in a dark place. This makes it possible to provide a mobile device capable of safely flying in the dark.

In the above mobile device, preferably
The infrared camera can capture an object.

  According to the mobile device of the above configuration, the infrared camera can be used as a normal camera as well as the infrared camera for dark places.

In the above mobile device, preferably
The control unit can three-dimensionally capture an object based on an imaging result of the camera and an imaging result of the infrared camera.

  According to the mobile device of the above configuration, the subject can be captured in three dimensions by the camera and the infrared camera, and therefore, it is possible to fly safely without colliding with an obstacle. In addition, since the infrared camera is configured to be able to pick up an object like the normal camera, it is possible to use the infrared camera as a camera for capturing an object in three dimensions and a camera for dark places. . As a result, compared to a configuration in which an infrared camera is separately provided in addition to two or more cameras, the mobile device can be configured in a smaller size.

In the above mobile device, preferably
A positioning unit (15) capable of positioning the position;
A storage unit (18) for storing position information determined by the positioning unit;
A battery (16) for supplying electric power to the wing drive unit;
The control unit controls the wing drive unit to move to the position of the past position information stored in the storage unit when detecting that the remaining amount of the battery is smaller than a predetermined value.

  According to the mobile device having the above configuration, it is possible to prevent unintentional dropping even if the remaining amount of the battery is reduced.

In the above mobile device, preferably
A positioning unit (15) capable of positioning the position;
A storage unit (18) for storing position information determined by the positioning unit;
A communication unit (17) for receiving a signal from the remote controller;
The control unit controls the wing drive unit to move to the position of the past position information stored in the storage unit when detecting that the communication unit has become incapable of communicating with the remote controller. .

  According to the mobile device having the above configuration, it is possible to execute a function of automatically returning to the place of the user even if the user goes to a place away from the remote controller and becomes inoperable.

Further, one means of the present invention is
Any of the mobile devices (1) above,
And a remote controller (2) capable of communicating with the mobile device.
The remote controller is
A communication unit (24) for transmitting a signal to the mobile device;
With a microphone (23) to get voice,
A control unit (20) that switches between an operation mode for transmitting a signal to the mobile device and a non-operation mode for stopping transmission of the signal to the mobile device according to a predetermined voice acquired by the microphone; With
It is a mobile system.

  According to the mobile system of the above configuration, even while operating the mobile apparatus, for example, it is possible to easily switch other functions such as a call to an executable state.

Further, one means of the present invention is
Use any of the mobile devices (1) above,
It is game application software.

  According to the game application software of the above configuration, it is possible to support the progress of the game by the user, and it is possible to widen the range of play by the user.

FIG. 1 is an external view of the drone of the present embodiment. FIG. 2 is a view showing an example of the configuration of a mobile unit system according to the present embodiment.

Embodiments according to the present invention will be specifically described with reference to the drawings according to the following configuration. However, the embodiments described below are merely examples of the present invention, and the technical scope of the present invention is not to be interpreted in a limited manner. In the drawings, the same components are denoted by the same reference numerals, and the description thereof may be omitted.
1. Embodiment 2. Supplementary items

<1. Embodiment>
The mobile device according to the present embodiment is a so-called drone, and is characterized in that it can safely fly even in a dark place by mounting an infrared camera in addition to a normal camera. Hereinafter, an embodiment of the present invention will be specifically described with reference to the drawings.

  FIG. 1 is an external perspective view of the drone 1 of the present embodiment. FIG. 2 is a diagram showing a configuration example of a mobile system including the drone 1 and the smartphone 2. The drone 1 is an example of the “mobile device” in the present invention. The smartphone 2 can remotely operate the drone 1 by wireless communication with the drone 1 and functions as a so-called remote controller. That is, the smartphone 2 is an example of the “remote controller” in the present invention. For wireless communication, for example, the technology of wireless communication using radio waves in the 5 GHz band or 2.4 GHz band is used.

  As shown in FIG. 1, the drone 1 includes a main body 1a, a camera 11, motors 121a, 121b, 121c and 121d, wings 122a, 122b, 122c and 122d, and the like. Further, as shown in FIG. 2, the drone 1 includes a control unit 10, a camera 11, an infrared camera 12, a wing drive unit 13, a sensor 14, a positioning unit 15, a battery 16, a communication unit 17, and a storage unit 18. It consists of

  In addition to the configuration specifically described here, the drone 1 naturally incorporates or can be equipped with a basic function that a so-called drone has at the time of application. Similarly, the smartphone 2 naturally incorporates or can be equipped with the basic functions of a so-called smartphone at the time of filing.

<Camera 11>
The camera 11 includes a lens, a lens barrel, an imaging device, and the like, and is configured to image a subject and output an imaging result to the control unit 10 as image data. The imaging device is a photoelectric conversion device such as a C-MOS sensor or a CCD that can receive light from a subject and convert it into image data. The camera 11 may be configured to have a stop that blocks part of incident light.

<Infrared camera 12>
The infrared camera 12 includes a lens, a lens barrel, an infrared sensor, and the like, and is configured to acquire, as infrared image data, an infrared ray emitted from a subject or reflected by the subject.

  The infrared camera 12 may be configured to include another sensor capable of receiving light including a wavelength other than infrared light and converting it into image data, instead of an infrared sensor capable of detecting only infrared light. For example, the infrared camera 12 may function as an ordinary camera similar to the camera 11.

  The infrared camera 12 may be configured to have an infrared irradiation unit that emits infrared light to a subject. In this case, the infrared camera 12 acquires infrared light reflected by the subject as infrared image data. Further, the infrared camera 12 may be configured not to have a function of emitting infrared light, and in this case, the infrared camera 12 acquires infrared light emitted by a subject as infrared image data. In addition, the smartphone 2 may have a light source capable of emitting infrared light. In this case, the user of the smartphone 2 can emit infrared light to an arbitrary position.

<Wing driver 13>
The wing drive unit 13 is configured to drive the wings 122 a to 122 d of the drone 1 under the control of the control unit 10 to fly the drone 1 in a predetermined direction. More specifically, under the control of the control unit 10, the wing drive unit 13 rotates the motors 121a to 121d at a predetermined rotational speed, and appropriately controls the mutual rotational speed to thereby set the drone 1 in a predetermined direction. Make it fly.

<Sensor 14>
The sensor 14 is various sensors such as an acceleration sensor, an angular velocity sensor, or a temperature sensor. The sensor 14 detects the situation where the drone 1 is placed and notifies the control unit 10 of the situation. More specifically, the sensor 14 can detect, for example, the flying speed of the drone 1, detect a state such as the tilt of the main body 1a, or detect the ambient temperature.

<Positioning unit 15>
The positioning unit 15 is configured to acquire position information using, for example, GPS (Global Positioning System), and measures the position information of the drone 1. The positioning unit 15 stores the measured position information in the storage unit 18 via the control unit 10. In addition, the positioning part 15 does not necessarily need to be GPS, and may be the structure in which another positioning is possible. For example, as an example of the positioning unit 15 using technology other than GPS, a method of acquiring position information of the drone 1 by the technology of positioning using radio wave intensity in wireless communication between the drone 1 and the smartphone 2 is applicable It is.

<Battery 16>
The battery 16 is a chargeable / dischargeable power storage unit, and is configured to supply the power stored by charging to each unit of the drone 1. That is, the battery 16 supplies power to all or part of the motors 121a to 121d, the control unit 10, the camera 11, the infrared camera 12, the wing drive unit 13, the sensor 14, the positioning unit 15, the communication unit 17, and the storage unit 18. Supply.

<Communication unit 17>
The communication unit 17 is configured to be able to transmit and receive signals to / from an external device including the smartphone 2 under the control of the control unit 10. However, the communication unit 17 may be configured to have only the function of receiving a signal. That is, the communication unit 17 receives at least the signal transmitted from the smartphone 2.

<Storage unit 18>
The storage unit 18 is a volatile or non-volatile memory, and is configured to be capable of storing various data. In particular, in the present embodiment, the storage unit 18 stores the positioning information at the place where the user has issued the movement instruction for the first time after activation of the drone 1. In addition, the storage unit 18 stores positioning information at the current location every predetermined time. In addition, the storage unit 18 may store various data such as software or firmware data used by the control unit 10, image data captured by the camera 11, and infrared image data acquired by the infrared camera 12, for example. .

<Control unit 10>
The control unit 10 is, for example, a control device such as a CPU or a semiconductor integrated circuit such as an ASIC, and is configured to be able to control each configuration included in the drone 1. The control unit 10 controls the respective units of the drone 1 to perform various operations, but in the present embodiment, for example, the following operations are possible.

<Operation of drone 1 under control of control unit 10>
The control unit 10 controls the blade driving unit 13 to change the flowing direction and magnitude of the current supplied to the motors 121a to 121d, thereby controlling the rotating direction and the number of rotations per hour of the motors 121a to 121d. Thereby, the control unit 10 controls the rotation of the wing via the wing drive unit 13 and the motors 121a to 121d, and controls the flight direction of the drone 1, takeoff and landing, and the like.

  The control unit 10 can control the camera 11 and the infrared camera 12 to obtain image data obtained by imaging a subject. The camera 11 and the infrared camera 12 are arranged side by side in the lateral direction, and have parallax. Thus, the control unit 10 can three-dimensionally capture the subject based on the image data captured by the camera 11 and the image data captured by the infrared camera 12.

  In a state where the surrounding area is bright, the control unit 10 flies by grasping the surrounding state based on the image data acquired by the camera 11. On the other hand, when the surroundings are dark, the control unit 10 grasps the surrounding state and flies based on the infrared image data acquired by the infrared camera 12. The control unit 10 can transmit the acquired image data or infrared image data to an external device such as the smartphone 2 via the communication unit 17.

  The control unit 10 can detect the remaining amount of the battery 16. For example, the control unit 10 may quantitatively detect the remaining amount of the battery 16 or receive a low battery signal transmitted from the battery 16 when the remaining amount of the battery 16 becomes smaller than a predetermined value. The remaining amount may be detected by When detecting that the remaining amount of the battery 16 has become smaller than a predetermined value, the control unit 10 performs control to fly back to the user based on the position information stored in the storage unit 18. That is, the control unit 10 determines the place to fly based on the position information measured by the positioning unit 15 in the past, and controls the wing driving unit 13 to fly toward the predetermined position.

  The control unit 10 determines whether the communication with the smartphone 2 is possible by confirming the communication state of the communication unit 17. Specifically, the communication unit 17 determines whether communication with the smartphone 2 is possible by receiving a signal transmitted from the smartphone 2 at predetermined time intervals. Here, for example, when the drone 1 moves beyond the communicable range with the smartphone 2, the communication between the drone 1 and the smartphone 2 becomes impossible. If the control unit 10 determines that the communication unit 17 can not communicate with the smartphone 2 for a predetermined time or more, the control unit 10 prevents the drone 1 from being lost. Control to fly back. That is, based on the position information which the positioning part 15 positioned in the past, it determines the place which should fly, and controls the wing | blade drive part 13, It flies toward a predetermined position (user's position).

  Alternatively, the control unit 10 may perform control to fly toward a position before communication becomes impossible. At this time, the control unit 10 associates the communication state with the smartphone 2 with the position information measured by the positioning unit 15 and stores the information in the storage unit 18. The control unit 10 determines a location where the drone 1 can not communicate with the smartphone 2 based on the communication state and the position information stored in the storage unit 18, and performs control to move to the location. Also good.

<Smart phone 2>
The smart phone 2 is comprised including the control part 20, the display part 21, the operation part 22, the microphone 23, the communication part 24, and the memory | storage part 25 as FIG. 2 shows.

<Display 21>
The display unit 21 is a display device such as an LCD (liquid crystal display device) or an organic EL display, and is configured to be able to display a predetermined image under the control of the control unit 20. The display unit 21 can display the image data acquired and transmitted by, for example, the camera 11 or the infrared camera 12 of the drone 1 dynamically (as a moving image) or statically (as a still image).

<Operation part 22>
The operation unit 22 detects an operation by the user and outputs the operation to the control unit 20. For example, the operation unit 22 detects the user's operation on the touch panel attached to the surface of the display unit 21.

<Mike 23>
The microphone 23 acquires surrounding voice as voice data and outputs the voice data to the control unit 20.

<Communication unit 24>
The communication unit 24 is configured to be able to transmit and receive signals to / from external devices including the drone 1 under the control of the control unit 20. However, the communication unit 24 may be configured to have only the function of transmitting a signal. That is, the communication unit 24 receives at least the signal transmitted from the drone 1.

<Storage unit 25>
The storage unit 25 stores data received by the communication unit 24, a program of application software for operating the smartphone 2, and the like.

<Control unit 20>
The control unit 20 is a control device such as a CPU or a semiconductor integrated circuit such as an ASIC, and is configured to be able to control each configuration included in the smartphone 2. The control unit 20 controls the respective units of the smartphone 2 to perform various operations, but in the present embodiment, for example, the following operations are possible.

  The control unit 20 can remotely operate the drone 1 by executing application software (software) for operating the drone 1. In addition to the application software for operating the drone 1, the control unit 20 can activate various application software to execute a predetermined function or execute a call function.

  While executing the application software for operating the drone 1, when the user makes a predetermined utterance such as “application termination” toward the microphone while the control unit 20 is executing the application software, the control unit 20 recognizes the utterance by the user. , To perform a predetermined operation. For example, the control unit 20 performs processing of switching from the operation mode for executing the application software for operating the drone 1 to the non-operation mode for stopping transmission of the control signal to the drone 1 according to the user's utterance.

  As an example of application software of the smartphone 2, game application software (game) or the like can be considered. For example, by replacing the position information of the drone 1 as the position information of the smartphone 2, the movement of the drone 1 can be virtually processed in the game as the movement of the smartphone 2 (or the user of the smartphone 2). For example, if the game uses the position information of the smartphone 2 (user), the user can use the drone 1 even if the user is restricted from moving by an obstacle such as a river, sea, or cliff. The game can be advanced without being restricted by movement due to obstacles. The game data (program) can be optionally downloaded and installed by the user through communication with the network. In addition, all or part of the game data may be stored in the storage unit 25 of the smartphone 2. When a part of the game program is stored in the storage unit 25, the remaining data is stored in a server on the network.

  According to the drone 1 of the present embodiment, by providing the infrared camera 12 in addition to the camera 11, it is possible to have a configuration capable of grasping the surrounding situation even in a dark place. This makes it possible to safely fly in the dark.

  Further, according to the drone 1 of the present embodiment, since the infrared camera 12 can pick up an object like the camera 11, the infrared camera can be used not only as an infrared camera for dark places but also as a normal camera. Can be configured.

  Further, according to the drone 1 of the present embodiment, as described above, the infrared camera 12 can capture an object as in the camera, and thereby, it is possible to acquire two image data having parallax. Therefore, since the drone 1 can three-dimensionally capture the subject by the image data acquired by the camera 11 and the infrared camera 12, the drone 1 can fly safely without colliding with an obstacle. Further, since the infrared camera 12 is configured to be capable of capturing an object as in the case of the camera 11, the infrared camera 12 can be used as a camera for capturing an object three-dimensionally as well as a camera for dark places. It becomes. This makes it possible to configure the drone in a smaller size, as compared to a configuration in which an infrared camera is separately provided in addition to two or more cameras.

  Further, according to the drone 1 of the present embodiment, when the control unit 10 detects that the remaining amount of the battery 16 is smaller than the predetermined amount, the positioning unit 15 performs positioning, and the past stored in the storage unit 18 The wing drive unit 13 can be controlled to move to the position of the position information. Therefore, even if the remaining amount of the battery 16 of the drone 1 is reduced, it is possible to prevent an unintentional crash.

  Further, according to the drone 1 of the present embodiment, when the control unit 10 detects that communication with the smartphone 2 is not possible, the position of the past position information measured by the positioning unit 15 and stored in the storage unit 18 is stored. The wing drive unit 13 can be controlled to move up to. Therefore, even if the drone 1 flies to a long distance and becomes incommunicable, it can be operated to automatically return to the user.

  Further, in the mobile system including the drone 1 and the smartphone 2 of the present embodiment, an operation mode for transmitting a signal to the drone 1 according to a predetermined voice emitted by the user acquired by the microphone 23 of the smartphone 2; It is possible to switch between a non-operational mode in which the transmission of the signal to 1 is stopped. Therefore, according to the mobile system of the present embodiment, even while the drone 1 is being operated, for example, other functions such as a call can be easily switched to an executable state.

  Further, according to the game application using the drone 1 of the present embodiment, it is possible to support the progress of the game by the user. For example, when the game application uses position information, the user can use the drone 1 to advance the game without being restricted by movement by an obstacle.

<2. Additional Notes>
The specific description of the embodiment of the present invention has been described above. The above description is merely an embodiment, and the scope of the present invention is not limited to this embodiment, and can be broadly interpreted to a range that can be grasped by those skilled in the art based on the same technical concept. is there.

  For example, although the mobile system is configured by the drone 1 and the smartphone 2 in the embodiment, the drone 1 and the smartphone 2 may be replaced with other devices having similar functions. For example, the smartphone 2 may be an electronic device such as a tablet device or a notebook PC, or may be a so-called remote controller. The drone 1 may be a flightable mobile body, that is, an aircraft.

  The drone 1 may be equipped with an omnidirectional camera capable of photographing the entire 360 degrees around.

  The mobile system of the present invention is suitably applied as a drone control system for game machines.

DESCRIPTION OF SYMBOLS 1 ... drone 1a ... main-body part 121a-121d ... motor 122a-122d ... wing 10 ... control part 11 ... camera 12 ... infrared camera 13 ... wing drive part 14 ... sensor 15 ... positioning part 16 ... battery 17 ... communication part 18 ... memory Section 2: Smartphone 20: Control section 21: Display section 22: Operation section 23: Microphone 24: Communication section 25: Storage section

Claims (7)

A mobile system comprising a mobile device and a remote controller capable of communicating with the mobile device, the mobile system comprising:
The mobile device is
With rotatable wings,
A motor coupled to the wing;
A blade drive unit for driving the motor;
A camera for imaging an object,
An infrared camera that acquires infrared radiation emitted from the subject;
E Bei and a control unit for controlling the blade drive unit,
The remote controller is
A communication unit for transmitting a signal to the mobile device;
With a microphone to get voice,
A control unit that switches between an operation mode for transmitting a signal to the mobile device and a non-operation mode for stopping transmission of a signal to the mobile device according to a predetermined voice acquired by the microphone. ,
The remote controller can execute various application software and can execute a call function.
Mobile system.   The remote controller recognizes the voice acquired by the microphone, and switches between the operation mode and the non-operation mode.
  The mobile system according to claim 1.   When switching to the non-operation mode, the remote controller switches the call function to an executable state.
  The mobile system according to claim 1 or 2. The mobile device is
A positioning unit capable of positioning the position,
A storage unit that stores position information determined by the positioning unit;
A battery for supplying power to the wing drive unit;
The control unit controls the wing drive unit to move to the position of the past position information stored in the storage unit when detecting that the remaining amount of the battery is smaller than a predetermined value.
The mobile body system according to any one of claims 1 to 3. The mobile device is
A positioning unit capable of positioning the position,
A storage unit that stores position information determined by the positioning unit;
A communication unit for receiving a signal from the remote controller;
The control unit controls the wing drive unit to move to the position of the past position information stored in the storage unit when detecting that the communication unit has become incapable of communicating with the remote controller. ,
The mobile body system according to any one of claims 1 to 3. A mobile system according to any one of claims 1 to 5 is used.
Game application.   A mobile system comprising a mobile device and a remote controller capable of communicating with the mobile device, the mobile system comprising:
  The mobile device is
    With rotatable wings,
    A motor coupled to the wing;
    A blade drive unit for driving the motor;
    A camera for imaging an object,
    A control unit that controls the wing drive unit;
  The remote controller is
    A communication unit for transmitting a signal to the mobile device;
    With a microphone to get voice,
    A control unit that switches between an operation mode for transmitting a signal to the mobile device and a non-operation mode for stopping transmission of a signal to the mobile device according to a predetermined voice acquired by the microphone. ,
  The remote controller can execute various application software and can execute a call function.
  Mobile system.

Images