CN105242599A - Music wireless control system based on gesture tracking sensor, and method thereof - Google Patents

Abstract

The invention discloses a music wireless control system and method based on a gesture tracking sensor. The method includes: 1) the sensor is embedded in the wall surface, and the player is controlled by means of wireless sensing. Compared with wired transmission, it is more space-saving, beautiful and convenient. 2) The background music can be intelligently controlled only by the human body's own actions. There is no need for close buttons, no remote control, and no need for mobile phones, tablets and other terminal devices to download special app control. 3) In some specific occasions such as KTV and venues that require background music, the system only needs the singer or host himself to control the music playback, which is simple and convenient. The system is mainly composed of three parts: data acquisition, data transmission and information processing. The data acquisition part senses the approach of the human body through the infrared sensor, and starts the gesture tracking sensor to track the gesture. The data transmission part sends and receives data through the Wi-Fi wireless transceiver module. The data processing part controls the music player according to the data.

Description

A music wireless control system and method based on a gesture tracking sensor

technical field

The invention relates to a music wireless control system and method based on a gesture tracking sensor, which belongs to the intersecting field of sensor technology and wireless communication technology.

Background technique

At present, gesture sensors and wireless transmission technologies are developing rapidly, but in some occasions music control still uses wired control, which is extremely inconvenient. In the field of smart home, although the wireless control of music has been realized, people still mostly use terminals such as mobile phones and tablets to realize intelligent control. However, these terminals have increased people's dependence on mobile phones and other products to a certain extent. It is impossible to use the simple actions of the human body to realize intelligent control of the outside world.

ams, the world's leading supplier of high-performance analog ICs and sensors, has launched a new TMx4903 series of advanced optical sensor modules that integrate universal remote control, barcode emulation, RGB color sensing, proximity sensing and 3D gesture detection. TMD4903 and TMG4903 are the Two families of modules for precise color perception and proximity detection. However, the present invention adopts this gesture sensor and combines Wi-Fi technology to solve the above problems well.

Contents of the invention

The object of the present invention is to propose a wireless music control system based on a gesture sensor, which includes an information collection module, a data transmission module, and a data processing module. First of all, in the data acquisition part, the infrared sensor module is used to automatically detect whether someone is approaching. When it detects that someone is approaching, the TMx4903 sensor module starts to capture and detect gestures and count through the counter at the same time. When there is no gesture after 30 seconds, then The TMx4903 sensor module returns to standby. Then, the data transmission part uses the Wi-Fi transmission module to wirelessly transmit the gesture information obtained by the data collection part from the Wi-Fi sending end to the Wi-Fi receiving end. Finally, the data processing part judges the data transmitted through the data transmission part and realizes the processing of the background music.

The system of the present invention adopts TMx4903 series sensors to recognize gestures, and the system can be used in occasions where music needs to be played, such as home and KTV. The system includes sensing device, wireless transmission module, single-chip microcomputer system, music player and audio. The information collection module mainly includes two sub-modules, namely:

(1) Infrared identification sub-module: Infrared identification whether someone is approaching. When no one is near, the system is in standby mode. When the infrared senses that someone is approaching, the gesture recognition part of the system is turned on. When the person leaves, the gesture recognition module is restored to the standby state.

(2) Gesture recognition sub-module: Use TMx4903 sensor to recognize gestures.

Data transmission module of the present invention mainly comprises:

Wi-Fi sending module: The sensor-side microcontroller (ArduinoUNOR3 hardware development board) sends data to the Wi-Fi sending module, and the Wi-Fi sending module sends the data to the Wi-Fi receiving module through the wireless LAN.

Wi-Fi receiving module: After receiving the data sent by the Wi-Fi sending module, the Wi-Fi receiving module sends the data to the music player-side microcontroller (ArduinoUNOR3 hardware development board).

Data processing module of the present invention comprises:

Sensor end processing module: The sensor end MCU (ArduinoUNOR3 hardware development board) will judge different gesture information. And send the corresponding data to the Wi-Fi sender.

Music player-side processing module: Wi-Fi receiving end sends data to the music player-side MCU (ArduinoUNOR3 hardware development board), and the music player-side MCU (ArduinoUNOR3 hardware development board) analyzes the data and then controls the analog switch. Realize the playback, pause, switch, and volume adjustment of songs.

The present invention also provides a method for realizing a music wireless control system based on a gesture tracking sensor, the method comprising the following steps:

Step 1: Design a wireless music control system based on gesture tracking sensors, including three parts: information collection module, data transmission module, and data processing module.

Step 2: Design the architecture of the data acquisition part. The sensor module (Arduino UNOR3 hardware development board) is used to integrate the TMx4903 sensor module, infrared sensor module and timing module.

Step 3: Design the architecture of the data transfer section. It consists of the Wi-Fi sending end on the sensor-side MCU (ArduinoUNOR3 hardware development board) and the Wi-Fi receiving end on the music player-side MCU (ArduinoUNOR3 hardware development board).

Step 4: Set the communication protocol of the ESP8266 serial port Wi-Fi wireless transceiver module, and connect the VCC terminal of the module to a 5V to 3.3V power supply module. GPIO0 low level, GPIO2 high level, GPIO15 low level, when CH-PD is connected to high level, the module enters the working mode. Set the communication protocol between the sending end and the receiving end by sending AT commands. Among them, the ESP8266 serial port Wi-Fi wireless transceiver module is used as the sending end to perform the following settings: input the command AT+CWMODE=1 to enter the STA mode. For the ESP8266 serial port Wi-Fi wireless transceiver module as the receiving end, perform the following settings: Enter the command AT+CWMODE=2 to enter the AP mode.

Step 5: When someone approaches the infrared sensor, the sensor senses the human body and transmits the signal to the sensor-side microcontroller (ArduinoUNOR3 hardware development board), and the sensor-side microcontroller (ArduinoUNOR3 hardware development board) sends a signal to the TMx4903 module to turn on the TMx4903 sensor module . At the same time, it also starts counting. When the count reaches 30 seconds, if the TMx4903 sensor module senses the gesture and the sensor-side MCU (Arduino UNOR3 hardware development board) transmits data, then continue to turn on the gesture sensor and proceed to step 7. If the sensor-side microcontroller (ArduinoUNOR3 hardware development board) does not receive data, turn off the TMx4903 sensor module.

Step 6: If the infrared sensor cannot detect the human body, turn off the timing module and gesture sensing module.

Step 7: After receiving the gesture signal, the MCU on the sensor side (ArduinoUNOR3 hardware development board) judges the gesture through the gesture recognition algorithm, and generates different data according to the program's setting of the music control command represented by the gesture, and sends it to the Wi-Fi -Fi sender.

Step 8: The Wi-Fi sending end transmits 8bit data to the Wi-Fi receiving end through the wireless LAN.

Step 9: After receiving the data, the Wi-Fi receiving end sends the data to the MCU on the music player side (namely: ArduinoUNOR3 hardware development board), and the MCU on the music player side (ArduinoUNOR3 hardware development board) judges and selects the data to make The music player enters the following four modes. (1) Play mode. When the system receives the "play" gesture information, the system controls the music player to play; (2) pause mode. When the system receives the "pause" gesture information, the system controls the music player to pause playback; (3) switch modes. When the system receives the "switch" gesture information, the system continues to receive gesture data and judges whether to play the previous song or the next song, and then controls the music player to switch; (4) volume adjustment mode. When the system receives the "volume adjustment" gesture information, the system continues to receive gesture data and judges whether to increase or decrease the volume, and then controls the volume adjustment of the music player.

Beneficial effect:

1. The sensor of the present invention is embedded in the surface of the wall, and the player is controlled by wireless sensing, which saves space and is more beautiful and convenient.

2. The gestures of the present invention can realize the start, pause, switch, and volume adjustment of background music, without the need for close-range buttons, remote controls, and terminal devices such as mobile phones and tablets to download special app controls. The background music can be intelligently controlled only by the human body's own actions.

3. In some specific occasions such as KTV and venues that require background music, the present invention often requires other people to cooperate with the player to play music. However, this system only needs the singer himself or the host himself to control the music playback, which is simple and convenient, and there is no problem of insufficient fit between the host and the DJ personnel.

Description of drawings

Fig. 1 is a flow chart of the method of the present invention.

Fig. 2 is a system architecture diagram of the present invention.

Fig. 3 is a system structure diagram of the data acquisition part of the present invention.

FIG. 4 is a structural diagram of the data transmission part of the present invention.

Fig. 5 is a program flow chart of the data processing part of the present invention.

specific implementation plan

The invention will be described in further detail below in conjunction with the accompanying drawings.

As shown in Fig. 1, the present invention provides a music wireless control system based on a gesture tracking sensor, which includes three modules of information collection, data transmission and data processing. The data acquisition module uses the infrared sensing module to periodically detect whether someone is approaching. When someone approaches the infrared sensor, the sensor senses the human body and transmits the signal to the Arduino UNOR3 MCU, which then sends out a signal to pull the power terminal of the TMx4903 sensor module high to turn on the TMx4903 sensor module. At the same time, it also starts counting. When the count reaches 30 seconds, if the TMx4903 sensor module senses the gesture, it will transmit data to the microcontroller. If the MCU does not receive the data, turn off the counting module and the gesture sensor module. If the MCU receives the data, it will judge the gesture through the gesture recognition algorithm, and generate according to the setting of the control command for the music represented by the gesture different data. When the gesture is a command to play music, the Wi-Fi sender will send data 10000000. When the gesture is a command to pause music, the Wi-Fi sender will send data 01000000. When the gesture is a command to switch music and switch up, The Wi-Fi sender will send data 00100000. When the gesture is a command to switch music and switch down, the Wi-Fi sender will send data 00110000. When the gesture is a command to adjust the volume and decrease the volume, Wi-Fi will send The Wi-Fi sender will send data 00001000, and when the gesture is a command to adjust the volume and increase the volume, the Wi-Fi sender will send data 00001100. After the Wi-Fi receiving end receives the 8bit data sent from the Wi-Fi sending end through the wireless LAN, it sends the data to the MCU on the music player side (ie: ArduinoUNOR3 hardware development board), and the MCU on the music player side (ie: ArduinoUNOR3 hardware development board) board) to realize the control of music playback.

As shown in Figure 2, the music wireless control system of the gesture tracking sensor includes three modules: information collection, data transmission, and data processing. The information collection part includes an infrared sensor, a gesture tracking sensor, and a single-chip microcomputer at the sensor end. The data transmission part includes a Wi-Fi sender and a Wi-Fi receiver. The data processing part includes a music player-side microcontroller and a music player.

As shown in Figure 3, the data acquisition part uses the sensor-side single-chip microcomputer (that is, the Arduino UNOR3 hardware development board) to integrate the sending end of the TMx4903 sensor module, infrared sensor module, timing module and Wi-Fi transmission module. Among them, the infrared module uses HC-SR501 human body infrared sensor module, and the Wi-Fi sending module uses ESP8266 serial port Wi-Fi wireless transceiver. The specific way of hardware connection of the data acquisition part is as follows:

The connection between the HC-SR501 human body infrared sensor module and the ArduinoUNOR3 hardware development board: the pin GND of the HC-SR501 human body infrared sensor module is connected to the GND port of the ArduinoUNOR3 hardware development board, and the pin Vcc of the HC-SR501 human body infrared sensor module is connected to the ArduinoUNOR3 The 5V port of the power supply IO of the hardware development board, the pin signal output terminal of the HC-SR501 human body infrared sensor module is connected to the No. 5 port of the digital IO of the ArduinoUNOR3 hardware development board, and the pin of the HC-SR501 human body infrared sensor module can be triggered repeatedly The terminal is connected to the No. 6 port of the digital IO of the Arduino UNOR3 hardware development board.

The connection between the timing module and the ArduinoUNOR3 hardware development board: pin 1 of the timing module is connected to the 5V port of the power IO of the ArduinoUNOR3 hardware development board, and pin 2 of the button timing module is connected to the No. 8 port of the digital IO of the ArduinoUNOR3 hardware development board. Connect the pin 3 of the key timing module to the GND port of the ArduinoUNOR3 hardware development board

The connection between ESP8266 serial port Wi-Fi wireless transceiver module and ArduinoUNOR3 hardware development board: the pin 3.3V of ESP8266 serial port Wi-Fi wireless transceiver module is connected to the 3.3V output power module, and the pin of ESP8266 serial port Wi-Fi wireless transceiver module is connected to GND To the GND port of the ArduinoUNOR3 hardware development board, the pin UTXD of the ESP8266 serial port Wi-Fi wireless transceiver module is connected to the 0th port (RX) of the digital IO of the ArduinoUNOR3 hardware development board, and the HC-05 Bluetooth transmission slave module is connected to the pin URXD To port 1 (TX) of the digital IO of the Arduino UNOR3 hardware development board.

As shown in Figure 4, the data transmission part uses the Arduino UNOR3 hardware development board to integrate the sending end of the Wi-Fi transmission module with the receiving end of the Wi-Fi transmission module. The specific way of the hardware connection of the data transmission part is as follows:

The connection between ESP8266 serial port Wi-Fi wireless transceiver module and ArduinoUNOR3 hardware development board: the pin VCC of ESP8266 serial port Wi-Fi wireless transceiver module is connected to the 5V port of the power supply IO of ArduinoUNOR3 hardware development board, and the pin of ESP8266 serial port Wi-Fi wireless transceiver module Pin GND is connected to the GND port of the ArduinoUNOR3 hardware development board, and the pin TX_5V of the ESP8266 serial Wi-Fi wireless transceiver module is connected to the 0th port (RX) of the digital IO of the ArduinoUNOR3 hardware development board, and the ESP8266 serial Wi-Fi wireless transceiver module The pin RX_5V of the Arduino UNOR3 hardware development board is connected to the No. 1 port (TX) of the digital IO of the Arduino UNOR3 hardware development board.

To set the communication protocol of the ESP8266 serial port Wi-Fi wireless transceiver module, the specific operation is as follows:

The VCC terminal of the module is connected to a 5V to 3.3V power supply module. GPIO0 low level, GPIO2 high level, GPIO15 low level, when CH-PD is connected to high level, the module enters the working mode.

Use the HyperTerminal or the serial port debugging assistant to set the communication protocol between the sending end and the receiving end by sending AT commands. Among them, the ESP8266 serial port Wi-Fi wireless transceiver module is used as the sending end to perform the following settings: input the command AT+CWMODE=1 to enter the STA mode. For the ESP8266 serial port Wi-Fi wireless transceiver module as the receiving end, perform the following settings: Enter the command AT+CWMODE=2 to enter the AP mode.

As shown in Figure 5, the Wi-Fi receiving end receives the 8-bit data sent from the Wi-Fi sending end through the wireless LAN, and then sends the data to the single-chip microcomputer at the music player end. The internal program of the MCU on the music player side judges the data and then sends the data to the analog switch. The analog switch here will play the action of replacing people's finger keys. For different data, the music player will choose to enter the following four modes. (1) Play mode. When the system receives the "play" gesture information, it sends instructions to the analog switch chip to control the music player to play; (2) Pause mode. When the system receives the "pause" gesture information, the system controls the music player to suspend playback by sending instructions to the analog switch chip; (3) switching mode. When the system receives the "switch" gesture information, the system continues to receive gesture data and judges whether to play the previous song or the next song, and then controls the music player to switch by sending instructions to the analog switch chip; (4) volume adjustment mode . When the system receives the "volume adjustment" gesture information, the system continues to receive the gesture data and judge whether to increase or decrease the volume, and then control the volume adjustment of the music player by sending instructions to the analog switch chip.

Claims (4)

1. based on a music wireless control system for gesture tracing sensor, it is characterized in that: described system comprises information acquisition module, data transmission module, data processing module;

Described information acquisition module comprises two submodules, that is:

(1) infrared recognin module: it is close that infrared ray has identified whether people; When nobody is close, system is in holding state; When infrared ray perceived people near time then open system gesture identification part; After people leaves, then make gesture recognition module recover holding state;

(2) gesture identification submodule: utilize TMx4903 sensor to identify gesture;

Described data transmission module comprises:

Wi-Fi sending module: sensor side single-chip microcomputer sends data to Wi-Fi sending module, and data are sent to Wi-Fi receiver module by WLAN (wireless local area network) by Wi-Fi sending module;

Wi-Fi receiver module: data are sent to music player end single-chip microcomputer after Wi-Fi receiver module receives the data sent by Wi-Fi sending module;

Described data processing module comprises:

Sensor side processing module: sensor side single-chip microcomputer judges to different gesture informations, and send corresponding data to Wi-Fi transmitting terminal;

Music player end processing module: data are delivered to music player end single-chip microcomputer by Wi-Fi receiving end, music player end single-chip microcomputer controls analog switch after data analysis, to the broadcasting of song, suspends, switches, and volume adjusting.

2. a kind of music wireless control system based on gesture tracing sensor according to claim 1, it is characterized in that: described system comprises: first, part of data acquisition, use infrared sensing module automatic detection whether have people close, when detected people near time, TMx4903 sensor assembly starts, catch gesture and detect simultaneously by rolling counters forward, when having gesture not yet after 30 seconds, then TMx4903 sensor assembly recovers holding state; Then, tcp data segment, the gesture information using Wi-Fi transport module part of data acquisition to be obtained, is wirelessly transmitted to Wi-Fi receiving end from Wi-Fi transmitting terminal; Finally, data processing section is judged the data passed over by tcp data segment and realizes the process to background music.

3. a kind of music wireless control system based on gesture tracing sensor according to claim 1, is characterized in that: described system adopts TMx4903 series sensor to the identification of gesture, and described system needs for family and KTV the occasion playing music; Described system comprises perception device, wireless transport module, Single Chip Microcomputer (SCM) system, music player, sound equipment.

4. based on an implementation method for the music wireless control system of gesture tracing sensor, it is characterized in that, described method comprises the steps:

Step 1: design a kind of music wireless control system based on gesture tracing sensor, comprises information acquisition module, data transmission module, data processing module three part;

Step 2: the architecture of design data collecting part, adopts sensor side single-chip microcomputer to carry out integrated to TMx4903 sensor assembly, infrared sensing module, timing module;

Step 3: the architecture of design data hop, comprises the Wi-Fi transmitting terminal on sensor side single-chip microcomputer and the Wi-Fi receiving end on music player end single-chip microcomputer;

The setting of the communication protocol of step 4:ESP8266 serial ports Wi-Fi radio receiving transmitting module, module VCC end connects 5V and turns 3.3V power module, GPIO0 low level, GPIO2 high level, GPIO15 low level, when CH-PD is connected to high level, module enters mode of operation, by transmission AT instruction, transmitting terminal and receiving end is carried out to the setting of communication protocol, wherein, ESP8266 serial ports Wi-Fi radio receiving transmitting module is made transmitting terminal and is performed following setting: input instruction AT+CWMODE=1, enters STA mode; Receiving end is done for ESP8266 serial ports Wi-Fi radio receiving transmitting module and performs following setting: input instruction AT+CWMODE=2, enters ap mode;

Step 5: when there being people near infrared sensor, sensor senses is to human body, and passed to by signal in sensor side single-chip microcomputer, sensor side single-chip microcomputer sends signal to TMx4903 module again, opens TMx4903 sensor assembly; Also start counting simultaneously, when counting down to 30 seconds, if TMx4903 sensor assembly perceives gesture and sensor side single-chip microcomputer transmission data, continuing to open gesture sensor, and carry out step 7; If sensor side single-chip microcomputer does not receive data, close TMx4903 sensor assembly;

Step 6: if infrared sensor can't detect human body, then close timing module and gesture sensing module;

Step 7: after sensor side single-chip microcomputer receives hand signal, judges gesture by the algorithm of gesture identification, and produces different data according to the setting of program to the control command to music representated by gesture, sends to Wi-Fi transmitting terminal;

8bit data are transferred to Wi-Fi receiving end by WLAN (wireless local area network) by step 8:Wi-Fi transmitting terminal;

Step 9:Wi-Fi receiving end sends the data to music player end single-chip microcomputer after receiving data, music player end single-chip microcomputer, by the judgement to data, is selected, made music player enter four kinds of patterns below, comprising: (1) play mode; When system receives the gesture information of " broadcasting ", Systematical control music player is play; (2) park mode; When system receives the gesture information of " time-out ", Systematical control music player suspends to be play; (3) switch mode; When system receives the gesture information of " switching ", system continuation reception gesture data also judges it is play a upper song or play next song, then controls music player and switches; (4) volume control mode; When system receives the gesture information of " volume adjusting ", system continues to receive gesture data and judges heighten volume or turn down volume, then controls music player volume adjusting.