CN108200375A - A kind of building talkback method and system - Google Patents

Abstract

The invention discloses a kind of building talkback method and system.Ladder-port machine, user terminal and server are communicatively coupled by wiredly and/or wirelessly wide area Internet network and are transmitted with information in the system.Building talkback method using the present invention, after the request of user terminal remote response ladder-port machine video intercom, ladder-port machine shoots a width image scene and is sent to user terminal, simultaneously and user terminal starts speech talkback, this method in the case where user terminal network situation is undesirable, multiple video intercoms are carried out at the same time in system, can with the network bandwidth of effectively save user terminal and ladder-port machine, the efficient network resource usage that improves system equipment, it is cost-effective, improve to effective and user experience.

Description

A building intercom method and system

technical field

The invention relates to the field of building intercom technology, in particular to a remote visual intercom method and system.

Background technique

The building intercom system is currently the standard configuration of every new residence, and it carries the important mission of safeguarding the safety of families and communities. Under the background of technology and market environment, the whole industry has gradually entered a new stage of development, and the technical level of the building intercom system has also been greatly improved. It has evolved from a single-function unit intercom to today's Internet digital visual intercom system. During the development of the building intercom system, many types of systems have been derived, and the unlocking operation is completed by transmitting audio signals and video signals. Generally speaking, the building intercom system has experienced the technological development process of analog intercom system, semi-digital intercom system, pure digital intercom system and Internet digital intercom system.

The analog intercom system uses analog signals to transmit communication data, and the signal transmission efficiency and safety are high. The analog system divides the signal transmission network into the backbone vertical and branch buses, which cannot realize large-scale networking in the entire community. This kind of distributed wiring control system has relatively single system functions, is independent of each other, and is incompatible with each other. It also increases the intensity of residential line installation and maintenance, which is not easy to manage.

Semi-digital intercom system, the vertical and horizontal data in the unit building are networked by analog bus technology transmission, and TCP/IP is used for networking between units and between units and management centers. Through the host controller, inter-layer decoder and household isolator, the conversion of analog audio and video signals, digital coded signals and network protocols is realized.

Pure digital intercom system, both inside and outside the unit building adopts TCP/IP networking mode, and transmits audio and video signals through TCP, UDP and RTP. The sound, image, control and other signals of the pure digital building intercom system are transmitted through the network cable, which realizes the full network of intercom equipment between the buildings of the entire community, simplifies the wiring of the entire community, and makes the installation, commissioning and Maintenance has become very convenient.

Internet digital intercom system, with the mature development of Internet of Things technology and the service application of cloud platform in the past two years, the building intercom system is no longer limited to LAN communication, but is gradually derived from the Internet, and digital intercom terminals are no longer limited to Inside the building, residents can connect to the intercom system through personal mobile terminals connected to the Internet to operate access control and intercom.

The current Internet digital intercom system still has limitations when performing remote visual intercom. For example, in the operation of Internet digital intercom, the ladder machine equipment calls, and the mobile terminal (mobile phone or tablet computer, etc.) receives the call After answering, make an audio and video call. During the call process of the ladder machine device, the network on the mobile terminal may not be very good. At this time, data freezes or intercom failures will occur during audio and video calls, which will affect the customer experience.

Contents of the invention

The technical problem mainly solved by the present invention is: in the existing digital intercom system, when the user terminal of the user is in the case of poor network connection, the remote visual intercom will experience audio and video jams or direct intercom failure, which will affect the Talk about operation and user experience.

In order to solve the above technical problems, the present invention proposes a building intercom method for communication between the ladder machine and the user terminal. The method includes: the server receives the intercom request transmitted by the ladder machine, and the intercom request Include the number of the calling party; search for the user terminal bound with the calling party number according to the calling party number; send the intercom request to the user terminal bound with the calling party number; Establish a communication link between the ladder machines; receive an intercom live image and collected live audio data from the ladder machine, and transmit the intercom live image and live audio data to the user terminal, and transmit the audio data of the user terminal The data is sent to the ladder machine.

On the other hand, the present invention also proposes a building intercom method, which is used for communication between the ladder machine and the user terminal. Talking request, the intercom request includes the call object number; receive the response of the user terminal returned by the server, and establish a communication link with the user terminal through the server; the ladder machine takes a scene image of the intercom and collects the scene audio data; the stairway machine transmits the intercom live image and live audio data to the server, and at the same time receives the audio data of the user terminal from the server.

A building intercom system according to the above embodiment, comprising: at least one ladder machine, at least one user terminal and a server, in the system the ladder machine, the user terminal and the server communicate through a wired and/or wireless wide area Internet network Connection and information transmission; the server includes: a management module, which is used to manage the binding relationship information between the user terminal and the elevator machine, judge the network status of the user terminal, and automatically match the video data parameters according to the network status of the user terminal; communication forwarding module , used to receive and forward the intercom request instruction information of the ladder machine, the corresponding ladder machine number information, on-site image data, and on-site audio data to the user terminal; receive and forward the audio data of the user terminal to the ladder machine; forward the management module The generated video data parameters of the camera device of the ladder machine are sent to the ladder machine, and the video data of the ladder machine is received and forwarded to the corresponding bound user terminal; a copy of the video data of the ladder machine is received, copied into multiple copies, and forwarded to the Corresponding multiple user terminals.

By adopting a building intercom method and system proposed by the present invention, at the beginning of the remote visual intercom, an on-site image can be taken by the ladder machine and sent to the user terminal for display, and at the same time the user of the ladder machine and the user terminal can make a voice call. Intercom call, this method effectively improves the intercom efficiency and user experience when the network condition of the user terminal is not good.

Description of drawings

Fig. 1 is a schematic flow chart of a building intercom method;

Fig. 2 is a schematic flow chart of another building intercom method;

FIG. 3 is a schematic diagram of a building intercom system architecture.

Detailed ways

The present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. Wherein, similar elements in different implementations adopt associated similar element numbers. In the following implementation manners, many details are described for better understanding of the present application. However, those skilled in the art can readily recognize that some of the features can be omitted in different situations, or can be replaced by other elements, materials, and methods. In some cases, some operations related to the application are not shown or described in the description, this is to avoid the core part of the application being overwhelmed by too many descriptions, and for those skilled in the art, it is necessary to describe these operations in detail Relevant operations are not necessary, and they can fully understand the relevant operations according to the description in the specification and general technical knowledge in the field.

In addition, the characteristics, operations or characteristics described in the specification can be combined in any appropriate manner to form various embodiments. At the same time, the steps or actions in the method description can also be exchanged or adjusted in a manner obvious to those skilled in the art. Therefore, various sequences in the specification and drawings are only for clearly describing a certain embodiment, and do not mean a necessary sequence, unless otherwise stated that a certain sequence must be followed.

The serial numbers assigned to components in this document, such as "first", "second", etc., are only used to distinguish the described objects, and do not have any sequence or technical meaning. The "connection" and "connection" mentioned in this application all include direct and indirect connection (connection) unless otherwise specified.

As shown in Figure 3, the present invention proposes a building intercom system, including: at least one ladder machine, at least one user terminal and a server, in the system, the ladder machine, user terminal and server communicate through wired and/or wireless radio domain interconnection network for communication connection and information transmission; among them:

The ladder machine includes a camera module, which is used to collect the on-site images of the ladder machine, especially the face image. The camera device has the function of supplementary light, and it can also take pictures of the face image when the light is dark. Camera; according to the video data parameters forwarded by the server, such as: resolution and bit rate, set the camera device and collect video data;

The ladder machine also includes a first audio collection and playback module, which is used to collect the user audio data of the ladder machine and play the remote user audio data of the user terminal;

The ladder mouth machine also includes a first human-computer interaction module that receives user instructions, and is used to request people to input intercom request instructions;

The stairway machine can also include a first access control module, which is used to receive an access control instruction issued by the user, connect to the smart door lock and send an access control instruction to the smart door lock to perform the door opening operation;

The user terminal includes an image data processing module, which is used to display the on-site image data of the ladder machine;

The user terminal also includes a second audio collection and playback module, which is used to collect user terminal user audio data and play the ladder machine user audio data;

The user terminal includes a second human-computer interaction module for receiving user instructions, which is used for users to input intercom request instructions, including user input requests corresponding to remote video monitoring instructions bound to the ladder machine;

The user terminal also includes a video data playback module for playing the video data of the ladder machine;

The user terminal also includes a second access control module, configured to receive an instruction to open the access control issued by the user;

The user terminal also includes an intercom information management module, which is used to record the intercom request sending time information, the intercom start and end time information, the corresponding elevator machine number information and the intercom scene image information to the storage space of the user terminal; and provide The function of viewing the above information on the user terminal.

The server includes a management module, which is used to manage the binding relationship information between the user terminal and the ladder machine, and judge the network status of the user terminal, and automatically match the video data parameters of the camera device of the ladder machine according to the network status of the user terminal, for example: rate and code rate.

The server also includes a communication forwarding module, which is used to receive and forward the intercom request instruction information of the elevator machine, the corresponding number information of the elevator machine, on-site image data, and on-site audio data to the user terminal; receive and forward the intercom instruction of the user terminal, Including: video monitoring request, and audio data to the ladder machine; forwarding the video data parameters of the camera device of the ladder machine generated by the management module to the ladder machine; receiving and forwarding the video data of the ladder machine to the corresponding bound user terminal, receiving A copy of the video data of the elevator machine is copied into multiple copies and forwarded to corresponding multiple user terminals respectively.

The function of the communication forwarding module of the server also includes receiving and forwarding the access control instruction information sent by the user terminal to the elevator machine.

Based on the above-mentioned building intercom system, this embodiment specifically describes a building intercom method as shown in Figure 1, and the steps are as follows:

100: The ladder machine receives the requester's input of the caller's number, and sends the intercom request information to the server, and the intercom request includes the caller's number;

101: The server receives the intercom request information from the ladder machine, and searches for the binding relationship between the ladder machine and the user terminal;

102: The server forwards the intercom request information of the ladder machine to the user terminal bound to the ladder machine;

103: The user terminal responds to the intercom request and starts intercom answering;

104: The user terminal collects and sends user intercom audio data to the server;

105: The server establishes a communication link between the user terminal and the ladder machine based on the response of the user terminal, and forwards the audio data to the ladder machine;

106: The ladder machine receives and plays remote user audio data, and establishes a communication link with the user terminal through the server;

107: The ladder machine takes a picture of the intercom scene, and collects the on-site audio data of the intercom requester;

108: The ladder machine sends the intercom scene image and the live audio data of the ladder machine end user to the server;

109: The server receives and forwards the on-site intercom image and on-site audio data of the ladder machine to the user terminal;

110: The user terminal receives and displays the on-site intercom image of the ladder machine, and plays the on-site audio data at the same time.

Through the above forwarding method of the server, the user terminal and the elevator machine respond to the requester's intercom instruction and execute the remote visual intercom operation. Through the above steps, it can be known that the difference between the remote visual intercom method of the common Internet digital intercom system and this method mainly lies in: after the remote user answers the intercom through the user terminal, the common Internet remote visual intercom method usually At the same time, the audio and video data is requested, at this time, the user terminal and the ladder machine perform audio and video intercom; in this method, after the remote user responds to the intercom request of the ladder machine requester, the ladder machine takes a live image and sends it to the user terminal. At the same time, start the voice intercom with the user terminal, so that the intercom efficiency can be effectively improved when the network condition of the user terminal is not ideal, for example, the user's network traffic can be saved when the mobile phone uses traffic.

Embodiment 2: A kind of building intercom method as shown in Figure 2, the steps are as follows:

200: The user terminal receives the video surveillance intercom instruction input by the requester, and sends it to the server;

201: The server receives the video monitoring request information of the user terminal, and automatically judges the network status of the user terminal;

202: The server automatically matches the parameters of the required video data according to the network status information of the user terminal, such as: resolution and bit rate; according to the user terminal information, it searches for the number of the elevator machine bound to the user terminal;

203: The server sends the video monitoring request information and video data parameters to the elevator machine bound to the user terminal;

204: The ladder machine receives the video monitoring request and video data parameters forwarded by the server, for example: the resolution and bit rate corresponding to the video data;

205: The ladder machine sets the camera device according to the video data parameters, starts the camera device, collects the on-site video data of the ladder machine, and transmits the on-site video data to the server;

206: Receive the on-site video data collected by the ladder machine according to the video data parameters, and transmit the on-site video data to the user terminal;

207: The client receives and plays the video data from the ladder machine.

In this embodiment, on the one hand, the user terminal can directly send a video surveillance request to the corresponding bound elevator machine through the server; on the other hand, if the user terminal considers that the elevator The image captured by the mouth machine and the intercom audio information are not enough. If you want to see the live video information of the ladder mouth machine, the remote user can also send a remote video monitoring request through the user terminal in the remote visual intercom state. The server follows the second embodiment The method forwards the on-site video monitoring data of the elevator machine to the user terminal for display.

The method automatically adjusts the video resolution and bit rate according to the network condition of the user terminal, can optimize the video freeze problem that occurs when the network condition of the mobile device is not good, and improves the efficiency of visual intercom.

In this embodiment, when multiple user terminals have a requester input a video monitoring request command at the same time, send the corresponding bound ladder machine on-site video monitoring request to the server, and the request is the video data of the same ladder machine; the server After receiving the video surveillance request information from the user terminal, according to the network status of any user terminal that establishes a communication connection, automatically match the camera video parameters of the elevator machine, and search for the elevator machine number bound to the user terminal according to the user terminal information ; For example: the resolution and bit rate of the camera device, and send the corresponding video parameters and video monitoring request to the ladder machine.

After receiving the video monitoring request information from the server, the ladder machine sets the video parameters of the camera device according to the server's request information and video parameters, such as: the resolution and bit rate of the camera device, starts the camera device, and collects the on-site video data of the ladder machine , and send the live video data to the server.

The server copies the received video data of the ladder machine into multiple copies, and sends them to corresponding multiple user terminals respectively, and the multiple user terminals respectively receive and play the real-time video monitoring data of the ladder machine.

When the user terminal receives the termination video monitoring command, it stops receiving and playing video data, sends the termination video monitoring command information to the server, and interrupts the connection with the server; when all connected user terminals respond to the termination video monitoring command, the server Disconnect the connection with all user terminals, forward the terminated video monitoring information to the ladder machine, and interrupt the connection with the ladder machine; after the ladder machine receives the above-mentioned termination video monitoring command information, it stops collecting and sending the on-site data of the ladder machine. Video data information.

In the common remote video intercom method, the point-to-point mode is adopted, and each video request needs to use a part of the network bandwidth. Due to the limited bandwidth of the Internet, the video display of all users is usually not smooth, which seriously affects the intercom quality. Customer Experience. Using the method described in this embodiment, when multiple user terminals simultaneously request the live video data of the same ladder machine, the server only needs to request the video data of the ladder machine once, which only occupies a part of the network bandwidth, and then copies and distributes the video data through the server , to solve the problem of insufficient network bandwidth and insufficient system performance when multiple users of the point-to-point intercom system perform video surveillance at the same time.

Embodiment 3: A building intercom method proposed by the present invention also includes that when the user terminal receives the intercom request information sent by the server, it simultaneously records the time information of the intercom request, the start and end time information of the intercom, and the corresponding ladder entrance information. The machine number information and intercom scene image information are stored in the storage space of the user terminal; the above information can be viewed on the user terminal.

The method is convenient for the user to manage the historical information of the building intercom.

The above uses specific examples to illustrate the present invention, which is only used to help understand the present invention, and is not intended to limit the present invention. For those skilled in the technical field to which the present invention belongs, some simple deduction, deformation or replacement can also be made according to the idea of the present invention.

Claims (10)

1. A building intercom method, used for communication between the ladder machine and the user terminal, characterized in that the method comprises: The server receives the intercom request sent by the ladder machine, and the intercom request includes the call object number; Find the user terminal bound to the call partner number according to the call partner number; Send the intercom request to the user terminal bound with the call partner number; Based on the response of the user terminal, the server establishes a communication link between the user terminal and the ladder machine; Receive an intercom live image and collected live audio data captured by the ladder machine, and transmit the intercom live image and live audio data to the user terminal, and transmit the audio data of the user terminal to the ladder machine. 2. A building intercom method for communication between the ladder machine and the user terminal, characterized in that the method comprises: The ladder mouth machine receives the caller number input by the requester, and sends an intercom request to the server, and the intercom request includes the caller number; Receive and play the user terminal audio data returned by the server, and establish a communication link with the user terminal through the server; The ladder machine takes a live image of the intercom and collects the live audio data; The ladder machine transmits the intercom live image and live audio data to the server. 3. The building intercom method according to claim 1, further comprising: The server receives the video monitoring request from the user terminal; Determine the network status of the user terminal; According to the network status of the user terminal, automatically match the parameters of the required video data; According to the user terminal information, find the elevator machine number bound to the user terminal; Send the video monitoring request information and video data parameters to the elevator machine bound to the user terminal; Receive the on-site video data collected by the ladder machine according to the video data parameters, and transmit the intercom on-site video data to the user terminal. 4. The building intercom method according to claim 1, further comprising: The server receives video monitoring requests from multiple user terminals, and the multiple user terminals request live video data of the same ladder machine; According to the network status information of the user terminal, automatically match the parameters of a required video data; Find the same elevator machine number bound to the plurality of user terminals according to the user terminal information; Send a video monitoring request and video data parameters to the ladder machine bound to the plurality of user terminals; Receive a piece of on-site video data collected by the ladder machine according to the video data parameters, and copy it, and transmit the intercom live video data to multiple user terminals respectively. 5. The building intercom method as claimed in claim 2, further comprising: The ladder machine receives the video monitoring request and video data parameters forwarded by the server; Set the camera device according to the video data parameters, start the camera device, and collect the on-site video data of the ladder machine; The ladder machine transmits the live video data to the server. 6. The building intercom method according to any one of claims 1 to 5, further comprising: When the user terminal receives the intercom request information sent by the server, it simultaneously records the intercom request sending time information, the intercom start and end time information, the corresponding elevator machine number information and the intercom scene image information to the storage space of the user terminal; All the above information can be viewed on the user terminal. 7. A building intercom system, characterized in that it comprises: At least one ladder machine, at least one user terminal and a server, in the system, the ladder machine, user terminal and server perform communication connection and information transmission through a wired and/or wireless wide-area Internet network; wherein the server includes: The management module is used to manage the binding relationship information between the user terminal and the elevator machine, judge the network status of the user terminal, and automatically match the video data parameters according to the network status of the user terminal; The communication forwarding module is used to receive and forward the intercom request instruction information of the elevator machine, the corresponding number information of the elevator machine, on-site image data, and on-site audio data to the user terminal; receive and forward the audio data of the user terminal to the elevator machine; Forwarding the video data parameters of the ladder machine camera device generated by the management module to the ladder machine, receiving and forwarding the video data of the ladder machine to the corresponding bound user terminal; receiving one copy of the ladder machine video data, and copying it into multiple copies, are respectively forwarded to corresponding multiple user terminals. 8. The building intercom system according to claim 7, characterized in that, the ladder mouth machine also includes: The camera module is used to collect the on-site images of the elevator machine, especially the face images. The camera device has a supplementary light function, and it can also take pictures of the face images when the light is dark, and can take normal pictures during the day and night; it can also Set the camera device according to the video data parameters sent by the server to collect video data; The ladder machine also includes a first audio collection and playback module, which is used to collect the user audio data of the ladder machine and play the audio data of the remote user terminal; The ladder machine also includes a first human-computer interaction module that receives user instructions, and is used to request people to input intercom request instructions. 9. The building intercom system according to claim 7, wherein the user terminal further comprises: The image display module is used to display the on-site image data of the ladder machine; The second audio collection and playback module is used to collect the user audio data of the user terminal and play the audio data of the intercom requester of the elevator machine; The video data playback module is used to play the on-site video data of the ladder machine; The second human-computer interaction module for receiving user instructions is used for the user to input an intercom request instruction. 10. The building intercom system according to claim 9, wherein the user terminal further comprises: The intercom information management module is used to record the time information of the intercom request, the start and end time information of the intercom, the corresponding elevator machine number information and the intercom scene image information to the storage space of the user terminal; and provide the user terminal to view function of the above information.