CN100456830C - User terminal equipment and review method for realizing streaming media content review - Google Patents

Abstract

The present invention relates to streaming media technology, in particular to a user terminal device and a review method for realizing streaming media content review, so as to solve the problem of how to realize in-depth content review of video streams on user terminal devices in the prior art. The technical solution of the present invention uses the first decoding module, the delay module and the first display module on the user terminal equipment to decode and reconstruct the original video code stream image of the streaming media service and delay display; using the second decoding module and the second display module, Synchronously decode and display the censored code stream image, the user reviews the censored code stream image and sends a control command when the censored code stream image contains harmful content; the user command processing module is used to receive and process the user's control command, according to the control command Triggering the first display module to stop displaying the original video code stream image. The technical scheme of the present invention realizes in-depth review of streaming media content on the side of the user terminal equipment.

Description

User terminal equipment and review method for realizing streaming media content review

technical field

The invention relates to streaming media technology, in particular to a user terminal device and a review method for realizing review of streaming media content.

Background technique

Streaming Media, as a basic form of multimedia communication, has derived numerous forms of multimedia communication services: conference TV/videophone, IPTV, VOD, instant messaging and so on. Therefore, streaming media will become the basic form of communication on NGN (Next Generation Network). Especially in recent years, with the rapid rise of IPTV (Internet Protocol Television, IP TV) services at home and abroad, the application of streaming media on the Internet is also developing rapidly.

A class of services on streaming media, such as IPTV and VOD (Video on Demand, video on demand), both function to provide video and audio content. The range of content is very wide, including film and television programs, news, sports games, concerts and so on. Various countries, especially my country, have always attached great importance to content security and monitoring, and have relevant laws. From the perspective of protecting minors, countries also have relevant regulations. At the same time, there are also such demands in operators/ISP (Internet Service Provider, Internet Service Provider) and content providers. The operation of IPTV in China is about to be carried out on a large scale, so the first problem is how to ensure effective content monitoring and filtering, and block harmful content. Licenses may be issued. Therefore, the solution to this problem is of great significance for promoting the development of the IPTV industry. For content security, the common understanding includes two aspects:

1. For content protection, prevent content from being received by users without authorization;

For example, to prevent pirated TV programs and so on. For this type of intrusion, there are many mature technologies, such as encryption (Encryption) and scrambling (Scrambling), authentication authentication, and digital rights management DRM (Digital Right Management).

2. For the prevention of harmful and illegal content intrusion, the object of protection is the object of content attack, usually the audience.

The so-called content filtering is to process and judge certain attributes of the content. These content attributes can include: the name of the content provider, the URL of the content (Universal Resource Locator, the URL is an important type of URL), content Provide the IP address of the server, etc., as well as the packet header (packet header) information of the data packet and the information in the packet when the media stream is encapsulated in the data packet. It can be seen that this kind of processing and filtering is also carried out according to the level from shallow to deep.

The existing technologies for filtering streaming media content on the network side mainly include the following two types:

One is to filter content based on the external characteristics of the content, or shallow features. The most typical example is URL-based filtering. This filtering technology has the problem of wrong killing or misplacement, and usually requires a third-party rating system. There are such rating systems, and some charging rating service providers specialize in Provide rating services. But their results are not completely accurate and exhaustive of all content on the Internet. Moreover, the content on the Internet is also changing frequently, and it is impossible for any rating system to keep up with these changes in time.

For application scenarios with very high requirements, such as IPTV for the national public, once harmful content, especially politically sensitive content, is successfully invaded, the harm will be huge. It must be foolproof, so shallow filtering is unreliable. The deepest level of content filtering must be used, that is, the filtering of video and audio data itself, such as image recognition, identifying harmful scenes (violence, pornography, etc.), harmful text information (subtitles), faces of specific people, etc.

Second, to achieve a high filtering accuracy rate, it is necessary to penetrate to the deepest level, that is, the content data itself. This aspect belongs to the current research hotspot, Deep Packet Filtering DPF (Deep Packet Filtering). The existing deep DPF is based on artificial deep content identification. In this case, the content filtering device can decode the media stream and play the content (assuming that encryption is not a problem, because the problem of encryption can be solved by the legal monitoring requirements of the communication device. ) for human review. If a problem is found, the monitor will immediately take measures to cut off harmful content and switch to a piece of harmless content such as a public service advertisement. Of course, there must be a rather large-capacity delay device behind the content filtering device to delay harmful content and give monitoring personnel a certain judgment and response time (such as 5 seconds).

This filtering method lacks versatility and scalability: it is obvious that artificial methods cannot adapt to the needs of future networks. Poor versatility and poor scalability. And artificial discrimination, the discrimination standard is related to very subjective factors such as people's education, cultural level and ideology, and the standards cannot be consistent; it cannot be applied to the situation of IPTV: the above manual method can be applied to the monitoring of TV programs, but for IPTV Very inappropriate. Because of the huge amount of IPTV content and the large number of content sources on the network, it is almost impossible to do it manually; and there is a large delay, which cannot be applied to the situation of real-time communication between two parties: in the case of two-way streaming media, the delay cannot exceed 400ms, it is impossible for manual judgment to achieve such a low delay. But two-way communications, such as video chats, are places where harmful content can easily exist.

As shown in FIG. 1 , there is basically only one existing solution for content security control on a terminal at present, which is parental control. The so-called parental control comes from the parents' control over minors' viewing of TV programs. The principle is as follows:

Before the streaming media content is sent from the streaming media service system to the user terminal, the classification, qualitative and grading attributes of the program are first sent to the user terminal in the form of metadata through the electronic program guide (EPG=Electronic Program Guide). For example, the classification qualitative and grading attributes are as follows:

Violence, xxx, recommended audience age range: >=18 years old, etc.;

The parental control mechanism is to use these attributes in the program metadata to control minors from receiving harmful content by setting a parental lock. Parental lock is essentially a set of filtering rules and conditions, such as:

Condition 1. It is forbidden to receive programs above xxx1 level yyy1 level; here it is assumed that the higher the degree of harmfulness, the higher the level.

Condition 2. Prohibition of receiving programs above xxx2 level yyy2 level;

 …

Condition n. Prohibition of receiving programs recommended for viewers younger than 18 years old;

These filter conditions are matched with the corresponding part of the metadata carrying information in the program to achieve filtering, and the result is to allow or prohibit reception. Through logical operations (AND, OR, not NOT), these filter conditions can be combined arbitrarily. At present, commercial streaming media systems on the market generally have two options when implementing parental control:

1. Configure the parental lock data in the user terminal, and the terminal performs matching and filtering when receiving metadata information from the streaming media service system;

2. The parental lock data is sent to the streaming media service system and stored in the user database, and can be stored in such a database together with other data of the user. In the streaming media service system, there is such a user management subsystem. Then, once a service request for a certain content is received from the user terminal, these filtering rules and the metadata of the requested program are taken out from the database for matching and filtering.

For those who have permission to set the parental lock, it is often set through password authentication. Similarly, if you want to enable yourself to watch programs without restriction, you can unlock the parental lock, or add the function of watching programs with a password in the parental lock. For the latter, if the parental lock finds that the element data of the requested content matches the filtering rules, the user is required to provide a password. If the password entered by the user is correct, viewing is allowed, otherwise viewing is prohibited.

This technical scheme has following shortcoming:

1. It is required that the program must have metadata. Generally, the metadata is added manually according to the content of the program. It can be implemented for on-demand services, but it is difficult to control live programs. For example, in a talk show, guests or hosts perform impromptu performances, and the implementation has no way of knowing whether the content is harmful, so metadata cannot be added;

2. The description of metadata attributes is not necessarily scientific. Parents see only the metadata description. Unable to see the program video and hear the audio preview to make a more direct judgment;

3. Metadata is easily forged by attacks. Parental controls won't work if the metadata of harmful content is masquerading as harmless;

4. The particle size is relatively coarse. The grading of a program may be determined by 1% of harmful shots. 99% of content that may be harmless or even beneficial will be forced to be completely discarded according to this coarse-grained classification method, and fine-grained content reception control cannot be achieved.

Contents of the invention

The present invention provides a user terminal device and a review method for realizing streaming media content review, so as to solve the problem of how to realize in-depth content review of video code streams on the user terminal device in the prior art.

A user terminal device for implementing streaming media content review, including:

A first decoding module, a delay module and a first display module, wherein the delay module is connected between the first decoding module and the first display module, and the first decoding module decodes and reconstructs the original video code stream of the streaming media service The image is delayed and output to the first display module through the delay module for display;

The second decoding module and the second display module, the second decoding module decodes the review code stream image of the original video code stream, and synchronously outputs to the second display module for display, the user reviews the review code stream image and Issue control instructions when the review code stream image contains harmful content;

The user instruction processing module receives and processes the user's control instruction, and triggers the first display module to stop displaying the original video code stream image according to the control instruction.

The first communication module is connected to the first decoding module and the second decoding module respectively, and the first decoding module and the second decoding module are connected to each other; the first communication module receives from the network side using a layered coding method Compressed original video code stream, the original video code stream includes a base layer code stream and at least one enhancement layer code stream, the first communication module outputs the enhancement layer code stream to the first decoding module, and uses the base layer code stream as The review code stream is output to the second decoding module, the second decoding module decodes the base layer code stream image, and the first decoding module reconstructs the decoded base layer code stream and the corresponding enhancement layer code stream according to the second decoding module Original video code stream image.

Or the first communication module is connected to the first decoding module and the second decoding module respectively; the first communication module receives the original video code stream and the low bit rate review generated based on the original video code stream in parallel from the network side code stream, outputting the original video code stream to the first decoding module, and outputting the reviewed code stream to the second decoding module.

The display processing module is connected between the delay module and the first display module; the second decoding module is connected to the second display module through the display processing module; Do relevant processing.

A second communication module and a user instruction input module, wherein the second communication module is connected between the user instruction processing module and the user instruction input module, and the user instruction input module receives the user's control instruction and communicates The module is transmitted to the user instruction processing module.

The second display module is set independently or combined with the user instruction input module.

The user terminal equipment also includes:

The electronic program guide EPG information processing module receives and processes the metadata information of the original video code stream sent by the EPG/metadata system on the network side through the first communication module;

The parental lock database is connected to the second communication module and stores the parental lock data input by the user through the user instruction input module;

The parental lock processing module is connected between the EPG information processing module and the second communication module, and is connected to the first decoding module and the parental lock database at the same time, and stream media content is streamed according to the metadata information and parental lock data Do match filtering.

The user terminal equipment also includes:

The URL filtering information database is connected to the second communication module and stores the URL filtering information input by the user through the user instruction input module;

The URL filtering processing module is connected between the URL filtering information database and the first communication module, and filters harmful content sources according to the URL filtering information input by the user.

The user terminal device further includes: an information feedback module, connected between the user instruction processing module and the first communication module, and extracting harmful content video from the censored code stream according to the feedback instruction input by the user through the user instruction input module code stream related information and feed back the related information to the network side through the first communication module.

The information feedback module includes at least one of the following:

The first feedback unit extracts the name and/or code name of the original video code stream provider, the name and/or number of the original video code stream sending channel, And the program name and/or serial number of the original video code stream and fed back to the EPG/metadata system on the network side;

The second feedback unit extracts the name and/or code name of the original video code stream provider, the name and/or number of the original video code stream sending channel, and the program name and/or serial number of the original video code stream and feed it back to the video code stream content review system on the network side;

The third feedback unit extracts the URL information of the original video code stream from the first communication module and feeds it back to the third-party URL rating system on the network side.

The user terminal equipment further includes: a main control module, which is connected to each other module, controls the operation of the user terminal equipment, and other information processing modules, which are connected between the first communication module and the main control module, and receive information from Other information on the network side is output to the main control module, and the main control module distributes it to related modules. The other information includes at least network management information or software version update information.

The log recording module is connected to each other module respectively, records the operation log of the user terminal equipment and generates a log report.

The replacement content library is connected between the display processing module and the main control module, and the main control module notifies the display processing module to extract the replacement content library from the replacement content library when the first display module stops displaying the original video code stream image. The content is output to the first display module for display.

A method for implementing video content review on a user terminal device, comprising the steps of:

The user terminal device decodes the review code stream image of the original video code stream and synchronously outputs it to the second display module of the user terminal device, and the second display module displays the review code stream image, and the user reviews the review code stream image and Issue control instructions when reviewing code stream images containing harmful content;

The user terminal device decodes and reconstructs the original video code stream image of the streaming media content, delays displaying the original video code stream image on the first display module, and stops displaying the original video code stream image when receiving a user control instruction.

Wherein, the original video code stream is hierarchically coded by the content source into a base layer code stream and at least one enhancement layer code stream, wherein the base layer code stream is the review code stream, and the user terminal device has completed decoding The base layer code stream and the corresponding enhancement layer code stream are decoded to reconstruct the original video code stream image.

Alternatively, the review code stream is a low-bit-rate dedicated review code stream generated by the network-side device or content source based on the original video code stream, and the network-side device combines the low-bit-rate dedicated review code stream with the corresponding original video code stream Together, they are forwarded to the user terminal equipment in parallel.

After the user terminal device decodes the original video code stream, the method further includes: the user terminal device receives the metadata information containing the classification and grading qualitative attributes of the original video code stream and The parental lock data input by the user is matched and filtered on the streaming media content.

The method also includes: the user terminal device sends the parental lock data input by the user to the streaming media service system; when the streaming media service system receives the user's streaming media service request, according to the parental lock data and the requested streaming media The metadata information of the content is matched and filtered.

Before the user terminal device decodes the original video code stream, the method also includes: the user terminal device filters harmful content sources according to URL filtering information input by the user in advance. Wherein, the filtering of harmful content sources includes: prohibiting sending streaming media content requests to harmful content sources in URL filtering information; or prohibiting receiving streaming media content pushed by harmful content sources in URL filtering information.

The method further includes: while the user terminal device stops displaying the original video code stream image according to the user's control instruction, obtains the following related information: the name and/or code number of the original video code stream provider that stopped displaying, the original video code stream image The name and/or number of the code stream transmission channel, and the program name or number of the original video code stream; and when receiving the feedback instruction input by the user, feed back the above-mentioned relevant information to the network side EPG/metadata system and/or Network-side video stream content review system.

The method further includes: the user terminal device stops displaying the original video code stream image according to the user's control instruction, and at the same time obtains the URL information of the original video code that stops displaying; and when receiving the feedback instruction input by the user, the The URL information of the original video code is fed back to the third-party URL rating system on the network side. It is also possible to obtain and feed back the time period information of harmful content and/or the level information of harmful content given by the user at the same time.

In this method, the user terminal device stops displaying the original video code stream image according to the user's control instruction, and at the same time keeps displaying the review code stream image. The user terminal device displays the replacement content pre-stored in the replacement content library while stopping displaying the original video code stream image according to the user's control instruction.

In this method, the delayed display time of the original video code stream image is determined according to the time required for the user to examine the review code stream image.

The beneficial effects of the present invention are as follows:

The technical solution of the present invention previews and reviews the review code stream of the original video code stream on the user terminal side, realizes the local review of the original video code stream by the user, can increase the reliability of content review, and is especially suitable for the protection of minors ;

The technical scheme of the present invention can be used in combination with the existing parental lock control and URL filtering technology, and can be used in conjunction with the content review mechanism on the network side, thereby improving the entire streaming media content security review system;

The technical solution of the present invention provides a feedback mechanism for harmful content-related information, and continuously improves the knowledge base and database of relevant streaming media content security through user reports and feedback, and continuously improves the streaming media content review capability on the network side;

The technical solution of the present invention can use the multi-layer structure of the code stream of the layered coding mechanism and the relationship between the basic layer and the enhancement layer to generate a review code stream. Because layered coding is very suitable for use in heterogeneous networks and complex network conditions, Therefore, it must be used by streaming media services in the future, so the present invention meets the technical development trend and market needs, and does not add any additional requirements.

Description of drawings

FIG. 1 is a schematic diagram of the principle of implementing parental control on an existing user terminal device;

Fig. 2 is a schematic diagram of the principles of the first video code stream inspection system described in the embodiment;

FIG. 3 is a schematic diagram of the principle of the second video code stream inspection system described in the embodiment;

FIG. 4 is a schematic diagram of the main structure of a user terminal device implementing the technical solution of the present invention;

FIG. 5 is a schematic diagram of a specific structure of the information feedback module in FIG. 4 .

Detailed ways

First of all, the present invention provides the first method for realizing in-depth review of streaming media content on the network side. The basic principle of the method is shown in Figure 2. The review center is set at the core network center of the operator. The communication connection of the censorship code stream generation node, the censorship code stream generation node can be set independently, or combined with other existing network entities, such as media gateway or media resource server. The review code stream generation node generates a review media stream based on the original content media stream and sends it to the review center. The censorship media stream mainly includes the video censorship code stream, and the method for generating the video censorship code stream is relatively complicated, which may include the following: a method for generating a video censorship code stream based on scene segmentation; generating a video censorship code according to all I frames in the video code stream stream method; video censorship code stream generation method based on requantized DCT coefficients; video censorship code stream generation method based on reducing image resolution and video censorship code stream generation method based on frame rate reduction. The censorship code stream generated by the above method keeps the main information of the original content code stream as much as possible, at least when manually watching, the nature of the content can be judged; and the bit rate is as low as possible, reducing the burden of network transmission.

After the censored media streams from various censorship code stream generation nodes are aggregated to the content review center, the review center can manually or automatically identify the censorship code stream, and if it is harmful, it will take measures to order the review of the problematic content The code stream generation node performs the following processing:

1. Cut off the stream of harmful content;

2. Replace it with a harmless alternate content code stream, so that users can still see the content. The most common way is to insert advertisements, etc.;

Of course, if the operator's network is very large, the review center can also be set up hierarchically, and one review center is responsible for a part of the network. Still referring to Figure 3, there is a highest level 1 review center. In addition, the review experts in the highest review center have the highest authority. If there is any questionable content, if the following level 2 review center cannot judge, it can be handed over to the highest review center. The center uses manual identification to make a judgment.

The present invention also provides a second video stream review method, system and related equipment implemented on the network side based on layered coding technology. The review code stream is generated through the basic layer, and the review device will review the review code stream. If there is no problem in the review, the review device will forward the basic layer code stream to the receiving end of the receiving user, and the enhancement layer code stream will not pass through the review device. After the user terminal receives all the basic layers plus the enhancement layer, it can decode and reconstruct the total video code stream and watch the program. If the user terminal cannot receive the basic layer, it cannot decode, reconstruct and watch the program.

The structural diagram of the review system for implementing this technical solution is shown in Figure 2, which mainly includes related devices of content sources, content databases, streaming media servers, content review devices and user receiving end devices, among which:

The solid line part is the review implementation process of the live broadcast mode. In the live broadcast mode, the content source directly sends the basic code stream for review to the content review device through the streaming media server, and the remaining enhanced code stream is delayed and sent to the user receiving end. When the device checks that the basic code stream does not contain harmful content, it forwards the basic code stream to the user receiving end. If the basic code stream contains harmful content, it does not forward the basic code stream to the user receiving end. In this way, the user receiving end receives When the basic code stream is not reached, the original video code stream cannot be decoded and reconstructed. During this process, the censorship device can notify the content source to increase/decrease the coding quality of the basic layer code stream according to the required video quality, or increase/decrease the forwarding while forwarding the basic layer code stream to enhance the review effect and Accurate enhancement layer bitstream. If it is the latter, part of the enhanced code stream is also included in the corresponding code stream for review.

The dotted line is the review implementation process of the stored content playback mode. In the stored content playback mode, the content source first stores the generated base layer code stream and enhancement layer code stream to the corresponding base layer code stream track and enhancement layer track respectively; streaming media When the server plays the video content again, it reads the basic layer code stream from the basic layer code stream track and forwards it to the inspection device, reads out the enhancement layer code stream and sends it to the user terminal after delay processing; similarly, in this process, According to the required video quality, the inspection device notifies the streaming media server to increase/decrease the forwarding of the enhanced layer code stream to enhance the review effect and accuracy while forwarding the basic layer code stream. The code stream used for review also includes Part of the enhanced code stream.

The technical solution is mainly implemented based on the following three mainstream layered coding technologies: a time-based layered video coding method; an SNR-based layered video coding method; a spatially layered video coding method.

The above two technical solutions provide a technical solution for in-depth content review by using the review code stream on the network side. Based on the above two technical solutions, this application proposes a technical solution for implementing in-depth content review on user terminal equipment. The technical concept mainly include:

The user terminal device decodes the censored code stream image of the original video code stream and displays the censored code stream image synchronously, and the user reviews the censored code stream image and issues a control command when the censored code stream image contains harmful content;

The user terminal device decodes the original video code stream image of the reconstructed streaming media content, delays displaying the original video code stream image, and stops displaying the original video code stream image when receiving a user control instruction.

The delay time of the original video code stream image depends on the time required for preview review, usually it can be set to 5 seconds.

Based on the aforementioned first technical solution, the review code stream is a dedicated low-bit-rate review code stream generated based on the original video code stream, and the low-bit-rate review code stream and the original video code stream are forwarded to the user terminal equipment in parallel by the network side, The low-bit rate censored code stream and the original video code stream may arrive at the user terminal device at the same time or approximately at the same time, mainly depending on the delay introduced by the network-side content review system (that is, the review center) to the original video code stream relative to the censored code stream.

Based on the aforementioned second technical solution, the original video code stream is hierarchically encoded by the content source into a base layer code stream and at least one enhancement layer code stream, and the user terminal device uses the base layer code stream as the review code stream; and The original video code stream image is decoded and reconstructed according to the decoded base layer code stream and the corresponding enhancement layer code stream. If the inspection device on the network side does not inspect the code stream of the basic layer, the code stream of the basic layer and the code stream of the enhancement layer reach the user terminal equipment at the same time; The code streams of the enhancement layer arrive at the user terminal equipment one after another.

In the above two scenarios, the user can realize the review of harmful content by previewing the review code stream image, and cut off the playback of the original video code stream image containing harmful content in time to realize the control of harmful content.

This technical solution can also be applied simultaneously with the existing parental lock control solution, specifically: the user stores the parental lock data in the user terminal device in advance, and the network-side EPG/metadata system first includes the parental lock data when the user requests streaming media content. The metadata information of the original video stream classification, grading and qualitative attributes is sent to the user terminal device; the user terminal device performs matching and filtering on the streaming media content according to the metadata information and the parental lock data input by the user; the user terminal device can also simultaneously The input parental lock data is sent to the streaming media service system, and the streaming media service system performs matching and filtering according to the parental lock data and the metadata of the requested content when receiving the streaming media service request from the user.

This technical solution can also be applied at the same time as the existing URL filtering solution, specifically: filtering harmful content sources according to the URL filtering information input by the user in advance, wherein, URL filtering includes two aspects of control: prohibiting the harmful content in the URL filtering information; The content source sends a content request; or it is forbidden to receive the streaming media content pushed by the harmful content source in the URL filtering information.

In this way, for the time period when the parents are not at home, the parents can take the following measures to ensure that the underage children are protected from harmful content:

(1) Traditional parental lock settings, blocking certain channels or programs.

(2) Parents order a third-party URL filtering service;

(3) Customize the content review service on the network side to achieve fine-grained content reception control.

If the network is limited to technical reasons or economic reasons and cannot provide content review services, there are two different situations:

(1) The content source (such as the streaming media server of the content provider) provides the censored code stream, but there is no censorship system on the network side to review the censored code stream. You can only rely on the user terminal to accept the code stream for review and conduct review through preview.

(2) If the content source cannot provide the review code stream, and there is no review system on the network side to review the review code stream. Then you can only rely on parental controls or third-party URL filtering.

For URL filtering, firstly, the content security system of the streaming media service system on the network side can use the URL classification and rating information provided by a third party to control the content media stream sent from the network side to the user terminal. The user terminal obtains the URL rating of the content to be requested from the third-party URL service system, matches the third-party URL rating information with the user's own filter conditions, and then performs reception control.

After reviewing the harmful content, the technical solution can further feed back relevant information about the harmful content to the relevant system on the network side, including feedback from the following aspects:

1. Feedback the following information to the network side EPG/metadata system: the name and/or code of the original video code stream provider, the name and/or number of the original video code stream sending channel, the original video code stream the program title or serial number;

2. Feedback the following information to the network-side video code stream content review system: the name and/or code number of the original video code stream provider, the name and/or number of the sending channel of the original video code stream, the original video code stream the program name or number of the stream;

3. Feedback the URL information of the original video code to the third-party URL rating system.

It is also possible to feed back the time period information of the harmful content and/or the level information of the harmful content given by the user at the same time. This feedback mechanism can provide good reference data for the network side to improve various filtering and review mechanisms of the network. For example: the network-side EPG/metadata system can correct metadata information in a timely manner based on real feedback information; the content review system can implement more refined content review based on real feedback information; third-party URL rating systems can also use real feedback information Correction of rating data, etc.

If a feedback mechanism is used, there are two main channels for collecting feedback information:

After the metadata information sent by the EPG/metadata system arrives at the user terminal device, part of the information is stored in the corresponding memory of the terminal device. This information is automatically extracted for feedback. The relevant information that needs to be fed back generally includes:

(1) The name and code of the original video stream content provider;

(2) Send the channel name and number of the original video stream;

(3) The program name and serial number of the original video code stream;

In addition, some information that needs to be fed back is input by the user, for example:

(1) Classification of harmful content;

Violence, pornography, reactionary, etc. Feedback is selected by the user via the remote control.

(2) The degree of harmfulness;

0-N level. Level 0 is the highest and the most serious, level N is the lowest and the least serious, the user selects feedback through the remote control, and the default level is 0.

Of course, the information that needs to be input by the user is optional. If the user does not input the above information, there will be a set of default values for use.

If you need to feed back the time information of harmful content, you can use the following two recording methods:

(1) When the terminal device receives the user's stop display control instruction, it automatically extracts the system time and records it. The time is a relative offset time relative to the start time of the program based on the time system of the terminal. This time information is fed back to the network side, and the network side needs to make necessary corrections (considering factors such as the time non-uniformity of the media stream played on the terminal caused by network transmission and the asynchronous time between the network side and the terminal time).

(2) The terminal device prompts the user to input time period information.

Users can give feedback after watching all the programs, so it is possible to record multiple time period information, such as:

Record 0: start time: hh:mm:ss (start time of the first harmful content);

End time: hh:mm:ss (the end time of the first harmful content);

Record 1: start time: hh:mm:ss (start time of the second harmful content);

End time: hh:mm:ss (end time of the second harmful content);

 …

Record N-1: start time: hh:mm:ss (start time of harmful content in paragraph N);

End time: hh:mm:ss (the end time of the harmful content of paragraph N);

The above time is a relative time offset, relative to the program start time, the time corresponding to the program start time is 00:00:00.

When the user needs feedback, he can input a feedback command to the user terminal device through a specific button. After receiving the feedback command, the user terminal device automatically combines the aforementioned information to generate a feedback message and send it to the network side.

Further control can be achieved by feeding back corresponding information to different related systems on the network side, such as content review systems (such as review centers) on the network side, EPG/metadata systems or third-party URL rating systems, etc.

After receiving the feedback information, the network-side content review system (such as the review center) may take the following measures to deal with it:

(1) After being verified by the inspectors, it is recorded in the database;

(2) For the content data recorded in the database after verification, it can be controlled when the content is played next time. One strategy is to pause playback of harmful content and continue playing subsequent media streams when the harmful content ends. Control and the like can be precisely performed by using the start and end time information of each harmful segment.

In this way, the combination of the user terminal device and the network-side content inspection service provides a content security policy combining multiple content security methods and implements fine-grained content reception control.

Compared with the prior art, the present invention can provide user terminal-based fine-grained content receiving control. Not only can you control whether to receive a certain channel or a certain film in the channel, but you can also go deep into the film to realize the reception control of different clips.

If the streaming media service system on the network side provides the content review function, there are two situations:

(1) Mandatory: All content media streams transmitted from the network side to the user terminal must be inspected.

(2) Optional: the user obtains the content review service on the network side by ordering the service. This service may be paid for. After the user customizes such a service, some content media streams sent from the network side to the user terminal will be censored. Users can control the scope of content review by setting filter conditions. For example, all channels from a certain IPTV network TV company are checked, or a few specific channels are checked. As far as channels are concerned, it is possible to censor programs broadcast within a certain time period (midnight 00:00AM-7:00PM, etc.) of a channel. Users can also choose whether to receive the review code stream to preview on their own user terminals. If you choose to preview, it is equal to the user's own review, plus network review is double insurance. Vulnerabilities in web censorship, etc. can also be reported through the feedback mechanism.

In this technical solution, while the user stops displaying the original video code stream image, the terminal device can keep displaying the censored code stream image, and the user can instruct the terminal device to continue displaying the original video code stream image after the harmful content ends.

It can be seen that by combining with the content security mechanism on the network side and by utilizing the existing user terminal-based content security technology, the present invention can provide a comprehensive, multi-level, suitable for various application scenarios, and supports fine-grained content security control scheme.

In order to realize the above technical solution, the present invention provides a user terminal device 100, the main structure of which is shown in Figure 4, including:

1. The first decoding module 1011, the delay module 1012 and the first display module 1013, wherein the delay module 1012 is connected between the first decoding module 1011 and the first display module 1013, and the first decoding module 1011 decodes and reconstructs the streaming media service The original video code stream image is delayed by the delay module 1012 and output to the first display module 1013, and the first display module 1013 displays the original video code stream image;

Wherein, the first display module 1013 is used to display the original video code stream image of the streaming media program, which is a display device for the streaming media service on the existing user terminal, which may be a monitor of a computer or a display screen of a TV.

2. The second decoding module 1021 and the second display module 1023, the second decoding module 1021 decodes the review code stream image of the original video code stream, and synchronously outputs it to the second display module 1023, and the second display module 1023 synchronously displays the review code Streaming image, the user conducts manual review of harmful content by previewing the review code stream image, and sends a control instruction when the review code stream image contains harmful content;

Wherein, the second display module 1023 displays a preview image. Generally, in order to realize isolated inspection, the second display module 1023 is set separately from the first display module 1013, and may be a separate auxiliary display device. For the convenience of control, the auxiliary display device may be set in The remote control or handheld terminal sends the image display signal of the review code stream to the remote control or other small handheld terminals that can receive signals with such a standard format for display through a wired or wireless connection. At present, there are already many commercial products such as mobile phones and PADs that exchange data with other home appliances through wireless interfaces such as bluetooth. The advantage of adopting this method is that the preview image can only be seen by the person (usually the parent) who holds the remote control/other handheld device, and cannot be seen by others (minors), which completely prevents the infringement of harmful content.

Of course, the second display module 1023 can also be displayed as a sub-screen in the first display module 1013 .

3. The user instruction processing module 1031 and the user instruction input module 1032, the user previews the censored code stream image through the second display module 1023, and sends a control instruction when the censored code stream image contains harmful content, the user instruction input module 1032 receives and The control instruction is processed, and the first display module 1013 is triggered to stop displaying the original video code stream image according to the control instruction.

The user instruction processing module 1031 processes the user control instructions from the user instruction input module 1032, and interacts with the user to generate a graphical user interface, and sends the interface graphic data to the first display module 1013 for display. For the content security feedback instruction input by the user, the notification information feedback module 108 collects relevant information and generates a feedback message, and the feedback message is sent to the network side content review system, EPG/metadata system or third-party URL service through the first network side communication module 1041 system.

The second display module 1023 can be configured independently or combined with the user instruction input module 1032 . The user instruction input module 1032 includes, but is not limited to: a keyboard, a remote controller, a control panel of a set-top box, a software control interface based on a personal computer, and the like. Correspondingly, the user instruction input module 1032 should at least include a control instruction input unit and a feedback instruction input unit.

4. The first communication module 1041 and the second communication module 1042, the first communication module 1041 is respectively connected to the first decoding module 1011 and the second decoding module 1021;

If it is based on layered coding technology, as shown in Figure 10, the first decoding module 1011 and the second decoding module 1021 are directly connected to each other; the first communication module 1041 receives the original video code stream compressed by layered coding from the network side , the original video code stream includes a base layer code stream and at least one enhancement layer code stream, the first communication module 1041 outputs the enhancement layer code stream to the first decoding module 1011, and outputs the base layer code stream as a review code stream For the second decoding module 1021, the second decoding module 1021 decodes the base layer code stream image, and the first decoding module 1011 decodes and reconstructs the original video according to the base layer code stream and the corresponding enhancement layer code stream decoded by the second decoding module 1021 stream image.

If it is based on the dedicated review code stream technology, there is no direct connection between the first decoding module 1011 and the second decoding module 1021 (the former case is shown in Figure 10); the first communication module 1041 receives the original video code stream in parallel from the network side and the low-bit-rate review code stream generated based on the original video code stream, output the original video code stream to the first decoding module 1011 , and output the review code stream to the second decoding module 1021 .

The second communication module 1042 is connected between the user instruction processing module 1031 and the user instruction input module 1032. The user instruction input module 1032 receives the user's control instruction and transmits it to the user instruction processing module 1031 through the second communication module 1042. The user instruction processing module Step 1031 triggers the first display module 1013 to stop displaying the original video code stream image according to the control instruction.

5. The display processing module 105, the first decoding module 1011 is connected to the display processing module 105 through the delay module 1012; the second decoding module 1021 is connected to the second display module 1023 through the display processing module 105; the display processing module 105 is connected to the video stream image Do relevant processing.

6. The parental lock database 1061 is connected to the second communication module 1042 to store the parental lock data input by the user;

The parental lock processing module 1062 is connected between the EPG information processing module 1063 and the second communication module 1042, and is connected to the first decoding module 1011 at the same time, and performs matching filtering on the streaming media content according to the metadata information of the video code stream and the parental lock data.

The electronic program guide EPG information processing module 1063 is connected to the first communication module 1041, and receives and processes the metadata information of the original video stream sent by the EPG/metadata system on the network side through the first communication module 1041;

7. The URL filtering information database 1071 is connected to the second communication module 1042 and stores the URL filtering information input by the user;

The URL filtering processing module 1072 is connected between the URL filtering information database 1071 and the first communication module 1041, and filters harmful content sources according to the filtering URL information input by the user.

8. The information feedback module 108 is connected between the user instruction processing module 1031 and the first communication module 1041, extracts information related to the video code stream of the harmful content according to the user feedback instruction, and sends the feedback message to the network through the first communication module 1041 side related system.

As shown in Figure 5, the information feedback module 108 includes at least one of the following:

The first feedback unit 1081 extracts the name and/or code name of the original video code stream provider, the name and/or number of the original video code stream sending channel, and the original video code stream from the EPG information processing module according to the user's feedback instruction program name and/or number and feed back to the EPG/metadata system on the network side;

The second feedback unit 1082 extracts the name and/or code name of the original video code stream provider, the name and/or number of the original video code stream sending channel, and the original video code stream from the EPG information processing module according to the user's feedback instruction program name and/or number and feed back to the video code stream content review system on the network side;

The third feedback unit 1083 extracts the URL information of the original video code stream from the first communication module 1041 according to the user's feedback instruction and feeds it back to the third-party URL rating system on the network side.

9. The main control module 1091 is connected to each of the other modules to control the operation of the user terminal equipment. The user command processing module 1031 sends the user's control command to the main control module 1091, and the main control module 1091 controls the first display module 1013 Stop/continue to display the original video stream image;

The other information processing module 1092 is connected between the first communication module 1041 and the main control module 1091, receives other information from the network side and outputs it to the main control module 1091, and the main control module 1091 then distributes it to related modules. The other information is at least Including network management information or software version update information.

The log recording module 1093 is respectively connected to each other module, records the operation log of the user terminal equipment and generates a log report.

The replacement content library 1094 is connected between the display processing module and the main control module 1091. The main control module 1091 notifies the display processing module 105 to extract the replacement content from the replacement content library when the first display module 1013 stops displaying the original video stream image And output to the first display module 1013 for display.

Once the user finds that there is a problem with the previewed review code stream image, he can immediately control the user terminal device to stop receiving/decoding the content media stream through the user instruction input module 1032 (such as a remote control), and instruct the terminal to play pre-stored video and audio clips, such as favorite animation, or display a screen saver. In the case of using an independent second display device (such as a remote control) to display the preview video, it is also allowed to continue to accept the censored code stream, so that you can know when the harmful part is played, and you can control the user terminal device in time after the harmful content is over. Continue to play the original video code stream image.

There are many ways to realize the above control, which can be realized by setting different user commands (such as specific remote control buttons). Parents themselves decide what measures to take according to the current display mode and operate the corresponding buttons accordingly. In the case of using the remote control to display the preview video, the parent can instruct the terminal to stop receiving the enhanced layer code stream and only receive the basic layer code stream. For non-hierarchical cases, parents can instruct the terminal to stop displaying content streams and only display preview streams. There can be multiple buttons to handle multiple situations, which is troublesome, but the advantage is that people have a high degree of autonomy. It can also be one, fool-like, but the degree of autonomy of people is poor. For example, if the user wants to stop playing harmful content, he only needs to press a button, but after the terminal system receives this instruction, it will automatically take actions intelligently according to whether the current layered encoding is used or whether the separate display mode is used.

Utilizing the scheme of the present invention, the mainstream healthy content is controlled and deleted locally, so that it can play the role of "extracting the essence and repelling the dross", providing the maximum absorption and utilization of excellent cultures from different countries and historical eras. technical conditions.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (26)

1. A user terminal device for implementing streaming media content review, characterized in that it includes: A first decoding module, a delay module and a first display module, wherein the delay module is connected between the first decoding module and the first display module, and the first decoding module decodes and reconstructs the original video code stream of the streaming media service The image is delayed and output to the first display module through the delay module for display; The second decoding module and the second display module, the second decoding module decodes the review code stream image of the original video code stream, and synchronously outputs to the second display module for display, the user reviews the review code stream image and Issue control instructions when the review code stream image contains harmful content; The user instruction processing module receives and processes the user's control instruction, and triggers the first display module to stop displaying the original video code stream image according to the control instruction. 2. The user terminal device according to claim 1, characterized in that, the user terminal device further comprises: a first communication module connected to the first decoding module and the second decoding module respectively, and the first decoding module The module and the second decoding module are directly connected to each other; The first communication module receives from the network side an original video code stream compressed in a layered encoding manner, the original video code stream includes a base layer code stream and at least one layer of enhancement layer code stream, and the first communication module converts the enhancement layer code stream into The code stream is output to the first decoding module, and the base layer code stream is output to the second decoding module as the review code stream, and the second decoding module decodes the base layer code stream image, and the first decoding module decodes the base layer code stream based on the second decoding module. The layer code stream and the corresponding enhancement layer code stream are decoded to reconstruct the original video code stream image. 3. The user terminal device according to claim 1, wherein the user terminal device further comprises: a first communication module connected to the first decoding module and the second decoding module respectively; The first communication module receives the original video code stream and the low-bit-rate inspection code stream generated based on the original video code stream in parallel from the network side, outputs the original video code stream to the first decoding module, and transmits the The review code stream is output to the second decoding module. 4. The user terminal device according to claim 1, 2 or 3, characterized in that, the user terminal device further comprises: a display processing module connected between the delay module and the first display module; The second decoding module is connected to the second display module through the display processing module; the display processing module performs related processing on the original video code stream image. 5. The user terminal device according to claim 4, further comprising: a second communication module and a user instruction input module, wherein the second communication module is connected to the user instruction input module. Between the processing module and the user instruction input module, the user instruction input module receives the user's control instruction and transmits it to the user instruction processing module through the second communication module. 6. The user terminal device according to claim 5, wherein the second display module is configured independently or combined with the user instruction input module. 7. The user terminal device according to claim 5, characterized in that, the user terminal device further comprises: The electronic program guide EPG information processing module receives and processes the metadata information of the original video code stream sent by the EPG/metadata system on the network side through the first communication module; The parental lock database is connected to the second communication module and stores the parental lock data input by the user through the user instruction input module; The parental lock processing module is connected between the EPG information processing module and the second communication module, and is connected to the first decoding module and the parental lock database at the same time, and stream media content is streamed according to the metadata information and parental lock data Do match filtering. 8. The user terminal device according to claim 5, characterized in that, the user terminal device further comprises: The URL filtering information database is connected to the second communication module and stores the URL filtering information input by the user through the user instruction input module; The URL filtering processing module is connected between the URL filtering information database and the first communication module, and filters harmful content sources according to the URL filtering information input by the user. 9. The user terminal device according to claim 5, further comprising: an information feedback module connected between the user instruction processing module and the first communication module, according to the user through the user The feedback instruction input by the instruction input module extracts the relevant information of the video code stream of the harmful content and feeds back the relevant information to the network side through the first communication module. 10. The user terminal device according to claim 5, wherein the user instruction input module at least comprises: a user feedback instruction input unit. 11. The user terminal device according to claim 9, wherein the information feedback module includes at least one of the following: The first feedback unit extracts the name and/or code of the original video code stream provider, the name and/or code of the original video code stream sending channel from the metadata information of the original video code stream received by the electronic program guide EPG information processing module or serial number, and the program name and/or serial number of the original video code stream and feed back to the EPG/metadata system on the network side; The second feedback unit extracts the name and/or code name of the original video code stream provider, the name and/or number of the original video code stream sending channel, and the program name and/or serial number of the original video code stream and feed it back to the video code stream content review system on the network side; The third feedback unit extracts the URL information of the original video code stream from the first communication module and feeds it back to the third-party URL rating system on the network side. 12. The user terminal device according to any one of claims 6-11, characterized in that, the user terminal device further comprises: a main control module, connected to each of the other modules respectively, to control the operation of the user terminal device . 13. The user terminal device according to claim 12, characterized in that, the user terminal device further includes one or any combination of the following: Other information processing modules, connected between the first communication module and the main control module, receive other information from the network side and output it to the main control module, and the main control module then distributes it to related modules. The other information includes at least network management Information or software version update information; The log recording module is connected to each other module respectively, records the operation log of the user terminal equipment and generates a log report; The user terminal device further includes: a replacement content library connected between the display processing module and the main control module, and the main control module notifies the display when the first display module stops displaying the original video code stream image The processing module extracts the replacement content from the replacement content library and outputs it to the first display module for display. 14. The user terminal device according to claim 5, wherein the user instruction input module includes but not limited to: a keyboard, a remote controller, a control panel of a set-top box, and a software control interface based on a personal computer. 15. The user terminal device according to claim 5 or 14, wherein the user instruction input module at least comprises: a user control instruction input unit. 16. A method for implementing video content review on a user terminal device, comprising the following steps: The user terminal device decodes the review code stream image of the original video code stream and synchronously outputs it to the second display module of the user terminal device, and the second display module displays the review code stream image, and the user reviews the review code stream image and Issue control instructions when reviewing code stream images containing harmful content; The user terminal device decodes the original video code stream image of the reconstructed streaming media content and delays displaying the original video code stream image on the first display module, and stops displaying the original video code stream image when receiving a user control instruction. 17. The method according to claim 16, wherein the original video code stream is hierarchically encoded into a base layer code stream and at least one enhancement layer code stream by the content source, wherein the base layer code stream is Examining the code stream, the user terminal device decodes and reconstructs the original video code stream image according to the decoded base layer code stream and the corresponding enhancement layer code stream. 18. The method according to claim 17, wherein the review code stream is a low-bit-rate dedicated review code stream generated by the network-side device based on the original video code stream, and the network-side device dedicated the low-bit-rate review code stream. The review code stream and the corresponding original video code stream are forwarded to the user terminal equipment in parallel. 19. The method according to claim 16, further comprising: before the user terminal device decodes the original video code stream, the method further comprises: the user terminal device filters harmful content sources according to the URL filtering information input by the user in advance. 20. The method according to claim 19, wherein the filtering of harmful content sources comprises: Prohibit streaming content requests to harmful content sources in URL filtering information; or It is forbidden to receive streaming media content pushed by harmful content sources in URL filtering information. 21. The method of claim 16, further comprising: When the user terminal device stops displaying the original video code stream image according to the user's control instruction, it obtains the following related information: the name and/or code number of the provider of the original video code stream that stops displaying, the sending of the original video code stream that stops displaying the name and/or number of the channel, and the program name or number of the raw video stream that ceased to be displayed; and When the feedback instruction input by the user is received, the above relevant information is fed back to the network-side EPG/metadata system and/or the network-side video code stream content inspection system. 22. The method of claim 16, further comprising: The user terminal device obtains the URL information of the original video code while stopping displaying the original video code stream image according to the user's control instruction; and When receiving the feedback instruction input by the user, the URL information of the original video code to stop displaying is fed back to the third-party URL rating system on the network side. 23. The method according to claim 21 or 22, characterized in that the user terminal device stops displaying the original video code stream image according to the user's control instruction, and at the same time obtains and feeds back the information of the time period when the harmful content appears and/or the user The harmful content level information given. 24. The method according to claim 16, wherein the user terminal device keeps displaying the review code stream image while stopping displaying the original video code stream image according to the user's control instruction. 25. The method according to claim 21, wherein the user terminal device displays the replacement content pre-saved in the replacement content library while stopping displaying the original video code stream image according to the user's control instruction. 26. The method according to claim 16, wherein the delayed display time of the original video code stream image is determined according to the time required for the user to examine the review code stream image.

Images