CN110198480A - A kind of code stream test method and device - Google Patents

A kind of code stream test method and device Download PDF

Info

Publication number
CN110198480A
CN110198480A CN201910601273.4A CN201910601273A CN110198480A CN 110198480 A CN110198480 A CN 110198480A CN 201910601273 A CN201910601273 A CN 201910601273A CN 110198480 A CN110198480 A CN 110198480A
Authority
CN
China
Prior art keywords
data
code stream
tested
playing
play
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910601273.4A
Other languages
Chinese (zh)
Inventor
钟波
肖适
王鑫
杨俊�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Jimi Technology Co Ltd
Original Assignee
Chengdu Jimi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Jimi Technology Co Ltd filed Critical Chengdu Jimi Technology Co Ltd
Priority to CN201910601273.4A priority Critical patent/CN110198480A/en
Publication of CN110198480A publication Critical patent/CN110198480A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

This application involves technical field of data processing, more particularly to a kind of code stream test method and device, this method is by first obtaining code stream to be measured, then the code stream to be measured is played, it acquires played data when playing the code stream to be measured and generates broadcasting log, then judge that, with the presence or absence of fault data in the played data, the result based on the broadcasting log and the judgement generates test report.In this way, can easily test code stream to be measured, the test report of high reference value is obtained.

Description

一种码流测试方法及装置A code stream testing method and device

技术领域technical field

本申请涉及数据处理技术领域,具体而言,涉及一种码流测试方法及装置。The present application relates to the technical field of data processing, and in particular, to a code stream testing method and device.

背景技术Background technique

随着互联网行业的发展,越来越多的人通过互联网资源来提高学习、完成工作或是进行娱乐等。音视频资源作为互联网资源中的一种重要形式,其码流能否正常解码直接影响资源的传播成功或失败,具有重要的意义。With the development of the Internet industry, more and more people use Internet resources to improve learning, complete work or entertainment. As an important form of Internet resources, audio and video resources, whether the code stream can be decoded normally directly affects the success or failure of resource dissemination, which is of great significance.

目前,用于判断音视频解码是否成功的方法,主要通过在解码过程中不断截取图像,对比这些图像获得的图像相似程度,以判断音视频解码是否成功。其存在数据来源单一、判断结果只能体现图像解码情况的缺陷,导致判断结果的参考价值低。At present, the method for judging whether the audio and video decoding is successful is mainly by continuously intercepting images during the decoding process, and comparing the image similarity obtained by these images to judge whether the audio and video decoding is successful. It has the defects that the data source is single, and the judgment result can only reflect the image decoding situation, resulting in low reference value of the judgment result.

发明内容Contents of the invention

有鉴于此,本申请实施例提供了一种码流测试方法及装置,基于全面的测试数据,对待测试的待测码流进行测试,获得高参考价值测试报告。In view of this, the embodiment of the present application provides a code stream testing method and device, based on comprehensive test data, the code stream to be tested is tested, and a test report with high reference value is obtained.

第一方面,本申请实施例提供一种码流测试方法,该方法包括:In the first aspect, the embodiment of the present application provides a code stream testing method, the method comprising:

获取待测码流;Obtain the code stream to be tested;

播放所述待测码流,采集播放所述待测码流时的播放数据,并生成播放日志;Play the code stream to be tested, collect and play the playback data when playing the code stream to be tested, and generate a play log;

判断所述播放数据中是否存在故障数据;Judging whether there is faulty data in the playing data;

基于所述播放日志和所述判断的结果生成测试报告。A test report is generated based on the playing log and the judgment result.

可选地,在本申请实施例中,采集播放所述待测码流时的播放数据具体为:按照预设的采集周期,采集播放所述待测码流时的播放数据。Optionally, in the embodiment of the present application, collecting and playing the playing data when the code stream to be tested is specifically: collecting and playing the playing data when playing the code stream to be tested according to a preset collection period.

其中,所述采集周期根据所述待测码流的时长信息设定。Wherein, the collection period is set according to the duration information of the code stream to be tested.

可选地,在本申请实施例中,所述播放数据包括图像数据、音频数据和心跳数据。Optionally, in this embodiment of the present application, the playing data includes image data, audio data and heartbeat data.

进一步可选地,所述图像数据包括播放所述待测码流时的多张截图,所述音频数据中包括多个音频数据包。Further optionally, the image data includes multiple screenshots when the code stream to be tested is played, and the audio data includes multiple audio data packets.

进一步可选地,在本申请实施例中,判断所述播放数据中是否存在故障数据具体为:Further optionally, in the embodiment of the present application, judging whether there is fault data in the playing data is specifically:

对所述多张截图进行对比,获得与所述多张截图对应的多个相似度,判断所述多个相似度中是否存在低于预设范围的所述相似度,若存在,则判定存在图像故障数据。Comparing the multiple screenshots, obtaining multiple similarities corresponding to the multiple screenshots, judging whether there is a similarity lower than a preset range among the multiple similarities, and if so, determining that there is Image glitch data.

判断所述多个音频数据包中是否存在空数据包,若存在,则判定存在音频故障数据。It is judged whether there is an empty data packet among the plurality of audio data packets, and if so, it is judged that there is audio fault data.

判断所述心跳数据中,是否存在停止运行数据或应用程序无响应数据,若存在,则判定存在心跳故障数据。It is judged whether there is stop operation data or application non-response data in the heartbeat data, and if there is, it is judged that there is heartbeat failure data.

可选地,在本申请实施例中,基于所述播放日志和所述判断的结果生成测试报告具体为:Optionally, in this embodiment of the application, generating a test report based on the play log and the result of the judgment is specifically:

当所述判断的结果中,存在所述图像故障数据、所述音频故障数据和所述心跳故障数据中的任意一种,则在测试报告中显示未通过测试。When any one of the image fault data, the audio fault data and the heartbeat fault data exists in the result of the judgment, it will be displayed in the test report as failing the test.

将所述播放日志保存于所述测试报告中。Save the playing log in the test report.

可选地,在本申请实施例中,当所述判断的结果中存在所述心跳故障数据时,在所述测试报告中显示设备故障。Optionally, in this embodiment of the present application, when the heartbeat fault data exists in the result of the judgment, the device fault is displayed in the test report.

第二方面,本申请实施例还提供了一种码流测试装置,所述装置包括:In the second aspect, the embodiment of the present application also provides a code stream testing device, the device comprising:

获取模块,用于获取待测码流。The obtaining module is used to obtain the code stream to be tested.

处理模块,用于播放所述待测码流并采集播放所述待测码流时的播放数据,以及生成播放日志。The processing module is used to play the code stream to be tested, collect play data when playing the code stream to be tested, and generate a play log.

判断模块,用于判断所述播放数据中是否存在故障数据。A judging module, configured to judge whether there is faulty data in the playing data.

生成模块,用于基于所述播放日志和所述判断的结果生成测试报告。A generating module, configured to generate a test report based on the playing log and the judgment result.

可选地,在本申请实施例中,所述处理模块,还用于按照预设的采集周期,采集播放所述待测码流时的播放数据。其中,所述采集周期根据所述待测码流的时长信息设定。Optionally, in the embodiment of the present application, the processing module is further configured to collect playback data when playing the code stream to be tested according to a preset collection period. Wherein, the collection period is set according to the duration information of the code stream to be tested.

可选地,在本申请实施例中,所述播放数据包括图像数据、音频数据和心跳数据。Optionally, in this embodiment of the present application, the playing data includes image data, audio data and heartbeat data.

本申请实施例还提供了一种可读存储介质,所述可读存储介质中存储有计算机程序,所述计算机程序被执行时实现上述码流测试方法。The embodiment of the present application also provides a readable storage medium, where a computer program is stored in the readable storage medium, and when the computer program is executed, the above code stream testing method is realized.

由此,本申请实施例所提供的码流测试方法及装置,该方法通过获取待测码流,然后播放所述待测码流,采集播放所述待测码流时的播放数据,并生成播放日志,然后判断所述播放数据中是否存在故障数据,基于所述播放日志和所述判断的结果生成测试报告。通过该方法,能够便捷地对待测码流进行测试,获得高参考价值的测试报告。Therefore, the code stream testing method and device provided in the embodiments of the present application, the method obtains the code stream to be tested, and then plays the code stream to be tested, collects the playback data when playing the code stream to be tested, and generates Playing the log, and then judging whether there is fault data in the playing data, and generating a test report based on the playing log and the judgment result. Through this method, the code stream to be tested can be tested conveniently, and a test report with high reference value can be obtained.

附图说明Description of drawings

为了更清楚地说明本申请实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本申请的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它相关的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, so It should be regarded as a limitation on the scope, and those skilled in the art can also obtain other related drawings based on these drawings without creative work.

图1为本申请实施例提供的码流测试方法的一种流程示意图;FIG. 1 is a schematic flow chart of a code stream testing method provided in an embodiment of the present application;

图2为本申请实施例提供的码流测试装置的一种结构示意框图。FIG. 2 is a schematic block diagram of a structure of a code stream testing device provided by an embodiment of the present application.

图标:100-码流测试装置;10-获取模块;20-处理模块;30-判断模块;40-生成模块。Icons: 100-code stream testing device; 10-obtaining module; 20-processing module; 30-judging module; 40-generating module.

具体实施方式Detailed ways

为了使本领域的技术人员更好地理解发明的技术方案,下面结合具体实施方式对本申请作进一步的详细说明。In order to enable those skilled in the art to better understand the technical solution of the invention, the present application will be further described in detail below in conjunction with specific embodiments.

随着互联网行业的发展,越来越多的人通过互联网来提高学习、完成工作或是进行娱乐。音视频成为互联网资源传播的重要形式,音视频能否正常播放影响着互联网资源的传播,具有重要的意义。With the development of the Internet industry, more and more people use the Internet to improve learning, complete work or entertainment. Audio and video have become an important form of Internet resource dissemination. Whether audio and video can be played normally affects the dissemination of Internet resources, which is of great significance.

目前,大部分音视频解码判断方法,通过人工方法,逐一播放被测试的一视频,通过人工的视觉和听觉的感知,判断播放的各个音视频是否解码成功。这样的方法不仅耗时耗力,还容易出现“漏检”的情况。At present, most audio and video decoding judgment methods use manual methods to play a video to be tested one by one, and judge whether each audio and video played is successfully decoded through artificial visual and auditory perception. Such a method is not only time-consuming and labor-intensive, but also prone to "missed detection".

有一部分音视频解码判断方法通过自动化手段来判断音视频解码是否成功,但是这些方法,在获取视频中的画面的对比相似度后,仅仅依靠画面的对比相似度,就判断解码是否成功。这样存在的问题是,判断依据单一,当该单次数据的采集或者相似度计算出问题时,判断结果随之出现问题,导致判断结果参考价值不高甚至无法进行判断的后果。并且,对于判断的过程没有记录,不能追溯判断的过程。当需要查找与分析解码失败的视频的解码失败原因时,该方法不能提供有用信息、没有参考价值。Some audio and video decoding judgment methods use automatic means to judge whether the audio and video decoding is successful, but these methods, after obtaining the contrast similarity of the pictures in the video, only rely on the contrast similarity of the pictures to judge whether the decoding is successful. The problem that exists in this way is that the judgment basis is single, and when the collection of the single data or the calculation of the similarity has a problem, there will be problems in the judgment result, resulting in the consequence that the judgment result has low reference value or even cannot be judged. Moreover, there is no record of the judgment process, and the judgment process cannot be traced back. This method cannot provide useful information and has no reference value when it is necessary to find and analyze the cause of decoding failure of a video that fails to decode.

基于上述问题,本申请实施例提供了一种码流测试方法及装置。Based on the above problems, the embodiments of the present application provide a code stream testing method and device.

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。通常在此处附图中描述和示出的本申请实施例的组件可以以各种不同的配置来布置和设计。The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. The components of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

因此,以下对在附图中提供的本申请的实施例的详细描述并非旨在限制要求保护的本申请的范围,而是仅仅表示本申请的选定实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动的前提下所获得的所有其它实施例,都属于本申请保护的范围。Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the protection scope of the present application.

应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。It should be noted that like numerals and letters denote similar items in the following figures, therefore, once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.

本申请实施例提供的方法,通过程序编码和指令实现,用于实现该码流测试方法的编码程序及指令,以封装的、exe格式的软件工具为载体,安装到电子设备上。通过在电子设备上运行该软件工具,即可进行码流测试。The method provided by the embodiment of the present application is implemented through program code and instructions, and the code program and instructions used to realize the code stream testing method are installed on electronic equipment with a packaged software tool in exe format as a carrier. By running the software tool on the electronic device, the stream test can be performed.

本申请实施例中的电子设备可以是需要进行码流测试的任意终端,例如但不限于,智能手机、个人电脑(Personal Computer,PC)、投影仪、机顶盒、笔记本电脑、监控设备、服务器等具备音视频解码及处理能力的计算机设备。The electronic device in the embodiment of the present application can be any terminal that needs to perform code stream testing, such as but not limited to, smart phones, personal computers (Personal Computer, PC), projectors, set-top boxes, notebook computers, monitoring equipment, servers, etc. Computer equipment with audio and video decoding and processing capabilities.

请结合参阅图1,为本申请实施例提供的码流测试方法的一种流程示意框图。所应说明的是,本申请实施例提供的码流测试方法不以图1及以下所述的具体顺序为限制。在本申请实施例中,该码流测试方法可以通过以下步骤实现:Please refer to FIG. 1 in conjunction with FIG. 1 , which is a schematic flow diagram of a code stream testing method provided by an embodiment of the present application. It should be noted that the code stream testing method provided in the embodiment of the present application is not limited to the specific order shown in FIG. 1 and the following. In the embodiment of this application, the code stream testing method can be implemented through the following steps:

S10,获取待测码流。S10. Obtain a code stream to be tested.

本申请实施例中,所述待测码流可以通过各种方式获得,例如,可以通过与服务器通信,进行服务器用户名和服务器密码的验证,获取服务器中的码流路径,再根据该路径,读取待测试的码流并生成Json(Java Script Object Notation)格式的码流文件。再例如,待测码流在移动硬盘上,则可以通过将该移动硬盘插到播放或者投影设备,将码流测试软件工具安装到电子设备上,码流测试软件工具,基于电子设备与播放或者是电子设备与投影设备之间建立的通信连接,获取待测码流。上述播放或者投影设备,能够自动生成与待测码流对应的挂载路径,再根据与待测试码流对应的挂载路径,读取移动硬盘中的全部音视频格式的码流,再生成Json(Java Script Object Notation)格式的码流文件,生成能够显示出全部音视频格式码流的列表。In the embodiment of the present application, the code stream to be tested can be obtained in various ways, for example, by communicating with the server, verifying the server user name and server password, obtaining the code stream path in the server, and then reading the code stream according to the path Take the code stream to be tested and generate a code stream file in Json (Java Script Object Notation) format. For another example, if the code stream to be tested is on a mobile hard disk, you can install the code stream testing software tool on the electronic device by inserting the mobile hard disk into the playback or projection device. It is a communication connection established between the electronic device and the projection device to obtain the code stream to be tested. The above playback or projection device can automatically generate the mount path corresponding to the code stream to be tested, and then read all the audio and video format code streams in the mobile hard disk according to the mount path corresponding to the code stream to be tested, and then generate Json (Java Script Object Notation) format code stream file to generate a list that can display all audio and video format code streams.

应当进一步说明的是,Json(Java Script Object Notation)文件是一种轻量级的数据交换格式。易于人阅读和编写。同时也易于机器解析和生成。它基于Java ScriptProgramming Language,Standard ECMA-262 3rd Edition-December 1999的一个子集。JSON采用完全独立于语言的文本格式,但是也使用了类似于C语言家族的习惯(包括C、C++、C#、Java、JavaScript、Perl、Python等)。这些特性使JSON成为理想的数据交换语言。所以,码流文件为Json(Java Script Object Notation)格式的文件,能够更为便捷地满足该软件工具与服务器、播放设备或者是投影设备之间的通信和信息交互,避免信息交互出现错误进而影响码流测试,保证码流测试结果的准确和高参考价值。It should be further explained that the Json (Java Script Object Notation) file is a lightweight data exchange format. Easy for humans to read and write. It is also easy for machines to parse and generate. It is based on Java Script Programming Language, a subset of Standard ECMA-262 3rd Edition - December 1999. JSON uses a text format that is completely language-independent, but also uses conventions similar to the C language family (including C, C++, C#, Java, JavaScript, Perl, Python, etc.). These properties make JSON an ideal data interchange language. Therefore, the code stream file is a file in Json (Java Script Object Notation) format, which can more conveniently meet the communication and information interaction between the software tool and the server, playback device or projection device, and avoid errors in information interaction that will affect the Code flow test, to ensure the accuracy and high reference value of the code flow test results.

在本实施例中,上述列表是用户可以看到并进行选择操作的。用户可以根据自己的意愿和需求点选出需要测试的码流,或是对列表中的码流进行自由勾选组合,码流测试软件工具则将这些被选出的码流作为待测码流,从而对待测码流进行码流测试。In this embodiment, the above-mentioned list is visible and selectable by the user. Users can select the code streams to be tested according to their wishes and needs, or freely select and combine the code streams in the list, and the code stream test software tool will use these selected code streams as the code streams to be tested , so as to perform a code stream test on the code stream to be tested.

应当进一步说明的是,在本申请实施例中,需要将预先编写好的、带有APK签名的安装包(Android Package,APK),安装到待测码流所在的播放或者投影设备上。从而能够支持码流测试软件工具对上述播放或者投影设备的接口进行调用。这些接口包括播放器接口、视频截图接口、音频数据采集接口、心跳接口。以支持播放或者投影设备采集播放数据并将播放数据传输到码流测试软件工具的。APK签名是能够通过播放或者投影设备认证的,以保证播放或者投影设备允许接口被调用。It should be further explained that in the embodiment of the present application, the pre-written installation package (Android Package, APK) with APK signature needs to be installed on the playback or projection device where the code stream to be tested is located. Therefore, it is possible to support the code stream testing software tool to call the interface of the playback or projection device. These interfaces include player interface, video screenshot interface, audio data collection interface, and heartbeat interface. To support playback or projection equipment to collect playback data and transmit the playback data to the stream testing software tool. The APK signature can be authenticated by the playback or projection device to ensure that the playback or projection device allows the interface to be called.

可以理解的,带有待测码流的移动硬盘也可以直接插到电子设备上,电子设备能够直接读取该移动硬盘上的待测码流,从而运行码流测试软件工具对待测码流进行码流测试。It is understandable that the mobile hard disk with the code stream to be tested can also be directly inserted into the electronic device, and the electronic device can directly read the code stream to be tested on the mobile hard disk, so as to run the code stream test software tool to test the code stream to be tested. Stream test.

应当说明的是,本申请实施例中,当上述的待测码流的获取是基于服务器时,安装和运行码流测试的电子设备为支持DLNA(Digital Living Network Alliance,数字生活网络联盟)的设备。安装有码流测试软件工具的电子设备在运行时,该软件工具基于HTTP通信协议与服务器、播放设备或者是投影设备进行通信和信息交互。It should be noted that, in the embodiment of the present application, when the acquisition of the code stream to be tested is based on the server, the electronic device for installing and running the code stream test is a device that supports DLNA (Digital Living Network Alliance, Digital Living Network Alliance) . When the electronic device installed with the stream testing software tool is running, the software tool communicates and exchanges information with the server, playback device or projection device based on the HTTP communication protocol.

在本申请实施例中,应当理解的是,互联网资源中的音视频码流存在着一些待测码流包含有大量音视频数据、占用内存很大的情况,这些数据量大待测码流在进行码流测试时会比较困难,特别一些测试方法需要将待测码流加载到测试设备上再进行测试,码流测试基本不能进行。在本申请实施例中,通过将用于实现该码流测试方法的编码程序及指令,封装成软件工具并安装到电子设备上,该软件工具基于HTTP通信协议与服务器、播放设备或者是投影设备进行通信,从而获取待测码流。这样的设计,是的本申请所提供的码流测试方法,即便是遇到数据量较大的待测码流,也能轻松进行码流测试,生成具有参考价值的测试报告。In the embodiment of the present application, it should be understood that some audio and video code streams in Internet resources contain a large amount of audio and video data and occupy a large amount of memory. It will be more difficult to test the code stream, especially some test methods need to load the code stream to be tested on the test equipment before testing, and the code stream test is basically impossible. In the embodiment of the present application, by packaging the encoding program and instructions used to realize the code stream testing method into a software tool and installing it on the electronic device, the software tool communicates with the server, playback device or projection device based on the HTTP communication protocol. Communicate to obtain the code stream to be tested. Such a design enables the code stream testing method provided by this application to easily perform code stream testing even when encountering a code stream with a large amount of data to be tested, and generate a test report with reference value.

S20,播放所述待测码流,采集播放所述待测码流时的播放数据,并生成播放日志。S20. Play the code stream to be tested, collect play data when playing the code stream to be tested, and generate a play log.

在本申请实施例中,所述待测码流的播放,是通过运行所述软件工具,执行所述软件工具中的编码程序,调用与所述电子设备通信连接的播放设备或者是投影设备,通过播放设备或者是投影设备来播放所述待测码流,并通过播放设备或者是投影设备的接口来获取所述播放数据。In the embodiment of the present application, the playback of the code stream to be tested is performed by running the software tool, executing the encoding program in the software tool, calling a playback device or a projection device that is communicatively connected to the electronic device, The code stream to be tested is played through a playback device or a projection device, and the playback data is acquired through an interface of the playback device or a projection device.

在本申请实施例中,采集播放所述待测码流时的播放数据可以通过以下步骤实现:In the embodiment of the present application, collecting and playing the playback data of the code stream to be tested can be realized through the following steps:

按照预设的采集周期,采集播放所述待测码流时的播放数据。According to the preset acquisition period, the playback data when playing the code stream to be tested is collected.

其中,所述采集周期根据所述待测码流的时长信息设定。Wherein, the collection period is set according to the duration information of the code stream to be tested.

应当说明的是,不同的待测试的待测码流的文件大小和时长信息通常不同,例如大部分的电影音视频的待测码流的时长信息为2小时,而一些短小音视频的待测码流的时长信息为20分钟。本申请实施例中,采集周期是根据所述待测码流的时长信息而设定的,例如采样频率为10次每秒时,采样周期为0.1S,本申请不对采样周期的具体取值进行限定,可根据实际应用场景调整采样周期。例如,当待测试的待测码流时长较长时,适当地延长采集周期,从而保证采集的播放数据不会过多,从而导致采集播放数据的接口被频繁调用而出错,或是在对播放数据数据进行分析处理时,占用的运行内存过大而导致处理设备崩溃。这样的设计能够避免上述情况可能带来的无法生成测试报告或是测试报告中数据错误,进而使测试报告没有参考价值。It should be noted that the file size and duration information of different code streams to be tested are usually different. For example, the duration information of the code streams to be tested for most movie audio and video is 2 hours, while some short audio and video code streams to be tested have The duration information of the stream is 20 minutes. In the embodiment of the present application, the collection period is set according to the duration information of the code stream to be tested. For example, when the sampling frequency is 10 times per second, the sampling period is 0.1S. This application does not make any adjustments to the specific value of the sampling period. The sampling period can be adjusted according to the actual application scenario. For example, when the length of the code stream to be tested is long, the collection period should be extended appropriately to ensure that the collected playback data will not be too much, resulting in frequent calls to the interface for collecting playback data, or errors in the playback When the data is analyzed and processed, the operating memory occupied is too large, which causes the processing device to crash. Such a design can avoid the failure to generate the test report or data errors in the test report that may be caused by the above-mentioned situation, thereby making the test report useless for reference.

S30,判断所述播放数据中是否存在故障数据。S30, judging whether there is fault data in the playing data.

S40,基于所述播放日志和所述判断的结果生成测试报告。S40. Generate a test report based on the playing log and the judgment result.

可选地,在本申请实施例中,所述播放数据包括图像数据、音频数据和心跳数据。Optionally, in this embodiment of the present application, the playing data includes image data, audio data and heartbeat data.

进一步可选地,在本申请实施例中,所述图像数据包括播放所述待测码流时的多张截图,所述音频数据中包括多个音频数据包。Further optionally, in this embodiment of the present application, the image data includes multiple screenshots when the code stream to be tested is played, and the audio data includes multiple audio data packets.

进一步可选地,在本申请实施例中,判断所述播放数据中是否存在故障数据具体为:Further optionally, in the embodiment of the present application, judging whether there is fault data in the playing data is specifically:

对所述多张截图进行对比,获得与所述多张截图对应的多个相似度,判断所述多个相似度中是否存在低于预设范围的所述相似度,若存在,则判定存在图像故障数据。若不存在,则判定不存在图像故障数据。Comparing the multiple screenshots, obtaining multiple similarities corresponding to the multiple screenshots, judging whether there is a similarity lower than a preset range among the multiple similarities, and if so, determining that there is Image glitch data. If not, it is determined that there is no image fault data.

判断所述多个音频数据包中是否存在空数据包,若存在,则判定存在音频故障数据。若不存在,则判定不存在音频故障数据。It is judged whether there is an empty data packet among the plurality of audio data packets, and if so, it is judged that there is audio fault data. If not, it is determined that there is no audio fault data.

判断所述心跳数据中,是否存在停止运行(Crash)数据或应用程序无响应(anr)数据,若存在,则判定存在心跳故障数据。若不存在,则判定不存在心跳故障数据。It is judged whether there is crash data or application non-response (anr) data in the heartbeat data, and if there is, it is judged that there is heartbeat failure data. If not, it is determined that there is no heartbeat fault data.

进一步地,当所述判断的结果中存在所述心跳故障数据时,在所述测试报告中显示设备故障。Further, when the heartbeat fault data exists in the result of the judgment, the device fault is displayed in the test report.

在本申请实施例中,所述心跳故障数据能够体现出,播放所述待测码流的播放设备或者投影设备是否发生了运行故障,例如停止运行(Crash)或应用程序无响应(anr)。通过这样的设计,本申请在进行待测码流的测试时,区分了是待测码流的解码和播放或投影设备的设备运行数据,这两类数据包含了导致未通过解码的两类原因。并且在测试报告中记录下具体的故障信息,由此,可以通过报告直观地判断出,是由于待测码流的解码出现了问题导致未通过解码,还是播放或投影设备的设备运行出现故障,进而导致的未通过解码。In the embodiment of the present application, the heartbeat failure data can reflect whether the playback device or the projection device playing the code stream to be tested has an operation failure, such as stop running (Crash) or application program not responding (anr). Through such a design, when testing the code stream to be tested, this application distinguishes between the decoding of the code stream to be tested and the device operation data of the playback or projection device. These two types of data include two types of reasons that lead to the failure of decoding . And record the specific failure information in the test report. From this, you can intuitively judge through the report whether it is due to a problem with the decoding of the code stream to be tested that the decoding failed, or the equipment operation of the playback or projection equipment is faulty. As a result, the decoding failed.

在本申请实施例中,可选地,相似度的预设范围,例如可以是但不限于8%-10%。在实际应用中,该预设范围可以根据实际应用场景的需要进行调整。In the embodiment of the present application, optionally, the preset range of the similarity may be, for example, but not limited to 8%-10%. In practical applications, the preset range can be adjusted according to the needs of practical application scenarios.

可选地,在本申请实施例中,基于所述播放日志和所述判断的结果生成测试报告具体为:Optionally, in this embodiment of the application, generating a test report based on the play log and the result of the judgment is specifically:

当所述判断的结果中,存在所述图像故障数据、所述音频故障数据和所述心跳故障数据中的任意一种,则在测试报告中显示未通过测试。否则,在测试报告中显示通过测试。When any one of the image fault data, the audio fault data and the heartbeat fault data exists in the result of the judgment, it will be displayed in the test report as failing the test. Otherwise, pass the test is shown in the test report.

将所述播放日志保存于所述测试报告中。Save the playing log in the test report.

应当说明的是,本申请实施例在所述测试报告中,所述播放日志中,记载有待测码流的名称和判断过程中数据处理记录,包括各种故障数据出现的时间、该判定所依据的播放数据,判定所依据的播放数据具体到:故障数据是图像故障数据、音频故障数据或者是心跳故障数据。当故障数据是图像故障数据时,记录下低于预设阈值的相似度所对应的截图。当故障数据是心跳故障数据时,记录下是停止运行(Crash)数据或应用程序无响应(anr)数据。由此,本申请实施例提供的码流测试方法所生成的测试报告,不仅包括了是否通过解码测试的信息提示,还会对测试过程中的具体数据进行记录,从而便于相关操作人员,基于该测试报告进行问题追溯,提高了测试结果的参考价值。It should be noted that, in the embodiment of the present application, in the test report, the play log records the name of the code stream to be tested and the data processing records during the judgment process, including the time when various fault data appeared, the judgment result Based on the playback data, the determination based on the playback data is specific: the fault data is image fault data, audio fault data or heartbeat fault data. When the fault data is image fault data, a screenshot corresponding to a similarity lower than a preset threshold is recorded. When the fault data is the heartbeat fault data, the recorded data is stop running (Crash) data or application program not responding (anr) data. Therefore, the test report generated by the code stream test method provided by the embodiment of the present application not only includes the information prompt of whether the decoding test is passed, but also records the specific data in the test process, so that it is convenient for relevant operators. The test report traces the problem and improves the reference value of the test results.

在本申请实施例中,利用每个待测码流名作为日志压缩包的名称,每个待测码流名可以包括有码流路径,从而进一步便于相关操作人员,基于该测试报告进行问题追溯,以及进一步提高了测试结果的参考价值。In the embodiment of this application, each code stream name to be tested is used as the name of the compressed log package, and each code stream name to be tested can include a code stream path, which further facilitates relevant operators to trace problems based on the test report , and further improved the reference value of the test results.

请结合参阅图2,为本申请实施例提供的码流测试装置100的一种方框示意图。Please refer to FIG. 2 , which is a schematic block diagram of a code stream testing device 100 provided in an embodiment of the present application.

所述装置包括:The devices include:

获取模块10,用于获取待测码流。The obtaining module 10 is used to obtain the code stream to be tested.

处理模块20,用于播放所述待测码流并采集播放所述待测码流时的播放数据,以及生成播放日志。The processing module 20 is configured to play the code stream to be tested, collect play data when playing the code stream to be tested, and generate a play log.

判断模块30,用于判断所述播放数据中是否存在故障数据。A judging module 30, configured to judge whether there is fault data in the playing data.

生成模块40,用于基于所述播放日志和所述判断的结果生成测试报告。A generating module 40, configured to generate a test report based on the playing log and the judgment result.

可以理解的是,本实施例中的各功能模块的具体操作方法可参照上述方法实施例中相应步骤的详细描述,在此不再重复赘述。It can be understood that, for specific operation methods of each functional module in this embodiment, reference may be made to the detailed description of corresponding steps in the foregoing method embodiments, and details are not repeated here.

本申请实施例还提供了一种可读存储介质,所述可读存储介质中存储有计算机程序,所述计算机程序被执行时实现上述码流测试方法。The embodiment of the present application also provides a readable storage medium, where a computer program is stored in the readable storage medium, and when the computer program is executed, the above code stream testing method is implemented.

由此,本申请实施例所提供的码流测试方法及装置,该方法通过获取待测码流,然后播放所述待测码流,采集播放所述待测码流时的播放数据,并生成播放日志,然后判断所述播放数据中是否存在故障数据,基于所述播放日志和所述判断的结果生成测试报告。通过该方法,能够便捷地对待测码流进行测试,获得高参考价值的测试报告。Therefore, the code stream testing method and device provided in the embodiments of the present application, the method obtains the code stream to be tested, and then plays the code stream to be tested, collects the playback data when playing the code stream to be tested, and generates Playing the log, and then judging whether there is fault data in the playing data, and generating a test report based on the playing log and the judgment result. Through this method, the code stream to be tested can be tested conveniently, and a test report with high reference value can be obtained.

在本申请所提供的实施例中,应该理解到,所揭露的装置和方法,也可以通过其它的方式实现。以上所描述的装置和方法实施例仅仅是示意性的,例如,附图中的流程图和框图显示了根据本申请的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现方式中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。In the embodiments provided in this application, it should be understood that the disclosed devices and methods may also be implemented in other ways. The apparatus and method embodiments described above are only illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show possible implementation architectures of systems, methods, and computer program products according to multiple embodiments of the present application, function and operation. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or part of code that includes one or more Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified function or action , or may be implemented by a combination of dedicated hardware and computer instructions.

以上所述仅为本申请的优选实施例而已,并不用于限制本申请,对于本领域的技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may be made to the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this application shall be included within the protection scope of this application.

Claims (10)

1.一种码流测试方法,其特征在于,所述方法包括:1. A code stream testing method is characterized in that the method comprises: 获取待测码流;Obtain the code stream to be tested; 播放所述待测码流,采集播放所述待测码流时的播放数据,并生成播放日志;Play the code stream to be tested, collect and play the playback data when playing the code stream to be tested, and generate a play log; 判断所述播放数据中是否存在故障数据;Judging whether there is faulty data in the playing data; 基于所述播放日志和所述判断的结果生成测试报告。A test report is generated based on the playing log and the judgment result. 2.根据权利要求1所述的码流测试方法,其特征在于,采集播放所述待测码流时的播放数据具体为:2. code stream test method according to claim 1, is characterized in that, the playback data when collecting and playing described code stream to be tested is specifically: 按照预设的采集周期,采集播放所述待测码流时的播放数据;According to the preset collection cycle, collect and play the playback data when the code stream to be tested is played; 其中,所述采集周期根据所述待测码流的时长信息设定。Wherein, the collection period is set according to the duration information of the code stream to be tested. 3.根据权利要求1所述的码流测试方法,其特征在于,所述播放数据包括图像数据、音频数据和心跳数据。3. The code stream testing method according to claim 1, wherein the playing data includes image data, audio data and heartbeat data. 4.根据权利要求3所述的码流测试方法,其特征在于,所述图像数据包括播放所述待测码流时的多张截图,所述音频数据中包括多个音频数据包;4. The code stream testing method according to claim 3, wherein the image data includes multiple screenshots when playing the code stream to be tested, and the audio data includes a plurality of audio data packets; 判断所述播放数据中是否存在故障数据具体为:Judging whether there is fault data in the playing data is specifically: 对所述多张截图进行对比,获得与所述多张截图对应的多个相似度,判断所述多个相似度中是否存在低于预设范围的所述相似度,若存在,则判定存在图像故障数据;Comparing the multiple screenshots, obtaining multiple similarities corresponding to the multiple screenshots, judging whether there is a similarity lower than a preset range among the multiple similarities, and if so, determining that there is image glitch data; 判断所述多个音频数据包中是否存在空数据包,若存在,则判定存在音频故障数据;Judging whether there is an empty data packet in the plurality of audio data packets, if there is, then determining that there is audio fault data; 判断所述心跳数据中,是否存在停止运行数据或应用程序无响应数据,若存在,则判定存在心跳故障数据。It is judged whether there is stop operation data or application non-response data in the heartbeat data, and if there is, it is judged that there is heartbeat failure data. 5.根据权利要求4所述的码流测试方法,其特征在于,基于所述播放日志和所述判断的结果生成测试报告具体为:5. The code stream testing method according to claim 4, characterized in that, generating a test report based on the play log and the result of the judgment is specifically: 当所述判断的结果中,存在所述图像故障数据、所述音频故障数据和所述心跳故障数据中的任意一种,则在测试报告中显示未通过测试;When any one of the image fault data, the audio fault data and the heartbeat fault data exists in the result of the judgment, it will be displayed in the test report as failing the test; 将所述播放日志保存于所述测试报告中。Save the playing log in the test report. 6.根据权利要求5所述的码流测试方法,其特征在于,当所述判断的结果中存在所述心跳故障数据时,在所述测试报告中显示设备故障。6 . The code stream testing method according to claim 5 , wherein when the heartbeat fault data exists in the result of the judgment, the device fault is displayed in the test report. 7 . 7.一种码流测试装置,其特征在于,所述装置包括:7. A stream testing device, characterized in that the device comprises: 获取模块,用于获取待测码流;The acquisition module is used to acquire the code stream to be tested; 处理模块,用于播放所述待测码流并采集播放所述待测码流时的播放数据,以及生成播放日志;A processing module, configured to play the code stream to be tested and collect playback data when playing the code stream to be tested, and generate a play log; 判断模块,用于判断所述播放数据中是否存在故障数据;A judging module, configured to judge whether there is faulty data in the playing data; 生成模块,用于基于所述播放日志和所述判断的结果生成测试报告。A generating module, configured to generate a test report based on the playing log and the judgment result. 8.根据权利要求7所述的码流测试装置,其特征在于,所述处理模块,还用于按照预设的采集周期,采集播放所述待测码流时的播放数据;8. The code stream testing device according to claim 7, wherein the processing module is further configured to collect and play the playback data when the code stream to be tested is played according to a preset collection period; 其中,所述采集周期根据所述待测码流的时长信息设定。Wherein, the collection period is set according to the duration information of the code stream to be tested. 9.根据权利要求7所述的码流测试装置,其特征在于,所述播放数据包括图像数据、音频数据和心跳数据。9. The code stream testing device according to claim 7, wherein the play data includes image data, audio data and heartbeat data. 10.一种可读存储介质,其特征在于,所述可读存储介质中存储有计算机程序,所述计算机程序被执行时实现权利要求1-6中任意一项所述的码流测试方法。10. A readable storage medium, wherein a computer program is stored in the readable storage medium, and when the computer program is executed, the code stream testing method according to any one of claims 1-6 is implemented.
CN201910601273.4A 2019-07-02 2019-07-02 A kind of code stream test method and device Pending CN110198480A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910601273.4A CN110198480A (en) 2019-07-02 2019-07-02 A kind of code stream test method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910601273.4A CN110198480A (en) 2019-07-02 2019-07-02 A kind of code stream test method and device

Publications (1)

Publication Number Publication Date
CN110198480A true CN110198480A (en) 2019-09-03

Family

ID=67755827

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910601273.4A Pending CN110198480A (en) 2019-07-02 2019-07-02 A kind of code stream test method and device

Country Status (1)

Country Link
CN (1) CN110198480A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112188192A (en) * 2020-11-16 2021-01-05 四川长虹电器股份有限公司 Code stream adaptability test method, system, computer equipment and storage medium
CN114025240A (en) * 2021-10-12 2022-02-08 山东百盟信息技术有限公司 Method and device for determining television equipment capability, storage medium and electronic device
CN114520900A (en) * 2020-11-19 2022-05-20 成都极米科技股份有限公司 Projection picture anti-shake method and device, anti-shake equipment and readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104850456A (en) * 2015-05-27 2015-08-19 苏州科达科技股份有限公司 Multi-process decoding method and multi-process decoding system
CN105025318A (en) * 2015-06-30 2015-11-04 北京奇艺世纪科技有限公司 Feedback method and device for abnormal log information of application program
EP3096229A1 (en) * 2014-01-14 2016-11-23 Entrix Co., Ltd. Application error detection method for cloud streaming service, and apparatus and system therefor
CN108769672A (en) * 2018-06-22 2018-11-06 四川九州电子科技股份有限公司 A kind of audio and video Auto-Test System and method instead of human perception

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3096229A1 (en) * 2014-01-14 2016-11-23 Entrix Co., Ltd. Application error detection method for cloud streaming service, and apparatus and system therefor
CN104850456A (en) * 2015-05-27 2015-08-19 苏州科达科技股份有限公司 Multi-process decoding method and multi-process decoding system
CN105025318A (en) * 2015-06-30 2015-11-04 北京奇艺世纪科技有限公司 Feedback method and device for abnormal log information of application program
CN108769672A (en) * 2018-06-22 2018-11-06 四川九州电子科技股份有限公司 A kind of audio and video Auto-Test System and method instead of human perception

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112188192A (en) * 2020-11-16 2021-01-05 四川长虹电器股份有限公司 Code stream adaptability test method, system, computer equipment and storage medium
CN114520900A (en) * 2020-11-19 2022-05-20 成都极米科技股份有限公司 Projection picture anti-shake method and device, anti-shake equipment and readable storage medium
CN114520900B (en) * 2020-11-19 2023-09-01 成都极米科技股份有限公司 Anti-shake method and device for projection picture, anti-shake device and readable storage medium
CN114025240A (en) * 2021-10-12 2022-02-08 山东百盟信息技术有限公司 Method and device for determining television equipment capability, storage medium and electronic device
CN114025240B (en) * 2021-10-12 2024-04-23 山东百盟信息技术有限公司 Method and device for determining television equipment capability, storage medium, and electronic device

Similar Documents

Publication Publication Date Title
CN108717393B (en) Application program testing method and mobile terminal
US9639412B1 (en) Application performance management tools with a service monitor for collecting network breadcrumb data
CN108984389B (en) Application program testing method and terminal equipment
US7904580B2 (en) Digital media player exposing operational state data
CN106294176B (en) The method and system that application failure positions in Mac OS systems
CN104063305A (en) Pressure testing method, device and system for intelligent terminal software
CN111309632A (en) Application program testing method and device, computer equipment and storage medium
CN110177300B (en) Program running state monitoring method and device, electronic equipment and storage medium
CN110198480A (en) A kind of code stream test method and device
CN112685306A (en) Test method, test device, user terminal and storage medium
CN113760721A (en) Page testing method and device
CN105578203B (en) Video file quality detecting system and method
CN111190791A (en) Application exception reporting method and device and electronic equipment
CN110569184B (en) Test method and terminal equipment
CN107885648B (en) Method and device for generating test report
CN113923443A (en) Network video recorder testing method and device and computer readable storage medium
CN105391602A (en) Data acquisition test method and device
US10691524B2 (en) Diagnostic system and method
CN110209581A (en) Trigger action analysis method and device based on application program
CN112995648B (en) Internet TV full-process fault diagnosis method, device and computing equipment
CN110471841B (en) A method, device, medium and electronic device for comparing drawing information
CN117519524A (en) Terminal application testing method and device, electronic equipment and storage medium
CN109960646A (en) Application testing method and terminal
US20210239737A1 (en) Annotated decode of oscilloscope signals
CN119052297B (en) Asset identification method, device, equipment, storage medium and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190903

RJ01 Rejection of invention patent application after publication