JPH0488426A - Program coverage measuring instrument - Google Patents

Abstract

PURPOSE:To objectively decide a program coverage by storing coverage information utilizing a branch instruction interruption and automatically calculating the rate of the number of instructions which are already executed according to the information. CONSTITUTION:A branch instruction interrupting means 30 holds the priority level of the run of a program including a branch instruction, a before-branch address, and an after-branch address by executing the branch instruction to initiate an internal interruption. Further, an after-branch address storage means 22 is stored with the after-branch address corresponding to the priority level and a coverage information storage means 23 is stored with a range, indicated by the before-branch address and an after-branch address corresponding to the priority level when a branch instruction interruption is initiated by the after-branch address storage means 22, as the coverage information. An instruction word analyzing means 25 obtains the addresses of all instruction words of a program to be evaluated on a main storage 4 and an editing output means 24 calculates the ratio of the instructions which are already executed from the addresses of the instruction words and the coverage information stored in the coverage information storage means 23. Consequently, the program coverage is automatically calculated.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention is utilized in an information processing system. In particular, the present invention relates to a program coverage measuring means for measuring the ratio of instructions that are executed in small numbers in a program to be evaluated.

〔overview〕

The present invention provides means for measuring program coverage, which objectively determines program coverage by storing coverage information using branch instruction interrupts and automatically calculating the ratio of the number of executed instructions based on this information. It has been made possible to do so.

[Conventional technology]

Conventionally, as a measure of the degree of evaluation of a program, evaluation items for the program to be evaluated were listed in advance, and the evaluation was completed after all of the evaluation items had been verified.

[Problem to be solved by the invention]

The disadvantages of this evaluation method are: ■ The creation of evaluation items often relies on individual experience and intuition, and the degree of debugging varies among individuals; ■ As the program grows, it becomes difficult to create evaluation items that cover all It is expected that some areas will not be evaluated as it will be difficult to do so.

SUMMARY OF THE INVENTION An object of the present invention is to provide a program coverage measuring device capable of automatically calculating a program coverage rate in order to eliminate such drawbacks.

[Means to solve the problem]

The present invention includes a main storage device in which a plurality of programs to be evaluated are stored, a central processing unit on which the programs to be evaluated are run, and an output device through which the program coverage rate calculated for each program to be evaluated is transmitted. In the program coverage measurement method having and a branch instruction interrupt section that holds a post-branch address and generates an internal interrupt for each of the priority levels, and branch instruction interrupt mode setting and cancellation means that instructs the branch instruction interrupt section to start and stop; A post-branch address storage unit that stores the post-branch address in correspondence with the priority level, and a pre-branch address notified from the branch instruction interrupt unit and the branch instruction stored in the post-branch address storage unit. Evaluation indicated by the post-branch address corresponding to the priority level at the time of interrupt (i) A comprehensive information storage unit that stores the range of the target program as comprehensive information, and the address of all instruction words of the target program in the main memory. a coverage ratio calculation unit that calculates the ratio of executed instructions from the address of the instruction word obtained by the instruction word analysis unit and the coverage information stored in the coverage information storage unit; The present invention is characterized by comprising a measurement result editing/output unit that edits the address of the instruction word that can identify the instruction word and the unexecuted instruction, and provides the edited address to the output device.

Here, it is also possible to include an external storage device and a cumulative file input/output control section that cumulatively stores the storage contents of the comprehensive information storage section in the external storage device.

Furthermore, the apparatus may further include a starting means for giving an instruction to start the cumulative file input/output control section at predetermined time intervals.

[Effect]

The branch instruction interrupt means generates an internal interrupt by holding the priority level of the program including the branch instruction, the pre-branch address, and the post-branch address before the first instruction of the branch machine is executed by executing the branch instruction. let Here, this internal interrupt can occur for each of one or more priority levels.

Further, the post-branch address storage means stores the post-branch address in correspondence with the priority level. With comprehensive information storage means,
The range indicated by the pre-branch address notified from the branch instruction interrupt means and the post-branch address already stored by the post-branch address storage means and corresponding to the priority level at the time of this branch instruction interrupt is stored as comprehensive information. Further, the instruction word analysis means obtains the addresses of all instruction words of the evaluation target program on the main memory. The measurement result editing output means calculates the ratio of executed instructions from the address of the instruction word obtained by the instruction word analysis means and the exhaustive information stored in the exhaustive information storage means, and also calculates the ratio of executed instructions and unexecuted instructions. Edit and output the address of the instruction word so that it can be identified.

〔Example〕

An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of this embodiment.

This embodiment includes an input device 1 through which input operations are performed, an input information analysis section 20, a coverage rate measurement control section 21, a post-branch address storage section 22, a coverage information storage section 23, a measurement result editing output control section 24, and an instruction Word analysis section 25, coverage rate calculation section 26, cumulative file person output control section 27, and automatic accumulation instruction section 28
a program coverage measuring device 2 including a program coverage measurement device 2, and a branch instruction interrupt that holds a priority level, a pre-branch address, and a post-branch address and generates an internal interrupt before the first instruction of the branch machine is executed by executing the branch instruction. A central processing unit 3 including a section 30, a main storage device 4 that stores an evaluation target program,
An output device 5 for outputting a measurement result list, an external storage device 6 in which a cumulative file exists for cumulatively storing the contents from the exhaustive information storage section 23, and an automatic accumulation instruction section 28 for obtaining an automatic accumulation interval. and a time device 7 referenced by.

As shown in FIG. 1, this embodiment includes a main storage device 4 in which a plurality of programs to be evaluated are stored, a central processing unit 3 on which the programs to be evaluated are run, and a calculation process for each program to be evaluated. In the program coverage measuring method, which includes an output device 5 through which the program coverage rate determined, the central processing unit 3 executes the branch instruction before the first instruction after the branch is executed. A branch instruction interrupt unit 30 is provided that holds priority levels, pre-branch addresses, and post-branch addresses related to the running of the included program, and generates internal interrupts for each of the priority levels, and is capable of starting and stopping this branch instruction interrupt unit 30. Input information analysis unit 2 which is a means for setting and canceling branch instruction interrupt mode that commands
0 and input device 1, and a post-branch address storage unit 22 that stores the post-branch address in correspondence with the priority level.
and the pre-branch address and post-branch address address notified from the branch instruction interrupt unit 30. A coverage information storage unit 23 that stores the range as coverage information, an instruction word analysis unit 25 that obtains the addresses of all instruction words of the evaluation target program on the main storage device 4, and an instruction word analysis unit 25 that obtains the addresses of all instruction words of the program to be evaluated on the main storage device 4. a coverage ratio calculation unit 26 that calculates the ratio of executed instructions from the address of the address and the mra information stored in the coverage information storage unit 23;
And a measurement result editing/output means that edits the address of the instruction word that can distinguish between executed and unexecuted instructions and provides it to the output device! 24, an external storage device 6, a cumulative file input/output control section 27 that cumulatively stores the storage contents of the comprehensive information storage section 23 in the external storage device 6, and a cumulative file input/output control section 2.
7 at predetermined time intervals.

Next, the operation of this embodiment will be explained.

The main storage device 4 contains the evaluation target program 41.421.4.
n exists, and the respective start addresses are Sl, S2,
, Sn addresses, and the end addresses are El, E2.
, , En addresses. The priority levels of the evaluation target programs 41, 421, and 40 are 1.2, , and n, respectively.

First, when measuring the evaluation target program 41, a branch instruction interrupt mode setting command for priority level number 1 is sent from the input device 1 to the coverage measurement control unit via the input information analysis unit 20 of the program coverage measurement device 2. 21 will be notified. Upon receiving this notification, the coverage measurement control unit 21 refers to the branch instruction interrupt mode status for each priority level that is internally managed by the branch instruction interrupt unit 30, and executes the branch life capital side-in mode at another priority level. It is possible to judge whether the cumulative file output control unit 2
7 to restore the contents of the cumulative file in the external storage device 6 to the exhaustive information storage section 23. The cumulative file input/output control section 27, which has completed the return upon receiving this command, notifies the coverage rate measurement control section 21 that the return has been completed. After this, the coverage measurement control unit 21 instructs the branch instruction interrupt unit 30 to set the priority level number 1 to the branch instruction interrupt mode, and also stores the branch address in the post-branch address storage unit 22 corresponding to the priority level number 1. Initialize the rear address with zero.

After this, the evaluation target program 41 in the main storage device 4
is activated and a branch instruction is executed, the central processing unit 3
The branch instruction interrupt unit 30 generates a branch instruction interrupt at the branch destination address to operate the coverage measurement control unit 21 of the program coverage measurement device 2.

The coverage measurement control unit 21 uses the branch instruction interrupt unit 3o to obtain the priority level number 1, the pre-branch address that is the address of the branch instruction itself in the evaluation target program 41, and the post-branch address that is the branch destination of this branch instruction. And the receiver takes the
The range from the post-branch address corresponding to priority level number 1 in the post-branch address storage unit 22 to the pre-branch address notified at the time of this branch instruction interrupt is stored as comprehensive information in the comprehensive information storage unit 23, and this branch The post-branch address notified at the time of instruction interrupt is stored in the post-branch address storage unit 22 in correspondence with priority level number 1.

In addition, at the time of the first branch instruction interrupt in which the post-branch address in the post-branch address storage unit 22 corresponding to the priority level number 1 of the amm measurement control unit 21 is initialized to zero,
The post-branch address notified from the branch instruction interrupt unit 30 is associated with the priority level number 1 and stored in the post-branch address storage unit 22.
The comprehensive information storage unit 2 only stores the comprehensive information in the comprehensive information storage unit 2.
It will not be stored within 3.

After performing the above operations, the coverage rate measurement control 121 instructs the branch instruction interrupt unit 30 to resume execution from the post-branch address in the evaluation target program 41, and enters the next branch instruction interrupt wait state.

FIG. 2 is a related diagram when comprehensive information is stored in the comprehensive information storage unit 23, taking as an example the routine from address PO to address P4 of the evaluation target program 41. In the evaluation target program 41, addresses PO1P1, P2,
P3 and P4 are the branch destination addresses of the branch instruction, and addresses BL82, B3, and B4 are the addresses of the branch instruction itself. First, when a branch instruction that branches to address PO of the evaluation target program 41 is executed, the branch instruction interrupt unit 30
A branch instruction interrupt occurs, and the coverage measurement control unit 2
1 works. The coverage measurement control unit 21 stores the post-branch address PO notified from the branch instruction interrupt unit 30 in the post-branch address storage unit 22 in correspondence with the priority level number 1 (here, the address PO before branching to the address PO is stored in the post-branch address storage unit 22). (The explanation of the procedure for storing exhaustive information is omitted.) Next, a branch instruction at address B1 of the evaluation target program 41 is executed, and a branch instruction interrupt occurs at address P1, which is the branch destination. At this time, the coverage rate measurement control unit 21 determines the range between the pre-branch address B1 notified from the branch instruction interrupt unit 30 and the address PO stored in the post-branch address storage unit 22 at this time (from address PO to (Up to address B1) Coverage information Ml
Further, the notified post-branch address P1 is stored in the post-branch address storage unit 22 in correspondence with the priority level number 1.

Similarly, branch instruction interrupts occur at addresses P2, P3, and P4 due to execution of branch instructions at addresses B2, B3, and B4, respectively, and coverage information M2, M3, and M4 are stored in coverage information memory by the coverage rate measurement control unit 21, respectively. 823.

FIG. 3 is a diagram showing an example of the storage contents of the exhaustive information storage 823.

The exhaustive information storage unit 23 stores addresses in bit units (address 0, bit number 0, address 100 → bit number 100), and the address of the executed instruction has the corresponding bit turned on. ). Therefore, since the start address of the evaluation target program 41 on the main memory is address 81 and the end address is address E1, the evaluation target program 41
The coverage information is the coverage information 23M stored in the range from bit number S1 to bit number E1 of the coverage information storage unit 230.
become. The coverage information 23M includes the #8 information M1, M2, M3, and goods shown in the explanation in FIG. 2, and all bits included in the coverage information M1, M2, M3, and M4 are in the ON state. be. In addition, comprehensive information 23M includes comprehensive information M
1. Similar to M2, M3, and M4, evaluation target program 4
The bit corresponding to the executed instruction area at 1 is stored in the on state.

Finally, the evaluation is completed, and a branch instruction interrupt mode cancellation command for priority level number 1 is notified from the input device 1 to the coverage measurement control section 21 via the input information analysis section 20. Upon receiving this notification, the coverage rate measurement control unit 21 instructs the cumulative file input/output control unit 27 to save the contents of the comprehensive information storage unit 23 to the cumulative file in the external storage device 6. The cumulative file input/output control section 27, which has completed the evacuation upon receiving this command, notifies the coverage rate measurement control section 21 of the evacuation completion.

After this, the coverage measurement control unit 21 selects the priority level number 1.
It instructs the branch instruction interrupt section 30 to cancel the branch instruction interrupt mode of , and also instructs the measurement result editing output control section 24 to edit and output the measurement results for the evaluation target program 41 . Upon receiving this instruction, the measurement result editing output control section 24 instructs the instruction word analysis section 25 to report the addresses of all instruction words from address 81 to address E1. The instruction word analysis section 25 interprets all instruction words from address 81 to address E1 and sequentially reports the addresses of all instruction words to the measurement result editing output control section 24. Thereafter, when the measurement result editing output control section 24 outputs the addresses of the instruction words sequentially reported by the instruction word analysis section 25 to the output device 5, the measurement result editing output control section 24 outputs the comprehensive information storage section corresponding to the address of the instruction words to be reported. Only the addresses of unexecuted instructions whose bits in 23 are off are output. Furthermore, the measurement result editing output control section 24 can know the number of executed instruction words and the total number of instruction words from the address of the instruction word successively reported by the instruction word analysis section 25 and the exhaustive information storage section 23. Instructs the coverage calculation unit 26 to calculate the ratio of the number of executed instruction words to the total number of instruction words, and outputs the calculation result to the output device 5 as the program coverage rate for the evaluation target program 41.

By the way, the contents of the exhaustive information storage section 23 (exhaustive information) are as follows.
When a branch instruction interrupt mode release command is input through the input device 1, it is saved in the cumulative information file. Separately, the automatic accumulation instruction section 28 instructs the accumulation file input/output control section 27 to accumulate exhaustive information at regular time intervals. With this instruction, the comprehensive information storage unit 2
It is possible to automatically save the comprehensive information of No. 3 to the cumulative file of the external storage device 6.

Note that since the post-branch address in the post-branch address storage unit 22 can be stored in correspondence with the priority level, it is possible to measure not only the evaluation target program 41 running at priority level 1 described above, but also multiple priority levels at the same time. It is possible to measure.

Furthermore, it is assumed that whether or not the branch instruction interrupt mode is being executed at another priority level is determined by referring to the branch instruction interrupt mode status for each priority level that is internally managed by the branch instruction interrupt unit 30. A branch instruction interrupt mode status for each priority level may be configured in the program coverage measuring device 2. Further, the comprehensive information may be configured to be classified by priority level, so that it is possible to eliminate whether or not the branch instruction interrupt mode is being executed at other priority levels.

Furthermore, in this embodiment, when a branch instruction interrupt mode cancellation command is input from the input device 1, the measurement results are edited and output, but since the exhaustive information is saved in the cumulative file, the measurement results cannot be edited. Edit output command is human-powered device 1
It may also be used when input from .

In addition to receiving a branch instruction interrupt mode release command and instructing accumulation by the automatic accumulation instruction unit 28, the operating system sends a termination notification of the program to be evaluated so that comprehensive information can be accumulated automatically at the end of the program to be evaluated. It may be configured so that it can be received from

〔Effect of the invention〕

As explained above, the present invention stores coverage information using branch instruction interrupts, and calculates the ratio of the number of executed instructions (program coverage rate) based on the information stored after execution of the program to be evaluated. By calculating the coverage of the program, the degree of coverage of the program can be determined objectively, and the quality measure of the program can be unified regardless of the number of years of experience.Furthermore, by outputting the addresses of unexecuted instructions, In the next evaluation step, evaluation can be performed focusing on unexecuted instructions, so
This has the effect of efficiently improving the quality of a program without modifying the program to be evaluated.

Furthermore, since the comprehensive information is configured to be accumulated in the external storage device, evaluation can be freely interrupted and continued, which has the effect of allowing efficient evaluation.

Furthermore, since the present invention is configured to automatically accumulate coverage information at fixed time intervals, coverage information will not be accumulated due to forgetting a branch instruction interrupt mode release command or updating the program coverage measurement device. , which has the effect of not requiring re-evaluation.

[Brief explanation of drawings]

FIG. 1 is a block diagram showing the configuration of an embodiment of the present invention. FIG. 2 is a related diagram when comprehensive information is stored in the comprehensive information storage unit. FIG. 3 is a diagram showing an example of the contents stored in the exhaustive information storage section. DESCRIPTION OF SYMBOLS 1... Input device, 2... Program coverage measurement device, 3... Central processing unit, 4-... Main storage device, 5...
- Output device, 6... external storage device, 7... time device.

Claims (1)

[Claims] 1. A main storage device in which a plurality of programs to be evaluated are stored, a central processing unit in which the programs to be evaluated run, and a program coverage rate calculated for each program to be evaluated. In the program coverage measurement method, the central processing unit determines the priority level of the program including the branch instruction before the first instruction after the branch is executed by executing the branch instruction. , a branch instruction interrupt section that holds a pre-branch address and a post-branch address and generates an internal interrupt for each of the above priority levels, and a branch instruction interrupt mode setting and command to start and stop this branch instruction interrupt section. a release means, a post-branch address storage unit that stores the post-branch address in correspondence with the priority level, and a pre-branch address notified from the branch instruction interrupt unit and the post-branch address stored in the post-branch address storage unit. a coverage information storage unit that stores, as coverage information, the range of the program to be evaluated indicated by the post-branch address corresponding to the priority level at the time of the branch instruction interrupt; an instruction word analysis unit that obtains an address; a coverage rate calculation unit that calculates a ratio of executed instructions from the address of the instruction word obtained by the instruction word analysis unit and the coverage information stored in the coverage information storage unit; A program coverage measurement device comprising: a measurement result editing/output unit that edits the address of an instruction word that can distinguish between completed instructions and unexecuted instructions and provides the edited instruction to the output device. 2. The program coverage measuring device according to claim 1, further comprising: an external storage device; and a cumulative file input/output control section that cumulatively stores the contents of the coverage information storage section in the external storage device. 3. The program coverage measuring device according to claim 2, further comprising a starting means for giving an instruction to start the cumulative file input/output control section at predetermined time intervals.