Summary of the invention
For people in correlation technique when using mobile terminal to read the multimedia document such as the word of screen display, image, because rocking the problem that causes reading quality sharply to descend, the invention provides a kind of method for displaying image and device of mobile terminal, to address this problem at least.
According to an aspect of the present invention, provide a kind of method for displaying image of mobile terminal, having comprised: when mobile terminal rocks, the directional information that the Real-time Obtaining mobile terminal rocks, velocity information and displacement information; Adopt directional information, velocity information and displacement information calculating to obtain the change in location offset data of the image of mobile terminal demonstration; Adopt the change in location offset data to compensate processing to the change in location parameter of image, and show the image after compensation deals.
The change in location offset data that adopts directional information, velocity information and displacement information calculating to obtain the image of mobile terminal demonstration comprises: adopt directional information, velocity information and displacement information Calculation of Three Dimensional change in location offset data; Use projection algorithm that three-dimensional position compensating for variations data transformation is two-dimensional position compensating for variations data.
By one of following algorithm, directional information, velocity information and displacement information are calculated as three-dimensional position compensating for variations data: representative point match algorithm, characteristic quantity track algorithm, bit plane matching algorithm.
Before adopting directional information, velocity information and displacement information Calculation of Three Dimensional change in location offset data, also comprise: the change in location track that obtains image; The corresponding data of directional information, velocity information and displacement information that slip chart the position of image variation track surpassed predetermined threshold are carried out the filtering operation.
Adopt the change in location offset data to compensate processing to the change in location parameter of image, and show that the image after compensation deals comprises: the change in location offset data is increased in the change in location parameter of image; Image after showing compensation deals on the screen that refreshes according to default refresh interval.
Showing on the screen that refreshes according to default refresh interval that the image after compensation deals comprises: judge that whether velocity information that mobile terminal rocks and/or displacement information are greater than predetermined threshold value; If greater than predetermined threshold value, show image in default framing mask scope.According to a further aspect in the invention, provide a kind of image display device of mobile terminal, having comprised: acquisition module is used for when mobile terminal rocks the directional information that the Real-time Obtaining mobile terminal rocks, velocity information and displacement information; Computing module is used for adopting directional information, velocity information and displacement information calculating to obtain the change in location offset data of the image of mobile terminal demonstration; Display module is used for adopting the change in location offset data to compensate processing to the change in location parameter of image, and shows the image after compensation deals.
Above-mentioned acquisition module comprises: the direction sensing unit is used for obtaining the directional information that mobile terminal rocks; The acceleration sensing unit is used for obtaining velocity information and the displacement information that mobile terminal rocks.
Above-mentioned computing module comprises: computing unit is used for adopting directional information, velocity information and displacement information Calculation of Three Dimensional change in location offset data; Converter unit is used for using projection algorithm that three-dimensional position compensating for variations data transformation is two-dimensional position compensating for variations data.
Said apparatus also comprises: the second acquisition module, for the change in location track that obtains image; Filtering module is used for slip chart the position of image variation track is surpassed the corresponding data execution of directional information, velocity information and the displacement information filtering operation of predetermined threshold.
Above-mentioned display module comprises: data updating unit, for the change in location offset data being increased to the change in location parameter of image; Display unit is used for the image after showing compensation deals on the screen that refreshes according to default refresh interval.By the present invention, the directional information that employing is rocked the mobile terminal that gets, velocity information and displacement information are processed, process with the change in location offset data positional change even parameter that draws, and the method for the image after the demonstration compensation deals, people have been solved in the correlation technique when using mobile terminal to read the multimedia document such as the word of screen display, image, because rocking the problem that causes reading quality sharply to descend, so make people be in still can be clear, stable under the state that rocks reading.Improved user's experience.
Embodiment
Hereinafter also describe in conjunction with the embodiments the present invention in detail with reference to accompanying drawing.Need to prove, in the situation that do not conflict, embodiment and the feature in embodiment in the application can make up mutually.
For solving in correlation technique people when using mobile terminal to read the multimedia document such as the word of screen display, image, because rocking the problem that causes reading quality sharply to descend, the present embodiment provides a kind of method for displaying image of mobile terminal, as shown in Figure 1, comprises the following steps:
Step S102, when mobile terminal rocks, the directional information that the Real-time Obtaining mobile terminal rocks, velocity information and displacement information;
Step S104 adopts directional information, velocity information and displacement information calculating to obtain the change in location offset data of the image of mobile terminal demonstration;
Step S106 adopts the change in location offset data to compensate processing to the change in location parameter of image, and shows the image after compensation deals.
Pass through the present embodiment, the directional information that employing is rocked the mobile terminal that gets, velocity information and displacement information are processed, process with the change in location offset data positional change even parameter that draws, and the method for the image after the demonstration compensation deals, people have been solved in the correlation technique when using mobile terminal to read the multimedia document such as the word of screen display, image, because rocking the problem that causes reading quality sharply to descend, so make people be in still can be clear, stable under the state that rocks reading.Improved user's experience.
When the user read displaying contents on mobile device at the volley, mobile terminal was shaken, and felt and rocked when obvious, and the user can or click the image stabilization Presentation Function that unlatching stable mode icon on screen start mobile terminal by button.
Preferably, in above-mentioned steps S102, the data that acceleration sensing unit that can be by mobile terminal self and direction sensing unit collection produce when rocking, the acquisition module of the image display device of mobile terminal can obtain real-time orientation, speed, displacement information.The acceleration sensing unit can gather mobile terminal acceleration of motion data in the horizontal and vertical directions, thus acquisition speed information and displacement information; The direction sensing unit is to gather current mobile terminal in the directional information in space, and with its transmission.Above-mentioned flow process specifically can be referring to Fig. 2, and two groups of data of acceleration sensing unit and direction sensing unit output can reflect the status information of current system.
Preferably, above-mentioned steps S104 may further include following processing:
(1) adopt above-mentioned directional information, velocity information and displacement information Calculation of Three Dimensional change in location offset data;
(2) use projection algorithm that three-dimensional position compensating for variations data transformation is two-dimensional position compensating for variations data.
In preferred implementation process, in above-mentioned processing procedure (1), the algorithm of Calculation of Three Dimensional change in location offset data can use one of the following algorithm in correlation technique to realize: representative point match algorithm, characteristic quantity track algorithm, bit plane matching algorithm.
Need to prove, can't realize and be presented at because of three-dimensional position compensating for variations data on the mobile terminal screen of two dimension, therefore, we need to be converted to three-dimensional position compensating for variations data two-dimensional position compensating for variations data, only have two-dimensional position compensating for variations data after conversion just can be input in the change in location compensating parameter and process.Existing mobile terminal is mostly the display screen of two dimension, if the mobile terminal of following 3-D display is generally used, just three-dimensional position compensating for variations data can be directly inputted in the change in location compensating parameter and process.Whether be converted to two-dimensional position compensating for variations data by three-dimensional position compensating for variations data and depend on the screen of mobile terminal and user's wish.The algorithm of Calculation of Three Dimensional change in location offset data is not limited to above-mentioned three kinds of algorithms, can select according to the arithmetic capability of processor in mobile terminal and the difference of storage capacity.Increased the method for displaying image that this processes the mobile terminal of process, hommization more can improve user's experience.
Preferably, in above-mentioned processing procedure (1) before, can also comprise following pretreatment process: the change in location track that obtains image; The corresponding data of directional information, velocity information and displacement information that slip chart the position of image variation track surpassed predetermined threshold are carried out the filtering operation.
In preferred implementation process, can come calculating location to be about to the track that changes by linear prediction algorithm, with the smothing filtering algorithm, described directional information, described velocity information and the corresponding data of described displacement information further are tending towards regulation, be about to obviously depart from real-time directional information, velocity information and displacement information the excessive data filtering of central value, in order to avoid affect the accuracy of subsequent calculations.For example, rocking of mobile terminal is straight path, can carry out filtering with departing from the excessive data of this track.By the enforcement of said method, guaranteed greatly the correctness of subsequent treatment.
Further describe above-mentioned preferred implementation below in conjunction with Fig. 3.
As shown in Figure 3, after the input data, at first to carry out pre-service, for example, obtain the change in location track of described image by linear prediction algorithm, adopt the smothing filtering algorithm that undesired signal is gone to filter out, by pre-service, can avoid interference the stability of effect of signals backoff algorithm, to input to through the signal that filters and (for example carry out Electronic Image Stabilization, representative point match algorithm, characteristic quantity track algorithm, bit plane matching algorithm etc.) device.Again the steady picture offset data of this device output is carried out two-dimensional process, adopt described change in location offset data to compensate processing to the change in location parameter of described image, and show the image after compensation deals.Above-mentioned treatment scheme process can comprise the following steps (step S302-step S306) as shown in Figure 3:
Step S302 carries out pre-service to data.In directional information, velocity information and the displacement information of input, often with sensor noise signal and space undesired signal.Noise signal is very large to the interference of backoff algorithm, even can cause the backoff algorithm misconvergence.The effect of pretreatment module, be exactly by initial position and the attitude information of equipment, based on the linear prediction trial and error procedure, will obviously depart from the excessive data filtering of central value in real-time motion and position data, then by the balance filtering algorithm, data further are tending towards regulation.Can guarantee greatly so surely correct the and convergence as algorithm.
Step S304 calculates offset data.Electronic Image Stabilization is the status information of rocking in order to calculate present equipment, and the offset data synchronometer is calculated.And then by projection algorithm, converse the offset data of two dimension.Electronic Image Stabilization is at present general RPM (representative point match algorithm), FTA (characteristic quantity track algorithm), a BPM (Bit-plane matching) etc.Wherein, Electronic Image Stabilization can be representative point match algorithm (RPM), characteristic quantity track algorithm (FTA), Bit-plane matching (BPM) etc.Except above-mentioned algorithm, those skilled in the art also can calculate according to other related algorithms.
Step S306, the image after the demonstration compensation deals.Display module begins the dynamic refresh screen display after getting compensated information, refresh rate is considered the identification situation of human eye, for example, and generally greater than 70 frame/seconds.Simultaneously, consider the scope impact of frame, need first to specify a stable frame scope according to present shaking degree, effective information that needing to avoid demonstration moves to beyond on-screen display (osd) area because compensate for displacement applies.The setting of this frame is also dynamic synchronization.
Preferably, above-mentioned steps S106 may further include following processing:
(1) the change in location offset data is increased in the change in location parameter of image;
(2) image after showing compensation deals on the screen that refreshes according to default refresh interval.
In above-mentioned processing procedure (2), this processing procedure can also comprise: judge that whether velocity information that mobile terminal rocks and/or displacement information are greater than predetermined threshold value; If greater than predetermined threshold value, show image in default framing mask scope.
In preferred implementation process, the speed that refreshes is considered the identification situation of human eye, the refresh rate of an acquiescence can just be set in advance, but this refresh rate is not what fix, also can arrange with reference to difference custom and the different wish of different people.Some user wishes brush screen fast, and reading that like this can continous-stable can tune up considering carefully of refreshing; And some user may not need too fast brush screen, as long as can see clearly, speed can be slowed down.When greater than predetermined threshold value, image can show in default frame scope, if moving range is larger, exceeded the frame that can show, downscaled images, will be presented in default frame scope by image, and the user can amplify the information in the frame scope voluntarily.Adding of said method, what make this mobile terminal has surely obtained larger lifting as performance, can satisfy the different demands of different user.
Fig. 4 is the structured flowchart according to the image display device of the mobile terminal of the embodiment of the present invention; As shown in Figure 4, the image display device of this mobile terminal comprises: the first acquisition module 10 is used for when mobile terminal rocks the directional information that the Real-time Obtaining mobile terminal rocks, velocity information and displacement information; Computing module 20 is connected with the first acquisition module 10, is used for adopting directional information, velocity information and displacement information calculating to obtain the change in location offset data of the image of mobile terminal demonstration; Display module 30 is connected with computing module 20, is used for adopting the change in location offset data to compensate processing to the change in location parameter of image, and shows the image after compensation deals.
Preferably, as shown in Figure 5, above-mentioned the first acquisition module can comprise: direction sensing unit 102 is used for obtaining the directional information that mobile terminal rocks; Acceleration sensing unit 104 is used for obtaining velocity information and the displacement information that mobile terminal rocks.
Preferably, as shown in Figure 5, above-mentioned computing module can comprise: computing unit 202 is used for adopting directional information, velocity information and displacement information Calculation of Three Dimensional change in location offset data; Converter unit 204 is used for using projection algorithm that three-dimensional position compensating for variations data transformation is two-dimensional position compensating for variations data.
Preferably, as shown in Figure 5, above-mentioned display module can comprise: data updating unit 302, for the change in location offset data being increased to the change in location parameter of image; Display unit 304 is used for the image after showing compensation deals on the screen that refreshes according to default refresh interval.
Preferably, as shown in Figure 5, the image display device of above-mentioned mobile terminal can also comprise: the second acquisition module 40, can be connected with the first acquisition module 10, and be used for obtaining the change in location track of image; Filtering module 50 is connected between the first acquisition module 10 and computing module 20, is used for slip chart the position of image variation track is surpassed the corresponding data execution of directional information, velocity information and the displacement information filtering operation of predetermined threshold.
Further describe above-mentioned preferred implementation below in conjunction with an example.
The mobile terminal of most has all carried industry very ripe acceleration sensing unit and direction sensing unit as smart mobile phone, PAD, e-book etc.Particularly the android mobile phone, require the above-mentioned standard configuration that is configured to.Acceleration sensing unit (be equivalent to above-mentioned acceleration sensing unit 104) is used for surveying mobile device self-acceleration parameter at the volley.Simultaneously can according to acceleration and surrounding time, calculate movement velocity roughly.Direction sensing unit (be equivalent to above-mentioned direction sensing unit 102) also is electronic compass, and this equipment is to obtain the directional information of current mobile device by orientation, perception magnetic field of the earth.The cooperation of these two kinds of equipment just can realize obtaining of mobile device orientation and velocity information, that is to say, can simulate gyrostatic function.This function is the basis of steady picture.After getting sensing data, sensing data is input in software servo module (being equivalent to above-mentioned the second acquisition module 40, filtering module 50 and computing module 20), by the software servo module, sensing data is processed, and result is transported to display module (be equivalent to above-mentioned on carry out display module 30) shows.This apparatus structure specifically can be referring to Fig. 6.
The image display device of the present embodiment can get present mobile device real-time orientation and/or velocity information in rocking.If realize that demonstration is stable, just need image display device to give display module with compensation by Electronic Image Stabilization, the exercise data of output compensation for example needs to compensate how many displacement datas to the opposite direction of rocking.Due to rocking on three-dimensional of mobile device, the data that get are also three-dimensional through calculating, and be to show on two dimensional surface, so image display device also needs the offset data of three-dimensional is changed by projection algorithm the offset data that claims two dimension, sends to display module.The display module of mobile terminal joins offset data in the change in location parameter that shows image after receiving offset data, and the refresh interval of setting with the user comes dynamic refresh.Finally realize still can stablizing the demonstration image under mobile device rocks situation.
In sum, by above-described embodiment provided by the invention, signal (can effectively simulate the function of gyroscope system) by the acceleration sensing unit that carries on hand-held mobile terminal and direction sensing unit, processing through Electronic Image Stabilization, realize handheld device in the process of rocking, the method that screen display is stable.Solve the problem that causes reading quality sharply to descend because rocking, given people the experience with electronic reading in better motion.And realize that cost is lower, power consumption is less, is convenient to commercialization and uses.
obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention or each step can realize with general calculation element, they can concentrate on single calculation element, perhaps be distributed on the network that a plurality of calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in memory storage and be carried out by calculation element, and in some cases, can carry out step shown or that describe with the order that is different from herein, perhaps they are made into respectively each integrated circuit modules, perhaps a plurality of modules in them or step being made into the single integrated circuit module realizes.Like this, the present invention is not restricted to any specific hardware and software combination.
The above is only the preferred embodiments of the present invention, is not limited to the present invention, and for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.