WO2011069435A1 - Procédé et dispositif terminal pour commande d'opération d'objet d'opération - Google Patents

Procédé et dispositif terminal pour commande d'opération d'objet d'opération Download PDF

Info

Publication number
WO2011069435A1
WO2011069435A1 PCT/CN2010/079507 CN2010079507W WO2011069435A1 WO 2011069435 A1 WO2011069435 A1 WO 2011069435A1 CN 2010079507 W CN2010079507 W CN 2010079507W WO 2011069435 A1 WO2011069435 A1 WO 2011069435A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
image
operation direction
terminal device
window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2010/079507
Other languages
English (en)
Chinese (zh)
Inventor
张渊毅
刘俊峰
王茜莺
贺志强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Beijing Lenovo Software Ltd
Original Assignee
Lenovo Beijing Ltd
Beijing Lenovo Software Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN200910241771.9A external-priority patent/CN102087571B/zh
Priority claimed from CN200910242423.3A external-priority patent/CN102096517B/zh
Application filed by Lenovo Beijing Ltd, Beijing Lenovo Software Ltd filed Critical Lenovo Beijing Ltd
Priority to US13/513,948 priority Critical patent/US9836139B2/en
Publication of WO2011069435A1 publication Critical patent/WO2011069435A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • the present invention relates to a handheld terminal device, and more particularly to a method and a terminal device for operating control of an operation object.
  • handheld devices More and more handheld devices are pursuing thin and large screens, and touch technology is becoming more widely used on handheld devices. As the computing power of handheld devices has increased, it has become common to display 3D graphics, such as street view maps and stereoscopic menu displays.
  • panning and rotation are two common modes of operation that can be done by touch.
  • only one operation mode is usually supported at a time, that is, only a pan operation or a rotation operation can be performed. If you want to do another type of operation, you must switch, otherwise the operation will be ambiguous.
  • FIG. 1 it is an effect diagram of a pan operation performed by using a touch screen thereof in an existing handheld device.
  • FIG. 2 it is an effect diagram of a rotation operation of a touch panel using an existing handheld device.
  • the panning operation and the rotation operation cannot be performed simultaneously. If the effect of both translation and rotation is to be achieved, the translation operation must be performed, after the operation object is translated to the predetermined position, and then switched to the rotation operation mode, the rotation operation is performed. The object is then rotated at the position to which the operational object is translated.
  • the technical problem to be solved by the present invention is to provide a method and a terminal device for realizing operation control of an operation object simultaneously performed by two operations, which can realize an operation effect in which two operations are simultaneously performed.
  • the technical problem to be solved by the present invention is to provide a terminal device and an input method, which do not affect the display effect of the user screen when implementing touch control.
  • an embodiment of the present invention provides a method for controlling operation of an operation object, including: acquiring a first operation direction and a second operation direction of an operation object; determining the first operation direction and the first The operation corresponding to the direction combination of the two operation directions; the operation is performed on the operation object.
  • the step of determining an operation corresponding to a direction combination relationship between the first operation direction and the second operation direction is: determining the first operation direction and the second according to an operation type of the operation object The direction of the direction of operation combines the operations corresponding to the relationship.
  • the operation type of the operation object is: when the operation of the stereo operation object is performed, determining an operation corresponding to the direction combination relationship between the first operation direction and the second operation direction according to the operation type of the operation object
  • the step is specifically: when the first operation direction and the second operation direction are the same, determining that the operation is: a translation operation of the stereoscopic operation object in the first operation direction or the second operation direction Or when the first operation direction and the second operation direction are opposite, the vertical line of the trajectory line formed by the first operation direction and the second operation direction is rotated for the axis.
  • the operation type of the operation object is: when the operation of the plane operation object is performed, determining, according to the operation type of the operation object, an operation corresponding to the direction combination relationship of the first operation direction and the second operation direction
  • the step is specifically: when the first operation direction and the second operation direction are the same, determining that the operation is: the planar operation object is in the first operation direction or the second operation direction a panning operation; or when the first operating direction and the second operating direction are opposite, determining that the operation is: an overall zooming operation of the planar operating object.
  • the operation type of the operation object is: when the operation of the window operation object is performed, determining an operation corresponding to the direction combination relationship between the first operation direction and the second operation direction according to the operation type of the operation object
  • the step is specifically: when the first operation direction and the second operation direction are the same first direction, determining that the operation is: an opening operation of the window operation object; or determining an operation object with the window operation
  • the operation of the opposite direction of the opening operation is: the closing operation of the window operation object; or when the first operation direction and the second operation direction are the same second direction, determining that the operation is:
  • the operation of maximizing the operation of the window operation object; or determining the operation in the opposite direction to the maximum operation of the window operation object is: a reduction operation of the window operation object; wherein the first direction and the second direction are different.
  • determining that the operation is a first operation
  • when the first operation direction and the second operation direction are opposite determining The operation is the second operation.
  • the method further includes: selecting a third operation of an positioning point on the operation object; performing a first operation away from the positioning point with respect to the positioning point, performing amplification with respect to the positioning point .
  • An embodiment of the present invention further provides a terminal device, including a housing, a first operating unit disposed on the housing, further comprising: a second operating unit disposed on the housing; the first operation a unit, configured to acquire a first operation direction of an operation object, a second operation unit, configured to acquire a second operation direction of the operation object, and a processing unit, configured to determine the first operation direction and the first An operation corresponding to the direction combination relationship of the two operation directions; an operation execution unit, configured to perform the operation on the operation object, and output the execution result of the operation output.
  • the processing unit includes: a first processing subunit, configured to determine an operation type of the operation object according to an attribute feature of the operation object; and a second processing subunit, configured to operate according to the operation object And determining an operation corresponding to a combination of directions of the first operation direction and the second operation direction.
  • the first processing sub-unit determines that the operation type of the operation object is: when the operation is performed on the stereoscopic operation object, the second processing sub-unit is specifically configured to: in the first operation direction and the first When the two operation directions are on the same line and are the same, the operation is determined as: a translation operation of the stereoscopic operation object in the first operation direction or the second operation direction; or in the first operation direction and When the second operation direction is opposite, the vertical line of the trajectory line formed by the first operation direction and the second operation direction is rotated as an axis.
  • the first processing sub-unit determines that the operation type of the operation object is: when the operation of the planar operation object is performed, the second processing sub-unit is specifically configured to: in the first operation direction and the first When the two operation directions are the same, determining that the operation is: a translation operation of the planar operation object in the first operation direction or the second operation direction; or in the first operation direction and the second When the operation direction is reversed, it is determined that the operation is: an overall enlargement operation of the planar operation object.
  • the first processing sub-unit determines that the operation type of the operation object is: when the window operation object is operated, the second processing sub-unit is specifically configured to: in the first operation direction and the first When the second direction of operation is the same, the operation is determined as: An opening operation of the image; or an operation of determining a direction opposite to the opening operation of the window operation object is: a closing operation of the window operation object; or the same in the first operation direction and the second operation direction In the case of the two directions, the operation is determined to be: a maximization operation of the window operation object; or an operation of determining a direction opposite to the maximization operation of the window operation object is: a reduction operation of the window operation object.
  • the first operating unit is disposed at a first position of the housing; and the second operating unit is disposed at a second position of the housing opposite the first position.
  • the operation when the first operation direction is the same as the second operation direction, the operation is a first operation; when the first operation direction is opposite to the second operation, the operation is a second operation. operating.
  • the first operation unit includes: an image collection unit; and a transparent window disposed on the image collection channel of the image collection unit, the transparent window being away from the image collection unit a surface is spaced apart from the image collecting unit to form a space; wherein the image collecting unit is configured to collect an image when the pointing object contacts the first surface of the transparent window, and the image is
  • the processing unit is configured to calculate a trajectory of the pointing object according to the image, and acquire a first operating direction of the operating object according to the trajectory.
  • the first operating unit further comprises: at least one illuminating device for illuminating light into the space; the illuminating device and the image concentrating unit are located on the same side of the first surface.
  • the image collection unit has a shooting mode or a positioning mode, and when the image collecting unit operates in the positioning mode, the lighting device is in an activated state.
  • the illuminating device is fixedly disposed, and the illuminating direction is toward the transparent window.
  • the illuminating device is fixedly disposed, and the first operating unit further includes an optical device disposed in a light emitting direction of the illuminating device for guiding light emitted by the illuminating device to the space.
  • the illuminating device is fixedly disposed, and the illuminating device is an annular illuminator disposed around the image concentrating unit.
  • the illuminating device is fixedly disposed in the transparent window at one end of the transparent window, and the illuminating direction is toward the other end of the transparent window.
  • the illuminating device is adjustable, and the illuminating device comprises: an illuminating unit; an angle adjusting module, connected to the illuminating unit, configured to work on the positioning modulating unit in the image concentrating unit In the formula, the illuminator is adjusted to transmit the illuminant to the space.
  • the illuminating device is adjustable, and the illuminating device comprises: an illuminating unit; an optical device, configured to adjust a ray path of the illuminating body when the image concentrating unit operates in a positioning mode, so that The illuminator transmits light to the space, and when the image concentrating unit operates in a shooting mode, adjusts a ray path of the illuminator to cause the illuminator to transmit light to a space outside the transparent window.
  • the optical device when the image collecting unit is operated in the positioning mode, the optical device is located on a light path of the illuminant, and the light emitted by the illuminating body is emitted into the space through the illuminant.
  • the optical device When the image collecting unit operates in the shooting mode, the optical device is located outside the light path of the light emitting body, and the light emitted by the light emitting body is emitted to the outside through the transparent window.
  • the second operation unit includes: an image collection unit, and a transparent window disposed on the image collection channel of the image collection unit, the transparent window being away from the image collection unit a surface is spaced apart from the image collecting unit to form a space; wherein the image collecting unit is configured to collect an image when the pointing object contacts the first surface of the transparent window, and The processing unit is configured to calculate a trajectory of the pointing object according to the image, and acquire a second operating direction of the operating object according to the trajectory.
  • An embodiment of the present invention further provides a method for controlling operation of an operation object, the operation object including at least one display object, comprising: determining a priority of the display object; receiving a first operation direction and the second to the display object An instruction to operate the direction; when the first operation direction and the second operation direction are opposite, display information of the current priority of the display object and display information lower than the current priority are displayed.
  • the embodiment of the present invention further provides a terminal device, including: a storage unit, configured to store an operation object including at least one display object; a processing unit, configured to determine a priority of the display object; An operation direction and a second operation direction instruction; when the first operation direction and the second operation direction are opposite, generating display information indicating a current priority of the display object and an instruction lower than a current priority display information a display unit, configured to display display information of the display object according to the instruction.
  • a terminal device including: a storage unit, configured to store an operation object including at least one display object; a processing unit, configured to determine a priority of the display object; An operation direction and a second operation direction instruction; when the first operation direction and the second operation direction are opposite, generating display information indicating a current priority of the display object and an instruction lower than a current priority display information
  • a display unit configured to display display information of the display object according to the instruction.
  • An embodiment of the present invention further provides a terminal device, including: a housing; a main board disposed in the housing; an operation unit disposed on the housing and connected to the main board; and being disposed in the housing and the a processing unit connected to the motherboard; wherein the operating unit comprises: an image collection And a transparent window disposed on the image collection channel of the image collection unit, the transparent window being spaced apart from the image collection unit by a distance from the first surface of the image collection unit, forming a
  • the image collection unit is configured to collect an image when the pointing object contacts the first surface of the transparent window; and the processing unit is configured to calculate a trajectory of the pointing object according to the image And generating a corresponding input instruction according to the trajectory.
  • An embodiment of the present invention further provides an input method, which is applied to the terminal device, and the method includes: collecting an image when the pointing object contacts the first surface of the transparent window; and calculating the pointing according to the image The trajectory of the object, and corresponding input instructions are generated according to the trajectory.
  • the first operation direction and the second operation direction of an operation object are simultaneously acquired, and according to the combination relationship of the first operation direction and the second operation direction, the corresponding operation is determined, and two operations are simultaneously performed. And can get the effect of the two operations performed at the same time.
  • the existing image collection unit is used to capture the image of the pointing object on the transparent window surface, and then the analysis is performed to determine the position of the pointing object, which does not need to add additional equipment, realizes low cost, and is very important for small portable devices. .
  • FIG. 1 is an effect diagram of a panning operation using a touch screen thereof in a conventional handheld device
  • FIG. 2 is an effect diagram of a rotating operation using a touch screen thereof in a conventional handheld device
  • FIG. 3 is an operation control of an operation object of the present invention Method flow chart
  • FIG. 4 is a structural diagram of a terminal device of the present invention.
  • FIG. 5 is a schematic diagram of an operation direction of the terminal device shown in FIG. 4 performing an operation on an operation object
  • FIG. 6 is an operation effect diagram of the operation object shown in FIG. 5;
  • Figure 7 is a schematic illustration of the operation direction of another operation performed by the terminal device of Figure 4 on an operation object
  • FIG. 8 is an operation effect diagram of the operation object shown in FIG. 7;
  • FIG. 9 is a schematic diagram of the operation direction and opening of the terminal device shown in FIG. 4 to the address book operation object;
  • FIG. 10 is a schematic diagram of the operation of the terminal device shown in FIG.
  • FIG. 11 is a schematic diagram showing a relative positional relationship between a transparent window and an image collection unit according to an embodiment of the present invention;
  • FIG. 12 to FIG. 15 are schematic diagrams showing possible relative positional relationships between a light-emitting device, an image collection unit, and a transparent window when a light-emitting device having a fixed setting is provided in an embodiment of the present invention
  • FIG. 16 is a schematic diagram showing a relative positional relationship between a light-emitting device, an image collecting unit, and a transparent window in a normal imaging mode when an adjustable light-emitting device is provided in the embodiment of the present invention
  • FIG. 16 when an adjustable illuminating device is provided, in a positioning mode, a schematic diagram of a relative positional relationship between the illuminating device, the image concentrating unit, and the transparent window.
  • the method for controlling the operation of the operation object of the present invention includes:
  • Step 31 Obtain a first operation direction and a second operation direction of an operation object.
  • Step 32 Determine an operation corresponding to a direction combination relationship between the first operation direction and the second operation direction;
  • Step 33 Perform the operation on the operation object.
  • the method simultaneously determines the first operation direction and the second operation direction of an operation object, and determines a corresponding operation according to the combination relationship of the first operation direction and the second operation direction, thereby realizing two operations simultaneously.
  • the foregoing step 32 determines an operation corresponding to the direction combination relationship between the first operation direction and the second operation direction according to the operation type of the operation object.
  • the operation type of the operation object may include: operations on the stereo operation object, operations on the planar operation object, or operations on the window operation object, but are not limited thereto, and may also perform other operation objects according to specific requirements.
  • the definition of the operation in all directions, but the implementation is similar to the operation types of these kinds of operation objects.
  • the operation type of the operation object is: the operation of the stereoscopic operation object
  • the step of determining the operation corresponding to the direction combination relationship of the first operation direction and the second operation direction according to the operation type of the operation object Specifically for the following situations:
  • the trajectory line formed by the second operation direction is parallel and the direction is the same, or the trajectory line is considered to be parallel by the system, that is, the trajectory of the first operation direction and the second operation direction may have a certain angle, but after the system processes If the operation is parallel, determining that the operation is: a translation operation of the stereoscopic operation object in the first operation direction or the second operation direction;
  • the operation is: in the first operation
  • first operation direction and the second operation direction are not strictly in the X-axis or Y-axis direction, as long as the first operation
  • the operation direction and the second operation direction may be the same in the same direction, such as the direction of the angle bisector along the X axis and the Y axis, and the angle bisector of the angle bisector and the X axis, or the angle bisector and the Y axis
  • the direction of the angle bisector, and so on, all operations in the same direction are possible.
  • the operation is: performing a vertical line of the trajectory line formed by the first operation direction and the second operation direction as an axis
  • the rotation operation ie, the trajectory lines formed by the first operation direction and the second operation direction are parallel or approximately parallel, and the directions are opposite, wherein approximately parallel means that the trajectories of the first operation direction and the second operation direction may have a certain angle, but the system It is considered to be parallel; for example, the perpendicular line of the trajectory line formed by the first operation direction and the second operation direction is an axis, a rotation operation of the first operation direction or a rotation operation of the second operation direction.
  • the operation is: the stereo operation The rotation operation of the object in the first operation direction centered on the X axis or the rotation operation centered on the Y axis in the second operation direction;
  • the vertical operation object rotates with the perpendicular line of the trajectory line formed by the first operation direction and the perpendicular line of the trajectory line formed by the second operation direction as the axis, for example, the vertical line of the trajectory line formed by the first operation direction is the axis Rotation of the operation direction while rotating the second operation direction with the perpendicular line of the trajectory line formed by the second operation direction as the axis;
  • the operation is: centering on the X-axis Rotation in the first operational direction while rotating in the second operational direction centered on the Y axis;
  • the axis rotates in the forward direction; the axis rotates in the forward direction;
  • the axis rotates in the negative direction; the axis rotates in the negative direction;
  • the X-axis and the ⁇ axis in Table 3 can be defined as components on the X-axis and the ⁇ -axis in any two directions of different dimensions.
  • the system maps the curves to a straight line for processing.
  • the specific mapping method may be: using a start point and an end point of the track to determine a straight line, or mapping the curve to a plurality of consecutive straight lines, and processing in sequence.
  • the operation type of the operation object is: the operation of the planar operation object, determining the operation corresponding to the direction combination relationship of the first operation direction and the second operation direction according to the operation type of the operation object Specifically for the following situations:
  • the translation of the plane operation object if the plane operation object is a webpage or a plane image, the webpage is selected in the same direction by the operation of the first operation direction and the operation of the second operation direction, and the webpage is in accordance with the The operation direction and the second operation direction are moved to realize the function of the scroll bar on the webpage when the webpage is displayed on the small screen of the handheld device.
  • the system detects the operation in the first operation direction and the operation in the second operation direction, the webpage is moved along the first operation direction and the second operation direction, and the click trigger operation corresponding to the operation in the first operation direction is ignored, thereby being solved The problem of a webpage link being triggered by mistake.
  • the first operation direction is: from the X-axis negative direction to the X-axis positive direction (that is, from the user's point of view, from left to right), and the second operation direction is: from the X-axis positive direction to the X-axis negative direction. (from the user's point of view, from right to left), representing the overall magnification of the planar operation object; or
  • the first operating direction is: from the negative Y-axis to the positive Y-axis (ie from bottom to top from the user's point of view), and the second operating direction is: from the positive Y-axis to the negative Y-axis ( That is, from the user's point of view, from top to bottom), representing the overall magnification of the planar operation object; or
  • the first operational direction is: a first direction along the diagonal of the X-axis and the Y-axis (from the user's point of view, from the lower left to the upper right), and the second operational direction is: along the X-axis and the Y-axis
  • the second direction of the diagonal represents the overall magnification operation of the planar operation object
  • the combination of the directions of the first operational direction and the second operational direction is not limited to these, and as long as the directions are opposite, the overall amplification operation can be represented.
  • determining an operation opposite to an overall enlargement operation direction of the planar operation object is: an overall reduction operation of the planar operation object;
  • the first operation direction is: from the positive X-axis to the negative X-axis (from the user's point of view, right to left)
  • the second operation direction is: from the X-axis negative direction to the X-axis positive direction (that is, from the user's point of view, from left to right), representing the overall reduction of the planar operation object;
  • the first operational direction is: from the positive Y-axis to the negative Y-axis (ie from top to bottom from the user's point of view), while the second operational direction is: from the negative Y-axis to the positive Y-axis Toward (ie, from the user's point of view, from bottom to top), representing the overall reduction of the planar operation object;
  • the first operational direction is: a second direction along the diagonal of the X-axis and the Y-axis (from the user's point of view, from the upper right to the lower left), and the second operational direction is: along the X-axis and The first direction of the diagonal of the Y-axis (from the user's point of view, from the lower left to the upper right), represents the overall reduction operation of the planar operation object;
  • the reduction operation of the planar operation object is not limited to the above-described combination of the direction of the first operation direction and the second operation direction, and the operation of all the directions opposite to the overall enlargement operation can be defined as the overall reduction operation.
  • the rotation operation of the plane operation object on the plane may be defined, and the combination relationship between the first operation direction and the second operation direction corresponding to the rotation operation may be different from the direction of the operation defined above. No longer.
  • local enlargement can also be implemented on the planar operation object: if the operation operation of the second operation direction can be performed only on the planar operation object, that is, the planar operation object is positioned by the second operation The portion to be partially enlarged is subjected to movement in the second operational direction to achieve partial enlargement of the planar operation object.
  • the specific implementation process of the local operation of the planar operation object is as follows: generating a partial amplification control point; correspondingly generating a partial amplification area according to the partial amplification control point; and controlling the position of the partial amplification control point by the second operation direction; The display content of the control point is enlarged and displayed in the partial enlargement area.
  • the user operation can be prevented, and the problem of false triggering can be avoided.
  • first operation direction and the second operation direction are both positively along the X axis and the X axis are positive, which represents an open program operation; of course, the combination relationship between the first operation direction and the second operation direction is not limited thereto, and may be Any other direction of operation in the same direction.
  • the first operation direction and the second operation are based on the enlargement operation of the window defined in the above 1)
  • the direction is negative along the X-axis and the X-axis in the negative direction, which means that the window operation is closed; of course, the combination of the first operation direction and the second operation direction is not limited thereto, and the operation is reversed for all directions that can represent the amplification operation.
  • first operation direction and the second operation direction are the first movement directions of the diagonal lines along the X-axis and the Y-axis at the same time (ie, from the user's point of view, while doing the lower left obliquely to the upper right movement), representing the window maximization operation.
  • the combination relationship between the first operation direction and the second operation direction is not limited thereto, and may be any other two operation directions having the same direction;
  • determining an operation in a direction opposite to the maximization operation of the window operation object is: a reduction operation of the window operation object;
  • the first operational direction and the second operational direction are the second direction of motion of the diagonal along the X-axis and the Y-axis simultaneously (ie, from the perspective of the user, while doing the right upper oblique Move to the lower left), which minimizes the operation on behalf of the window.
  • the method further includes:
  • the implementation process is as shown in FIG. 10, an positioning point 102 of the operation object 101 is selected, and the same direction movement 103 is performed away from the positioning point, and the operation object is enlarged relative to the positioning point; An operation 104 opposite to the direction of the magnifying operation is performed, and the operating object is zoomed out relative to the positioning point.
  • the operation object here may be a stereo operation object, a plane operation object, or another operation object such as a window.
  • the stereoscopic operation object may be a stereoscopic object, a street view map, a stereoscopic menu, or the like;
  • the planar operation object may be a planar image in the screen, etc.;
  • the window operation object may be a window corresponding to various applications;
  • the above method of the present invention can also automatically determine according to the current scene according to the validity of the operation type of the operation object, for example, the current window display content is 3D solid object, the meaning of the touch motion is defined according to the operation type 1 of the above-mentioned stereoscopic operation object;
  • the current window display content is a planar image (such as a picture), the meaning of the touch motion is defined according to the operation type 2;
  • the current window is displayed as other content or Program Manager, the meaning of touch motion is defined by operation type 3.
  • an embodiment of the present invention further provides a terminal device 40, including a housing 41, and a first operating unit 42 disposed on the housing 41, further comprising: disposed on the housing 41 Second operating unit 44;
  • the first operation unit 41 is configured to acquire a first operation direction of an operation object 43.
  • the second operation unit 44 is configured to acquire a second operation direction of the operation object 43.
  • the processing unit is not shown. An operation for determining a direction combination relationship between the first operation direction and the second operation direction; when the processing unit is specifically implemented, the processor may be implemented by the processor of the terminal device;
  • An operation execution unit (not shown), configured to perform the operation on the operation object, and output an execution result of the operation; when the operation execution unit is specifically implemented, the operation may be performed by the terminal device To achieve.
  • the first operating unit and the second operating unit are physically separated two operating units, the first operating unit may be disposed at a first position of the housing; the second operating unit is disposed at the a second position of the housing opposite the first position; this facilitates user operation and conforms to the user's normal operating habits.
  • the first operation unit is a touch screen on the front side (the user-facing side) of the terminal device
  • the second operation unit is a touch panel disposed on the back side of the terminal device; of course, the touch panel can also be disposed on the side of the terminal device, as long as it is An operating unit is physically separated and can be positioned differently.
  • the terminal device may further include:
  • a display module (such as a display that can be a terminal device) is used to display the result of the operation performed on the operation object. If the display screen is a touch screen, the display screen can also serve as the first operation unit as a display unit.
  • the specific implementation of the processing unit may include:
  • a first processing subunit configured to determine an operation type of the operation object according to an attribute feature of the operation object
  • a second processing sub-unit configured to determine an operation corresponding to a direction combination relationship between the first operation direction and the second operation direction according to an operation type of the operation object.
  • the second processing sub-unit is specifically configured to:
  • the vertical line of the trajectory line formed by the first operation direction and the second operation direction is rotated for the axis, for example, a perpendicular line of the trajectory line formed by the first operation direction and the second operation direction is an axis, a rotation operation of the first operation direction or a rotation operation of the second operation direction; or
  • determining that the operation is: performing a first operation on the axis of the trajectory formed by the stereoscopic operation object in the first operation direction
  • the rotation of the direction while the vertical line of the trajectory formed by the second operation direction is the rotation of the second operation direction.
  • the stereoscopic operation object is centered on the Y axis, facing the user.
  • One is facing the X-axis forward rotation; the effect diagram of the three-dimensional operation object rotation is shown in FIG. 6.
  • the drawings merely show the first operational direction and the second operational direction. Depending on the position of the first operational unit and the second operational unit, the first operational direction and the second operational direction may or may not coincide.
  • the stereoscopic operation object is in the first operation direction and the second operation.
  • the perpendicular line of the trajectory formed by the direction is a rotation of the first operation direction or the second operation direction of the axis, such as in the system in which the operation object is located, with the X axis as the center, and a Y-axis forward rotation facing the user;
  • the effect diagram of the rotation of the operation object is shown in Fig. 8.
  • FIG. 5 and FIG. 6, or FIG. 7 and FIG. 8 represent only one of the operations, and other operations may be performed according to the definitions of Table 1, Table 2, and Table 3 above, and details are not described herein again.
  • the second processing sub-unit is specifically configured to:
  • the operation of determining the opposite direction of the overall enlargement operation of the planar operation object is: an overall reduction operation of the planar operation object.
  • the first processing sub-unit determines that the operation type of the operation object is: when the operation of the object is operated on the plane
  • the second processing sub-unit is further configured to:
  • the terminal only needs to be single on the touch panel.
  • the touch locates the part of the plane operation object to be partially enlarged, and then moves on the touch panel to trigger a partial enlargement of the part corresponding to the partial enlargement, such as a small link text on the webpage, and positioning the text through the touchpad
  • a partial enlargement of the part corresponding to the partial enlargement such as a small link text on the webpage
  • the area, and moving on the touchpad enlarges the link text area, and the magnification is preset.
  • the partially enlarged text area or image may be restored to the original size after being enlarged, and the normal webpage or image may be restored by double-clicking on the touch panel to cancel the enlargement; or the partially enlarged text area may be preset. Or the image will automatically return to the original size after a few seconds on the screen, or the enlarged text area or image will return to normal when leaving the touchpad; this can effectively solve the problem that the text on the handheld device is small, and the finger is difficult to click accurately. The problem with the link.
  • the operation object is an operation object having priority, and the first operation unit and the second operation unit are moved in opposite directions, that is, through the first operation direction of the first operation unit and through the second operation unit.
  • the operation object is opened step by step;
  • the specific implementation process is as follows: the operation object has at least one display object, and the display object includes high priority display information and low priority display information;
  • the priority of the displayed information may be three or more levels.
  • the foregoing implementation process may further include:
  • the display font of the display information of each display object can be reduced, and the current priority display object and the display object lower than the current priority can be displayed.
  • the display information is displayed; the display font of the displayed information can also be kept, and the operation object is displayed in a page.
  • each record in the address book is a display object, and each record includes multiple display contents with different priorities: if the name identification information is high priority; and the name identification information includes the phone number
  • the information and the like are medium priority display information; and the other identification information included in the name identification information is low priority display information, such as fax information, communication address, etc.;
  • the display module only displays the high-priority display content, that is, only the name identification information is displayed; in the interface displayed by the name display object, the first operation and the second operation with the opposite receiving directions may be: The operation acquired by the unit is downward movement relative to the display screen, and the operation acquired by the second operation unit is upward movement relative to the display screen; or the operation acquired by the first operation unit is upward movement relative to the display screen, and the operation acquired by the second operation unit is relative The display moves down in the address book;
  • the display module displays the high priority display content and the medium priority display content, that is, displays the identification information.
  • the display module displays high priority display content, medium priority display content, and low priority display content, that is, displays all content.
  • an embodiment of the present invention further provides a terminal device, where the terminal device includes: a storage unit, configured to store an operation object including at least one display object;
  • a processing unit configured to determine a priority of the display object; receive an instruction for the first operation direction and the second operation direction of the display object; and when the first operation direction and the second operation direction are opposite, generate the display Displaying display information of the current priority of the object and an instruction of displaying information lower than the current priority;
  • a display unit configured to display display information of the display object according to the instruction.
  • the processing unit receives an instruction of the first operation direction and the second operation direction; when the first operation direction and the second operation direction are opposite, displaying display information of the current priority of the display object and lower than the current Priority display information.
  • the display font of the display information of each display object may be reduced, so that the current priority display object and the current priority are lower than the current priority.
  • the display information of the display object is displayed; the display font of the display information may be maintained, and the operation object may be displayed in a page.
  • the second processing sub-unit is specifically configured to:
  • Determining an operation in a direction opposite to an opening operation of the window operation object is: a closing operation of the window operation object; or
  • the operation of determining the opposite direction to the maximize operation of the window operation object is: the window operation operation of the object reduction operation.
  • the above terminal device of the present invention may further have the following features:
  • the operation is the first operation, that is, the first operation is performed on the operation object;
  • the operation is a second operation, i.e., a second operation is performed on the operational object.
  • the method may further include:
  • an locating point 102 of the operating object 101 is selected by the first operating unit, and the first operating unit and the second operating unit simultaneously move in the same direction away from the positioning point. And performing an operation of the operation object with respect to the positioning point.
  • the operation object here may be a stereo operation object, a plane operation object, or other operation object such as a window.
  • the terminal device embodiment of the present invention may also have other applications:
  • one positioning point in the planar image may be selected first, and then the overall magnification with respect to the positioning point is performed, for example, an positioning point in the planar image is selected by the first operating unit, and then Further, by the movement of the first operation unit and the second operation unit in opposite directions, the overall enlargement of the planar image relative to the positioning point can be achieved, and the operation opposite to the enlarged direction is an overall reduction.
  • the terminal device of the present invention may specifically be a handheld device, and may specifically be operated by one hand.
  • the above solution of the present invention provides a new operation mode by adding a second operation unit to the terminal device, and the user can simultaneously translate and rotate the operation object, and can realize the operation effect of simultaneously shifting and rotating the operation object. It is more convenient to interactively control the screen content, providing users with richer interaction modes; it can be widely used for display and interactive control of street view maps, 3D stereoscopic images, etc. on handheld devices.
  • the pointing can be taken with the existing image collection unit as described below.
  • the image of the object on the surface of the transparent window is then analyzed to determine the location of the pointing object.
  • a transparent window is disposed on the image collection channel of the image collection unit of the terminal device, and the first window of the transparent window away from the image collection unit is spaced apart from the image collection unit. a distance is formed, and the image collecting unit collects an image when the pointing object contacts the first surface of the transparent window, and sends the image to the processing unit, and calculates a trajectory of the pointing object according to the image, and according to the image The trace generates a corresponding input command. Since the pointing object does not slide on the surface of the display, but operates on a transparent window different from the display, it does not affect the user. Watch what is displayed.
  • the terminal device of the embodiment of the invention includes a main board, a processing unit and an image collection unit disposed in the housing and connected to the main board, wherein:
  • a transparent window is disposed on the image collection channel of the image collection unit, and the transparent window is spaced apart from the image collection unit by a distance from the first surface of the image collection unit to form a space;
  • the terminal device further includes:
  • the image collection unit is configured to collect an image when the pointing object contacts the first surface of the transparent window
  • the processing unit is configured to calculate a trajectory of the pointing object according to the image, and generate a corresponding input instruction according to the trajectory.
  • the transparent window is spaced apart from the image collection unit by a distance from the first surface of the image collection unit, and a space is formed.
  • the space may include the transparent window corresponding to the image.
  • a portion of the collection channel may also include a portion of the transparent window corresponding to a portion of the image collection channel and a lower surface of the transparent window and the image collection unit.
  • the image collecting unit needs to collect the image when the pointing object contacts the first surface of the transparent window, it is required that the space between the first surface of the transparent window and the image collecting unit is illuminated by light, generally In other words, it can be achieved as follows.
  • the transparent window is set larger. As shown in FIG. 11, since the surface area of the transparent window is large, the pointing object (the user's finger in FIG. 11) can only contact a part of the transparent window, and the light can still pass through the transparent window. The other portion that is not touched by the pointing object enters the space between the first surface of the transparent window and the image collecting unit, and is captured by the image collecting unit, so that the image captured by the image collecting unit can be obtained to obtain the pointing object. position.
  • the terminal device is further provided with at least one illuminating device for illuminating the space to the space, and is connected to the main board, and when the pointing object contacts the first surface of the transparent window, the illuminating device is sent out The light reflection, and the image collection unit captures the emitted light image, so analyzing the image captured by the image collection unit can obtain the pointing object s position.
  • the image collection unit has two working modes: a shooting mode and a positioning mode, and the processing unit needs to activate the lighting device when the image collecting unit operates in the positioning mode.
  • the transparent window may be a transparent window that is separately provided, or may be a transparent protective layer that the image collection unit (such as a camera) itself has.
  • the illuminating device is fixedly set or adjustable, respectively, and is described below.
  • the light emitting device 21 is fixedly disposed, and the light emitting direction is toward the transparent window.
  • the light emitted from the illuminating device 21 is irradiated onto the finger touched on the outer surface of the transparent window 23, and is reflected in the image collecting unit 22, and the image collecting unit 22 forms an image in which the position of the finger is recorded.
  • the illuminating device 21 is fixedly disposed, and the terminal device further includes an optical device disposed in a light emitting direction of the illuminating device 21 for guiding light emitted by the illuminating device 21 to the space. twenty four.
  • the light emitted by the illuminating device 21 is reflected by the illuminating device 24 multiple times, exits the optical device 24, and is irradiated onto the finger touched on the outer surface of the transparent window 23, and is reflected into the image collecting unit 22 by the image collecting unit 22.
  • An image is recorded which records the position of the finger.
  • the optical device 24 is disposed under the optical device 24, but the relative position between the two is also in other forms.
  • the light-emitting device 21 is fixedly disposed, and the terminal device further includes a setting. In the light emitting direction of the light emitting device 21 (the optical device 24 is disposed on the left side of the optical device 24), the optical device 24 for guiding the light emitted by the light emitting device 21 to the space.
  • the light emitted by the illuminating device 21 is reflected by the illuminating device 24 multiple times, exits the optical device 24, and is irradiated onto the finger touched on the outer surface of the transparent window 23, and is reflected into the image collecting unit 22 by the image collecting unit 22.
  • An image is recorded which records the position of the finger.
  • the illuminating devices are located outside the transparent window, and the image concentrating unit is located on the same side of the transparent window, but the illuminating device may also be disposed inside the transparent window, as shown in FIG. 15 .
  • the light-emitting device 21 is fixedly disposed in the transparent window 23 at one end of the transparent window 23, and the light-emitting direction is toward the other end of the transparent window 23.
  • the light beam emitted from the illuminating device 21 is reflected from the transparent window 23 to the inside thereof, that is, after the inner surface of the transparent window 23.
  • the surface of the transparent protective layer is air, when the angle of the incident light satisfies certain conditions, the light is completely reflected on the surface of the transparent protective layer.
  • a substance having a relatively high refractive index e.g., a finger
  • the condition of total reflection on the surface of the transparent window 23 is broken, and part of the light beam is transmitted through the surface and projected onto the surface of the finger.
  • the uneven finger surface causes scattering of the light beam (diffuse reflection), and the scattered light passes through the transparent window 23 to reach the image collecting unit 22, and the image collecting unit 22 forms an image for recording the position of the finger.
  • the light emitting device may select the annular light emitting body and set around the image collecting unit.
  • the pointing object can obtain the same effect imaging at any position on the upper surface of the transparent window to meet the needs of subsequent image analysis.
  • the illuminating device 21 is fixedly disposed, but it is considered that the illuminating device can be used for the imaging module in the normal photography mode or in the imaging module.
  • the light emitted by the illuminating device should be transmitted to the outer surface through the transparent window as much as possible, and in the second case, the light emitted from the illuminating device should be It is projected into the transparent window as much as possible. Therefore, in both cases, in order to meet different needs, it is necessary to adjust the light-emitting direction of the light-emitting device so that the light emitted by the light-emitting device is irradiated to the predetermined space.
  • existing terminal devices such as mobile phones, PDAs, etc.
  • the flash is configured.
  • the camera and the camera that the terminal device already have can be directly utilized.
  • the flash is multiplexed to serve as an image collection unit and a light-emitting device. Therefore, the utilization of the function modules on the existing device is maximized, and the hardware cost is not increased, and the application range of the embodiment of the present invention is improved.
  • the apparatus is applied to a schematic diagram in a conventional camera mode, including a lighting device 25 provided with an angle adjustment module 251 for adjusting the lighting device 25 to cause the lighting device 25 to transmit light to the space.
  • the angle adjustment module 251 is controlled to adjust the illumination device 25 such that the illumination device 25 emits light at a first angle through which light as much light as possible can be transmitted to the outside.
  • the device should be applied with a schematic diagram for the positioning of the positioning mode, wherein the middle package includes a hair set to be provided with an angular angle adjustment mode module block 225511.
  • the illuminating light device is provided with 2255, and in the fixed positioning mode mode, the control angle is adjusted to adjust the mode module block 225511, so that the modulating and illuminating device is prepared.
  • the illuminating device 2255 is used to emit the ray of light at the second angle of the second angle, and at this time, the ray of light can be exhausted, and the light ray can be illuminated. Shooted into the pre-determined space. .
  • the test considers that the illuminating device is prepared in the normal normal camera mode mode, and the required illuminating intensity is relatively large, so as to be full. Satisfy the needs of the demand, but in the fixed positioning mode mode, it only needs to illuminate a relatively small area, which is relatively small, at this time , in order to be strong, in order to facilitate the root according to the situation of the same different conditions to adjust the intensity of the intensity of the light, the full satisfaction needs. .
  • the device for illuminating the light-emitting device can be adjusted, and it should be understood that the light-emitting device is set. 1100
  • the light path of the light path can be adjusted and adjusted, or the light path of the light source can be adjusted, and when the path of the light path can be adjusted, the description
  • the specific package of the illuminating device is included:
  • a light optical device device for use in the positioning of a picture unit, such as when the image unit is set to work in a fixed position mode mode, Depicting a path of the light ray path of the illuminating body, and causing the illuminating body to transmit the light ray line between the vacant spaces, as described above
  • the light path path diameter of the light emitting body body described in the adjusting section is adjusted.
  • the illuminating light body emits a light ray line between the empty spaces outside the transparent transparent window. .
  • Adjusting the illuminating path path of the illuminating section which may be implemented by adjusting the illuminating optics device by over-adjusting, as in the image-like collection of the image
  • the optical optical device device is located on a path of the light ray path of the illuminating body body, And the light ray line emitted by the illuminating body is emitted between the empty space and the illuminating body, and is in the image
  • the setting of the illuminating device is only set to Figure 1166 and And Figure 1177 is carried out to explain, but, but should be understood properly, the illuminating device is equipped with an adjustable setting method, and its
  • the emitted light ray line may also be passed through the optical optics device to facilitate the projection of the light ray line to a better pre-scheduled projection.
  • the bit position of 2255 is set, and it can also be set to be placed in its other position, and it is not mentioned here---detailed in detail. .
  • the specific position position of the image unit is not limited to the specific position of the image unit. It may be located at each position of the terminal device, such as the surface surface of the upper surface, the back surface, the side surface, or even the corner angle. It may be possible, as long as the user's finger can be used to reach the position that can be reached. .
  • the image of the image is collected into the camera mode, and the camera is taken.
  • Genus The original function of the image collection unit.
  • the illuminating device After the user initiates the positioning process, when the illuminating device is present, the illuminating device is activated, and the light emitted by the illuminating device is irradiated onto the finger touched on the outer surface of the transparent window, and is reflected into the image concentrating unit, and the recording finger is formed by the image concentrating unit.
  • the image of the head position is subjected to a positioning process by the processing unit, that is, a trajectory of the pointing object is calculated according to the image, and a corresponding input command is generated according to the trajectory.
  • the angle should be adjusted so that as much light as possible can be radiated to the predetermined space.
  • the above-mentioned image capturing unit of the pointing object on the transparent window surface and then analyzing to determine the position of the pointing object can be used for the first operating unit of the foregoing terminal device or The second operating unit or both the first operating unit and the second operating unit.
  • the above configuration may be separately applied to any terminal device using the touch screen, or a method of controlling the operation of the operation object simultaneously with the two operations.
  • the terminal device is used in combination, and the embodiments of the present invention are not intended to limit this.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention porte sur un procédé et un dispositif terminal pour commande d'opération d'un objet d'opération. Le procédé consiste à : obtenir une première direction d'opération et une seconde direction d'opération de l'objet d'opération (31), déterminer une opération correspondant à la relation de combinaison de directions entre la première direction d'opération et la seconde direction d'opération (32), et réaliser l'opération sur l'objet d'opération (33). La solution peut permettre de réaliser deux types d'opérations sur l'objet d'opération simultanément et de générer un effet d'opération selon lequel deux types d'opérations sont réalisés simultanément.
PCT/CN2010/079507 2009-12-07 2010-12-07 Procédé et dispositif terminal pour commande d'opération d'objet d'opération Ceased WO2011069435A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/513,948 US9836139B2 (en) 2009-12-07 2010-12-07 Method and terminal device for operation control of operation object

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN200910241771.9A CN102087571B (zh) 2009-12-07 2009-12-07 操作对象的操作控制的方法及终端设备
CN200910241771.9 2009-12-07
CN200910242423.3 2009-12-11
CN200910242423.3A CN102096517B (zh) 2009-12-11 2009-12-11 一种便携式电子设备及输入方法

Publications (1)

Publication Number Publication Date
WO2011069435A1 true WO2011069435A1 (fr) 2011-06-16

Family

ID=44145106

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/079507 Ceased WO2011069435A1 (fr) 2009-12-07 2010-12-07 Procédé et dispositif terminal pour commande d'opération d'objet d'opération

Country Status (2)

Country Link
US (1) US9836139B2 (fr)
WO (1) WO2011069435A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103500062A (zh) * 2013-09-17 2014-01-08 华为技术有限公司 一种终端、终端控制方法及装置
CN104714635B (zh) * 2013-12-16 2018-07-06 联想(北京)有限公司 信息处理的方法及电子设备
CN105335116B (zh) * 2014-07-30 2018-11-09 联想(北京)有限公司 一种显示控制方法及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1926500A (zh) * 2004-03-05 2007-03-07 诺基亚公司 控制器和控制器配置
CN101441541A (zh) * 2007-11-19 2009-05-27 乐金显示有限公司 多点触摸平板显示模块
CN101533649A (zh) * 2008-03-10 2009-09-16 创新科技有限公司 使用动作变化模拟按键操作的方法和便携媒体播放器

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11341114A (ja) 1998-05-27 1999-12-10 Mitsubishi Electric Corp 携帯型電話機
US7508377B2 (en) 2004-03-05 2009-03-24 Nokia Corporation Control and a control arrangement
KR100667817B1 (ko) * 2005-09-26 2007-01-11 삼성전자주식회사 직하발광형 백라이트 유닛 및 이를 적용한 칼라 필터를사용하지 않는 액정표시장치
JP4567028B2 (ja) * 2006-09-26 2010-10-20 エルジー ディスプレイ カンパニー リミテッド マルチタッチ感知機能を有する液晶表示装置とその駆動方法
WO2009076503A1 (fr) * 2007-12-11 2009-06-18 Firstpaper Llc Appareil à écran tactile éclairé et son procédé de fonctionnement
US20100177053A2 (en) * 2008-05-09 2010-07-15 Taizo Yasutake Method and apparatus for control of multiple degrees of freedom of a display
US8477139B2 (en) * 2008-06-09 2013-07-02 Apple Inc. Touch screen device, method, and graphical user interface for manipulating three-dimensional virtual objects
US8130207B2 (en) * 2008-06-18 2012-03-06 Nokia Corporation Apparatus, method and computer program product for manipulating a device using dual side input devices
EP2294375B8 (fr) * 2008-06-19 2024-02-14 Massachusetts Institute of Technology Capteur tactile utilisant l'imagerie élastomère
US8345014B2 (en) * 2008-07-12 2013-01-01 Lester F. Ludwig Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface
WO2010039663A2 (fr) * 2008-10-02 2010-04-08 Next Holdings, Inc. Capteurs optiques stéréos pour résoudre un toucher multiple dans un système de détection de toucher
US8669945B2 (en) * 2009-05-07 2014-03-11 Microsoft Corporation Changing of list views on mobile device
KR101604692B1 (ko) * 2009-06-30 2016-03-18 엘지전자 주식회사 이동 단말기 및 그 제어 방법
US8497884B2 (en) * 2009-07-20 2013-07-30 Motorola Mobility Llc Electronic device and method for manipulating graphic user interface elements
JP2011028345A (ja) * 2009-07-22 2011-02-10 Olympus Imaging Corp 条件変更装置、カメラ、携帯機器、およびプログラム
US20110055753A1 (en) * 2009-08-31 2011-03-03 Horodezky Samuel J User interface methods providing searching functionality
EP2480957B1 (fr) * 2009-09-22 2017-08-09 Apple Inc. Dispositif, procédé et interface utilisateur graphique pour manipuler des objets d'interface utilisateur
US8839128B2 (en) * 2009-11-25 2014-09-16 Cooliris, Inc. Gallery application for content viewing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1926500A (zh) * 2004-03-05 2007-03-07 诺基亚公司 控制器和控制器配置
CN101441541A (zh) * 2007-11-19 2009-05-27 乐金显示有限公司 多点触摸平板显示模块
CN101533649A (zh) * 2008-03-10 2009-09-16 创新科技有限公司 使用动作变化模拟按键操作的方法和便携媒体播放器

Also Published As

Publication number Publication date
US20120242611A1 (en) 2012-09-27
US9836139B2 (en) 2017-12-05

Similar Documents

Publication Publication Date Title
US12504937B2 (en) Information display apparatus and method
US9264694B2 (en) Hand-held imaging apparatus and storage medium storing program
US9430045B2 (en) Special gestures for camera control and image processing operations
JP6561141B2 (ja) タッチパッドを用いて携帯端末の撮影焦点距離を調整する方法および携帯端末
CN110710191B (zh) 一种拍照方法及终端
EP2189835A1 (fr) Appareil terminal, procédé de contrôle de l'affichage et programme de contrôle de l'affichage
WO2019227553A1 (fr) Procédé de photographie et dispositif électronique
WO2021115479A1 (fr) Procédé de commande d'affichage et dispositif électronique
US7359003B1 (en) Display, input and form factor for portable instruments
US8310504B2 (en) System and method for panning and selecting on large displays using mobile devices without client software
CN106657455A (zh) 一种带可旋转摄像头的电子设备
TW202018486A (zh) 多螢幕操作方法與使用此方法的電子系統
KR20240004839A (ko) 촬영 방법, 장치 및 전자기기
JP2002539742A (ja) 対話のための装置
JP4190935B2 (ja) 携帯端末装置
CN112637495A (zh) 拍摄方法、装置、电子设备及可读存储介质
TW202004432A (zh) 電子裝置及電子裝置的操作控制方法
US9088720B2 (en) Apparatus and method of displaying camera view area in portable terminal
CN103529947A (zh) 显示装置及其控制方法、手势识别方法
CN210323721U (zh) 一种云台相机
US9836139B2 (en) Method and terminal device for operation control of operation object
CN110213407A (zh) 一种电子装置的操作方法、电子装置和计算机存储介质
CN108604128A (zh) 一种处理方法及移动设备
KR102151206B1 (ko) 이동 단말기 및 그 제어방법
CN108600641A (zh) 拍照方法及移动终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10835470

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 13513948

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10835470

Country of ref document: EP

Kind code of ref document: A1