US8390586B2 - Image display apparatus that detects pointing element using imaging device - Google Patents

Image display apparatus that detects pointing element using imaging device Download PDF

Info

Publication number
US8390586B2
US8390586B2 US12/702,595 US70259510A US8390586B2 US 8390586 B2 US8390586 B2 US 8390586B2 US 70259510 A US70259510 A US 70259510A US 8390586 B2 US8390586 B2 US 8390586B2
Authority
US
United States
Prior art keywords
image
screen
picturized
display apparatus
imaging device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/702,595
Other languages
English (en)
Other versions
US20100141897A1 (en
Inventor
Kiyohiko Kawano
Hiroshi Noge
Hideki Ueda
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Original Assignee
Panasonic Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corp filed Critical Panasonic Corp
Assigned to PANASONIC ELECTRIC WORKS CO., LTD. reassignment PANASONIC ELECTRIC WORKS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NOGE, HIROSHI, UEDA, HIDEKI, KAWANO, KIYOHIKO
Publication of US20100141897A1 publication Critical patent/US20100141897A1/en
Assigned to PANASONIC CORPORATION reassignment PANASONIC CORPORATION MERGER (SEE DOCUMENT FOR DETAILS). Assignors: PANASONIC ELECTRIC WORKS CO.,LTD.,
Application granted granted Critical
Publication of US8390586B2 publication Critical patent/US8390586B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/02—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes by tracing or scanning a light beam on a screen
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/18—Diffraction gratings
    • G02B5/1876—Diffractive Fresnel lenses; Zone plates; Kinoforms
    • G02B5/189—Structurally combined with optical elements not having diffractive power
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0464—Positioning

Definitions

  • the present invention relates to an image display apparatus which can display an image on a screen by two-dimensionally scanning visible light from a light source on the screen by an optical scanning device.
  • an image display apparatus which emits invisible light L 1 from a light emitting device 11 to a pointing device 10 for detecting a position of the pointing device 10 which is used to point out an optional position on an image G 1 , is conventionally known (see Japanese Laid-Open Patent Publication No. 2006-277357, for example).
  • a retroreflector member which deflects the invisible light L 1 from the light emitting device 11 and reflects the invisible light L 1 to the incident direction, is provided on the pointing device 10 .
  • the invisible light L 1 which is reflected by the pointing device 10 is received by a photoreception means in the light emitting means 11 .
  • the position of the pointing device 10 is estimated based on a photoreception timing of the invisible light by the photoreception device.
  • the conventional apparatus requires a high time-resolution in order of pico-second (ps) for positional detection based on the photoreception timing of the reflected light, and thus, it needs a complicated and high-performance detect circuit. Thereby, manufacturing cost rises.
  • the present invention is conceived to solve the above mentioned conventional problems and purposed to provide an image display apparatus which enables to judge the presence or absence of pointing out of an image even when a finger or fingers of a person is or are used as a pointing means to point out an optional position on the image, and consequently enables to reduce a number of components, to simplify a configuration and to reduce manufacturing cost.
  • an image display apparatus of the present invention comprises: a light source which emits visible light; a scanner which two-dimensionally scans light emitted from the light source to display an image on a screen in synchronism with the light source; a controller which controls the light source and the scanner based on a data of an image to be displayed on the screen; an imaging device which picturizes an image of the image displayed on the screen; and a judger which judges presence or absence of a pointing element between the optical scanning device and the screen, which is used to point out an optional position on the image based on temporal change of the image picturized by the imaging device.
  • the image displayed on the screen and the image picturized by the imaging device temporally change responding to presence or absence of the pointing elements between the optical scanning device and the screen, and the presence or absence of the pointing out of the image by the pointing element is judged on the basis of the temporal change of the image picturized by the imaging device, so that the presence or absence of the pointing out of the image can be judged even when a finger or fingers of a person or the like is used as the pointing element.
  • FIG. 1 is a drawing showing a configuration of an image display apparatus in accordance with a first embodiment of the present invention.
  • FIG. 2 is a drawing showing a picturized image by an imaging unit of the above apparatus.
  • FIG. 3A is a drawing showing a state that an image is pointed out by a user
  • FIG. 3B is a drawing showing the picturized image at that time.
  • FIG. 4 is a drawing showing an example of image switch by the above apparatus.
  • FIG. 5 is a drawing showing a variation of an image responding to a distance between a screen on which an image is displayed and the above apparatus.
  • FIG. 6A is a perspective illustration showing a state that the above apparatus projects an image from diagonal side of the screen
  • FIG. 6B is a drawing showing a picturized image by the above imaging unit at that time
  • FIG. 6C is a perspective illustration showing a state when the screen on which an image is displayed is formed to be a curved surface
  • FIG. 6D is a drawing showing a picturized image by the imaging unit at the time.
  • FIG. 7 is a drawing showing internal angles of a picturized image when an image display apparatus in accordance with a second embodiment of the present invention projects an image from diagonal side of a screen.
  • FIG. 8A is a perspective illustration showing a state that the above apparatus projects an image from a direction in diagonal side of the screen but different from the above
  • FIG. 8B is a drawing showing internal angles of a picturized image at that time
  • FIG. 8C is a perspective illustration showing a state that the apparatus projects an image from diagonal above of the screen
  • FIG. 8D is a drawing showing internal angles of a picturized image at that time
  • FIG. 8E is a perspective illustration show a state that the apparatus projects an image from diagonal below of the screen
  • FIG. 8F is a drawing showing internal angles of a picturized image at that time.
  • FIG. 9 is a drawing showing internal angles and picturized reference marks of a picturized image by the above apparatus when a horizontal section of the screen on which the image is displayed is curved.
  • FIG. 10A is a perspective illustration showing a state that the horizontal section of the above screen is curved to different direction from the above
  • FIG. 10B is a drawing showing internal angles and inclination of the picturized reference marks of a picturized image at that time
  • FIG. 10C is a perspective illustration showing a state that a vertical section of the screen is curved
  • FIG. 10D is a drawing showing internal angles and inclination of the picturized reference marks of a picturized image at that time
  • FIG. 10E is a perspective illustration showing a state that the vertical section of the screen is curved to different direction from the above
  • FIG. 10F is a drawing showing internal angles and inclination of the picturized reference marks of a picturized image at that time.
  • FIG. 11A is a drawing showing a picturized image by the apparatus before image compensation when the above apparatus projects an image from diagonal side of the screen
  • FIG. 11B is a drawing showing an image projected in the image compensation by the apparatus
  • FIG. 11C is a drawing showing an image actually displayed at that time.
  • FIG. 12A is a drawing showing a picturized image by then above apparatus before image compensation when the screen on which an image is displayer forms a curved surface
  • FIG. 12B is a drawing showing an image projected by the apparatus at the time of image compensation
  • FIG. 12C is a drawing of an image actually displayed at that time.
  • FIG. 13 is a drawing of configuration of a conventional image display apparatus.
  • FIG. 1 An image display apparatus in accordance with a first embodiment of the present invention is described below with reference to FIG. 1 to FIGS. 6A to 6D .
  • This image display apparatus 1 displays an image G 1 by projecting light on a screen P 1 , detects pointing out and a position thereof on the image G 1 by a finger or fingers of a person or the like by taking an image of the image G 1 , and switches the display of the image G 1 responding to a result of the detection, for example.
  • the image display apparatus 1 comprises a laser diode (hereinafter, abbreviated as “D”) 2 which emits visible light, an LD driver 3 which is configured by a driving circuit for driving the LD 2 , an optical scanning device (scanner) 4 which two-dimensionally scans the visible light from the LD 2 on a screen P 1 .
  • the LD driver 3 displays an image G 1 and reference marks M 1 on the screen P 1 by modulating light output of the LD 2 and emits the modulated visible light from the LD 2 .
  • the LD 2 and the LD driver 3 constitute a light source by this manner.
  • the image display apparatus 1 comprises an imaging device 5 which picturizes an image of the image G 1 and the reference marks M 1 displayed on the screen P 1 by the LD 2 , the LD driver 3 and the optical scanning device 4 (hereinafter, abbreviated as “LD 2 and so on”).
  • the image G 1 and the reference marks M 1 picturized by the imaging device 5 are respectively called “picturized image G 2 ” and “picturized reference marks M 2 ”.
  • the image display apparatus 1 further comprises an image processor 6 which processes the picturized image G 2 based on the picturized reference marks M 2 and a controller 7 which controls the LD driver 3 and the optical scanning device 4 responding to the image G 1 to be displayed or signals from the image processor 6 .
  • the LD driver 3 and the optical scanning unit 4 are synchronously driven by the controller 7 .
  • the image processor (judger) 6 judges whether pointing element which is used to point out an optional position on the image G 1 exists or not based on temporal change of the processed picturized image G 2 .
  • a pointing element is not limited in particular, and it is sufficient to be a material object such as a finger or fingers of a person or a pen.
  • a filter 8 which is formed of an optical material enabling to pass through only a visible light of the same color as the visible light from the LD 2 , is provided between the screen P 1 and the imaging unit 5 .
  • the LD 2 and so on, the image processor 6 and the controller 7 are built in a housing (not illustrated) of a main body of the apparatus.
  • the imaging unit 5 and the filter 8 may be provided inside the housing of the main body of the apparatus or outside of the housing.
  • alphabets A, B, C and D are illustrated as examples of the keys in the image G 1 .
  • the reference marks M 1 each having a shape of a cross, for example, are displayed so that cross points coincide with the corners of the image G 1 .
  • Shape of the image G 1 , a number, positions and shapes of the reference marks M 1 are not limited as above in particular.
  • the optical scanning device 4 is configured of a polygon mirror, a galvanometer mirror or a MEMS (Micro Electro Mechanical Systems) or a combination of them, for example, and it enables to scan the visible light emitted from the LD 2 in two directions of vertical direction and horizontal direction, that is, biaxial direction.
  • the biaxial optical scanning enables to project a two-dimensional image G 1 on the screen P 1 .
  • the imaging device 5 is configured of a CCD camera or a CMOS camera and so on. Only the visible light of the same color as the visible light from the LD 2 enters into the imaging unit 5 by the function of the filter 8 . Picturizing operations of the image G 1 and the reference marks M 1 by the imaging device 5 is executed at a predetermined time period. Data of the picturized image G 2 and the picturized reference marks M 2 are outputted from the imaging device 5 to the image processor 6 . When the imaging device 5 is provided outside the housing of the main body of the apparatus, it transmits the data to the image processing unit via wires or radio.
  • the image processor 6 is configured by a microcomputer including CPU and so on.
  • the image processor 6 binarize shading value of each pixel of the picturized image G 2 based on the data of the picturized image G 2 and the picturized reference marks M 2 outputted from the imaging device 5 and divide the picturized image G 2 using the picturized reference marks M 2 as criteria.
  • the image processor 6 divides the picturized image G 2 along a plurality of dividing lines to carve up the picturized image G 2 corresponding to the keys. As shown in FIG.
  • a vertical and a horizontal dividing lines D are respectively specified at a substantially center of the upper and lower picturized reference marks M 2 in the figure and at a substantially center of the left and right picturized reference marks M 2 .
  • the picturized image G 2 is divided and carved into four keys.
  • the image processor 6 detects temporal change in each divided images G 2 . Specifically, the image processor 6 compares a current picturized image G 2 with a previous picturized image temporally in each divided picturized image G 2 , and detects reduction of an area of a character or a key frame (hereinafter, it is called “character or the like”) in the picturized image G 2 , that is reduction of a number of pixels that form the character or the like. Such reduction of the number of pixels occurs due to a certain pointing out on the image G 1 by the pointing means.
  • character or the like an area of a character or a key frame
  • the image processor 6 When the image processor 6 detects the pointing means on a specific picturized image among the divided picturized images G 2 , that is, when detecting the pointing out of a specific position of the image G 1 by the pointing means, it outputs detection information to the controller 7 .
  • a key image G 11 of alphabet “A” is pointed out with fingers F 1 in an image including a plurality of keys by a user as shown in FIG. 3A , so that key-touching operation of the key image G 11 is performed.
  • a picturized image of the key image G 11 which is obtained by dividing in the image processor 6 (hereinafter, it is called “picturized key image G 21 ”) becomes a shape that a part of a character or the like therein is hollowed.
  • a portion “g” of the character or the like in the picturized key image G 21 which corresponds to a portion of the key image G 11 covered by fingers F 1 or a hand, becomes a shape which is hollowed to correspond to the shape of the fingers F 1 or the hand and so on. Consequently, the area of the character or the like in the picturized key image G 21 is reduced in comparison with that before key-touching operation. That is, the number of pixels forming the character or the like is reduced. Therefore, it is possible to detect the key-touching of the key image G 11 , that is, the pointing out of the key image G 11 by the pointing means such as fingers F 1 or the like by detecting the reduction of the number of pixels.
  • the controller 7 is configured of the microcomputer including CPU and so on. Data of the image G 1 to be displayed is inputted to the microcomputer and so on from an external apparatus such as a personal computer or the like. The microcomputer and so on controls the LD 2 and so on responding to the inputted data of the image G 1 .
  • the data of the image G 1 may be stored in a memory provided in the controller 7 .
  • the controller 7 controls the LD 2 depending on detection information outputted from the image processor 6 .
  • the LD 2 and so on switches the display of the image G 1 on a screen responding to a picturized image on which the pointing means is detected among the divided picturized images G 2 .
  • hierarchical display of menus shown in FIG. 4 can be exemplified.
  • a plurality of keys which show various kinds of menus are displayed in the image G 1 , and when a menu is selected by pointing one of them by a finger or fingers F 1 of the user, keys (illustrated as “a” and “b” keys) which show low-order menus depending on the menu are displayed as an image G 1 .
  • keys illustrated as “a” and “b” keys
  • images showing menus are not limited to the keys, and they may be tags.
  • page skip or page return may be performed by switching display of the image other than hierarchical display of menus.
  • the picturized image G 2 is temporally changed corresponding to presence or absence of the pointing means on the image G 1 , and presence or absence of the pointing out of the image by the pointing means is judged depending on the change, so that, even when a finger or fingers of a person is or are used as the pointing means, it is possible to judge whether the pointing out of the image by the finger or fingers of the person presences or not. Thereby, a number of components can be reduced.
  • a complex detection circuit having a high time-resolution becomes unnecessary, so that it enables to simplify the configuration and to reduce the manufacturing cost.
  • the filter 8 passes only the visible light of the same color as the visible light emitted from the LD 2 and shields lights of other colors, the image G 1 and the reference marks M 1 which are displayed by the visible light from the LD 2 can be extracted by the filter 8 , and thus, the imaging device 5 can picturize the extracted ones. Therefore, temporal change of the picturized image G 1 can be judged in high accuracy. Accordingly, it is judged whether a part of the image G 1 is covered due to pointing out of the image by the pointing means or not, that is, presence or absence of the pointing means on the image G 1 can be judged in high accuracy.
  • FIG. 5 when a distance between the image display apparatus 1 and the screen P 1 varies, the shape of the image G 1 is not varied, but the size of the image G 1 varies corresponding to the distance.
  • the positions of the reference marks M 1 vary responding to variation of the size of the image G 1 , the reference marks M 1 are displayed at four corners with no relation to the size of the image G 1 . Therefore, positional relations between the image G 1 and the reference marks M 1 are invariant with no relation to the above distance.
  • the portion pointed out by the pointing means in the image G 1 can be derived with the reference marks M 1 with no relation to the distance between the image display apparatus 1 and the screen P 1 .
  • the picturized image G 2 becomes a trapezoid that the left vertical side is shorter than the right vertical side not the rectangle.
  • a vertical length at an optional position in the picturized image G 2 is designated by a character “y”.
  • a value obtained by calculating a mathematical formula (H ⁇ y)/H ⁇ 100 is called compression ratio of the picturized image G 2 .
  • the picturized image G 2 shown in FIG. 6B is regarded as a shape compressed in vertical direction in a manner so that the compression ratio is gradually increased from a side to the other side in horizontal direction.
  • the imaging device 5 When the main body 1 a of the apparatus exists at a position facing the center of the screen P 1 , the imaging device 5 is built in the housing of the main body 1 a of the apparatus and a horizontal section pg the screen P 1 forms a curve convex to the image display apparatus 1 as shown in FIG. 6C , the picturized image G 2 becomes a shape compressed in vertical direction from both side to the center in horizontal direction as shown in FIG. 6D
  • the reference marks M 1 are displayed at four corners of the image G 1 , even when shape distortion occurs in the picturized image G 2 , the positional relations between the picturized image G 2 and the picturized reference marks M 2 are invariant with no relation to the projection direction of the image G 1 to the screen P 1 and the shape of the screen P 1 . Therefore, it is possible to set the dividing lines D based on the positional relations of the picturized reference marks M 2 , the picturized image G 2 is divided along the dividing lines D, and presence or absence of the pointing out of the image by the pointing means in each divided picturized images G 2 is judged. Therefore, the pointed portion on the image G 1 can be derived using the reference marks M 1 with no relation to the projection direction of the image G 1 to the screen p 1 and the shape of the screen P 1 .
  • a reduction number of pixels which forms the character or the like, becomes small.
  • the above reduction number of pixels becomes large. Therefore, for preventing erroneous detection of the pointing out, it is preferable to establish an upper limit and a lower limit previously for the reduction number of pixels, which serves as references to judge the presence or absence of the pointing out of the image.
  • the image processing unit 6 preferably judges that the pointing out by the pointing means is existed.
  • an image display apparatus in accordance with a second embodiment of the present invention is described with reference to FIG. 7 to FIGS. 12A to 12C . Since a configuration of the image display apparatus in this embodiment is the same as that in the first embodiment, the configuration is described to divert FIG. 1 .
  • the image display apparatus 1 of this embodiment is different that the image processor (image compensator) 6 performs a process to compensate an image G 1 referring to positional relations to a screen P 1 on which the image G 1 is displayed or a shape of the screen P 1 or the like (hereinafter, it is called “positional relations to the screen P 1 or the like”) in comparison with the first embodiment.
  • the image processor 6 detects inclination or distortion of picturized reference marks M 2 which occurs due to the positional relations to the screen P 1 or the like, and estimates the positional relations to the screen P 1 or the shape of the screen P 1 corresponding to the detection result. Then, the image processor 6 compensates the image G 1 based on the estimation result.
  • the picturized image G 2 becomes a distorted shape, for example.
  • the vertical lines of the picturized reference marks M 2 are not varied from the case that no distortion exists, but horizontal lines of them incline.
  • the horizontal lines incline in respective picturized reference marks M 2 at upper left, upper light, lower left and lower right positions in the figure, and internal angles. 1 , . 2 , . 3 and . 4 of the picturized image G 2 which are shown by vertical lines and the horizontal lines satisfy mathematical formulae .1 . . . .3>90 degrees and .2 . . . . 4 ⁇ 90 degrees, as shown in FIG. 7 .
  • the image processor 6 calculates that the internal angles . 1 to . 4 satisfy the mathematical formulae, it is estimated that the image display apparatus 1 projects the image G 1 and the reference marks M 1 to the screen P 1 from the position having an angle in clockwise direction to the screen P 1 in planar observation.
  • the internal angles. 1 , . 2 , . 3 and . 4 satisfy mathematical formulae .1 . . . .3 ⁇ 90 degrees and .2 . . . .4>90 degrees, as shown in FIG. 8B .
  • the image processing unit 6 estimates the positional relations to the screen P 1 based on the above mathematical formulae that the internal angles. 1 , . 2 , . 3 and . 4 satisfy.
  • the horizontal lines of the picturized reference marks M 2 incline in opposite directions to the directions to the center of the image and the internal angles. 1 , . 2 , . 3 and . 4 satisfy mathematical formulae .1 . . . .2 . . . .3 . . . .4>90 degrees, as shown in FIG. 10B .
  • the horizontal section of the screen P 1 forms a curve convex to the image display apparatus 1 as shown in FIG.
  • the vertical lines of the picturized reference marks M 2 incline in the directions to the center of the image and the internal angles. 1 , . 2 , . 3 and . 4 satisfy mathematical formulae .1 . . . .2 . . . .3 . . . .4 ⁇ 90 degrees, as shown in FIG. 10D .
  • the vertical section of the screen P 1 forms a curve convex to the image display apparatus 1 as shown in FIG. 10E
  • the vertical lines of the picturized reference marks M 2 incline in directions opposite to the directions to the center of the image and the internal angles. 1 , . 2 , . 3 and . 4 satisfy mathematical formulae .1 . . . .2 .
  • FIGS. 11A to 11C and FIG. 12A to 12C the image compensation process in the image processor 6 is described with reference to FIGS. 11A to 11C and FIG. 12A to 12C .
  • the main body 1 a of the apparatus 1 exists at the position having an angle in clockwise direction from the position facing the center of the screen P 1 in planar observation and the imaging device 5 is positioned at the position facing the center of the screen P 1 as shown in the above FIG. 6A
  • distortions occur in the picturized image G 2 as shown in FIG. 11A
  • a relation H L ⁇ H R is concluded between a vertical length H L of a left side and a vertical length H R of a right side in the figure.
  • the image processing unit 6 calculates quantities of distortions in the picturized image G 2 .
  • the image processor 6 instructs the controller 7 to project an image G 1 in which a relation H L ′>H R ′ is concluded between a vertical length H L ′ of a left side and a vertical length H R ′ of a right side as shown in FIG. 11B , based on the calculation result.
  • the controller 7 controls the LD 2 and so on and the optical scanning device 4 based on this instruction, and the LD 2 and so on compensates the image G 1 based on this control.
  • the image G 1 actually displayed on the screen P 1 becomes a desired shape, for example, a rectangular shape shown in FIG. 11C .
  • the image processor 6 may narrow the width of scanning by the optical scanning device 4 and modulate light outputs of the LD 2 corresponding thereto so as to display the image G 1 compressing in horizontal direction entirely. In such a case, it is possible to prevent that the image G 1 is displayed expanding in horizontal direction on the screen P 1 .
  • the main body 1 a of the apparatus 1 exists at the position facing the center of the screen P 1 and the imaging device 5 is built in the housing of the main body 1 a of the apparatus, and the horizontal section of the screen P 1 forms a curve convex to the image displaying apparatus 1 as shown in FIG. 6C , distortions occur in the picturized image G 2 as shown in FIG. 12A , and a relation H M ⁇ H E is concluded between a vertical length H M at the center and vertical lengths H E at both sides.
  • the image processing unit 6 calculates quantities of distortions in the picturized image G 2 .
  • the image processor 6 instructs the controller 7 to project an image G 1 in which a relation H M ′>H E ′ is concluded between a vertical length H M ′ at the center and vertical lengths H E ′ at both ends as shown in FIG. 12B , based on the calculation result.
  • the control unit 7 controls the LD 2 and so on and the optical scanning device 4 based on this instruction, and the LD 2 and so on compensates the image G 1 based on this control.
  • the image G 1 actually displayed on the screen P 1 becomes a desired shape, for example, a rectangular shape shown in FIG. 12C .
  • an image can be displayed on the screen P 1 with a desired size and shape with no relation to the light projection direction to the screen P 1 , that is, the projection direction of the image G 1 or the shape of the screen P 1 .
  • the same effects as those in the first embodiment can be brought in this embodiment.
  • detection of temporal change of the picturized image G 2 may be performed by performing a pattern matching of a temporally prior picturized image and a current picturized image and detecting whether they coincide each other or not.
  • detection of pointing out the image may be performed by comparing the image G 1 memorized in the image processing unit 6 with the picturized image G 2 .
  • judgment of presence or absence of the pointing out of the image may be performed based on a time that the image G 1 has been pointed out by the pointing means or a motion, for example, a speed of the pointing means on the image G 1 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Mechanical Optical Scanning Systems (AREA)
US12/702,595 2007-08-10 2010-02-09 Image display apparatus that detects pointing element using imaging device Expired - Fee Related US8390586B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2007209748A JP4835538B2 (ja) 2007-08-10 2007-08-10 画像表示装置
JP2007-209748 2007-08-10
PCT/JP2008/064327 WO2009022659A1 (ja) 2007-08-10 2008-08-08 画像表示装置

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2008/064327 Continuation-In-Part WO2009022659A1 (ja) 2007-08-10 2008-08-08 画像表示装置

Publications (2)

Publication Number Publication Date
US20100141897A1 US20100141897A1 (en) 2010-06-10
US8390586B2 true US8390586B2 (en) 2013-03-05

Family

ID=40350712

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/702,595 Expired - Fee Related US8390586B2 (en) 2007-08-10 2010-02-09 Image display apparatus that detects pointing element using imaging device

Country Status (7)

Country Link
US (1) US8390586B2 (de)
EP (1) EP2199889A4 (de)
JP (1) JP4835538B2 (de)
CN (1) CN101802758A (de)
DE (1) DE08827203T1 (de)
TW (1) TWI400636B (de)
WO (1) WO2009022659A1 (de)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110210945A1 (en) * 2010-02-25 2011-09-01 Nikon Corporation Projector
US20120287083A1 (en) * 2011-05-12 2012-11-15 Yu-Yen Chen Optical touch control device and optical touch control system
US20140104164A1 (en) * 2011-07-04 2014-04-17 Huawei Device Co., Ltd. Method and Electronic Apparatus for Realizing Virtual Handwriting Input
US11399165B2 (en) 2018-05-17 2022-07-26 Panasonic Intellectual Property Management Co., Ltd. Projection system, projection device, and projection method

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010137626A1 (ja) * 2009-05-27 2010-12-02 京セラ株式会社 携帯電子機器
JP5244084B2 (ja) * 2009-12-21 2013-07-24 パナソニック株式会社 表示制御システムおよび表示制御方法
JP2013070368A (ja) 2011-09-05 2013-04-18 Panasonic Corp テレビ対話システム、端末および方法
US20130169887A1 (en) * 2012-01-03 2013-07-04 Aiptek International Inc. Projection Application Device Working Through a Wireless Video Output Device and Its Video Output Control Unit
CN104583921A (zh) * 2012-08-27 2015-04-29 西铁城控股株式会社 信息输入装置
US9298072B2 (en) * 2012-12-19 2016-03-29 Seiko Epson Corporation Projector having inclination detection section for detecting inclination of projector enclosure and method for controlling the same
US9317171B2 (en) * 2013-04-18 2016-04-19 Fuji Xerox Co., Ltd. Systems and methods for implementing and using gesture based user interface widgets with camera input
JP6323040B2 (ja) * 2014-02-12 2018-05-16 株式会社リコー 画像処理装置、画像処理方法およびプログラム
KR102274542B1 (ko) * 2014-07-31 2021-07-07 삼성전자주식회사 디스플레이 장치 및 이의 화면을 제어하는 방법
JP6149825B2 (ja) 2014-08-22 2017-06-21 トヨタ自動車株式会社 車両用操作装置
JP6592904B2 (ja) * 2015-01-22 2019-10-23 セイコーエプソン株式会社 電子機器、プログラム
JP6635679B2 (ja) * 2015-05-26 2020-01-29 国立大学法人千葉大学 マーカーの解析方法
US20180059863A1 (en) * 2016-08-26 2018-03-01 Lenovo (Singapore) Pte. Ltd. Calibration of pen location to projected whiteboard
JP6911439B2 (ja) * 2017-03-24 2021-07-28 セイコーエプソン株式会社 プロジェクター
US10691217B2 (en) * 2017-04-20 2020-06-23 Fuji Xerox Co., Ltd. Methods and systems for providing a camera-based graphical user interface
JP7114415B2 (ja) * 2018-09-07 2022-08-08 キヤノン株式会社 投影制御装置、投影制御方法、及び、プログラム
JP7025391B2 (ja) 2018-10-11 2022-02-24 アプティブ・テクノロジーズ・リミテッド 自動車用通信ケーブル
WO2022003876A1 (ja) * 2020-07-01 2022-01-06 日本電気株式会社 制御装置、制御方法、及びコンピュータ可読媒体
JP7600703B2 (ja) 2021-01-21 2024-12-17 日本電気株式会社 手動走査装置、及びシステム

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH089309A (ja) 1994-06-23 1996-01-12 Canon Inc 表示方法及び装置
US5532765A (en) * 1993-03-17 1996-07-02 Matsushita Electric Industrial Co., Ltd. Image correction apparatus using a displayed test signal
JPH1195895A (ja) 1997-09-18 1999-04-09 Sony Corp 情報入力装置
US6120374A (en) 1996-08-05 2000-09-19 Kabushiki Kaisha Konami Computer Entertainment Osaka Apparatus for and method of designating a point on displayed image, and readable recording medium storing program for designating a point on displayed image
US20020075240A1 (en) 2000-05-29 2002-06-20 Vkb Inc Virtual data entry device and method for input of alphanumeric and other data
US6512507B1 (en) * 1998-03-31 2003-01-28 Seiko Epson Corporation Pointing position detection device, presentation system, and method, and computer-readable medium
US6788289B2 (en) * 2000-02-08 2004-09-07 Seiko Epson Corporation System and method of pointed position detection system, projector and program
US20050168700A1 (en) * 2004-01-29 2005-08-04 Heidelberger Druckmaschinen Ag Projection-area dependent display/operating device
US20060026533A1 (en) 2004-08-02 2006-02-02 Joshua Napoli Method for pointing and selection of regions in 3-D image displays
US20060221063A1 (en) * 2005-03-29 2006-10-05 Canon Kabushiki Kaisha Indicated position recognizing apparatus and information input apparatus having same
EP1710665A1 (de) 2004-01-15 2006-10-11 Vodafone K.K. Mobilkommunikationsendgerät
US20090268095A1 (en) 2006-02-21 2009-10-29 Matsushita Electric Works, Ltd. Image display apparatus and image distortion correction method of the same
US20100033692A1 (en) 2006-12-25 2010-02-11 Panasonic Electric Works Co., Ltd. Discharge lamp lighting device and image display apparatus
US20100039426A1 (en) 2008-08-18 2010-02-18 Panasonic Corporation Data signal loading circuit, display panel driving circuit, and image display apparatus

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5532765A (en) * 1993-03-17 1996-07-02 Matsushita Electric Industrial Co., Ltd. Image correction apparatus using a displayed test signal
JPH089309A (ja) 1994-06-23 1996-01-12 Canon Inc 表示方法及び装置
US6310662B1 (en) 1994-06-23 2001-10-30 Canon Kabushiki Kaisha Display method and apparatus having distortion correction
US6120374A (en) 1996-08-05 2000-09-19 Kabushiki Kaisha Konami Computer Entertainment Osaka Apparatus for and method of designating a point on displayed image, and readable recording medium storing program for designating a point on displayed image
JPH1195895A (ja) 1997-09-18 1999-04-09 Sony Corp 情報入力装置
US6512507B1 (en) * 1998-03-31 2003-01-28 Seiko Epson Corporation Pointing position detection device, presentation system, and method, and computer-readable medium
US6788289B2 (en) * 2000-02-08 2004-09-07 Seiko Epson Corporation System and method of pointed position detection system, projector and program
JP2003535405A (ja) 2000-05-29 2003-11-25 ブイケービー インコーポレイティド 文字・数字及び他のデータを入力する仮想データ入力装置及び方法
US20020075240A1 (en) 2000-05-29 2002-06-20 Vkb Inc Virtual data entry device and method for input of alphanumeric and other data
US20060101349A1 (en) 2000-05-29 2006-05-11 Klony Lieberman Virtual data entry device and method for input of alphanumeric and other data
EP1710665A1 (de) 2004-01-15 2006-10-11 Vodafone K.K. Mobilkommunikationsendgerät
US20070159453A1 (en) 2004-01-15 2007-07-12 Mikio Inoue Mobile communication terminal
US20050168700A1 (en) * 2004-01-29 2005-08-04 Heidelberger Druckmaschinen Ag Projection-area dependent display/operating device
US20060026533A1 (en) 2004-08-02 2006-02-02 Joshua Napoli Method for pointing and selection of regions in 3-D image displays
WO2006022912A1 (en) 2004-08-02 2006-03-02 Actuality Systems, Inc. Method for pointing and selection of regions in 3-d image displays
US20060221063A1 (en) * 2005-03-29 2006-10-05 Canon Kabushiki Kaisha Indicated position recognizing apparatus and information input apparatus having same
JP2006277357A (ja) 2005-03-29 2006-10-12 Canon Inc 指示位置認識装置及びそれを有する情報入力装置
US20090268095A1 (en) 2006-02-21 2009-10-29 Matsushita Electric Works, Ltd. Image display apparatus and image distortion correction method of the same
US20100033692A1 (en) 2006-12-25 2010-02-11 Panasonic Electric Works Co., Ltd. Discharge lamp lighting device and image display apparatus
US20100039426A1 (en) 2008-08-18 2010-02-18 Panasonic Corporation Data signal loading circuit, display panel driving circuit, and image display apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Eurepean Search Report, dated Jun. 4, 2012.

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110210945A1 (en) * 2010-02-25 2011-09-01 Nikon Corporation Projector
US20120287083A1 (en) * 2011-05-12 2012-11-15 Yu-Yen Chen Optical touch control device and optical touch control system
US8537139B2 (en) * 2011-05-12 2013-09-17 Wistron Corporation Optical touch control device and optical touch control system
US20140104164A1 (en) * 2011-07-04 2014-04-17 Huawei Device Co., Ltd. Method and Electronic Apparatus for Realizing Virtual Handwriting Input
US9335836B2 (en) * 2011-07-04 2016-05-10 Huawei Device Co., Ltd. Method and electronic apparatus for realizing virtual handwriting input
US11399165B2 (en) 2018-05-17 2022-07-26 Panasonic Intellectual Property Management Co., Ltd. Projection system, projection device, and projection method

Also Published As

Publication number Publication date
JP2009043157A (ja) 2009-02-26
US20100141897A1 (en) 2010-06-10
TW200925959A (en) 2009-06-16
JP4835538B2 (ja) 2011-12-14
CN101802758A (zh) 2010-08-11
TWI400636B (zh) 2013-07-01
DE08827203T1 (de) 2011-03-17
EP2199889A1 (de) 2010-06-23
WO2009022659A1 (ja) 2009-02-19
EP2199889A4 (de) 2012-07-04

Similar Documents

Publication Publication Date Title
US8390586B2 (en) Image display apparatus that detects pointing element using imaging device
US10218951B2 (en) MEMS scan controlled keystone and distortion correction
US8408720B2 (en) Image display apparatus, image display method, and recording medium having image display program stored therein
US8123361B2 (en) Dual-projection projector and method for projecting images on a plurality of planes
EP2026170B1 (de) Positionsbestimmungsvorrichtung
EP2120455B1 (de) Elektronikvorrichtung mit Projektormodul
JP5300859B2 (ja) 撮像装置、表示撮像装置および電子機器
US20050280628A1 (en) Projector pen image stabilization system
US10244197B2 (en) Projector and control method of projector
CN103365549A (zh) 输入装置、显示系统及输入方法
JP2013182061A (ja) 投影システム
US20110193969A1 (en) Object-detecting system and method by use of non-coincident fields of light
HK1145364A (en) Image display device
KR100860158B1 (ko) 펜 형의 위치 입력 장치
US12468147B2 (en) Multi-beam laser beam scanner in a picture generation unit
US11228744B2 (en) Method for controlling projection system, projection system, and control program
US11330236B2 (en) Projector controlling method and projector
CN101446875B (zh) 一种交互式显示屏幕及交互式显示的方法
US9335158B2 (en) Projector and projector system
US12206994B2 (en) Image capture systems utilizing adjustable illumination
US10860144B2 (en) Projector and method for controlling projector
JP2020122696A (ja) 位置検出装置、位置検出ユニット、画像表示システムおよび位置検出方法
JP2011198258A (ja) 情報入力装置、情報入出力装置および電子機器
JP2004062409A (ja) 座標入力装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: PANASONIC ELECTRIC WORKS CO., LTD.,JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KAWANO, KIYOHIKO;NOGE, HIROSHI;UEDA, HIDEKI;SIGNING DATES FROM 20100126 TO 20100131;REEL/FRAME:023932/0485

Owner name: PANASONIC ELECTRIC WORKS CO., LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KAWANO, KIYOHIKO;NOGE, HIROSHI;UEDA, HIDEKI;SIGNING DATES FROM 20100126 TO 20100131;REEL/FRAME:023932/0485

AS Assignment

Owner name: PANASONIC CORPORATION, JAPAN

Free format text: MERGER;ASSIGNOR:PANASONIC ELECTRIC WORKS CO.,LTD.,;REEL/FRAME:027697/0525

Effective date: 20120101

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20170305