WO2024258057A1 - Dispositif électronique pour aligner les positions d'un appareil de prise de vues et d'un écran souple à l'aide d'un motif formé sur l'écran souple, et procédé associé - Google Patents
Dispositif électronique pour aligner les positions d'un appareil de prise de vues et d'un écran souple à l'aide d'un motif formé sur l'écran souple, et procédé associé Download PDFInfo
- Publication number
- WO2024258057A1 WO2024258057A1 PCT/KR2024/006042 KR2024006042W WO2024258057A1 WO 2024258057 A1 WO2024258057 A1 WO 2024258057A1 KR 2024006042 W KR2024006042 W KR 2024006042W WO 2024258057 A1 WO2024258057 A1 WO 2024258057A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- camera
- flexible display
- electronic device
- region
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B30/00—Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Definitions
- the present disclosure relates to a wearable device and method for aligning the positions of a camera and a flexible display using a pattern formed on the flexible display.
- the shape and/or size of electronic devices are becoming more diverse. In order to enhance mobility, electronic devices having a reduced size and/or reduced volume are being designed.
- the electronic device may include a display for visualizing information. As the number of functions supported by the electronic device increases, the size of the display may be increased in order to visualize more information to the user and/or to support the execution of the functions. For example, the size and/or volume of the electronic device may be designed to be reduced, while the size of the display is maintained or increased.
- an electronic device may include a housing including a second housing part configured to engage a first housing part so as to be moveable between a collapsed position and an extended position, and a flexible display coupled to the first housing part and the second housing part.
- a size of an area of the flexible display visible from a front surface of the housing may change as the housing is moved between the collapsed position and the extended position.
- the electronic device may include an actuator within the housing configured to move the second housing part relative to the first housing part, a camera within the housing positioned below an active area of the flexible display, a memory storing instructions, the memory including one or more storage media, and at least one processor within the housing including a processing circuit.
- the active area may include a first area having a first density of subpixels and a second area surrounding the first area and having a second density higher than the first density.
- the rear surface of the flexible display, toward which the camera is directed, may include a pattern arranged along a boundary between the first region and the second region.
- the instructions, when individually and/or collectively executed by the at least one processor, may cause the electronic device, in response to an input activating the camera, to acquire an image through the camera.
- the instructions, when individually and/or collectively executed by the at least one processor may cause the electronic device to identify whether a visual object corresponding to the pattern is included in the image.
- the instructions, when individually and/or collectively executed by the at least one processor may cause the electronic device to control the actuator to align the camera with respect to the first region based on the image including the visual object.
- a method of an electronic device may include an operation of acquiring an image through a camera of the electronic device, the camera being positioned below an active area of a flexible display of the electronic device, in response to an input activating the camera of the electronic device.
- the method may include an operation of identifying whether a visual object corresponding to a pattern formed on a rear surface of the flexible display toward which the camera is directed is included in the image.
- the method may include an operation of controlling the actuator to align the camera with respect to the flexible display based on the image including the visual object.
- an electronic device may include a housing, a flexible display at least partially exposed to the outside through one side of the housing, a camera within the housing positioned to face one side of the flexible display, an actuator for adjusting a position of the flexible display relative to the camera, a memory storing instructions, the memory including one or more storage media, and at least one processor including a processing circuit.
- the instructions when individually and/or collectively executed by the at least one processor, may cause the electronic device to acquire an image using the camera.
- the instructions, when individually and/or collectively executed by the at least one processor may cause the electronic device to identify whether a visual object associated with a boundary between a first region and a second region of the flexible display, the boundary being distinguished by a density of pixels, is included in the image.
- the above instructions, when individually and/or collectively executed by the at least one processor may cause the electronic device to control the actuator to adjust the position based on the image including the visual object.
- a method of an electronic device may include an operation of acquiring an image using a camera positioned to face one side of a flexible display of the electronic device.
- the method may include an operation of identifying whether a visual object associated with a boundary between a first region and a second region of the flexible display, the boundary being distinguished by a density of pixels, is included in the image.
- the method may include an operation of controlling the actuator to adjust the position based on the image including the visual object.
- FIGS. 1A to 1E illustrate one embodiment of an electronic device including a flexible display and a camera.
- FIG. 2 illustrates an example block diagram of an electronic device, according to one embodiment.
- FIGS. 3A to 3C illustrate an example of a flow diagram of an electronic device according to one embodiment.
- FIG. 4 illustrates an example of the structure of a portion of a flexible display overlapping a camera.
- Figure 5 illustrates an example of a pattern formed on one side of a flexible display toward which a camera is directed.
- FIG. 6 illustrates an example of the operation of an electronic device for aligning a camera and a flexible display.
- FIG. 7 illustrates an example of an electronic device including a sweeper structure associated with a camera.
- FIG. 8 illustrates an example of an electronic device including a rail structure associated with a camera.
- Figure 9 illustrates an example of the operation of an electronic device performed to obtain information for controlling an actuator.
- FIG. 10 is a block diagram of an electronic device within a network environment according to various embodiments.
- FIG. 11 is a block diagram illustrating a camera module according to various embodiments.
- FIG. 12 is a block diagram of a display module according to various embodiments.
- Expressions such as “first”, “second”, “first” or “second” can modify the corresponding components, regardless of order or importance, and are only used to distinguish one component from another and do not limit the corresponding components.
- a certain (e.g., a first) component is "(functionally or communicatively) connected” or “connected” to another (e.g., a second) component
- said certain component may be directly connected to said other component, or may be connected through another component (e.g., a third component).
- module includes a unit composed of hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit.
- a module may be an integrally composed component or a minimum unit or part thereof that performs one or more functions.
- a module may be composed of an application-specific integrated circuit (ASIC).
- ASIC application-specific integrated circuit
- FIGS. 1A to 1E illustrate an embodiment of an electronic device (101) including a flexible display (110) and a camera (130).
- the electronic device (101) may be referred to as a terminal (or user terminal) in terms of being owned by a user.
- the terminal may include, for example, a personal computer (PC) such as a laptop or a desktop.
- the terminal may include, for example, a smartphone, a smartpad, and/or a tablet PC.
- the terminal may include a smart accessory such as a smartwatch and/or a head-mounted device (HMD).
- HMD head-mounted device
- a housing (120) of the electronic device (101) may include an internal space in which one or more hardwares included in the electronic device (101) (e.g., one or more of the hardwares described above with reference to FIG. 2 ) are disposed.
- the above housing (120) can form the outer shape of an electronic device (101).
- the electronic device (101) may have a deformable form factor. Deforming the electronic device (101) may mean that at least one of the dimensions, such as width, height, and/or thickness, of the electronic device (101) is changed. At least one of the dimensions may be passively changed by an external force applied to the electronic device (101), and/or actively changed by one or more actuators included in the electronic device (101) (e.g., actuator (220) of FIG. 2).
- actuators included in the electronic device (101) (e.g., actuator (220) of FIG. 2).
- the housing (120) of the electronic device (101) may be divided into a first housing part (121) and a second housing part (122), which are interconnected.
- the electronic device (101) may change the shape of the flexible display (110) and/or the electronic device (101) by adjusting the positional relationship of the first housing part (121) and the second housing part (122) using an actuator.
- the flexible display (110) of the electronic device (101) may be arranged across one side of the first housing part (121) and one side of the second housing part (122).
- a surface on which the flexible display (110) is disposed and formed by the first housing part (121) and the second housing part (122) may be referred to as a front surface of the electronic device (101).
- a front surface of the electronic device (101) that is parallel to the x-y plane is illustrated.
- changing the shape of the flexible display (110) by the electronic device (101) may include an operation of changing at least one of a width, a height, and/or an extent of at least a portion that is exposed to the outside within the flexible display (or is visible from the front surface of the housing (120).
- a housing (120) of an electronic device (101) may include a second housing part (122) configured to engage with the first housing part (121) so as to be movable between a retracted position and an extended position.
- a flexible display (110) may be coupled to the first housing part (121) and the second housing part (122).
- a size of an area of the flexible display (110) visible from the front of the housing (120) may change as the housing (120) is moved between the retracted position and the extended position.
- the flexible display (110) of the electronic device (101) may be insertable into the first housing part (121) and/or the second housing part (122), or extractable from the first housing part (121) and/or the second housing part (122), based on a deformation of the electronic device (101).
- a size of an area where the flexible display (110) is exposed to the outside may be reduced.
- a size of an area where the flexible display (110) is exposed to the outside may be increased.
- a displaying area of a flexible display (110) may mean an area formed by pixels, among pixels included in the flexible display (110), arranged on an area of the flexible display (110) exposed to the outside.
- the displaying area may be referred to as an active area of the flexible display (110).
- an area of the flexible display (110) visible from the front surface of the housing (120) may be referred to as an active area.
- the active area of the flexible display (110) may correspond to at least a portion of the flexible display (110) distinguished by pixels in an active state, among pixels included in the flexible display (110).
- the electronic device (101) may switch between the states (191, 192, 193) using an actuator (e.g., actuator 220 of FIG. 2 ).
- the states (191, 192, 193) of the electronic device (101) may be distinguished based on dimensions (e.g., width, height, thickness, and/or an aspect ratio) of the electronic device (101) and/or the flexible display (110).
- the states (191, 192, 193) can be distinguished according to the distance between the first housing part (121) and the second housing part (122) of the electronic device (101).
- the distance between the first housing part (121) and the second housing part (122) can be the distance between one side of the first housing part (121) (e.g., the left side of the first housing part (121)) and the other side of the second housing part (122) (e.g., the right side of the second housing part (122)) that is parallel to one side of the first housing part (121) and spaced apart from the one side of the first housing part (121).
- States (191, 193) of FIGS. 1A and 1C may be states in which the surface area of the electronic device (101) and/or the area of the active region of the flexible display (110) are minimized as the electronic device (101) is deformed.
- states in which the surface area of the electronic device (101) and/or the area of the active region are minimized such as states (191, 193), may be referred to as a slide-in state, a rolled state, a closed state, a roll-in state, and/or a contracted state.
- a first region (110-1) of the flexible display (110) may be exposed to the outside, and a second region (110-2) may be introduced into the housing (120).
- a second region (110-2) of the flexible display (110) may be exposed to the outside, and a first region (110-1) may be introduced into the housing (120).
- the electronic device (101) may move the flexible display (110) along either one of the two directions (the direction of the +x-axis and/or the direction of the -x-axis).
- the electronic device (101) may have a structure for accommodating at least a portion (e.g., a first region (110-1) and/or a second region (110-2)) of the flexible display (110) that moves along one of the two directions.
- the first region (110-1) and the second region (110-2) may be different regions spaced apart from each other within the flexible display (110), or may at least partially overlap.
- the first housing part (121) and the second housing part (122) may be positioned based on the reduced position.
- the state (192) of FIG. 1b may be a state in which the surface area of the electronic device (101) and/or the area of the active area of the flexible display (110) are maximized as the electronic device (101) is deformed.
- the state in which the surface area of the electronic device (101) and/or the area of the active area are maximized such as the state (192), may be referred to as a slide-out state, an unrolled state, an opened state, a roll-out state, and/or an expanded state.
- the state of the electronic device (101) may further include other states between a state in which the area of the active area is minimized (e.g., the states (191, 193) of FIG. 1a and/or FIG.
- the first housing part (121) and the second housing part (122) may be positioned based on the extended position.
- the flexible display (110) of the electronic device (101) may have a rectangular shape.
- corners of the display (140) may have rounded corners.
- a first direction parallel to a relatively long side may be referred to as a height direction, and the relatively long side may be referred to as a height.
- a second direction parallel to a relatively short side may be referred to as a width direction, and the relatively short side may be referred to as a width.
- an embodiment of an electronic device (101) that extends or contracts along the width direction of the flexible display (110) or the height direction is illustrated.
- the embodiment is not limited thereto, and the electronic device (101) may extend or contract along the height direction of the flexible display (110).
- the electronic device (101) may move the second housing part (122) relative to the first housing part (121) (e.g., by withdrawing the second housing part (122) relative to the first housing part (121)) to withdraw the second region (110-2) of the flexible display (110).
- the second region (110-2) of the flexible display (110) is pulled out, so that the active region of the flexible display (110) can be extended (and/or expanded) along the width direction.
- the electronic device (101) can move the second housing part (122) relative to the first housing part (121) (e.g., by introducing the second housing part (122) into the first housing part (121)) to introduce the first area (110-1) of the flexible display (110). While switching from the state (192) of FIG. 1b to the state (193) of FIG. 1c, as the first area (110-1) of the flexible display (110) is introduced into the housing (120), the active area of the flexible display (110) can be reduced along the width direction.
- the electronic device (101) may sequentially switch from the state (193) of FIG. 1c to the state (191) of FIG. 1a.
- the electronic device (101) may switch from the state (193) of FIG. 1c to the state (192) of FIG. 1b corresponding to the roll-out state, and then switch back to the state (193) of FIG. 1c.
- the electronic device (101) may switch from the state (191) of FIG. 1a, which is an example of a roll-in state, to the state (192) of FIG.
- the electronic device (101) can be switched to a roll-in state in which one of different regions (e.g., the first region (110-1) and/or the second region (110-2)) is selectively exposed based on the lifespan and/or deterioration of pixels included in the flexible display (110).
- the deterioration of the pixels can be identified or measured by the electronic device (101) to prevent and/or compensate for burn-in of an organic light emitting diode (OLED).
- OLED organic light emitting diode
- the electronic device (101) can be switched to a state (193) of FIG. 1C, which is a roll-in state in which the second region (110-2) is exposed to the outside.
- the electronic device (101) may include a camera (130) within a housing (120) positioned beneath an active area of the flexible display (110). For example, when viewing the front of the electronic device (101) along the z-axis direction, the camera (130) may be positioned beneath the flexible display (110). For example, when viewing the front of the electronic device (101) along the z-axis direction, the camera (130) may overlap at least a portion of the flexible display (110). In terms of being positioned beneath the flexible display (110), the camera (130) may be referred to as an under display camera (UDC) and/or an under panel display (UPC).
- UDC under display camera
- UPC under panel display
- an active area of a flexible display (110) in which a plurality of pixels are arranged may include a first area (111) configured to transmit ambient light toward a camera (130) positioned below the flexible display (110) and a second area (112) different from the first area (111).
- the structure of the flexible display (110) in the first area (111) and/or the second area (112) is described with reference to FIG. 4.
- the camera (130) when looking at the front of the electronic device (101) along the z-axis direction, the camera (130) may be positioned under the first region (111) of the flexible display (110). While positioned under the first region (111), the electronic device (101) may obtain information (e.g., images and/or videos) about light that passes through the first region (111) and reaches the camera (130) from the camera (130). When the camera (130) is positioned under the second region (112) different from the first region (111), obtaining images and/or videos through the camera (130) may be stopped as the amount of light reaching the camera (130) decreases. To support capturing images and/or videos using the camera (130), the electronic device (101) can align the position of the camera (130) with respect to the first area (111) of the flexible display (110).
- information e.g., images and/or videos
- a flexible display (110) is illustrated including a first region (111) having a shape extending along one direction (e.g., one direction parallel to the x-axis), but the shape of the first region (111) is not limited thereto.
- FIGS. 1D to 1E different states (194, 195) of the flexible display (110) and/or the electronic device (101) are illustrated including a first region (111) having a shape corresponding to a shape of a lens of a camera (130) (e.g., a circular shape).
- the state (194) of the electronic device (101) of FIG. 1D may correspond to the roll-in state described with reference to FIGS. 1A and/or 1C .
- the state (195) of the electronic device (101) of FIG. 1E may correspond to the roll-out state described with reference to FIG. 1B .
- the camera (130) of the electronic device (101) may be positioned below the first region (111) of the flexible display (110).
- the first region (111) may overlap with the camera (130) when the front of the electronic device (101) in the roll-in state is viewed along the z-axis. Since the first region (111) has a shape parallel to the outline of the camera (130) when the front of the electronic device (101) is viewed along the z-axis, as soon as the flexible display (110) is moved with respect to the camera (130), the camera (130) may be moved below a second region (112) different from the first region (111).
- the electronic device (101) may switch to the roll-in state (e.g., the state (194) of FIG. 1D) based on an input for activating the camera (130), and then execute a function related to the camera (130).
- the electronic device (101) may include a first region (111) and a third region (113) having a structure for transmitting light toward the camera (130).
- the embodiment is not limited thereto, and the electronic device (101) may include only one region of the first region (111) or the third region (113).
- the first region (111) may be aligned with the camera (130) in the roll-in state.
- the third region (113) may be formed on the flexible display (110) to be aligned with the camera (130) in the roll-out state.
- the third region (113) may overlap with the camera (130) when looking at the front of the electronic device (101) in a rolled-out state along the z-axis.
- the third region (113) may have a shape parallel to the outline of the camera (130) when looking at the front of the electronic device (101) along the z-axis.
- an electronic device (101) including a first region (111) and a third region (113) acquiring an image using a camera (130) is permitted in a state (194) of FIG. 1D corresponding to a roll-in state and a state (195) of FIG. 1E corresponding to a roll-out state, and may not be permitted in other states (e.g., an intermediate state and/or a free stop state) that are different from the roll-in state and the roll-out state.
- the electronic device (101) may switch to either the roll-in state or the roll-out state, and then execute a function related to the camera (130).
- the positional relationship between the flexible display (110) and the camera (130) may change. Since the electronic device (101) controls the actuator to move the second housing part (122) with respect to the first housing part (121), the positional relationship between the flexible display (110) and the camera (130) may be changed by the actuator.
- An error may occur while a driving part included in the actuator, such as a stepper motor, is physically moved.
- the error may be related to a difference between a shape of the electronic device (101) indicated by parameters stored in the electronic device (101) and an actual shape of the electronic device (101). As the period during which the actuator is activated increases, the error may accumulate and the difference between the actual shape of the electronic device (101) and the shape of the electronic device (101) represented by the parameters may increase.
- the electronic device (101) can use an image identified through the camera (130) to identify the difference. For example, using the image, the electronic device (101) can identify a misalignment between the flexible display (110) and the camera (130). To identify the misalignment, the electronic device (101) can include a pattern formed along a boundary between the first region (111) and the second region (112) of the flexible display (110). Based on whether the pattern is captured by the camera (130), the electronic device (101) can identify the misalignment of the camera (130) with respect to the flexible display (110). Based on identifying the misalignment, the electronic device (101) can control an actuator to align the camera (130) with respect to the first region (111) of the flexible display (110). Based on identifying the misalignment, the electronic device (101) can change one or more parameters (e.g., control information) for controlling the actuator.
- the electronic device (101) can change one or more parameters (e.g., control information) for controlling the actuator.
- an electronic device (101) for identifying and/or compensating for misalignment between a flexible display (110) and a camera (130) is described.
- the electronic device (101) can identify the misalignment using a camera (130) independently of a sensor (e.g., a Hall sensor) for identifying a shape of the flexible display (110) (or a distance between the first housing part (121) and the second housing part (122)).
- a sensor e.g., a Hall sensor
- FIG. 2 illustrates an example of a block diagram of an electronic device (101), according to one embodiment.
- the electronic device (101) of FIGS. 1A to 1E may be an example of the electronic device (101) of FIG. 2.
- the electronic device (101) may include at least one of a processor (210), a memory (215), a flexible display (110), an actuator (220), or a camera (130).
- the processor (210), the memory (215), the flexible display (110), the actuator (220), and the camera (130) may be electrically and/or operably coupled with each other by an electronic component, such as a communication bus (202).
- the hardwares being operatively coupled may mean that a direct connection or an indirect connection is established between the hardwares, either wired or wireless, so that the second hardware is controlled by the first hardware among the hardwares.
- the embodiment is not limited thereto, and some of the hardwares of FIG. 2 (e.g., at least a portion of the processor (210) and the memory (215)) may be included in a single integrated circuit such as a SoC (system on a chip).
- SoC system on a chip
- the type and/or number of hardware included in the electronic device (101) is not limited to that illustrated in FIG. 2.
- the electronic device (101) may include only some of the hardware components illustrated in FIG. 2.
- the processor (210) of the electronic device (101) may include hardware and/or circuitry for processing data based on one or more instructions.
- the processor (210) may include an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and/or an application processor (AP).
- ALU arithmetic and logic unit
- FPU floating point unit
- FPGA field programmable gate array
- CPU central processing unit
- AP application processor
- the number of processors (210) may be one or more.
- the processor (210) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.
- the memory (215) of the electronic device (101) may include hardware for storing data and/or instructions input to or output from the processor (210).
- the memory (215) may include, for example, volatile memory such as random-access memory (RAM) and/or non-volatile memory such as read-only memory (ROM).
- RAM random-access memory
- ROM read-only memory
- the volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), Cache RAM, and pseudo SRAM (PSRAM).
- the non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, solid state drive (SSD), and embedded multi-media card (eMMC).
- PROM programmable ROM
- EPROM erasable PROM
- EEPROM electrically erasable PROM
- flash memory hard disk, compact disk, solid state drive (SSD),
- a flexible display (110) of an electronic device (101) can output visualized information to a user.
- the flexible display (110) can visualize information provided from a controller, such as a graphic processing unit (GPU).
- the flexible display (110) can include a liquid crystal display (LCD), a plasma display panel (PDP), and/or a plurality of light emitting diodes (LEDs).
- the LEDs can include organic LEDs (OLEDs).
- the flexible display (110) can include electronic paper. As described above with reference to FIGS. 1A to 1E , the flexible display (110) can have an at least partially curved shape or a deformable shape.
- the flexible display (110) of the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the flexible display (110).
- a sensor e.g., a touch sensor panel (TSP)
- the processor (210) of the electronic device (101) may detect an external object that comes into contact with the flexible display (110) or is floating on the flexible display (110).
- the processor (210) may execute a function related to a specific visual object corresponding to a position of the external object on the flexible display (110) among visual objects displayed within the flexible display (110).
- an actuator (220) of an electronic device (101) may be configured to move a second housing part (e.g., a second housing part (122) of FIGS. 1A-1E) relative to a first housing part (e.g., a first housing part (121) of FIGS. 1A-1E) of a housing (e.g., a housing (120) of FIGS. 1A-1E).
- the actuator (220) may change the shape of the flexible display (110) and/or the electronic device (101).
- the actuator (220) may be referred to as a driving unit.
- the actuator (220) may include hardware for outputting kinetic energy from electrical energy.
- the actuator (220) may include a motor and/or a stepper motor.
- the step motor included in the actuator (220) can be rotated by an angle indicated by a pulse signal applied to the step motor.
- the actuator (220) may include a gear (e.g., a rack gear) to change a rotational motion of the motor into a linear motion (or translation motion) applied to the flexible display (110).
- the actuator (220) may include a plurality of gears engaged to each other to control the rotational force (e.g., torque) of the motor.
- the plurality of gears may be referred to as a gear assembly, or transmission portion, of the actuator (220).
- the processor (210) can control the speed and/or direction in which the flexible display (110) and/or the electronic device (101) deforms by changing the frequency, voltage, and/or current of a power signal applied to the motor of the actuator (220). In one embodiment, the processor (210) can control the speed and/or direction in which the flexible display (110) and/or the electronic device (101) deforms by controlling the positional relationship of a plurality of gears included in the gear assembly, and/or a gear ratio between interconnected gears.
- the camera (130) of the electronic device (101) may include optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing a color and/or brightness of light.
- the plurality of optical sensors included in the camera (130) may be arranged in the form of a two-dimensional array.
- the camera (130) may acquire electric signals of each of the plurality of optical sensors substantially simultaneously, and generate an image corresponding to light reaching the optical sensors of the two-dimensional grid and including a plurality of pixels arranged two-dimensionally.
- photographic data captured using the camera (130) may mean one image acquired from the camera (130).
- video data captured using the camera (130) may mean a sequence of a plurality of images acquired from the camera (130) according to a specified frame rate.
- a camera (130) positioned under a flexible display (110) is exemplarily illustrated, but the number and/or positions of the cameras (130) included in the electronic device (101) are not limited to the embodiments of FIGS. 1A to 1E.
- one or more instructions (or commands) representing operations and/or actions to be performed on data by the processor (210) may be stored in the memory (215) of the electronic device (101).
- a set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, a software application, and/or an application.
- the electronic device (101) and/or the processor (210) may perform at least one of the operations of FIGS. 3A to 3C when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and/or an application is executed.
- an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in the memory (215) of the electronic device (101), and that the one or more applications are stored in a format executable by the processor (210) of the electronic device (101) (e.g., a file having an extension specified by the operating system of the electronic device (101)).
- the processor (210) of the electronic device (101) can control the camera (130) based on the execution of the camera application (225).
- the processor (210) can execute the camera application (225) based on an input indicating the execution of the camera application (225).
- the input indicating the execution of the camera application (225) can be identified by a touch gesture (or a drag gesture) to a visual object (e.g., an icon) displayed on the flexible display (110) and representing the camera application (225).
- the input indicating the execution of the camera application (225) can be identified by the pressing of a designated button exposed externally through a portion of the housing of the electronic device (101).
- the input indicating execution of the camera application (225) may be identified by a voice command and/or a user's utterance including a natural language sentence related to the camera (130).
- the input indicating execution of the camera application (225) may be included in an input activating the camera (130).
- the processor (210) may perform an operation to identify a positional relationship between the flexible display (110) and the camera (130).
- the processor (210) may obtain an image through the camera (130).
- the processor (210) may obtain information for identifying a positional relationship between the flexible display (110) and the camera (130) from the image.
- the processor (210) may identify, from the image, a visual object corresponding to at least a portion of a pattern for distinguishing a first region (e.g., the first region (111) of FIGS. 1A to 1E) of the flexible display (110) configured to transmit light toward the camera (130).
- the electronic device (101) can execute a function for aligning the flexible display (110) and the camera (130), for example, a function for controlling the actuator (220).
- the processor (210) of the electronic device (101) may control the actuator (220) using actuator control information (230) stored in the memory (215).
- the actuator control information (230) may include information required for driving a step motor included in the actuator (220).
- the actuator control information (230) may include information on the amplitude and/or pulse width of a pulse signal required for controlling the step motor.
- the actuator control information (230) may include information on the degree to which the step motor rotates with respect to a unit pulse applied to the step motor.
- the actuator control information (230) may include a movement distance of the flexible display (110) and/or the housing (e.g., the first housing part (121) and/or the second housing part (122)) of the electronic device (101) for the unit pulse.
- the actuator control information (230) may include information indicating a relationship between the rotational number (e.g., step) of the step motor and the movement distance.
- the processor (210) may control the actuator (220) to align the flexible display (110) and the camera (130) when the processor (210) identifies a visual object corresponding to at least a portion of the pattern from an image acquired from the camera (130). Based on the aligning of the flexible display (110) and the camera (130), the processor (210) may change the actuator control information (230). For example, the processor (210) may change the actuator control information (230) to prevent an image including the visual object from being output from the camera (130).
- FIGS. 3A to 3C illustrate an example of a flow diagram of an electronic device according to one embodiment.
- the operations of the electronic device described with reference to FIGS. 3A to 3C may be performed by the electronic device (101) of FIGS. 1A to 1E and/or FIG. 2 and/or the processor (210) of FIG. 2.
- a processor of an electronic device may, in response to an input activating a camera (e.g., camera (130) of FIGS. 1A-1E and/or FIG. 2), acquire an image from the camera.
- the input may include an input to execute a camera application (225) of FIG. 2.
- Operation (310) may be performed while the shape and/or state of the electronic device is aligned with a portion of the flexible display (e.g., first region (111) of FIGS. 1A-1E) configured to transmit light, wherein the camera is positioned beneath a flexible display (e.g., flexible display (110) of FIGS. 1A-1E and/or FIG. 2).
- the processor may control the actuator (220) of FIG. 2 to position the camera below the portion of the flexible display, and then perform the operation (310).
- the embodiment is not limited thereto, and the processor of the electronic device may acquire an image of the operation (310) based on a test operation to verify the alignment of the camera and the flexible display.
- the test operation may be performed while the electronic device is being produced, manufactured, and/or assembled.
- the test operation may include a background process (e.g., a self-diagnosis process) executed by the electronic device.
- a processor of the electronic device may identify whether a visual object corresponding to a pattern formed on a rear surface of the flexible display is included in an image of operation (310).
- the rear surface of the flexible display facing the camera may include a pattern positioned along a boundary between a first region configured to transmit light toward the camera (e.g., the first region (111) of FIGS. 1A to 1E) and a second region different from the first region (e.g., the second region (112) of FIGS. 1A to 1E).
- a pattern may be formed on the rear surface of the flexible display to guide alignment of the camera and the flexible display. Exemplary shapes and/or positions of the pattern formed on the rear surface of the flexible display are described with reference to FIGS. 5 to 6.
- a processor of an electronic device may identify a visual object corresponding to the pattern from the image of the action (310) by comparing a reference image related to the pattern and an image of the action (310).
- the processor may identify the visual object from the image of the action (310) based on one or more feature points included in the image of the action (310).
- the embodiment is not limited thereto, and the processor may identify the visual object from the image of the action (310) using a neural network (or model), such as a convolutional neural network (CNN) and/or a long-short term memory (LSTM).
- CNN convolutional neural network
- LSTM long-short term memory
- the pattern of the action (320) is formed at a boundary between a first region configured to transmit light toward the camera and a second region different from the first region
- inclusion of a visual object corresponding to the pattern in an image may mean that at least a portion of the camera is positioned below the boundary and/or the second region.
- capturing of images and/or video using at least a portion of the camera may be interrupted because light directed to the camera is occluded by the second region. For example, vignetting may occur in a portion of an image and/or video corresponding to at least a portion of the camera.
- the processor may search for a visual object corresponding to the pattern in the image of the operation (310) to identify whether vignetting occurs. If vignetting occurs, the processor may perform an operation to prevent the vignetting. In terms of a mark formed to identify the vignetting, the pattern may be referred to as a vignetting recognition mark. Based on identifying an image including a visual object corresponding to at least a portion of the pattern (320-Yes), the processor may perform operation (330). Having identified the visual object corresponding to at least a portion of the pattern, the processor may determine that at least a portion of the camera overlaps a second area of the flexible display when looking at the front of the electronic device.
- the processor may control an actuator to reduce a size of at least a portion of the camera overlapping the second area. If the visual object is not identified from the image (320-No), the processor may perform operation (360). For example, if the visual object is not identified from the image (320-No), actions (330, 340, 350) may not be performed, or performing actions (330, 340, 350) may be bypassed.
- a processor of an electronic device may identify a location of a visual object within an image. For example, the processor may identify coordinate values representing a location of the visual object within the image. The processor may identify a distance between an edge of the image and the visual object. Identifying a location of a visual object within the image based on operation (330) by the processor may be performed to align a camera and a flexible display using the location.
- a processor of an electronic device may control an actuator (e.g., actuator (220) of FIG. 2) to align a camera and a flexible display.
- the processor may control the actuator based on a location identified based on operation (330).
- the processor may use the location to determine a movement distance required for the entire image sensor of the camera to move under the first region of the flexible display.
- the processor may control the actuator based on the determined movement distance.
- the processor may determine a number of pulses to be applied to the stepper motor based on the movement distance per unit pulse and the determined movement distance.
- the processor may transmit a pulse signal based on the number of pulses to the stepper motor. For example, to align the camera with respect to the first area of the flexible display, the processor may transmit, to the actuator, a pulse signal, indicating a movement distance of the flexible display based on a number of pulses, and/or a control signal including the pulse signal.
- the pulse signal may be included in a control signal transmitted from the processor to the actuator.
- the processor can obtain a control signal to be transmitted to the one or more motors to align the camera and the flexible display based on a relationship between rotation angles of one or more motors (e.g., the stepper motor) included in the actuator and a movement distance of the flexible display with respect to the camera.
- the processor can control the actuator to align the camera with respect to the first area of the flexible display. Based on the control of the actuator, the processor can align the camera and the flexible display such that the camera is positioned below the first area of the flexible display.
- the processor of the electronic device may change control information for the actuator (e.g., actuator control information (230) of FIG. 2).
- the control information indicating a relationship between rotation angles of one or more motors included in the actuator and a movement distance of the flexible display may be stored in the memory of the electronic device. Identifying a visual object corresponding to a pattern formed on the rear surface of the flexible display in the image may mean that the flexible display and the camera are misaligned by the driving of the actuator.
- the processor that has identified the visual object may align the flexible display and the camera based on the control of the actuator of operation (340), and change the control information used to control the actuator based on operation (350). For example, the processor may change the control information so that the camera is moved under the first region of the flexible display by an actuator controlled by the changed control information.
- the processor of the electronic device may execute a function related to the camera (e.g., capturing).
- the processor may display at least a portion of an image acquired from the camera on the flexible display as a preview image.
- the processor may perform operation (340) to control the actuator, and after the camera is moved under the first region of the flexible display, the processor may acquire another image to be displayed on the flexible display in response to the input of operation (310) using the camera.
- the other image may be referred to as a preview image.
- the processor may execute the function to acquire an image and/or a video.
- the processor may store the acquired image and/or the acquired video in a memory (e.g., the memory (215) of FIG. 2).
- the operation of the electronic device described with reference to FIG. 3a can be performed by the electronic device capable of acquiring an image using the camera (130) in all switchable states based on the deformation of the actuator, such as the electronic device (101) described with reference to FIGS. 1a to 1c.
- the electronic device (101) described with reference to FIGS. 1a to 1c such as the electronic device (101) described with reference to FIGS. 1a to 1c.
- FIGS. 1d to 1e depending on the size and/or position of the first region (111) (or the third region (113)) configured to transmit light toward the camera (130), acquiring an image using the camera (130) in a specific state (e.g., an intermediate state and/or a free stop state) of the electronic device (101) may not be permitted.
- a specific state e.g., an intermediate state and/or a free stop state
- a processor of an electronic device may control an actuator, in response to an input activating a camera, to move the camera below a first area of the flexible display.
- the first area of operation (312) may include the first area (111) of FIGS. 1A to 1E and/or the first area (111) and the third area (113) of FIGS. 1C to 1E.
- the processor may determine a rotation angle of the motor for moving the camera below the first area by using a relationship between a rotation angle of a motor included in the actuator and a movement distance of the flexible display.
- the processor may control the actuator based on the determined rotation angle to perform operation (312).
- a processor of an electronic device may acquire an image using a camera. Operation (314) of FIG. 3B may be performed similarly to operation (310) of FIG. 3A.
- the processor may acquire an image by performing operation (314) within a state in which the camera is moved below the first area of the flexible display based on operation (312).
- the processor of the electronic device may identify whether a visual object corresponding to a pattern formed along a boundary of the first area and the second area of the flexible display is included in the image of operation (314).
- the pattern and/or visual object of operation (322) may correspond to the pattern and/or visual object of operation (320) of FIG. 3A . If an image including the visual object of operation (322) is identified (322-Yes), the processor may perform operations (330, 340, 350) of FIG. 3B . Operations (330, 340, 350) of FIG. 3B may correspond to operations (330, 340, 350) of FIG. 3A . If the visual object of operation (322) is not identified from the image (322-No), the processor may perform operation (360).
- the operation (360) of Fig. 3b can correspond to the operation (360) of Fig. 3a.
- a processor that identifies an image including a visual object of operation may align the camera and the flexible display based on operations (330, 340, 350).
- the processor that aligns the camera and the flexible display may change or update information used to move the flexible display of operation (312) (e.g., information indicating a relationship between a rotation angle of the motor and a movement distance of the flexible display).
- a processor that controls a stepper motor of an actuator based on a first number of steps specified in operation (312) may determine a sum of the first number and the second number as a parameter used to control the stepper motor to move the camera below the first area when controlling the stepper motor based on a second number of steps based on operation (340). For example, after operation (340), the sum of the first number and the second number can be used to move the camera below the first area.
- a processor of an electronic device may control an actuator in response to an input for introducing and/or withdrawing a flexible display.
- the input may include a user input for deformation of the electronic device and/or the flexible display.
- the processor identifying the input may control the actuator to move the flexible display. By moving the flexible display, a positional relationship between a camera positioned under the flexible display and the flexible display may be changed.
- the processor controlling the actuator based on the operation (316) can perform the operation (314). Based on the image acquired by the operation (314), the processor can perform the operations (322, 330, 340, 350). Based on the operations (322, 330, 340, 350), the processor can adjust the position of the camera with respect to the flexible display. For example, the processor identifying a visual object in the image acquired after controlling the actuator can align the camera and the flexible display based on the operations (330, 340, 350). After performing the alignment, the processor can complete the introduction and/or withdrawal of the flexible display based on the operation (370).
- the operations described with reference to FIG. 3c may be performed based on a background process executed by the processor while controlling the actuator based on an input for ingress and/or egress of the flexible display.
- the processor may perform aligning the camera and the flexible display based on FIG. 3c independently of the screen displayed on the flexible display. Any of the operations (314, 322, 330, 340, 350) of FIG. 3c may be performed without displaying a screen on the flexible display.
- the processor of the electronic device may control the actuator to prevent a camera of the electronic device from being obscured by a specific area of the flexible display (e.g., the second area (112) of FIGS. 1A to 1E) in the UDC and/or UPC structure.
- a specific area of the flexible display e.g., the second area (112) of FIGS. 1A to 1E
- FIG. 4 illustrates an example of a structure of a portion of a flexible display (110) overlapping a camera (130).
- the electronic device (101) of FIGS. 1A to 1E and FIG. 2 may include the camera (130) and the flexible display (110) described with reference to FIG. 4.
- a second region (112) of the flexible display (110), which is different from a first region (111) configured to transmit light to the camera (130), may be configured to surround the first region (111).
- the second region (112) may have a structure different from the structure for transmitting light to the camera (130).
- the second region (112) may not include a structure including one or more openings for transmitting light to the camera (130).
- FIG. 4 an example of a structure formed in the first region (111) of the flexible display (110) for transmitting light to the camera (130) will be described.
- the first region (111) of the flexible display (110) may include a plurality of pixels (430) that are uniformly spaced from each other and an opaque metal layer (410) positioned under the plurality of pixels (430).
- Each of the plurality of pixels (430) may include sub-pixels (431, 432, 433) configured to emit different colors.
- the colors may include three primary colors of light (e.g., red, green, and blue).
- sub-pixel (431) may be configured to emit red light.
- Sub-pixel (432) may be configured to emit green light.
- Sub-pixel (433) may be configured to emit blue light.
- the opaque metal layer (410) may include a plurality of openings (420) positioned between a plurality of pixels (430) when viewing the first region (111) along the z-axis.
- each of the plurality of openings (420) may be partially surrounded by pixels.
- the plurality of pixels (430) may be positioned along a periphery of each of the plurality of openings (420).
- the opaque metal layer (410) may be positioned under a light-emitting layer (or panel layer) that includes a plurality of pixels (430) that are uniformly spaced from each other.
- Light directed from the outside of the electronic device (101) toward the front surface of the electronic device (101) where the flexible display (110) is positioned may be propagated underneath the flexible display (110) along the plurality of openings (420) included in the opaque metal layer (410).
- the light may be transmitted along the plurality of apertures (420) toward the camera (130) positioned below the flexible display (110).
- an image acquired by the camera (130) may represent light that has passed through the plurality of apertures (420) formed in the first region (111) and reached the camera (130).
- a plurality of apertures (420) may be positioned between a plurality of pixels (430). Meanwhile, in a second region (112) different from the first region (111), a plurality of pixels (430) may be positioned adjacent to each other in all directions on the x-y plane in order to provide a high-resolution screen. For example, the spacing between the plurality of apertures (420) and/or the plurality of pixels (430) may be minimized in the second region (112) of the flexible display (110).
- the first density of the pixels (430) in the first region (111) may be lower than the second density of the pixels (430) in the second region (112).
- the flexible display (110) of the electronic device (101) may include a first region (111) including a plurality of openings (420) for transmitting light from the front to the rear of the flexible display (110) and a second region (112) in which the plurality of openings (420) are not formed.
- the electronic device (101) including a camera (130) positioned under the flexible display (110) may identify whether the camera (130) is positioned under the first region (111) of the flexible display (110) by using an image obtained from the camera (130).
- the electronic device (101) may include a flexible display (110) in which a pattern for identifying the positional relationship is formed.
- FIG. 5 illustrates an example of a pattern formed on one side of a flexible display (110) toward which a camera (130) is directed.
- the electronic device (101) of FIGS. 1A to 1E and FIG. 2 may include a flexible display (110) having a pattern formed thereon as described with reference to FIG. 5.
- the flexible display (110) may include a panel layer (510), a light shielding layer (520), and a metal layer (530) sequentially stacked along the direction of the -z axis.
- the light shielding layer (520) may be referred to as an embo layer and/or a black emboss layer.
- the metal layer (530) may include the opaque metal layer (410) of FIG. 4. Referring to FIG.
- the flexible display (110) may include a first region (111) configured to transmit light to the camera (130) by overlapping with the camera (130) and a second region (112) designed not to overlap with the camera (130).
- a first region (111) of the flexible display (110) at least a portion of the light-shielding layer (520) and/or the metal layer (530) may be opened or perforated.
- the flexible display (110) of the electronic device (101) may include a pattern formed on one side facing the camera (130) (e.g., the rear side of the flexible display (110)).
- the pattern may be formed on one side of the metal layer (530).
- the pattern may be formed along an edge of an opening of the metal layer (530) formed to transmit light into the first region (111) on one side of the metal layer (530) facing the camera (130).
- the pattern may be formed along a boundary between the first region (111) and the second region (112).
- the pattern may have a shape of an outline of the first region (111).
- metal layers including a pattern representing a boundary of a first region (111) and a second region (112) are illustrated.
- a pattern (540) having a dashed line shape may be formed along the boundary of the first region (111) and the second region (112).
- the pattern (540) having a dashed line shape may be formed by a designated color and/or a designated material (e.g., a fluorescent material).
- the pattern (540) may be formed by an engraved or embossed metal layer (530-1).
- a pattern (540) formed along the periphery of the first region (111) is illustrated as an example, the embodiment is not limited thereto.
- the pattern (540) may be partially formed on the left edge and/or the right edge of the first region (111) extending along the x-axis, among the edges of the first region (111).
- the pattern (540) may not be formed on edges other than the left edge and the right edge among the edges of the first region (111).
- patterns (542, 544) having a shape indicating specific points between the first region (111) and the second region (112) may be formed.
- the patterns (542, 544) may be positioned at two points facing each other on the boundary line between the first region (111) and the second region (112).
- the patterns (542, 544) may represent the points based on the shape of a crosshair. The embodiment is not limited thereto.
- the electronic device (101) can execute a function for aligning the flexible display (110) and the camera (130) based on identifying patterns (540, 542, 544) illustrated with reference to FIG. 5 from an image acquired from the camera (130).
- identifying patterns 540, 542, 544 illustrated with reference to FIG. 5 from an image acquired from the camera (130).
- FIG. 6 an exemplary operation of the electronic device (101) for aligning the flexible display (110) and the camera (130) is described with reference to FIG. 6.
- FIG. 6 illustrates an example of an operation of an electronic device (101) for aligning a camera (130) and a flexible display (110).
- the electronic device (101) of FIGS. 1A to 1E, FIG. 2, and/or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 6.
- an example of an image (610) acquired by an electronic device (101) using a camera (130) is illustrated in an exemplary state (601) where at least a portion of the camera (130) is positioned under a second region (112) of a flexible display (110).
- the image (610) of FIG. 6 may be acquired based on operation (310) of FIG. 3A and/or operation (314) of FIG. 3B .
- the flexible display (110) may include a first region (111) including one or more openings for transmitting light (e.g., a plurality of openings (420) of FIG. 4 ) and a second region (112) formed independently of the one or more openings.
- Light passing through the flexible display (110) can reach the first part of the camera (130) positioned below the first region (111). No light can reach the second part of the camera (130) positioned below the second region (112) because the light directed toward the flexible display (110) is blocked by the second region (112).
- an image (610) obtained from the camera (130) can be divided into a first part (630) corresponding to a part of the camera (130) positioned under the first area (111) of the flexible display (110) and a second part (640) corresponding to a part of the camera (130) positioned under the second area (112) of the flexible display (110). Since light passing through the first area (111) of the flexible display (110) reaches the part of the camera (130) corresponding to the first part (630), the first part (630) of the image (610) can have a color distribution corresponding to the light.
- the second portion (640) of the image (610) may have a color (e.g., substantially black) less than a specified brightness.
- a visual object (620) corresponding to at least a portion of a pattern formed between the first area (111) and the second area (112) of the flexible display (110) may be included.
- an image (610) obtained from a camera (130) that is at least partially overlapped with a second region (112) of a flexible display (110) may include a second portion (640) that is obscured by the second region (112).
- the fact that the image (610) includes the second portion (640) may mean that the camera (130) does not fully receive ambient light (or external light) of the electronic device (101).
- the electronic device (101) may align the flexible display (110) and the camera (130) so as to move the camera (130) below the first region (111).
- the electronic device (101) can detect a visual object (620) corresponding to a pattern within the image (610) to identify a second portion (640) covered by the second region (112). Based on a shape of the visual object (620) included in the image (in the shape of an arc protruding toward the -x direction within the exemplary state (601) of FIG. 6), the electronic device (101) can identify the second portion (640) covered by the second region (112) within the image (610). According to one embodiment, the electronic device (101) can identify a position of the visual object (620) within the image (610) and/or a distance (650) between an edge of the image (610) and the visual object (620).
- a pixel (630) of a camera (130) of an electronic device (101) may include sub-pixels based on a Bayer pattern (e.g., a green sub-pixel having a “G” written on it, a red sub-pixel having a “R” written on it, and a blue sub-pixel having a “B” written on it).
- the pixel (630) of the camera (130) may correspond to each of the light sensors included in the camera (130) for receiving light.
- the electronic device (101) may identify a position of the pattern on the camera (130) by using the position of the visual object (621) within the image (610) and the size of the pixel (630) (e.g., the horizontal size (d1) and/or the vertical size (d2) of the pixel (630). Using the distance (650) identified based on the number (or unit) of pixels included in the image (610), the electronic device (101) can identify the movement distance and/or movement direction of the flexible display (110) and/or housing (120) required to move the camera (130) below the first area (111). The electronic device (101) can control an actuator (e.g., actuator (220) of FIG. 2) based on the movement distance and/or movement direction.
- an actuator e.g., actuator (220) of FIG. 220
- the electronic device (101) may control the actuator to move the second housing part (122) relative to the first housing part (121) based on the movement distance. For example, the electronic device (101) may determine the number of steps of the step motor included in the actuator based on the movement distance. Based on the control of the actuator, the electronic device (101) may move the camera (130) below the first area (111) of the flexible display (110). As the camera (130) is moved below the first area (111) of the flexible display (110), the size of a portion (e.g., the second portion (640)) corresponding to the second area (112) in an image (e.g., the image (610)) acquired from the camera (130) may be reduced or removed.
- a portion e.g., the second portion (640)
- the electronic device (101) includes an actuator based on a stepper motor
- the electronic device (101) that identifies a visual object (620) from an image (610) can identify an error caused by the control of the stepper motor.
- the electronic device (101) can change information used to control the stepper motor (e.g., actuator control information (230) of FIG. 2).
- the electronic device (101) can change a movement distance per unit pulse input to the stepper motor (e.g., a movement distance of the second housing part (122) with respect to the first housing part (121).
- the electronic device (101) can identify the rotation number (or step number) and the movement distance of the second housing part (122) relative to the first housing part (121) based on the position (or movement distance) of the visual object (620) in the image (610) per the rotation number (or step number) of the step motor.
- the electronic device (101) can store the relationship between the identified rotation number and the movement distance in a memory (e.g., the memory (215) of FIG. 2) as information for use in controlling the actuator (e.g., the actuator control information (230) of FIG. 2).
- the electronic device (101) can execute a function for aligning the camera (130) and the first region (111) by using a pattern representing the first region (111) of the flexible display (110).
- the electronic device (101) can obtain information used to control an actuator (e.g., information for controlling a step motor included in the actuator) by using the pattern.
- the electronic device (101) can execute the function by using an image (610) acquired from the camera (130) to align the camera (130) and the first region (111) without an additional sensor for identifying the positional relationship between the camera (130) and the first region (111).
- an electronic device (101) including a flexible display (110) movable on a camera (130) may have a structure for preventing damage to the camera (130) by foreign substances (e.g., dust) inside the electronic device (101).
- the structure may include a structure that at least partially covers a lens of the camera (130), such as a shutter (or aperture).
- the aperture may be controlled to cover the entire lens before the camera (130) is activated (or while the camera (130) is in an inactive state).
- the electronic device (101) may control the aperture so that the aperture is fully opened.
- FIG. 7 illustrates an example of an electronic device (101) including a sweeper structure (730) associated with a camera (130).
- the electronic device (101) of FIGS. 1A to 1E and/or FIG. 2 may include the sweeper structure (730) described with reference to FIG. 7.
- the electronic device (101) may include a printed circuit board (PCB) (720) and a metal layer (710).
- a camera (130) included in the electronic device (101) may include a sweeper structure (730) positioned toward the flexible display (110).
- the sweeper structure (730) may include an object for removing and/or moving foreign substances, such as a brush and/or a sponge.
- the sweeper structure (730) may be positioned along an edge of a lens of the camera (130).
- the flexible display (110) may be moved relative to the camera (130) while the second housing part (122) is moved relative to the first housing part (121).
- an at least partially sealed space may be formed between the lens and the first region (111) of the flexible display (110) by a sweeper structure (730) positioned along the edge of the lens of the camera (130).
- the electronic device (101) may further include the sweeper structure (730) to prevent the quality of an image and/or video acquired from the camera (130) from being reduced by the foreign substances.
- FIG. 8 illustrates an example of an electronic device (101) including a rail structure associated with a camera (130).
- the electronic device (101) of FIGS. 1A to 1E and/or FIG. 2 may include the rail structure described with reference to FIG. 8.
- the electronic device (101) may include a rail (810) that is movable according to the movement of the flexible display (110) relative to the camera (130).
- the position of the camera (130) on the rail (810) may change as the electronic device (101) switches between the states (191, 192, 193) of FIGS. 1A to 1C and/or the states (194, 195) of FIGS. 1D to 1E.
- the camera (130) of the electronic device (101) may include rail hooks (821, 822) relative to the rail (810).
- the rail (810) may have a shape that at least partially surrounds the camera (130).
- the rail (810) may have a shape to prevent foreign matter (e.g., dust) from moving into the space between the camera (130) and the flexible display (110).
- FIG. 9 illustrates an example of an operation of an electronic device (101) performed to obtain information for controlling an actuator.
- the electronic device (101) of FIGS. 1A to 1E and FIG. 2 may perform an operation described with reference to FIG. 9 to obtain information used for controlling an actuator (e.g., the actuator (220) of FIG. 2).
- the information may include a relationship between a rotation angle of a motor included in the actuator and a movement distance of the flexible display (110).
- the information may represent a movement distance of the flexible display (110) per step of the step motor.
- the operation described with reference to FIG. 9 may be performed during a production operation of the electronic device (101). The embodiment is not limited thereto, and the operation described with reference to FIG.
- the electronic device (101) obtaining information for controlling the actuator is not limited to the embodiment of FIG. 9.
- the information may be provided by a vendor of the actuator and/or the electronic device (101).
- the electronic device (101) can obtain information for controlling the actuator by using a panel (910) spaced apart from the electronic device (101) by a specified distance (d).
- the panel (910) may be referred to as a calibration chart.
- the panel (910) may include a pattern (920) recognizable by the camera (130). Although a pattern (920) having a broken line shape is illustrated as an example, the embodiment is not limited thereto.
- the electronic device (101) can obtain a first image for the panel (910). While the camera (130) is positioned at the first point (P1), the electronic device (101) can obtain the first image. Having obtained the first image, the electronic device (101) can control an actuator to move the camera (130). After controlling the actuator to move the camera (130) from the first point (P1) to the second point (P2) within the exemplary state of FIG. 9, which is spaced apart from the panel (910) by a specified distance (d), the electronic device (101) can obtain a second image from the camera (130). The electronic device (101) can move the camera (130) from a first point (P1) to a second point (P2) by rotating a motor included in an actuator according to a specified rotation angle.
- the electronic device (101) can identify a relationship between a movement distance of the flexible display (110) and/or the camera (130) for the specified rotation angle by comparing positions of visual objects corresponding to the patterns (920) within the first image and the second image. For example, the distance of the visual objects within the first image and the second image can represent a distance moved by the actuator when the camera (130) is rotated along the specified rotation angle.
- the electronic device (101) can store information representing the relationship. Using the information, the electronic device (101) can control the actuator to switch to a target state (e.g., a roll-in state, a roll-out state, and/or an intermediate state between the roll-in state and the roll-out state).
- a target state e.g., a roll-in state, a roll-out state, and/or an intermediate state between the roll-in state and the roll-out state.
- the electronic device (101) may identify the misalignment using a pattern formed on one side of the flexible display (110) (e.g., one side of the flexible display (110) facing the camera (130). Based on identifying the misalignment, the electronic device (101) may control the actuator to align the flexible display (110) and the camera (130). Based on identifying the above misalignment, the electronic device (101) can change or update the information that was acquired based on the operation described with reference to FIG. 9.
- the electronic device (901) of FIGS. 10 to 12 may be an example of the electronic device (101) of FIGS. 1A to 9.
- the camera module (1080) of FIGS. 10 to 12 may be an example of the camera (130) of FIGS. 1A to 9.
- the display module (1060) of FIGS. 10 to 12 may be an example of the flexible display (110) of FIGS. 1A to 8.
- FIG. 10 is a block diagram of an electronic device (1001) in a network environment (1000) according to various embodiments.
- the electronic device (1001) may communicate with the electronic device (1002) via a first network (1098) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1004) or the server (1008) via a second network (1099) (e.g., a long-range wireless communication network).
- the electronic device (1001) may communicate with the electronic device (1004) via the server (1008).
- the electronic device (1001) may include a processor (1020), a memory (1030), an input module (1050), an audio output module (1055), a display module (1060), an audio module (1070), a sensor module (1076), an interface (1077), a connection terminal (1078), a haptic module (1079), a camera module (1080), a power management module (1088), a battery (1089), a communication module (1090), a subscriber identification module (1096), or an antenna module (1097).
- the electronic device (1001) may omit at least one of these components (e.g., the connection terminal (1078)), or may have one or more other components added.
- some of these components e.g., the sensor module (1076), the camera module (1080), or the antenna module (1097) may be integrated into a single component (e.g., the display module (1060)).
- the processor (1020) may control at least one other component (e.g., a hardware or software component) of the electronic device (1001) connected to the processor (1020) by executing, for example, software (e.g., a program (1040)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (1020) may store a command or data received from another component (e.g., a sensor module (1076) or a communication module (1090)) in the volatile memory (1032), process the command or data stored in the volatile memory (1032), and store result data in the nonvolatile memory (1034).
- a command or data received from another component e.g., a sensor module (1076) or a communication module (1090)
- the processor (1020) may include a main processor (1021) (e.g., a central processing unit or an application processor) or an auxiliary processor (1023) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1021).
- a main processor (1021) e.g., a central processing unit or an application processor
- an auxiliary processor (1023) e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor
- the auxiliary processor (1023) may be configured to use less power than the main processor (1021) or to be specialized for a given function.
- the auxiliary processor (1023) may be implemented separately from the main processor (1021) or as a part thereof.
- the auxiliary processor (1023) may control at least a portion of functions or states associated with at least one of the components of the electronic device (1001) (e.g., the display module (1060), the sensor module (1076), or the communication module (1090)), for example, on behalf of the main processor (1021) while the main processor (1021) is in an inactive (e.g., sleep) state, or together with the main processor (1021) while the main processor (1021) is in an active (e.g., application execution) state.
- the auxiliary processor (1023) e.g., an image signal processor or a communication processor
- the auxiliary processor (1023) may include a hardware structure specialized for processing artificial intelligence models.
- the artificial intelligence models may be generated through machine learning. Such learning may be performed, for example, in the electronic device (1001) itself on which the artificial intelligence model is executed, or may be performed through a separate server (e.g., server (1008)).
- the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above.
- the artificial intelligence model may include a plurality of artificial neural network layers.
- the artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above.
- the artificial intelligence model may additionally or alternatively include a software structure.
- the memory (1030) can store various data used by at least one component (e.g., the processor (1020) or the sensor module (1076)) of the electronic device (1001).
- the data can include, for example, software (e.g., the program (1040)) and input data or output data for commands related thereto.
- the memory (1030) can include a volatile memory (1032) or a nonvolatile memory (1034).
- the program (1040) may be stored as software in memory (1030) and may include, for example, an operating system (1042), middleware (1044), or an application (1046).
- the input module (1050) can receive commands or data to be used in a component of the electronic device (1001) (e.g., a processor (1020)) from an external source (e.g., a user) of the electronic device (1001).
- the input module (1050) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
- the audio output module (1055) can output an audio signal to the outside of the electronic device (1001).
- the audio output module (1055) can include, for example, a speaker or a receiver.
- the speaker can be used for general purposes such as multimedia playback or recording playback.
- the receiver can be used to receive an incoming call. According to one embodiment, the receiver can be implemented separately from the speaker or as a part thereof.
- the display module (1060) can visually provide information to an external party (e.g., a user) of the electronic device (1001).
- the display module (1060) can include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device.
- the display module (1060) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure a strength of a force generated by the touch.
- the audio module (1070) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1070) can obtain sound through the input module (1050), or output sound through an audio output module (1055), or an external electronic device (e.g., an electronic device (1002)) (e.g., a speaker or a headphone) directly or wirelessly connected to the electronic device (1001).
- an electronic device e.g., an electronic device (1002)
- a speaker or a headphone directly or wirelessly connected to the electronic device (1001).
- the sensor module (1076) can detect an operating state (e.g., power or temperature) of the electronic device (1001) or an external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state.
- the sensor module (1076) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
- the interface (1077) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1001) to an external electronic device (e.g., the electronic device (1002)).
- the interface (1077) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
- HDMI high definition multimedia interface
- USB universal serial bus
- SD card interface Secure Digital Card
- the connection terminal (1078) may include a connector through which the electronic device (1001) may be physically connected to an external electronic device (e.g., the electronic device (1002)).
- the connection terminal (1078) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
- the haptic module (1079) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that a user can perceive through a tactile or kinesthetic sense.
- the haptic module (1079) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
- the camera module (1080) can capture still images and moving images.
- the camera module (1080) can include one or more lenses, image sensors, image signal processors, or flashes.
- the power management module (1088) can manage power supplied to the electronic device (1001).
- the power management module (1088) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
- PMIC power management integrated circuit
- the battery (1089) can power at least one component of the electronic device (1001).
- the battery (1089) can include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
- the communication module (1090) may support establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1001) and an external electronic device (e.g., the electronic device (1002), the electronic device (1004), or the server (1008)), and performance of communication through the established communication channel.
- the communication module (1090) may operate independently from the processor (1020) (e.g., the application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication.
- the communication module (1090) may include a wireless communication module (1092) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1094) (e.g., a local area network (LAN) communication module or a power line communication module).
- a wireless communication module (1092) e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
- GNSS global navigation satellite system
- a wired communication module (1094) e.g., a local area network (LAN) communication module or a power line communication module.
- a corresponding communication module among these communication modules may communicate with an external electronic device (1004) via a first network (1098) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1099) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)).
- a first network e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)
- a second network (1099) e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)
- a first network e
- the wireless communication module (1092) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1096) to verify or authenticate the electronic device (1001) within a communication network such as the first network (1098) or the second network (1099).
- subscriber information e.g., an international mobile subscriber identity (IMSI)
- IMSI international mobile subscriber identity
- the wireless communication module (1092) can support a 5G network after a 4G network and next-generation communication technology, for example, NR access technology (new radio access technology).
- the NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), terminal power minimization and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)).
- eMBB enhanced mobile broadband
- mMTC massive machine type communications
- URLLC ultra-reliable and low-latency communications
- the wireless communication module (1092) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate.
- a high-frequency band e.g., mmWave band
- the wireless communication module (1092) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna.
- the wireless communication module (1092) may support various requirements specified in the electronic device (1001), an external electronic device (e.g., the electronic device (1004)), or a network system (e.g., the second network (1099)).
- the wireless communication module (1092) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) respectively, or 1 ms or less for round trip) for URLLC realization.
- a peak data rate e.g., 20 Gbps or more
- a loss coverage e.g., 164 dB or less
- U-plane latency e.g., 0.5 ms or less for downlink (DL) and uplink (UL) respectively, or 1 ms or less for round trip
- the antenna module (1097) can transmit or receive signals or power to or from the outside (e.g., an external electronic device).
- the antenna module (1097) can include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB).
- the antenna module (1097) can include a plurality of antennas (e.g., an array antenna).
- at least one antenna suitable for a communication method used in a communication network, such as the first network (1098) or the second network (1099) can be selected from the plurality of antennas by, for example, the communication module (1090).
- a signal or power can be transmitted or received between the communication module (1090) and the external electronic device through the selected at least one antenna.
- another component e.g., a radio frequency integrated circuit (RFIC)
- RFIC radio frequency integrated circuit
- the antenna module (1097) can form a mmWave antenna module.
- the mmWave antenna module can include a printed circuit board, an RFIC positioned on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) positioned on or adjacent a second side (e.g., a top side or a side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
- a first side e.g., a bottom side
- a plurality of antennas e.g., an array antenna
- peripheral devices e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)
- GPIO general purpose input and output
- SPI serial peripheral interface
- MIPI mobile industry processor interface
- a command or data may be transmitted or received between the electronic device (1001) and an external electronic device (1004) via a server (1008) connected to a second network (1099).
- Each of the external electronic devices (1002, or 904) may be the same or a different type of device as the electronic device (1001).
- all or part of the operations executed in the electronic device (1001) may be executed in one or more of the external electronic devices (1002, 904, or 908). For example, when the electronic device (1001) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1001) may, instead of executing the function or service itself or in addition, request one or more external electronic devices to perform at least a part of the function or service.
- One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1001).
- the electronic device (1001) may process the result as it is or additionally and provide it as at least a part of a response to the request.
- cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
- the electronic device (1001) may provide an ultra-low latency service by using, for example, distributed computing or mobile edge computing.
- the external electronic device (1004) may include an IoT (Internet of Things) device.
- the server (1008) may be an intelligent server using machine learning and/or a neural network.
- the external electronic device (1004) or the server (1008) may be included in the second network (1099).
- the electronic device (1001) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
- FIG. 11 is a block diagram (1000) illustrating a camera module (1080) according to various embodiments.
- the camera module (1080) may include a lens assembly (1110), a flash (1120), an image sensor (1130), an image stabilizer (1140), a memory (1150) (e.g., a buffer memory), or an image signal processor (1160).
- the lens assembly (1110) may collect light emitted from a subject that is a target of an image capture.
- the lens assembly (1110) may include one or more lenses.
- the camera module (1080) may include a plurality of lens assemblies (1110). In this case, the camera module (1080) may form, for example, a dual camera, a 360-degree camera, or a spherical camera.
- Some of the plurality of lens assemblies (1110) may have the same lens properties (e.g., angle of view, focal length, autofocus, f number, or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of the other lens assemblies.
- a lens assembly (1110) may include, for example, a wide-angle lens or a telephoto lens.
- the flash (1120) can emit light used to enhance light emitted or reflected from a subject.
- the flash (1120) can include one or more light-emitting diodes (e.g., red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp.
- the image sensor (1130) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (1110) into an electrical signal.
- the image sensor (1130) can include one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties.
- Each image sensor included in the image sensor (1130) may be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.
- the image stabilizer (1140) can move at least one lens or image sensor (1130) included in the lens assembly (1110) in a specific direction or control the operating characteristics of the image sensor (1130) (e.g., adjusting read-out timing, etc.) in response to movement of the camera module (1080) or the electronic device (1001) including the same. This allows compensating for at least some of the negative effects of the movement on the captured image.
- the image stabilizer (1140) can detect such movement of the camera module (1080) or the electronic device (1001) by using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module (1080).
- the image stabilizer (1140) may be implemented as, for example, an optical image stabilizer.
- the memory (1150) may at least temporarily store at least a portion of an image acquired through the image sensor (1130) for the next image processing task. For example, when image acquisition is delayed due to a shutter, or when a plurality of images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) may be stored in the memory (1150), and a corresponding copy image (e.g., a low-resolution image) may be previewed through the display module (1060). Thereafter, when a specified condition is satisfied (e.g., a user input or a system command), at least a portion of the original image stored in the memory (1150) may be acquired and processed by, for example, the image signal processor (1160). According to one embodiment, the memory (1150) may be configured as at least a portion of the memory (1030), or as a separate memory that operates independently therefrom.
- a specified condition e.g., a user input or a system command
- the image signal processor (1160) can perform one or more image processing operations on an image acquired through an image sensor (1130) or an image stored in a memory (1150).
- the one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening).
- the image signal processor (1160) may perform control (e.g., exposure time control, read-out timing control, etc.) for at least one of the components included in the camera module (1080) (e.g., the image sensor (1130)).
- the image processed by the image signal processor (1160) may be stored back in the memory (1150) for further processing or provided to an external component of the camera module (1080) (e.g., the memory (1030), the display module (1060), the electronic device (1002), the electronic device (1004), or the server (1008)).
- the image signal The processor (1160) may be configured as at least a part of the processor (1020), or may be configured as a separate processor that operates independently of the processor (1020).
- the image signal processor (1160) is configured as a separate processor from the processor (1020
- at least one image processed by the image signal processor (1160) may be displayed through the display module (1060) as is or after undergoing additional image processing by the processor (1020).
- the electronic device (1001) may include a plurality of camera modules (1080), each having different properties or functions.
- at least one of the plurality of camera modules (1080) may be a wide-angle camera, and at least another may be a telephoto camera.
- at least one of the plurality of camera modules (1080) may be a front camera, and at least another may be a rear camera.
- FIG. 12 is a block diagram (1200) of a display module (1060) according to various embodiments.
- the display module (1060) may include a display (1210) and a display driver IC (DDI) (1230) for controlling the display (1210).
- the DDI (1230) may include an interface module (1231), a memory (1233) (e.g., a buffer memory), an image processing module (1235), or a mapping module (1237).
- the DDI (1230) may receive image information including, for example, image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device 901 through the interface module (1231).
- image information may be received from a processor (1020) (e.g., a main processor (1021) (e.g., an application processor) or an auxiliary processor (1023) (e.g., a graphics processing unit) that operates independently of the function of the main processor (1021).
- the DDI (1230) may communicate with a touch circuit (1250) or a sensor module (1076) through the interface module (1231).
- the DDI (1230) may store at least some of the received image information in the memory (1233), for example, in units of frames.
- the image processing module (1235) may perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least some of the image data based on at least the characteristics of the image data or the characteristics of the display (1210), for example.
- the mapping module (1237) may output a voltage value or a value corresponding to the image data preprocessed or postprocessed through the image processing module (1035).
- a current value can be generated. According to one embodiment, the generation of the voltage value or current value can be performed at least in part based on, for example, properties of pixels of the display (1210) (e.g., an arrangement of pixels (RGB stripe or pentile structure), or a size of each sub-pixel).
- At least some pixels of the display (1210) can be driven at least in part based on, for example, the voltage value or current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data can be displayed through the display (1210).
- visual information e.g., text, an image, or an icon
- the display module (1060) may further include a touch circuit (1250).
- the touch circuit (1250) may include a touch sensor (1251) and a touch sensor IC (1253) for controlling the same.
- the touch sensor IC (1253) may control the touch sensor (1251) to detect, for example, a touch input or a hovering input for a specific location of the display (1210).
- the touch sensor IC (1253) may detect the touch input or the hovering input by measuring a change in a signal (e.g., voltage, light amount, resistance, or charge amount) for a specific location of the display (1210).
- a signal e.g., voltage, light amount, resistance, or charge amount
- the touch sensor IC (1253) may provide information (e.g., location, area, pressure, or time) about the detected touch input or hovering input to the processor (1020).
- information e.g., location, area, pressure, or time
- at least a portion of the touch circuit (1250) e.g., the touch sensor IC (1253)
- the display module (1060) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (1076), or a control circuit therefor.
- the at least one sensor or the control circuit therefor may be embedded in a part of the display module (1060) (e.g., the display (1210) or the DDI (1230)) or a part of the touch circuit (1250).
- the sensor module (1076) embedded in the display module (1060) includes a biometric sensor (e.g., a fingerprint sensor)
- the biometric sensor may obtain biometric information (e.g., a fingerprint image) associated with a touch input through a part of the display (1210).
- the pressure sensor may obtain pressure information associated with a touch input through a part or the entire area of the display (1210).
- the touch sensor (1251) or the sensor module (1076) may be disposed between pixels of a pixel layer of the display (1210), or above or below the pixel layer.
- the electronic devices according to various embodiments disclosed in this document may be devices of various forms.
- the electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliance devices.
- portable communication devices e.g., smartphones
- computer devices portable multimedia devices
- portable medical devices e.g., cameras
- wearable devices e.g., smart watch devices
- home appliance devices e.g., smartphones
- the electronic devices according to embodiments of this document are not limited to the above-described devices.
- first, second, or first or second may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order).
- a component e.g., a first
- another component e.g., a second
- functionally e.g., a third component
- module used in various embodiments of this document may include a unit implemented in hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example.
- a module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions.
- a module may be implemented in the form of an application-specific integrated circuit (ASIC).
- ASIC application-specific integrated circuit
- Various embodiments of the present document may be implemented as software (e.g., a program (1040)) including one or more instructions stored in a storage medium (e.g., an internal memory (1036) or an external memory (1038)) readable by a machine (e.g., an electronic device (1001)).
- a processor e.g., a processor (1020)
- the machine e.g., the electronic device (1001)
- the one or more instructions may include code generated by a compiler or code executable by an interpreter.
- the machine-readable storage medium may be provided in the form of a non-transitory storage medium.
- 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
- the method according to various embodiments disclosed in the present document may be provided as included in a computer program product.
- the computer program product may be traded between a seller and a buyer as a commodity.
- the computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM) or directly between two user devices (e.g., smart phones).
- an application store e.g., Play StoreTM
- at least a part of the computer program product may be at least temporarily stored or temporarily generated in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or an intermediary server.
- each component e.g., a module or a program of the above-described components may include a single or multiple entities, and some of the multiple entities may be separately arranged in other components.
- one or more components or operations of the above-described components may be omitted, or one or more other components or operations may be added.
- the multiple components e.g., a module or a program
- the integrated component may perform one or more functions of each of the multiple components identically or similarly to those performed by the corresponding component of the multiple components before the integration.
- the operations performed by the module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
- An electronic device e.g., the electronic device (101) of FIGS. 1A to 1E and FIGS. 2 to 9 , the electronic device (1001) of FIGS. 10 to 12 ) as described above may include a housing (e.g., the housing (120) of FIGS. 1A to 1E and FIGS. 2 to 9 ) including a first housing part (e.g., the first housing part (121) of FIGS. 1A to 1E and FIGS. 2 to 9 ) and a second housing part (e.g., the second housing part (122) of FIGS. 1A to 1E and FIGS.
- a housing e.g., the housing (120) of FIGS. 1A to 1E and FIGS. 2 to 9
- a first housing part e.g., the first housing part (121) of FIGS. 1A to 1E and FIGS. 2 to 9
- a second housing part e.g., the second housing part (122) of FIGS. 1A to 1E and FIGS.
- the electronic device can include an actuator within the housing configured to move the second housing part relative to the first housing part (e.g., actuator (220) of FIG.
- the active region may include a first region (e.g., the first region (111) of FIGS. 1A to 1E and FIGS. 2 to 9) having a density of pixels of a first density and a second region (e.g., the second region (112) of FIGS. 1A to 1E and FIGS. 2 to 9) surrounding the first region and having a second density higher than the first density.
- a first region e.g., the first region (111) of FIGS. 1A to 1E and FIGS. 2 to 9) having a density of pixels of a first density
- a second region e.g., the second region (112) of FIGS. 1A to 1E and FIGS. 2 to 9 surrounding the first region and having a second density higher than the first density.
- the rear surface of the flexible display facing the camera may include a pattern (e.g., the patterns (540, 542, 544) of FIG. 5) arranged along a boundary between the first region and the second region.
- the processor may be configured to acquire an image (e.g., the image (610) of FIG. 6) through the camera in response to an input activating the camera.
- the processor may be configured to identify whether a visual object (e.g., the visual object (620) of FIG. 6) corresponding to the pattern is included in the image.
- the processor may be configured to control the actuator to align the camera with respect to the first area based on the image including the visual object.
- the processor may be configured to obtain a control signal to be transmitted to the one or more motors to align the camera with respect to the first area based on a relationship between rotational angles of the one or more motors included in the actuator and a movement distance of the flexible display relative to the camera.
- the electronic device may be configured to further include a memory (e.g., memory (215) of FIG. 2) configured to store information representing a relationship between the rotation angles of the one or more motors and the movement distance.
- the processor may be configured to change the stored information based on the alignment of the camera with respect to the first area.
- the processor may be configured to transmit a control signal to the actuator, the control signal including a pulse signal representing a movement distance of the flexible display based on pulse numbers to the actuator, to align the camera with respect to the first area.
- the processor may be configured to, based on controlling the actuator, use the camera to obtain another image to be displayed on the flexible display in response to the input after the camera has been moved below the first region.
- the first region may be configured to include a metal layer (e.g., the metal layer (410) of FIG. 4) that includes a plurality of openings (e.g., the plurality of openings (420) of FIG. 4) positioned between the pixels when viewed from the front.
- the second region may be configured to include a light-shielding layer (e.g., the light-shielding layer (520) of FIG. 5) for reducing reflection of light occurring between the pixels when viewed from the front.
- the processor may be configured to obtain an image representing light reaching the camera through the plurality of apertures in the first region.
- the processor may be configured to determine, based on the visual object within the image, that at least a portion of the camera overlaps the second area when viewed from the front.
- the processor may be configured to control the actuator to reduce a size of at least a portion of the camera that overlaps the second area.
- a method of an electronic device as described above may include an operation of acquiring an image through a camera of the electronic device positioned below an active area of a flexible display of the electronic device (e.g., operation (310) of FIG. 3A) in response to an input activating a camera of the electronic device positioned below an active area of the flexible display of the electronic device.
- the method may include an operation of identifying whether a visual object corresponding to a pattern formed on a rear surface of the flexible display toward which the camera is directed is included in the image (e.g., operation (320) of FIG. 3A).
- the method may include an operation of controlling an actuator to align the camera with respect to the flexible display based on the image including the visual object (e.g., operation (340) of FIGS. 3A-3B).
- the controlling action may include obtaining a control signal to be transmitted to the one or more motors to align the camera with respect to the flexible display based on a relationship between rotational angles of the one or more motors included in the actuator and a movement distance of the flexible display with respect to the camera.
- controlling action may include an action of changing information representing the relationship based on aligning the camera with respect to the flexible display.
- the controlling action may include transmitting a control signal including a pulse signal representing a movement distance of the flexible display based on a pulse number to the actuator to align the camera.
- the method may further include an operation of using the camera to acquire another image to be displayed on the flexible display in response to the input, based on controlling the actuator, after the camera has moved below the first area.
- the method may include a pattern disposed along a boundary between a first region and a second region of the flexible display, the first region and the second region being distinguished by a density of pixels of the flexible display, on the rear surface of the flexible display toward which the camera is directed.
- the identifying action may include an action of determining, based on the visual object in the image, that at least a portion of the camera overlaps the second area when looking at the front of the flexible display.
- the controlling action may include an action of controlling the actuator to reduce a size of at least a portion of the camera that overlaps the second area.
- an electronic device e.g., the electronic device (101) of FIGS. 1A to 1E and FIGS. 2 to 9, the electronic device (1001) of FIGS. 10 to 12) as described above comprises a housing (e.g., the housing (120) of FIGS. 1A to 1E and FIGS. 2 to 9), a flexible display (e.g., the flexible display (110) of FIGS. 1A to 1E and FIGS. 2 to 9) at least partially exposed to the outside through one side of the housing, a camera within the housing positioned to face one side of the flexible display (e.g., the camera (130) of FIGS. 1A to 1E and FIGS.
- a housing e.g., the housing (120) of FIGS. 1A to 1E and FIGS. 2 to 9
- a flexible display e.g., the flexible display (110) of FIGS. 1A to 1E and FIGS. 2 to 9
- a camera within the housing positioned to face one side of the flexible display (e.g.,
- the processor (210) may be configured to acquire an image (e.g., the image (610) of FIG. 6) using the camera.
- the processor may be configured to identify whether a visual object (e.g., the visual object (620) of FIG. 6) associated with a boundary between a first region (e.g., the first region (111) of FIGS. 1A to 1E and FIGS. 2 to 9) and a second region (e.g., the second region (112) of FIGS. 1A to 1E and FIGS. 2 to 9) of the flexible display, which are distinguished by a density of pixels, is included in the image.
- the processor may be configured to control the actuator to adjust the position based on the image including the visual object.
- the flexible display may be configured to include a pattern formed along the boundary of the first region and the second region on one side of the flexible display toward which the camera is directed.
- the processor may be configured to control the actuator using a location of the visual object within the image based on identifying the visual object corresponding to at least a portion of the pattern.
- the flexible display can be configured to include a first region including pixels positioned based on a first density and a second region including pixels positioned based on a second density exceeding the first density.
- the processor may be configured to control the actuator to move the camera below the first region among the first region and the second region.
- a method of an electronic device as described above may include an operation of acquiring an image using a camera positioned to face one side of a flexible display of the electronic device.
- the method may include an operation of identifying whether a visual object associated with a boundary between a first region and a second region of the flexible display, the boundary being distinguished by a density of pixels, is included in the image.
- the method may include an operation of controlling the actuator to adjust the position based on the image including the visual object.
- the identifying action may include an action of identifying a visual object corresponding to a pattern formed on the one surface of the flexible display toward which the camera is directed and formed along a boundary between the first region and the second region.
- controlling action may include controlling the actuator using a location of the visual object within the image based on identifying the visual object corresponding to at least a portion of the pattern.
- controlling action may include controlling the actuator to move the camera below the first area, the first area including pixels positioned based on a first density and the second area including pixels positioned based on a second density exceeding the first density.
- the devices described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components.
- the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them.
- the processing device may execute an operating system (OS) and one or more software applications running on the operating system.
- the processing device may access, store, manipulate, process, and generate data in response to the execution of the software.
- OS operating system
- the processing device may access, store, manipulate, process, and generate data in response to the execution of the software.
- the processing device is sometimes described as being used alone, but those skilled in the art will appreciate that the processing device may include multiple processing elements and/or multiple types of processing elements.
- the processing device may include multiple processors, or a processor and a controller.
- Other processing configurations, such as parallel processors, are also possible.
- the software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device.
- the software and/or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device.
- the software may be distributed over network-connected computer systems and stored or executed in a distributed manner.
- the software and data may be stored on one or more computer-readable recording media.
- the method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium.
- the medium may be one that continuously stores a program executable by a computer, or one that temporarily stores it for execution or downloading.
- the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, and may also be distributed on a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, etc., configured to store program commands.
- examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
Abstract
Selon un mode de réalisation, un dispositif électronique peut comprendre : un dispositif de prise de vues ; un écran souple ; et un processeur. La surface arrière de l'écran souple qui fait face à l'appareil de prise de vues peut comprendre un motif disposé le long de la limite entre une première zone et une seconde zone d'une zone active de l'écran souple. Le processeur du dispositif électronique peut acquérir une image par l'intermédiaire de l'appareil de prise de vues en réponse à une entrée visant à activer l'appareil de prise de vues. Le processeur peut identifier si un objet visuel correspondant au motif est inclus dans l'image. Le processeur peut commander un actionneur afin d'aligner l'appareil de prise de vues par rapport à la première zone sur la base de l'image comprenant l'objet visuel.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20230077285 | 2023-06-16 | ||
| KR10-2023-0077285 | 2023-06-16 | ||
| KR1020230089261A KR20240176733A (ko) | 2023-06-16 | 2023-07-10 | 플렉서블 디스플레이에 형성된 패턴을 이용하여 카메라 및 플렉서블 디스플레이의 위치를 정렬하기 위한 전자 장치 및 그 방법 |
| KR10-2023-0089261 | 2023-07-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024258057A1 true WO2024258057A1 (fr) | 2024-12-19 |
Family
ID=93852244
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2024/006042 Ceased WO2024258057A1 (fr) | 2023-06-16 | 2024-05-03 | Dispositif électronique pour aligner les positions d'un appareil de prise de vues et d'un écran souple à l'aide d'un motif formé sur l'écran souple, et procédé associé |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2024258057A1 (fr) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20220032782A (ko) * | 2020-09-08 | 2022-03-15 | 엘지이노텍 주식회사 | 디스플레이장치 |
| KR20220035947A (ko) * | 2019-09-27 | 2022-03-22 | 비보 모바일 커뮤니케이션 컴퍼니 리미티드 | 이미지 처리 방법, 장치, 전자기기 및 매체 |
| KR20220037755A (ko) * | 2020-09-18 | 2022-03-25 | 삼성전자주식회사 | 카메라 모듈을 포함하는 전자 장치 |
| KR102419299B1 (ko) * | 2020-12-04 | 2022-07-11 | (주)딥인사이트 | 전자 장치 |
| KR20230083939A (ko) * | 2021-12-03 | 2023-06-12 | 삼성전자주식회사 | 플렉서블 디스플레이를 갖는 전자 장치 및 그의 카메라 모듈 제어 방법 |
-
2024
- 2024-05-03 WO PCT/KR2024/006042 patent/WO2024258057A1/fr not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20220035947A (ko) * | 2019-09-27 | 2022-03-22 | 비보 모바일 커뮤니케이션 컴퍼니 리미티드 | 이미지 처리 방법, 장치, 전자기기 및 매체 |
| KR20220032782A (ko) * | 2020-09-08 | 2022-03-15 | 엘지이노텍 주식회사 | 디스플레이장치 |
| KR20220037755A (ko) * | 2020-09-18 | 2022-03-25 | 삼성전자주식회사 | 카메라 모듈을 포함하는 전자 장치 |
| KR102419299B1 (ko) * | 2020-12-04 | 2022-07-11 | (주)딥인사이트 | 전자 장치 |
| KR20230083939A (ko) * | 2021-12-03 | 2023-06-12 | 삼성전자주식회사 | 플렉서블 디스플레이를 갖는 전자 장치 및 그의 카메라 모듈 제어 방법 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022196924A1 (fr) | Dispositif électronique pour afficher un contenu sur la base d'une pluralité de vitesses de balayage et procédé de fonctionnement associé | |
| WO2022265269A1 (fr) | Dispositif électronique et procédé de prédiction et de compensation d'image résiduelle sur un dispositif d'affichage | |
| WO2022092706A1 (fr) | Procédé de prise de photographie à l'aide d'une pluralité de caméras, et dispositif associé | |
| WO2022186495A1 (fr) | Dispositif électronique comprenant une pluralité d'objectifs et procédé de commande dudit dispositif | |
| WO2022035267A1 (fr) | Dispositif électronique comprenant un module de caméra | |
| WO2022119218A1 (fr) | Procédé et dispositif électronique pour corriger un tremblement de caméra | |
| WO2022220444A1 (fr) | Procédé de balayage lors d'une prise de vue avec un appareil photo et appareil électronique associé | |
| WO2022098001A1 (fr) | Dispositif électronique ayant un écran souple et procédé de commande de module de caméra correspondant | |
| WO2022050627A1 (fr) | Dispositif électronique comprenant un affichage souple et procédé de fonctionnement de celui-ci | |
| WO2024258057A1 (fr) | Dispositif électronique pour aligner les positions d'un appareil de prise de vues et d'un écran souple à l'aide d'un motif formé sur l'écran souple, et procédé associé | |
| WO2023013904A1 (fr) | Procédé et dispositif de commande d'écran | |
| WO2022065844A1 (fr) | Procédé d'affichage d'image de prévisualisation et appareil électronique le prenant en charge | |
| WO2022196916A1 (fr) | Procédé, dispositif et support de stockage pour une authentification d'utilisateur | |
| WO2022186511A1 (fr) | Dispositif électronique comprenant un couvercle arrière et un module de caméra | |
| WO2025183350A1 (fr) | Dispositif électronique comprenant un écran souple pour éliminer les franges de couleur, procédé et support de stockage | |
| WO2024053902A1 (fr) | Panneau d'affichage comprenant un matériau de commande de lumière, et dispositif électronique | |
| WO2024162668A1 (fr) | Module de caméra, procédé de correction d'images par un module de caméra, dispositif électronique équipé d'un module de caméra | |
| WO2026023863A1 (fr) | Panneau d'affichage pour commander un angle de visualisation et dispositif électronique le comprenant | |
| WO2023214653A1 (fr) | Dispositif électronique comprenant une structure pour supporter une carte de circuit imprimé souple | |
| WO2022119274A1 (fr) | Dispositif électronique comprenant un écran souple | |
| KR20240176733A (ko) | 플렉서블 디스플레이에 형성된 패턴을 이용하여 카메라 및 플렉서블 디스플레이의 위치를 정렬하기 위한 전자 장치 및 그 방법 | |
| WO2023204419A1 (fr) | Dispositif électronique, et procédé pour régler une zone d'affichage d'une unité d'affichage sur la base d'une intensité de lumière émise par une unité d'affichage | |
| WO2025023489A1 (fr) | Dispositif électronique comprenant un écran d'affichage comportant un matériau conducteur pour détection | |
| WO2025028863A1 (fr) | Procédé d'obtention d'image et dispositif électronique associé | |
| WO2024196011A1 (fr) | Dispositif électronique de traitement d'image et procédé associé |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24823578 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |