WO2024085724A1 - 천체를 촬영하기 위한 전자 디바이스 및 방법 - Google Patents
천체를 촬영하기 위한 전자 디바이스 및 방법 Download PDFInfo
- Publication number
- WO2024085724A1 WO2024085724A1 PCT/KR2023/016394 KR2023016394W WO2024085724A1 WO 2024085724 A1 WO2024085724 A1 WO 2024085724A1 KR 2023016394 W KR2023016394 W KR 2023016394W WO 2024085724 A1 WO2024085724 A1 WO 2024085724A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- celestial body
- image
- celestial
- photographing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
Definitions
- This disclosure relates to electronic devices and methods for imaging moving celestial bodies.
- a first aspect of the present disclosure includes an operation of displaying a preview image generated through a camera of the electronic device; An operation of measuring the location of the electronic device using a global positioning system (GPS) sensor of the electronic device; An operation of measuring the orientation of the electronic device using an inertial measurement unit (IMU) sensor of the electronic device; An operation of identifying a celestial object corresponding to a photographing direction of a camera of the electronic device based on the measured position and the measured orientation; An operation of identifying an exposure time of the camera set to photograph the celestial body; Based on the exposure time, displaying a graphic user interface (GUI) on the preview image to guide a reference position at which the celestial body will be displayed within the image of the celestial body; An operation of receiving a user input for photographing the celestial body; and an operation of photographing the celestial body during the exposure time as the user input is received.
- An electronic device may provide a method of photographing an celestial object.
- a second aspect of the present disclosure includes a camera for photographing celestial bodies; A GPS sensor that measures the location of the electronic device; IMU sensor for measuring the orientation of the electronic device; display; Memory that stores one or more instructions; and a processor executing the one or more instructions, wherein the processor displays a preview image generated through the camera on the display by executing the one or more instructions, and displays the preview image generated through the camera on the electronic device using the GPS sensor.
- An electronic device can be provided that receives a user input for photographing the celestial body and, as the user input is received, photographs the celestial object during the exposure time.
- the third aspect of the present disclosure may provide a computer-readable recording medium for executing the method of the first aspect.
- a fourth aspect of the present disclosure includes an operation of displaying a preview image generated through a camera of an electronic device; determining whether the electronic device is fixed; Upon determining that the electronic device is fixed, identifying position coordinates on a preview of the virtual image of the celestial body; Identifying location coordinates of the celestial body in the preview image; and correcting the orientation of the electronic device by comparing the position coordinates of the celestial body and the position coordinates of the virtual image of the celestial body. and an operation of displaying the virtual image of the celestial body on a preview image based on the corrected orientation.
- An electronic device may provide a method of photographing a celestial body.
- FIG. 1 is a diagram illustrating an outline of a process in which an electronic device photographs a celestial body and obtains an image as a result of the photograph, according to an embodiment.
- FIG. 2 is a flowchart of a method for an electronic device to photograph a celestial object so that the celestial object is displayed at a reference position within a photographing result image, according to an embodiment.
- FIG. 3 is a flowchart of a method by which an electronic device guides a celestial object to be displayed at a reference position within a captured image, according to an embodiment.
- Figure 4 is a diagram illustrating an example of a celestial body moving during filming, according to an embodiment.
- FIG. 5 is a diagram illustrating an example of a preview image that guides a user so that a celestial object is displayed at a reference position in a shooting result image, according to an embodiment.
- FIG. 6 is a diagram illustrating an example of a preview image that guides a user so that a celestial object is displayed at a reference position in a shooting result image, according to an embodiment.
- FIG. 7 is a flowchart of a method in which an electronic device generates a captured image by combining a plurality of captured image frames, according to an embodiment.
- FIG. 8 is a diagram illustrating a plurality of captured image frames generated by an electronic device photographing a celestial body during an exposure time according to an embodiment.
- FIG. 9 is a diagram illustrating an example in which a plurality of captured image frames are arranged so that a celestial object is located at a reference position within a captured image, according to an embodiment.
- FIG. 10 is a diagram illustrating a photographing result image in which a celestial object is displayed at a reference position according to an embodiment.
- FIG. 11 is a flowchart of a method in which an electronic device corrects the orientation of the electronic device and displays a virtual image of a celestial body on a preview image based on the corrected orientation, according to an embodiment.
- FIG. 12 is a diagram illustrating preview images displayed on the screen of an electronic device for photographing a celestial body according to an embodiment.
- Figure 13 is a block diagram of an electronic device according to one embodiment.
- FIG. 14 is a block diagram of an electronic device in a network environment, according to various embodiments.
- An embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented in various numbers of hardware and/or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors, or may be implemented by circuit configurations for certain functions. Additionally, for example, functional blocks of the present disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as algorithms running on one or more processors. Additionally, the present disclosure may employ conventional technologies for electronic environment setup, signal processing, and/or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.
- connection lines or connection members between components shown in the drawings merely exemplify functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various replaceable or additional functional connections, physical connections, or circuit connections.
- a method of photographing a celestial body by an electronic device includes: displaying a preview image generated through a camera of the electronic device; An operation of measuring the location of the electronic device using a global positioning system (GPS) sensor of the electronic device; An operation of measuring the orientation of the electronic device using an inertial measurement unit (IMU) sensor of the electronic device; An operation of identifying a celestial object corresponding to a photographing direction of a camera of the electronic device based on the measured position and the measured orientation; An operation of identifying an exposure time of the camera set to photograph the celestial body; and displaying, based on the exposure time, a GUI for guiding a reference position at which the celestial body will be displayed in the image of the celestial body on the preview image. Additionally, the method includes receiving a user input for photographing the celestial body; and an operation of photographing the celestial body during the exposure time as the user input is received.
- GPS global positioning system
- IMU inertial measurement unit
- the method includes obtaining a plurality of captured image frames by photographing the celestial body during the exposure time; and generating the resulting image by combining the plurality of captured image frames.
- the positions of the celestial body in the plurality of captured image frames are different from each other, and the operation of generating the captured image results in that the celestial body is displayed in the captured image. It may include an operation of combining the plurality of captured image frames so that the celestial bodies within the plurality of captured image frames overlap at the reference position.
- the reference position at which the celestial body will be displayed in the shooting result image includes the exposure time, the starting position of the celestial body, and the shooting start position of the celestial body to prevent deterioration around the position of the celestial body in the shooting result image. It may be determined based on the ending position.
- the method further includes determining that the electronic device is fixed, and as the electronic device is fixed: identifying coordinates in the preview image at which the virtual image of the celestial body will be displayed; Comparing the position coordinates of the celestial body in the preview image with coordinates at which the virtual image will be displayed; and an operation of correcting a sensing value of the IMU sensor of the electronic device based on the comparison result.
- the operation of determining that the electronic device is fixed may use the IMU sensor to determine whether the shaking of the electronic device is within a preset threshold range.
- the method includes: correcting coordinates at which the virtual image will be displayed based on the sensing value of the IMU sensor of the electronic device being corrected; and displaying the virtual image of the celestial body at a location corresponding to the corrected coordinates on the preview image.
- the method includes determining that the photographing direction of the electronic device has changed; and recalibrating the sensing value of the IMU sensor of the electronic device and the corrected coordinates as the capturing direction of the electronic device changes.
- the operation of determining that the photographing direction has changed may determine whether the photographing direction of the electronic device deviates from a preset threshold.
- the operation of identifying the celestial body may identify the celestial body corresponding to the shooting direction of the camera of the electronic device from a DB (database) that stores celestial body information corresponding to the measured position and the measured orientation. there is.
- DB database
- an electronic device for photographing a celestial body includes: a camera for photographing the celestial body; a GPS sensor that measures the location of the electronic device; IMU sensor for measuring the orientation of the electronic device; display; Memory that stores one or more instructions; and a processor executing the one or more instructions, wherein the processor displays a preview image generated through the camera on the display by executing the one or more instructions, and displays the preview image generated through the camera on the electronic device using the GPS sensor.
- the processor may receive a user input for photographing the celestial body by executing the one or more instructions, and may photograph the celestial object during the exposure time as the user input is received.
- the processor may execute the one or more instructions to: acquire a plurality of captured image frames by photographing the celestial body during the exposure time, and generate the photographed result image by combining the plurality of photographed image frames. there is.
- the processor executes the one or more instructions to determine the celestial body in the captured image.
- the plurality of captured image frames may be combined so that the celestial bodies within the plurality of captured image frames overlap.
- the reference position at which the celestial body will be displayed in the shooting result image includes the exposure time, the starting position of the celestial body, and the shooting start position of the celestial body to prevent deterioration around the position of the celestial body in the shooting result image. It may be determined based on the ending position.
- the processor may execute the one or more instructions to: determine that the electronic device is stationary, identify coordinates in the preview image at which the virtual image of the celestial body will be displayed as the electronic device is stationary, and determine that the preview image is stationary.
- the position coordinates of the celestial body within the device may be compared with the coordinates at which the virtual image will be displayed, and based on the comparison result, the sensing value of the IMU sensor of the electronic device may be corrected.
- the processor may use the IMU sensor to determine whether shaking of the electronic device is within a preset threshold range to determine that the electronic device is fixed.
- the processor corrects the coordinates at which the virtual image will be displayed based on the correction of the sensing value of the IMU sensor of the electronic device, and corresponds to the corrected coordinates on the preview image.
- the virtual image of the celestial body can be displayed at a desired location.
- the processor determines that the photographing direction of the electronic device changes by executing the one or more instructions, and as the photographing direction of the electronic device changes, the sensing value of the IMU sensor of the electronic device and the corrected You can recalibrate the coordinates.
- the processor may determine whether the photographing direction of the electronic device deviates from a preset threshold in order to determine that the photographing direction has changed.
- an operation of displaying a preview image generated through a camera of an electronic device An operation of measuring the location of the electronic device using a Global Positioning System (GPS) sensor of the electronic device; An operation of measuring the orientation of the electronic device using an IMU (Inertial Measurement Unit) sensor of the electronic device; An operation of identifying a celestial object corresponding to a photographing direction of a camera of the electronic device based on the measured position and the measured orientation; An operation of identifying an exposure time of the camera set to photograph the celestial body; Based on the exposure time, displaying a GUI on the preview image to guide a reference position at which the celestial body will be displayed within the image taken of the celestial body; An operation of receiving a user input for photographing the celestial body; and an operation of photographing the celestial body during the exposure time as the user input is received.
- GPS Global Positioning System
- IMU Inertial Measurement Unit
- a celestial body is an object that exists in space and may be an object that is photographed by a camera of an electronic device.
- Celestial bodies may include, for example, stars, planets, satellites, comets, star clusters, nebulae, and/or interstellar material.
- Celestial bodies may include, for example, stars that form constellations.
- the image resulting from capturing a celestial body may be an image generated by an electronic device capturing a celestial body and stored in an electronic device or another device.
- the image of the celestial body on the preview image may be an image of the actual celestial body displayed within the preview image displayed on the screen of the electronic device in order to photograph the celestial body. If the brightness of the celestial body is dark, the image of the celestial body displayed in the preview image may not be identified by the user.
- the virtual image of the celestial body on the preview image may be a virtual image displayed to indicate the location of the actual celestial body on the preview image.
- the virtual image of the celestial body may be displayed overlapped on the preview image separately from the actual celestial body.
- a virtual image of a celestial body is created based on celestial information about an actual celestial body, and can be created virtually so that a user who photographs an actual celestial body can check the current location of the actual celestial body on a preview image.
- the guide image of the celestial body on the preview may be a virtual image provided to guide the composition of celestial body photography to the user photographing the celestial body.
- a guide image of a celestial body may be created to guide the user as to where the celestial body is located in an image resulting from shooting, but is not limited to this.
- FIG. 1 is a diagram illustrating an outline of a process in which an electronic device photographs a celestial body and obtains an image as a result of the photograph, according to an embodiment.
- the electronic device 1000 can photograph a celestial body 10 in the sky.
- the electronic device 1000 may photograph the astronomical object 10 for a predetermined exposure time, and due to the rotation of the Earth, the electronic device 1000 may photograph the astronomical object 10.
- the position of the celestial body 10 may move in the sky.
- the electronic device 1000 includes a GUI (12) that guides the user to locate the celestial body 10 in a specific position within the image 30 in which the moving celestial body 10 is captured.
- graphical user interface can be displayed on the preview image.
- the electronic device 1000 may display the GUI 12 at a location spaced apart from the image 14 of the celestial body 10 on the preview image, considering the movement trajectory of the celestial body 10 during the exposure time. Additionally, if the celestial body 10 is not bright enough, the celestial body image 14 on the preview image may not be clearly visible to the user. In this case, the electronic device 1000 displays a virtual image of the celestial body 10 on the preview. It can be displayed.
- the electronic device 1000 may acquire a plurality of captured image frames 20 by photographing the celestial body 10 during an exposure time.
- the electronic device 1000 combines a plurality of captured image frames 20 so that each astronomical image in the plurality of captured images 20 is located at a specific position in the captured image 30, thereby creating a captured image. (30) can be generated.
- the electronic device 1000 includes a smartphone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a global positioning system (GPS) device, an e-book reader, It may be, but is not limited to, digital broadcasting terminals, navigation, kiosks, MP3 players, digital cameras, home appliances, and other mobile or non-mobile computing devices. Additionally, the electronic device 1000 may be a wearable device such as a watch, glasses, hair band, or ring equipped with a data processing function. However, it is not limited thereto, and the electronic device 1000 may include all types of devices that provide a photographing function using a camera.
- FIG. 2 is a flowchart of a method for an electronic device to photograph a celestial object so that the celestial object is displayed at a reference position within a photographing result image, according to an embodiment.
- each operation may be performed sequentially, but is not necessarily performed sequentially.
- the order of each operation may be changed, and at least two operations may be performed in parallel.
- operations S200 to S270 are performed by a processor of an electronic device (e.g., the electronic device 1000 of FIG. 1, the electronic device 10001 of FIG. 13 and/or FIG. 14) It can be understood that it is performed in processor 10020 of 14).
- a processor of an electronic device e.g., the electronic device 1000 of FIG. 1, the electronic device 10001 of FIG. 13 and/or FIG. 14
- the electronic device 1000 uses a camera (e.g., the camera module 10080 of FIGS. 13 and/or 14).
- the generated preview image can be displayed.
- the photographing function of the electronic device 1000 is activated, the electronic device 1000 can photograph a celestial body using a camera, and a preview image containing an image of the celestial body is displayed on the display of the electronic device 1000 (e.g., FIGS. 13 and 13 ). /Or it can be displayed on the display module 10060 of 14).
- the electronic device 1000 displays a preview image including an image of a celestial body on the screen of the electronic device 1000. can do.
- the image of the celestial body on the preview image may be an image of the actual celestial body displayed within the preview image displayed on the screen of the electronic device for photographing the celestial body. If the brightness of the celestial body is dark, the image of the celestial body displayed in the preview image may not be identified by the user.
- the electronic device 1000 may measure the location of the electronic device 1000.
- the electronic device 1000 may measure the location of the electronic device 1000 using a sensor module (eg, the sensor module 10076 of FIGS. 13 and/or 14) of the electronic device 1000.
- the electronic device 1000 may obtain location information of the electronic device 1000.
- the electronic device 1000 may measure the location of the electronic device 1000 using a global positioning system (GPS) sensor and obtain information about the latitude and longitude of the electronic device 1000. .
- GPS global positioning system
- the location of the electronic device 1000 can be used to identify the location of a celestial body photographed by the electronic device 1000 from a celestial body DB, which will be described later.
- the electronic device 1000 may measure the orientation of the electronic device 1000.
- the electronic device 1000 uses a sensor module of the electronic device 1000 (e.g., the sensor module 10076 of FIGS. 13 and/or 14). ) can be used to obtain orientation information of the electronic device 1000.
- the electronic device 1000 may measure the orientation of the electronic device 1000 using an IMU sensor.
- an IMU sensor may include, but is not limited to, at least one of a geomagnetic sensor, an acceleration sensor, or a gyro sensor.
- an IMU sensor may include only a geomagnetic sensor and an acceleration sensor.
- the electronic device 1000 may acquire three-axis information based on the geomagnetic direction using a geomagnetic sensor.
- the electronic device 1000 may obtain three-axis information based on the direction of gravity using an acceleration sensor.
- the orientation of the electronic device 1000 can be used to identify the shooting direction of the electronic device 1000, and to identify the location of the celestial body photographed by the electronic device 1000 from the celestial body DB, which will be described later. It can be used.
- the electronic device 1000 may identify a celestial body corresponding to the location and orientation of the electronic device 1000 from the celestial body DB.
- the celestial body DB may store information about celestial bodies located in the photographing direction of the electronic device 1000, according to the location and orientation of the electronic device 1000 at a specific time.
- the celestial body DB may include information about the location of the celestial body and identification information of the celestial body, but is not limited thereto.
- information about the location of a celestial body may include information about the azimuth and altitude of the celestial body.
- the identification information of a celestial body may include information about the name of the celestial body, the shape of the celestial body, the size of the celestial body, and the color of the celestial body.
- the electronic device 1000 may identify the shooting direction in which the camera of the electronic device 1000 faces based on the orientation information of the electronic device 1000.
- the electronic device 1000 identifies the current time at which the celestial object is photographed, and based on the current time, the location of the electronic device 1000, and the photographing direction of the electronic device 1000, the photographed object is captured by the electronic device 1000 from the celestial object DB.
- Information about celestial bodies can be identified.
- the electronic device 1000 determines the portion that the camera of the electronic device 1000 is currently looking at based on location information measured using a GPS sensor, orientation information measured using an IMU sensor, and camera information. You can obtain information about right ascension, declination, angle of view, and rotation.
- the electronic device 1000 may identify information about a celestial object captured by the electronic device 1000 from a celestial object DB using plate solving technology.
- the electronic device 1000 may identify an exposure time for photographing a celestial body. If the brightness of the celestial body is not large enough, the image of the celestial body on the preview image may not be identifiable by the user, and the electronic device 1000 captures the celestial body for a predetermined exposure time so that the celestial body in the resulting image can be identified by the user. It can be identified.
- the exposure time for photographing a celestial body may be preset to a default value for photographing a celestial object.
- the exposure time for photographing a celestial body may be set to a predetermined value according to user input as the function for photographing a celestial body is activated.
- the exposure time for photographing a celestial body may be automatically set based on the brightness of the celestial body in the preview image.
- the electronic device 1000 may display a GUI on the preview image that guides the reference position at which the celestial body will be displayed within the image of the celestial body captured based on the exposure time.
- the electronic device 1000 may calculate the movement trajectory of a celestial body to be photographed at the location of the electronic device 1000 based on the exposure time.
- the electronic device 1000 may calculate the moving direction and moving distance of the celestial body during the exposure time based on the latitude and longitude of the location of the electronic device 1000.
- the electronic device 1000 may identify the start position of the celestial body in the preview image and, based on the start position and the movement trajectory of the celestial body, identify the end position of the celestial body in the preview image.
- the electronic device 1000 may determine a specific position between the capture start position and the capture end position on the preview image as the reference position. Additionally, the electronic device 1000 may display a GUI on the preview image to guide the user that the celestial object will be displayed at a position corresponding to the reference position on the preview image within the shooting result image. For example, in the preview image, the shooting start position and the shooting end position are located near the border of the preview image, and the GUI that guides the reference position at which the celestial body will be displayed within the image of the celestial body can be located in the center of the preview image. there is.
- the electronic device 1000 may photograph an astronomical object during an exposure time.
- the electronic device 1000 may acquire a plurality of captured image frames by photographing a celestial object during an exposure time.
- Each of the plurality of captured image frames may include an image of a celestial body.
- each image of the celestial body within the plurality of captured image frames may be displayed at different positions.
- the electronic device 1000 may generate a capture result image by combining a plurality of captured image frames.
- the electronic device 1000 may overlap a plurality of capture frames so that images of celestial bodies within the plurality of capture frames are located at reference positions within the capture result image. Additionally, the electronic device 1000 may generate a capture result image by combining a plurality of overlapping captured images.
- the electronic device 1000 identifies the location of a celestial body from each of a plurality of shooting frames and arranges the plurality of shooting frames so that the celestial body is located at a reference position in the shooting result image, thereby generating a shooting result image. can do.
- a method by which the electronic device 1000 generates a captured image from a plurality of captured image frames will be described in more detail with reference to FIGS. 7 to 10 .
- FIG. 3 is a flowchart of a method by which an electronic device guides a celestial object to be displayed at a reference position within a captured image, according to an embodiment.
- the operations of FIG. 3 may correspond to operation S250 of FIG. 2, but are not limited thereto.
- each operation may be performed sequentially, but is not necessarily performed sequentially.
- the order of each operation may be changed, and at least two operations may be performed in parallel.
- operations S300 to S340 are performed by a processor of an electronic device (e.g., the electronic device 1000 of FIG. 1, the electronic device 10001 of FIG. 13 and/or FIG. 14) It can be understood that it is performed in processor 10020 of 14).
- a processor of an electronic device e.g., the electronic device 1000 of FIG. 1, the electronic device 10001 of FIG. 13 and/or FIG. 14
- the electronic device 1000 may calculate the movement trajectory of the celestial body during the exposure time based on the position and orientation of the electronic device 1000.
- the electronic device 1000 may calculate the movement trajectory of a celestial body to be photographed at the location of the electronic device 1000 based on the exposure time.
- the electronic device 1000 may calculate the moving direction and moving distance of the celestial body during the exposure time based on the latitude and longitude of the location where the electronic device 1000 is located.
- the electronic device 1000 may store information in advance about the movement trajectory of a celestial body according to its location on the Earth, and calculate the movement trajectory of the celestial body during the exposure time based on the stored information and the location of the electronic device 1000. You can.
- the electronic device 1000 may identify the starting position of the celestial object for capturing.
- the electronic device 1000 may identify the current location of the celestial body on the preview image as the shooting start location.
- the electronic device 1000 may identify the image of a celestial body currently displayed in the preview image, and determine the position where the identified celestial body image is displayed on the preview image as the starting position for capturing the celestial body.
- the electronic device 1000 may identify the ending position of capturing the celestial body based on the starting position and movement trajectory of the celestial body. For example, the electronic device 1000 may calculate the end position of the celestial object by using the coordinate value of the starting position of the celestial object and the coordinate value of the movement trajectory.
- the electronic device 1000 may identify a reference position at which the celestial body will be displayed within the resulting image of the celestial body based on the capturing start position and the capturing end position. For example, when the shooting start position and the capturing end position are located at the edge of the shooting result image, the electronic device 1000 may determine the center part of the shooting result image as the reference position at which the celestial body will be displayed. For example, when the exposure time for photographing a celestial body is about 5 minutes, the electronic device 1000 selects a captured image frame corresponding to about 2 minutes and 30 seconds among the captured image frames that will be generated by photographing the celestial body for about 5 minutes. The display position of the celestial body in can be determined as the reference position.
- the electronic device 1000 may display a GUI guiding the reference position on the preview image.
- the GUI that guides the user to the reference position may include information indicating that the celestial object is displayed at the reference position in the resulting image.
- the GUI might say, “The celestial object will appear here in the captured image,” or “Place the celestial object to be photographed here, and the celestial object will be centered within the captured image.” It can include text such as:
- the GUI may include an object indicating the position on the preview image corresponding to the position of the celestial body in the resulting image.
- the GUI may include a guide image of a celestial body displayed at a position on a preview image corresponding to the position of a celestial body in a shooting result image.
- the guide image of a celestial body may be a virtual image provided to guide the composition of celestial body photography to a user photographing a celestial body.
- a guide image of a celestial body may be created to guide the user as to where the celestial body is located in an image resulting from shooting, but is not limited to this.
- a user when a user photographs a celestial body for a predetermined exposure time through the GUI, he or she can check the reference position where the celestial body will be displayed in the resulting image. Accordingly, the user can select the celestial body in the desired composition. You can take pictures.
- Figure 4 is a diagram illustrating an example of a celestial body moving during filming, according to an embodiment.
- the electronic device 1000 photographs a celestial body for a predetermined exposure time due to the rotation of the Earth
- the celestial body moves from a first position 40 on the celestial sphere to a second position due to the rotation of the Earth.
- the position at which the celestial body is displayed may be different within a plurality of celestial body image frames generated by photographing the celestial body during the exposure time.
- FIG. 5 is a diagram illustrating an example of a preview image that guides a user so that a celestial object is displayed at a reference position in a shooting result image, according to an embodiment.
- a guide image 50 of a celestial body and an object 52 for guiding the reference position may be displayed at a reference position determined based on the shooting start position and the capture end position. Additionally, text 54 may be displayed on the preview image: “A celestial object is displayed here in the captured image.” The image 56 of the celestial body currently being photographed may indicate the starting position of the celestial body, and the guide image 50 of the celestial body may be located on a movement trajectory between the celestial object's photographing start position and the photographing end position.
- the user positions the guide image 50 and the object 52 of the celestial body at a desired position on the preview image and starts shooting, so that the celestial body appears as desired by the user within the shooting result image generated by the electronic device 1000. You can have it displayed in the location.
- FIG. 6 is a diagram illustrating an example of a preview image that guides a user so that a celestial object is displayed at a reference position in a shooting result image, according to an embodiment.
- text informing that a celestial object is displayed at a position on the resulting image corresponding to a reference position determined based on the starting position and ending position may be displayed. For example, “If you place your object here, it will be centered within the image.” Text 64 such as may be displayed on the preview image. Additionally, an object 62 and a guide image 60 of the celestial body for guiding the location of the celestial object to be photographed at a specific location may be displayed on the preview image. Accordingly, the user positions the celestial body at the position of the guide image 60 of the celestial body and the object 62 and starts shooting, so that the celestial body is displayed at the reference position within the shooting result image generated by the electronic device 1000. can do.
- FIG. 7 is a flowchart of a method in which an electronic device generates a captured image by combining a plurality of captured image frames, according to an embodiment.
- the operations of FIG. 7 may correspond to operation S270 of FIG. 2, but are not limited thereto.
- each operation may be performed sequentially, but is not necessarily performed sequentially.
- the order of each operation may be changed, and at least two operations may be performed in parallel.
- operations S700 to S720 are performed by a processor of an electronic device (e.g., the electronic device 1000 of FIG. 1, the electronic device 10001 of FIG. 13 and/or FIG. 14) It can be understood that it is performed in processor 10020 of 14).
- a processor of an electronic device e.g., the electronic device 1000 of FIG. 1, the electronic device 10001 of FIG. 13 and/or FIG. 14
- the electronic device 1000 may acquire a plurality of captured image frames by photographing a celestial body during an exposure time. An image of a celestial body may be displayed within each of the plurality of captured image frames.
- the electronic device 1000 may identify the location of a celestial body from each of a plurality of captured frames.
- the celestial body may move on the celestial sphere, and the positions at which the celestial body is displayed may be different within a plurality of celestial image frames generated by photographing the celestial body during the exposure time. You can.
- the electronic device 1000 may arrange a plurality of capture frames so that the celestial object is located at a reference position within the capture result image.
- the electronic device 1000 may determine the central portion of the movement trace of the celestial body as a reference position at which the celestial body will be displayed in order to reduce deterioration of the portion containing the celestial body in the image resulting from the capture.
- the electronic device 1000 selects a captured image frame in which the celestial body is displayed in the center of the movement trajectory among the captured image frames as a reference frame, and causes the celestial body in the selected reference frame and the celestial body in other captured image frames to overlap each other, Multiple captured image frames can be overlapped.
- the electronic device 1000 selects a captured image frame corresponding to about 2 minutes and 30 seconds among the captured image frames generated by photographing the celestial body for about 5 minutes. can be selected as the reference frame. Additionally, a plurality of captured image frames may be overlapped and arranged so that the celestial bodies included in the reference frame overlap with celestial bodies in other captured image frames. The electronic device 1000 may generate a resulting image by combining a plurality of arranged captured image frames.
- the electronic device 1000 may determine the central portion of the image as a result of capturing the image as a reference position at which the celestial body will be displayed. In this case, the electronic device 1000 selects a captured image frame in which a celestial body is displayed in the center of the captured image frame among the captured image frames as a reference frame, and selects a plurality of captured image frames such that the celestial body in the selected reference frame and the celestial body in other captured image frames overlap.
- the captured image frames can be overlapped.
- FIG. 8 is a diagram illustrating a plurality of captured image frames generated by an electronic device photographing a celestial body during an exposure time according to an embodiment.
- the electronic device 1000 may generate a plurality of captured image frames 1, 2, 3, 4, and 5 by photographing a celestial object during an exposure time.
- the positions of each celestial body in the plurality of captured image frames 1, 2, 3, 4, and 5 may be different from each other.
- the position of the celestial body in the first captured image frame (1), the position of the celestial body in the second captured image frame (2), the position of the celestial body in the third captured image frame (3), and the position of the celestial body in the fourth captured image frame (4) ) and the position of the celestial body in the fifth captured image frame 5 may be different from each other.
- the electronic device 1000 may select the third captured image frame 3, in which the celestial body is located in the center of the celestial body's movement trajectory, as a reference frame.
- FIG. 9 is a diagram illustrating an example in which a plurality of captured image frames are arranged so that a celestial object is located at a reference position within a captured image, according to an embodiment.
- the image of the celestial body in the third captured image frame 3, which is a reference frame, and the image of each celestial body in the other captured image frames 1, 2, 4, and 5 overlap
- the first captured image frame (1), the second captured image frame (2), the third captured image frame (3), the fourth captured image frame (4), and the fifth captured image frame (5) may be arranged to overlap. there is.
- the first captured image frame (1), the second captured image frame (2), the third captured image frame (3), the fourth captured image frame (4), and the fifth captured image frame (5) As this overlaps, the most captured image frames (1, 2, 3, 4, and 5) may overlap in the central portion including the celestial body in the third image frame (3). Accordingly, deterioration of the central portion including the celestial body in the resulting image may be reduced.
- FIG. 10 is a diagram illustrating a photographing result image in which a celestial object is displayed at a reference position according to an embodiment.
- the image of the celestial body 102 may be located at the reference position of the captured image 100.
- the first captured image frame (1), the second captured image frame (2), the third captured image frame (3), the fourth captured image frame (4), and the fifth captured image frame (5) As this overlaps, the most captured image frames (1, 2, 3, 4, and 5) may overlap in the central portion including the celestial body in the third image frame (3). Accordingly, the deterioration of the central portion including the celestial body image 102 in the shooting result image 100 of FIG. 10 may occur less than the deterioration of the edge portion of the shooting result image 100.
- FIG. 11 is a flowchart of a method in which an electronic device corrects the orientation of the electronic device and displays a virtual image of a celestial body on a preview image based on the corrected orientation, according to an embodiment.
- the operations of FIG. 11 may be executed after operation S230 of FIG. 2, but are not limited thereto.
- each operation may be performed sequentially, but is not necessarily performed sequentially.
- the order of each operation may be changed, and at least two operations may be performed in parallel.
- the virtual image of the celestial body on the preview image may be a virtual image displayed to indicate the location of the actual celestial body on the preview image.
- the virtual image of the celestial body may be displayed overlapped on the preview image separately from the actual celestial body.
- a virtual image of a celestial body is created based on celestial information about an actual celestial body, and can be created virtually so that a user who photographs an actual celestial body can check the current location of the actual celestial body on a preview image.
- the electronic device 1000 may display a virtual image of the identified celestial body on a preview image.
- the electronic device 1000 collects information about the celestial object photographed by the electronic device 1000 from the celestial body DB based on the current time at which the celestial object is photographed, the location of the electronic device 1000, and the photographing direction of the electronic device 1000. It can be obtained.
- Information about the celestial body may include, for example, identification information of the celestial body, and information about the azimuth and altitude of the celestial body.
- the identification information of a celestial body may include information about the name of the celestial body, the shape of the celestial body, the size of the celestial body, and the color of the celestial body.
- the electronic device 1000 may generate a virtual image of a celestial body using information about a celestial body obtained from a celestial body DB and display the generated virtual image on a preview image.
- the electronic device 1000 may generate a virtual image of a celestial body based on the shape, size, and color of the celestial body.
- the electronic device 1000 provides a preview image to display a virtual image based on information about the azimuth and altitude of the celestial body, azimuth information of the electronic device 1000, and the angle of view of the camera of the electronic device 1000.
- the position of the image can be determined.
- the electronic device 1000 may display a virtual image of a celestial body at a location corresponding to the azimuth and altitude of the celestial body on the preview image. Additionally, the electronic device 1000 may display the name of the celestial body around the virtual image of the celestial body.
- the electronic device 1000 may determine whether the electronic device 1000 is fixed.
- the electronic device 1000 may determine whether the electronic device 1000 is shaking based on the sensing value sensed through the IMU sensor.
- the electronic device 1000 may determine whether the electronic device 1000 shakes more than a predetermined threshold.
- the predetermined threshold may be determined by considering whether the position of the celestial body on the preview is outside an error range when the electronic device 1000 photographs a celestial body, but is not limited thereto.
- the electronic device 1000 may repeat operation S1105.
- the electronic device 1000 may perform operations S1110 to S1125 to correct the orientation of the electronic device 1000. there is.
- the electronic device 1000 may acquire coordinates on a preview image of a virtual image of a celestial body. As the electronic device 1000 is fixed, the electronic device 1000 receives the electronic device 1000 from the astronomical object DB based on the current time for photographing the celestial body, the location of the electronic device 1000, and the photographing direction of the electronic device 1000. ), you can obtain information about the celestial body photographed. Information about the celestial body may include, for example, identification information of the celestial body, and information about the azimuth and altitude of the celestial body.
- the electronic device 1000 displays a virtual image of the celestial body based on information about the azimuth and altitude of the celestial body, azimuth information of the electronic device 1000, and the angle of view of the camera of the electronic device 1000.
- the coordinates of the location on the preview image can be calculated.
- the electronic device 1000 may identify the location coordinates of a celestial body in the preview image.
- the electronic device 1000 can identify the image of a celestial body within the preview image and identify the coordinates of a location where the image of the celestial body is displayed.
- the electronic device 1000 may compare the position coordinates of a celestial body with the position coordinates of a virtual image of the celestial body.
- the electronic device 1000 may correct the orientation of the electronic device 1000 based on the comparison result.
- the electronic device 1000 may correct the orientation of the electronic device 1000 so that the position coordinates of the celestial body and the position coordinates of the virtual image of the celestial body substantially match.
- the electronic device 1000 may calibrate the sensing value of the IMU sensor of the electronic device 1000 so that the position coordinates of the virtual image of the celestial body substantially match the position coordinates of the celestial body and the position coordinates of the virtual image of the celestial body.
- the sensing value sensed from the geomagnetic sensor may provide 3-axis information based on the magnetic north direction
- the 3-axis information sensed from the acceleration sensor may provide 3-axis information based on the direction of gravity. Accordingly, the geomagnetic sensor cannot detect the rotation of the electronic device 1000 based on the magnetic north direction, and the acceleration sensor cannot detect the rotation of the electronic device 1000 based on the direction of gravity.
- the information based on the captured image including the celestial body includes information about the rotation based on the magnetic north direction of the electronic device 1000 and the rotation based on the direction of gravity, the sensing value from the geolocation sensor is in the magnetic north direction.
- Rotation information based on can be expressed as a formula in which rotation information is a variable
- the acceleration sensor can be expressed in a formula in which rotation based on the direction of gravity is a variable. Accordingly, information about the rotation of the electronic device 1000 based on the magnetic north direction and the rotation of the electronic device 1000 based on the direction of gravity can be calculated from the two equations for the two variables expressed.
- the electronic device 1000 can predict the corrected sensing value using the calculated rotation information.
- the difference between the current value and the predicted value used in the calculation is a correction value, and the electronic device 1000 can reflect the correction value in the sensing value of the geomagnetic sensor and the sensing value of the acceleration sensor.
- the electronic device 1000 may display a virtual image of the identified celestial body on a preview image based on the corrected orientation.
- the electronic device 1000 may correct the coordinates at which the virtual image of the celestial body will be displayed and display the virtual image of the celestial body at a location corresponding to the corrected coordinates.
- a virtual image of the celestial body can be provided by correcting the orientation of the electronic device 1000 only when the electronic device 1000 is fixed. This allows for more effective provision to users.
- the electronic device 1000 may determine whether the shooting direction of the electronic device 1000 has changed.
- the electronic device 1000 may determine whether the shooting direction of the electronic device 1000 has changed by more than a predetermined threshold. For example, if the difference between the direction the camera is facing and the direction the camera was facing during the previous correction is more than a predetermined angle (for example, about 20 to about 30 degrees), the electronic device 1000 It can be determined that the shooting direction has changed. For example, in the case where the preview image before the shooting direction of the electronic device 1000 is changed and the preview image after the shooting direction of the electronic device 1000 is changed, the electronic device 1000 is It can be determined that the shooting direction of (1000) has changed.
- the electronic device 1000 may execute operation S220.
- the electronic device 1000 may determine operation S240.
- FIG. 12 is a diagram illustrating preview images displayed on the screen of an electronic device for photographing a celestial body according to an embodiment.
- the celestial body image on the preview image 120 displayed on the screen of the electronic device 1000 for photographing the celestial body may not be identified by the user. there is.
- the electronic device 1000 may display a preview image 122 including a virtual image of a celestial body captured by the electronic device 1000 on the screen of the electronic device 1000.
- the electronic device 1000 may obtain information about the celestial object that the electronic device 1000 is photographing from the celestial body DB, based on the location of the electronic device 1000, the current time, and the orientation of the electronic device 1000. Additionally, the electronic device 1000 may generate a virtual image of the celestial body based on the acquired information about the celestial body and display the virtual image of the celestial body on the preview image 122 .
- the location of the virtual image 132 of the celestial body and the The positions of the images 133 may be different.
- the electronic device 1000 when the electronic device 1000 is fixed without shaking, the electronic device 1000 adjusts the electronic device 1000 so that the virtual image 132 of the celestial body and the image 133 of the celestial body substantially match.
- the direction can be corrected.
- the position of the virtual image 132 of the celestial body and the position of the image 133 of the celestial body on the preview image 126 may substantially match.
- the electronic device 1000 may then change the composition for photographing the celestial body based on the user's operation, and as the composition changes, the preview image 128 appears on the screen of the electronic device 1000. can be displayed.
- the electronic device 1000 provides the user with a GUI to guide the photographing position of the celestial body as shown in FIGS. 5 and 6. can be provided to.
- the electronic device 1000 may then photograph a celestial body based on the user's input.
- the electronic device 1000 can photograph an astronomical object for a predetermined exposure time. While photographing a celestial object, the electronic device 1000 may display text on the preview image 130 informing that the celestial object is being photographed.
- Figure 13 is a block diagram of an electronic device according to one embodiment.
- the electronic device 10001 includes a processor 10020, a memory 10030, a display module 10060, a sensor module 10076, and a camera module 10080. can do. However, not all of the components shown in FIG. 13 are essential components of the electronic device 10001. The electronic device 10001 may be implemented with more components than those shown in FIG. 13 , or the device 10001 may be implemented with fewer components than the components shown in FIG. 13 .
- the electronic device 10001 includes a processor 10020, a memory 10030, a display module 10060, a sensor module 10076, and a camera module ( In addition to 10080), there is an input module (10050), audio output module (10055), audio module (10070), interface (10077), connection terminal (10078), haptic module (10079), power management module (10088), and battery (10089). , it may further include a communication module 10090, a subscriber identification module 10096, and/or an antenna module 10097.
- FIG. 14 is a block diagram of an electronic device 10001 in a network environment 10000, according to various embodiments.
- an electronic device 10001 communicates with an electronic device 10002 through a first network 10098 (e.g., a short-range wireless communication network) or a second network 10099. It is possible to communicate with the electronic device 10004 or the server 10008 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 10001 may communicate with the electronic device 10004 through the server 10008.
- a first network 10098 e.g., a short-range wireless communication network
- a second network 10099 e.g., a second network 10099.
- the electronic device 10004 or the server 10008 e.g., a long-distance wireless communication network
- the electronic device 10001 may communicate with the electronic device 10004 through the server 10008.
- the electronic device 10001 includes a processor 10020, a memory 10030, an input module 10050, an audio output module 10055, a display module 10060, an audio module 10070, and a sensor module ( 10076), interface (10077), connection terminal (10078), haptic module (10079), camera module (10080), power management module (10088), battery (10089), communication module (10090), subscriber identification module (10096) , or may include an antenna module 10097.
- at least one of these components eg, the connection terminal 10078
- some of these components e.g., sensor module 10076, camera module 10080, or antenna module 10097
- are integrated into one component e.g., display module 10060). It can be.
- Processor 10020 executes software (e.g., program 10040) to operate at least one other component (e.g., hardware or software component) of electronic device 10001 connected to processor 10020. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 10020 stores instructions or data received from another component (e.g., the sensor module 10076 or the communication module 10090) in the volatile memory 10032. The commands or data stored in the volatile memory 10032 can be processed, and the resulting data can be stored in the non-volatile memory 10034.
- software e.g., program 10040
- the processor 10020 stores instructions or data received from another component (e.g., the sensor module 10076 or the communication module 10090) in the volatile memory 10032.
- the commands or data stored in the volatile memory 10032 can be processed, and the resulting data can be stored in the non-volatile memory 10034.
- the processor 10020 may include a main processor 10021 (e.g., a central processing unit or an application processor) or an auxiliary processor 10023 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
- a main processor 10021 e.g., a central processing unit or an application processor
- auxiliary processor 10023 e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor.
- the electronic device 10001 includes a main processor 10021 and a auxiliary processor 10023
- the auxiliary processor 10023 may be set to use lower power than the main processor 10021 or be specialized for a designated function. You can.
- the auxiliary processor 10023 may be implemented separately from the main processor 10021 or as part of it.
- the auxiliary processor 10023 may, for example, act on behalf of the main processor 10021 while the main processor 10021 is in an inactive (e.g., sleep) state, or while the main processor 10021 is in an active (e.g., application execution) state. ), together with the main processor 10021, at least one of the components of the electronic device 10001 (e.g., the display module 10060, the sensor module 10076, or the communication module 10090) At least some of the functions or states related to can be controlled.
- coprocessor 10023 e.g., image signal processor or communication processor
- may be implemented as part of another functionally related component e.g., camera module 10080 or communication module 10090. there is.
- the auxiliary processor 10023 may include a hardware structure specialized for processing artificial intelligence models.
- Artificial intelligence models can be created through machine learning. For example, this learning may be performed in the electronic device 10001 itself, where artificial intelligence is performed, or may be performed through a separate server (e.g., server 10008).
- Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited.
- An artificial intelligence model may include multiple artificial neural network layers.
- Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above.
- artificial intelligence models may additionally or alternatively include software structures.
- the memory 10030 may store various data used by at least one component (eg, the processor 10020 or the sensor module 10076) of the electronic device 10001. Data may include, for example, input data or output data for software (eg, program 10040) and instructions related thereto.
- Memory 10030 may include volatile memory 10032 or non-volatile memory 10034.
- the program 10040 may be stored as software in the memory 10030 and may include, for example, an operating system 10042, middleware 10044, or an application 10046.
- the input module 10050 may receive commands or data to be used in a component of the electronic device 10001 (e.g., the processor 10020) from outside the electronic device 10001 (e.g., a user).
- the input module 10050 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).
- the sound output module 10055 can output sound signals to the outside of the electronic device 10001.
- the sound output module 10055 may include, for example, a speaker or receiver. Speakers can be used for general purposes such as multimedia playback or recording playback.
- the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
- the display module 10060 can visually provide information to the outside of the electronic device 10001 (eg, a user).
- the display module 10060 may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device.
- the display module 10060 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.
- the audio module 10070 can convert sound into electrical signals or, conversely, convert electrical signals into sound. According to one embodiment, the audio module 10070 acquires sound through the input module 10050, the sound output module 10055, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 10001). Sound may be output through an electronic device 10002 (e.g., speaker or headphone).
- an electronic device 10002 e.g., speaker or headphone
- the sensor module 10076 detects the operating state (e.g., power or temperature) of the electronic device 10001 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do.
- the sensor module 10076 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.
- the interface 10077 may support one or more designated protocols that can be used to connect the electronic device 10001 directly or wirelessly with an external electronic device (eg, the electronic device 10002).
- the interface 10077 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
- HDMI high definition multimedia interface
- USB universal serial bus
- SD card interface Secure Digital Card
- connection terminal 10078 may include a connector through which the electronic device 10001 can be physically connected to an external electronic device (eg, the electronic device 10002).
- the connection terminal 10078 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
- the haptic module 10079 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses.
- the haptic module 10079 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
- the camera module 10080 can capture still images and videos. According to one embodiment, the camera module 10080 may include one or more lenses, image sensors, image signal processors, or flashes.
- the power management module 10088 can manage power supplied to the electronic device 10001.
- the power management module 10088 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).
- PMIC power management integrated circuit
- Battery 10089 may supply power to at least one component of electronic device 10001.
- the battery 10089 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
- the communication module 10090 provides a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 10001 and an external electronic device (e.g., electronic device 10002, electronic device 10004, or server 10008). It can support establishment and communication through established communication channels.
- the communication module 10090 operates independently of the processor 10020 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication.
- the communication module 10090 is a wireless communication module 10092 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 10094 (e.g.
- GNSS global navigation satellite system
- LAN local area network
- power line communication module may be included.
- the corresponding communication module is a first network 10098 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 10099 (e.g., legacy It may communicate with an external electronic device 10004 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN).
- a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN).
- the wireless communication module 10092 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 10096 within a communication network such as the first network 10098 or the second network 10099.
- subscriber information e.g., International Mobile Subscriber Identifier (IMSI)
- IMSI International Mobile Subscriber Identifier
- the wireless communication module 10092 may support 5G networks and next-generation communication technologies after 4G networks, for example, NR access technology (new radio access technology).
- NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported.
- the wireless communication module 10092 may support high frequency bands (e.g., mmWave bands), for example, to achieve high data rates.
- the wireless communication module 10092 uses various technologies to secure performance in high frequency bands, such as beamforming, massive MIMO (multiple-input and multiple-output), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna.
- the wireless communication module 10092 may support various requirements specified in the electronic device 10001, an external electronic device (e.g., electronic device 10004), or a network system (e.g., second network 10099).
- the wireless communication module 10092 supports peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC.
- peak data rate e.g., 20 Gbps or more
- loss coverage e.g., 164 dB or less
- U-plane latency e.g., 164 dB or less
- the antenna module 10097 may transmit or receive signals or power to or from the outside (e.g., an external electronic device).
- the antenna module 10097 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB).
- the antenna module 10097 may include a plurality of antennas (eg, an array antenna).
- at least one antenna suitable for the communication method used in the communication network such as the first network 10098 or the second network 10099, is connected to the plurality of antennas by, for example, the communication module 10090.
- the communication module 10090 can be selected Signals or power may be transmitted or received between the communication module 10090 and an external electronic device through the selected at least one antenna.
- other components eg, radio frequency integrated circuit (RFIC) may be additionally formed as part of the antenna module 10097.
- RFIC radio frequency integrated circuit
- antenna module 10097 may form a mmWave antenna module.
- a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.
- a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of
- peripheral devices e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
- signal e.g. commands or data
- commands or data may be transmitted or received between the electronic device 10001 and an external electronic device 10004 through the server 10008 connected to the second network 10099.
- Each of the external electronic devices 10002 or 10004 may be of the same or different type as the electronic device 10001.
- all or part of the operations performed in the electronic device 10001 may be executed in one or more of the external electronic devices 10002, 10004, or 10008.
- the electronic device 10001 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 10001 does not execute the function or service on its own.
- one or more external electronic devices may be requested to perform at least part of the function or service.
- One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 10001.
- the electronic device 10001 may process the result as is or additionally and provide it as at least part of a response to the request.
- cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology can be used.
- the electronic device 10001 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
- the external electronic device 10004 may include an Internet of Things (IoT) device.
- Server 10008 may be an intelligent server using machine learning and/or neural networks.
- an external electronic device 10004 or a server 10008 may be included in the second network 10099.
- the electronic device 10001 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
- the electronic device 10001 may be the electronic device 1000 of FIGS. 1 to 12 .
- sensor module 10076 may include an IMU sensor.
- the IMU sensor may include, for example, at least one of a geomagnetic sensor, an acceleration sensor, or a gyro sensor. Or, for example, the IMU sensor may include a geomagnetic sensor and an acceleration sensor.
- the memory 10030 can store a celestial body DB.
- the processor 10020 of the electronic device 10001 may perform the operations of the electronic device 1000 of FIGS. 1 to 12 by executing instructions stored in the memory 10030.
- the electronic device 10001 can display a preview image generated through a camera.
- the photographing function of the electronic device 10001 is activated, the electronic device 10001 can photograph a celestial body using a camera, and a preview image containing an image of the celestial body can be displayed on the screen of the electronic device 10001. .
- the electronic device 10001 displays a preview image containing an image of a celestial body on the screen of the electronic device 10001. can do.
- the electronic device 10001 can measure the location of the electronic device 10001. As the camera application of the electronic device 10001 is executed and the function for photographing astronomical objects is activated, the electronic device 10001 may obtain location information of the electronic device 10001. For example, the electronic device 10001 may measure the location of the electronic device 10001 using a Global Positioning System (GPS) sensor and obtain information about the latitude and longitude of the electronic device 10001. . The location of the electronic device 10001 can be used to identify the location of a celestial body photographed by the electronic device 10001 from a celestial body DB, which will be described later.
- GPS Global Positioning System
- the electronic device 10001 can measure the orientation of the electronic device 10001. As the camera application of the electronic device 10001 is executed and the function of photographing astronomical objects is activated, the electronic device 10001 may obtain orientation information of the electronic device 10001. For example, the electronic device 10001 may measure the orientation of the electronic device 10001 using an IMU sensor.
- the IMU sensor may include, but is not limited to, at least one of a geomagnetic sensor, an acceleration sensor, or a gyro sensor.
- an IMU sensor may include only a geomagnetic sensor and an acceleration sensor.
- the electronic device 10001 may acquire three-axis information based on the geomagnetic direction using a geomagnetic sensor.
- the electronic device 10001 may acquire three-axis information based on the direction of gravity using an acceleration sensor.
- the orientation of the electronic device 10001 can be used to identify the photographing direction of the electronic device 10001, and can be used to identify the location of the celestial body photographed by the electronic device 10001 from the celestial object DB, which will be described later.
- the electronic device 10001 may identify a celestial body corresponding to the location and orientation of the electronic device 10001 from the celestial body DB.
- the celestial body DB may store information about celestial bodies located in the shooting direction of the electronic device 10001, according to the location and orientation of the electronic device 10001 at a specific time.
- the celestial body DB may include information about the location of the celestial body and identification information of the celestial body, but is not limited thereto.
- information about the location of a celestial body may include information about the azimuth and altitude of the celestial body.
- the identification information of a celestial body may include information about the name of the celestial body, the shape of the celestial body, the size of the celestial body, and the color of the celestial body.
- the electronic device 10001 may identify the shooting direction in which the camera of the electronic device 10001 faces based on the orientation information of the electronic device 10001.
- the electronic device 10001 identifies the current time for photographing an astronomical object, and based on the current time, the location of the electronic device 10001, and the photographing direction of the electronic device 10001, the photographed object is captured by the electronic device 10001 from the astronomical object DB.
- Information about celestial bodies can be identified.
- the electronic device 10001 determines the portion that the camera of the electronic device 10001 is currently looking at based on location information measured using a GPS sensor, orientation information measured using an IMU sensor, and camera information. You can obtain information about right ascension, declination, angle of view, and rotation.
- the electronic device 10001 may identify information about a celestial body photographed by the electronic device 10001 from a celestial body DB using plate solving technology.
- the electronic device 10001 can identify an exposure time for photographing a celestial object. If the brightness of the celestial body is not large enough, the image of the celestial body on the preview image may not be identifiable by the user, and the electronic device 10001 captures the celestial body for a predetermined exposure time so that the celestial body in the resulting image can be identified by the user. It can be identified.
- the exposure time for photographing a celestial body may be preset to a default value for photographing a celestial object.
- the exposure time for photographing a celestial body may be set to a predetermined value according to user input as the function for photographing a celestial body is activated.
- the exposure time for photographing a celestial body may be automatically set based on the brightness of the celestial body in the preview image.
- the electronic device 10001 may display a GUI on the preview image that guides the reference position at which the celestial body will be displayed within the image of the celestial body.
- the electronic device 10001 may calculate the movement trajectory of a celestial body to be photographed at the location of the electronic device 10001 based on the exposure time.
- the electronic device 10001 may calculate the moving direction and moving distance of the celestial body during the exposure time based on the latitude and longitude of the location of the electronic device 10001.
- the electronic device 10001 may identify the starting position of the celestial body in the preview image and, based on the starting position and the movement trajectory of the celestial body, identify the end position of the celestial body in the preview image.
- the electronic device 10001 may determine a specific position between the shooting start position and the shooting end position on the preview image as the reference position. Additionally, the electronic device 10001 may display a GUI on the preview image to guide the user that the celestial body will be displayed at a position corresponding to the reference position on the preview image within the shooting result image. For example, in the preview image, the shooting start position and the shooting end position are located near the border of the preview image, and the GUI that guides the reference position at which the celestial body will be displayed within the image of the celestial body can be located in the center of the preview image. there is.
- the electronic device 10001 can photograph an astronomical object during an exposure time.
- the electronic device 10001 may acquire a plurality of captured image frames by photographing a celestial object during an exposure time.
- Each of the plurality of captured image frames may include an image of a celestial body.
- each image of the celestial body within the plurality of captured image frames may be displayed at different positions.
- the electronic device 10001 may generate a capture result image by combining a plurality of captured image frames.
- the electronic device 10001 may overlap a plurality of capture frames so that images of celestial bodies within the plurality of capture frames are located at reference positions within the capture result image. Additionally, the electronic device 10001 may generate a resulting image by combining a plurality of overlapping captured images.
- the electronic device 10001 may identify the location of a celestial body from each of a plurality of shooting frames and generate a shooting result image by arranging the plurality of shooting frames so that the celestial body is located at a reference position in the shooting result image.
- the electronic device 10001 may display a virtual image of an identified celestial body on a preview image.
- the electronic device 10001 collects information about the celestial body photographed by the electronic device 10001 from the celestial body DB based on the current time at which the celestial object is photographed, the location of the electronic device 10001, and the photographing direction of the electronic device 10001. It can be obtained.
- Information about the celestial body may include, for example, identification information of the celestial body, and information about the azimuth and altitude of the celestial body.
- the identification information of a celestial body may include information about the name of the celestial body, the shape of the celestial body, the size of the celestial body, and the color of the celestial body.
- the electronic device 10001 may generate a virtual image of the celestial body using information about the celestial body obtained from the celestial body DB and display the generated virtual image on the preview image. For example, the electronic device 10001 may generate a virtual image of a celestial body based on the shape, size, and color of the celestial body.
- the electronic device 10001 may determine a position on the preview image to display the virtual image based on information about the azimuth and altitude of the celestial body, azimuth information of the electronic device 10001, and the angle of view of the camera of the electronic device 10001. .
- the electronic device 10001 may display a virtual image of a celestial body at a location corresponding to the azimuth and altitude of the celestial body on the preview image. Additionally, the electronic device 10001 may display the name of the celestial body around the virtual image of the celestial body.
- the electronic device 10001 may determine whether the electronic device 10001 is fixed.
- the electronic device 10001 may determine whether the electronic device 10001 is shaking based on the sensing value sensed through the IMU sensor.
- the electronic device 10001 may determine whether the electronic device 10001 shakes more than a predetermined threshold.
- the predetermined threshold may be determined by considering whether the position of the celestial body on the preview is outside an error range when the electronic device 10001 photographs a celestial body, but is not limited thereto.
- the electronic device 10001 may repeat the operation of determining whether the electronic device 10001 is fixed.
- the electronic device 10001 may perform operations to correct the orientation of the electronic device 10001.
- An operation to correct the orientation of the electronic device 10001 may include an operation to correct the sensing value of the IMU sensor of the electronic device 10001.
- the electronic device 10001 may acquire coordinates on a preview image of a virtual image of a celestial body. As the electronic device 10001 is fixed, the electronic device 10001 is selected from the astronomical object DB based on the current time for photographing the celestial body, the location of the electronic device 10001, and the photographing direction of the electronic device 10001. ), you can obtain information about the celestial body photographed. Information about the celestial body may include, for example, identification information of the celestial body, and information about the azimuth and altitude of the celestial body.
- the electronic device 10001 displays a virtual image of the celestial body based on information about the azimuth and altitude of the celestial body, azimuth information of the electronic device 10001, and the angle of view of the camera of the electronic device 10001.
- the coordinates of the location on the preview image can be calculated.
- the electronic device 10001 may identify the location coordinates of a celestial body in the preview image.
- the electronic device 10001 can identify the image of a celestial body within the preview image and identify the coordinates of a location where the image of the celestial body is displayed.
- the electronic device 10001 may compare the position coordinates of a celestial body with the position coordinates of a virtual image of the celestial body.
- the electronic device 10001 may correct its orientation based on the comparison result.
- the electronic device 10001 may correct the orientation of the electronic device 10001 so that the position coordinates of the celestial body match the position coordinates of the virtual image of the celestial body.
- the electronic device 10001 may calibrate the sensing value of the IMU sensor of the electronic device 10001 so that the position coordinates of the virtual image of the celestial body match the position coordinates of the celestial body and the position coordinates of the virtual image of the celestial body.
- the sensing value sensed from the geomagnetic sensor may provide 3-axis information based on the magnetic north direction
- the 3-axis information sensed from the acceleration sensor may provide 3-axis information based on the direction of gravity. Accordingly, the geomagnetic sensor cannot detect the rotation of the electronic device 10001 based on the magnetic north direction, and the acceleration sensor cannot detect the rotation of the electronic device 10001 based on the direction of gravity.
- the sensing value from the geolocation sensor is based on the magnetic north direction
- Rotation information based on can be expressed as a formula in which rotation information is a variable
- the acceleration sensor can be expressed in a formula in which rotation based on the direction of gravity is a variable.
- information about the rotation based on the magnetic north direction and the rotation of the electronic device 10001 based on the direction of gravity can be calculated from the two equations for the two variables expressed.
- the electronic device 10001 can predict the corrected sensing value using the calculated rotation information.
- the difference between the current value and the predicted value used in the calculation is a correction value, and the electronic device 10001 can reflect the correction value in the sensing value of the geomagnetic sensor and the sensing value of the acceleration sensor.
- the electronic device 10001 may display a virtual image of the identified celestial body on the preview image, based on the corrected orientation.
- a virtual image of the celestial body can be provided by correcting the orientation of the electronic device 10001 only when the electronic device 10001 is fixed. It can be effectively provided to users.
- the electronic device 10001 may determine whether the shooting direction of the electronic device 10001 has changed.
- the electronic device 10001 may determine whether the shooting direction of the electronic device 10001 has changed by more than a predetermined threshold. For example, the electronic device 10001 determines the shooting direction of the electronic device 10001 when the difference between the direction the camera is facing and the direction the camera was facing during the previous correction is more than a predetermined angle (for example, 20 to 30 degrees). It can be judged that this has changed. For example, when the preview image before the shooting direction of the electronic device 10001 is changed and the preview image after the shooting direction of the electronic device 10001 is changed, the electronic device 10001 is the electronic device 10001. It can be determined that the shooting direction of (10001) has changed.
- the electronic device 10001 may display a virtual image of the celestial body on the preview image and perform an operation to correct the orientation of the electronic device 10001.
- the electronic device 10001 may perform operations to guide photographing of the celestial body.
- Electronic devices may be of various types.
- Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances.
- Electronic devices according to embodiments of this document are not limited to the above-described devices.
- first, second, or first or second may be used simply to distinguish one component from another, and to refer to those components in other respects (e.g., importance or order) is not limited.
- One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.”
- any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.
- module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions.
- the module may be implemented in the form of an application-specific integrated circuit (ASIC).
- ASIC application-specific integrated circuit
- Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 10036 or external memory 10038) that can be read by a machine (e.g., electronic device 10001). It may be implemented as software (e.g., program 10040) including these.
- a processor e.g., processor 10020
- a device e.g., electronic device 10001
- the one or more instructions may include code generated by a compiler or code that can be executed by an interpreter.
- a storage medium that can be read by a device may be provided in the form of a non-transitory storage medium.
- 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.
- Computer program products are commodities and can be traded between sellers and buyers.
- the computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or via an application store (e.g. Play Store TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online.
- a machine-readable storage medium e.g. compact disc read only memory (CD-ROM)
- an application store e.g. Play Store TM
- two user devices e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online.
- at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
- each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is.
- one or more of the components or operations described above may be omitted, or one or more other components or operations may be added.
- multiple components eg, modules or programs
- the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. .
- operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims (15)
- 전자 디바이스가 천체를 촬영하는 방법에 있어서,상기 전자 디바이스의 카메라를 통하여 생성되는 프리뷰 이미지를 디스플레이하는 동작;상기 전자 디바이스의 GPS (Global Positioning System) 센서를 이용하여 상기 전자 디바이스의 위치를 측정하는 동작;상기 전자 디바이스의 IMU (Inertial Measurement Unit) 센서를 이용하여, 상기 전자 디바이스의 방위를 측정하는 동작;상기 측정된 위치 및 상기 측정된 방위에 기초하여, 상기 전자 디바이스의 카메라의 촬영 방향에 대응되는 천체를 식별하는 동작;상기 천체를 촬영하기 위해 설정된 상기 카메라의 노출 시간을 식별하는 동작;상기 노출 시간에 기초하여, 상기 천체의 촬영 결과 이미지 내에서 상기 천체가 표시될 기준 위치를 가이드하기 위한 GUI를 상기 프리뷰 이미지 상에 디스플레이하는 동작;상기 천체를 촬영하기 위한 사용자 입력을 수신하는 동작; 및상기 사용자 입력이 수신됨에 따라, 상기 노출 시간 동안 상기 천체를 촬영하는 동작;을 포함하는, 방법.
- 제1 항에 있어서,상기 노출 시간동안 상기 천체를 촬영함으로써, 복수의 촬영 이미지 프레임들을 획득하는 동작; 및상기 복수의 촬영 이미지 프레임들을 조합함으로써, 상기 촬영 결과 이미지를 생성하는 동작;을 포함하는, 방법.
- 제2 항에 있어서,상기 노출 시간동안 상기 천체가 이동함에 따라, 상기 복수의 촬영 이미지 프레임들 내의 상기 천체의 위치들은 서로 상이하며,상기 촬영 결과 이미지를 생성하는 동작은, 상기 촬영 결과 이미지 내에서 상기 천체가 표시될 기준 위치에서, 상기 복수의 촬영 이미지 프레임들 내의 상기 천체들이 중첩되도록, 상기 복수의 촬영 이미지 프레임들을 조합하는 동작을 포함하는 것인, 방법.
- 제3 항에 있어서,상기 촬영 결과 이미지 내에서 상기 천체가 표시될 상기 기준 위치는, 상기 촬영 결과 이미지 내에서 상기 천체의 위치 주변의 열화가 방지되도록, 상기 노출 시간, 상기 천체의 촬영 시작 위치 및 상기 천체의 촬영 종료 위치에 기초하여 결정되는 것인, 방법.
- 제1 항에 있어서,상기 전자 디바이스가 고정됨을 판단하는 동작;상기 전자 디바이스가 고정됨에 따라:상기 천체의 가상 이미지가 표시될 상기 프리뷰 이미지 내의 좌표를 식별하는 동작;상기 프리뷰 이미지 내의 상기 천체의 위치 좌표를 상기 가상 이미지가 표시될 좌표와 비교하는 동작; 및상기 비교 결과에 기초하여, 상기 전자 디바이스의 상기 IMU 센서의 센싱 값을 보정하는 동작;을 더 포함하는, 방법.
- 제5 항에 있어서,상기 전자 디바이스가 고정됨을 판단하는 동작은, 상기 IMU 센서를 이용하여, 상기 전자 디바이스의 흔들림이 미리 설정된 임계치 범위 이내인지를 판단하는 것인, 방법.
- 제5 항에 있어서,상기 전자 디바이스의 상기 IMU 센서의 센싱 값이 보정됨에 기초하여, 상기 가상 이미지가 표시될 좌표를 보정하는 동작; 및상기 프리뷰 이미지 상에서 상기 보정된 좌표에 대응되는 위치에 상기 천체의 상기 가상 이미지를 디스플레이하는 동작;을 더 포함하는, 방법.
- 제5 항에 있어서,상기 전자 디바이스의 촬영 방향이 변경됨을 판단하는 동작;상기 전자 디바이스의 촬영 방향이 변경됨에 따라, 상기 전자 디바이스의 상기 IMU 센서의 센싱 값 및 상기 보정된 좌표를 재보정하는 동작;을 더 포함하는, 방법.
- 제8 항에 있어서,상기 촬영 방향이 변경됨을 판단하는 동작은, 상기 전자 디바이스의 촬영 방향이 미리 설정된 임계치를 벗어나는지를 판단하는 것인, 방법.
- 제1 항에 있어서,상기 천체를 식별하는 동작은,상기 측정된 위치 및 상기 측정된 방위에 대응되는 천체 정보를 저장하는 DB로부터, 상기 전자 디바이스의 카메라의 촬영 방향에 대응되는 상기 천체를 식별하는 것인, 방법.
- 천체를 촬영하는 전자 디바이스에 있어서,상기 천체를 촬영하는 카메라;상기 전자 디바이스의 위치를 측정하는 GPS 센서;상기 전자 디바이스의 방위를 측정하기 위한 IMU 센서;디스플레이;하나 이상의 명령어를 저장하는 메모리; 및상기 하나 이상의 명령어를 실행하는 프로세서;를 포함하며,상기 프로세서는 상기 하나 이상의 명령어들을 실행함으로써,상기 카메라를 통하여 생성되는 프리뷰 이미지를 상기 디스플레이 상에 디스플레이하고,상기 GPS 센서를 이용하여 상기 전자 디바이스의 위치를 측정하고,상기 IMU 센서를 이용하여, 상기 전자 디바이스의 방위를 측정하고,상기 측정된 위치 및 상기 측정된 방위에 기초하여, 상기 카메라의 촬영 방향에 대응되는 천체를 식별하고,상기 천체를 촬영하기 위해 설정된 상기 카메라의 노출 시간을 식별하고,상기 노출 시간에 기초하여, 상기 천체의 촬영 결과 이미지 내에서 상기 천체가 표시될 기준 위치를 가이드하기 위한 GUI를 상기 프리뷰 이미지 상에 디스플레이하고,상기 천체를 촬영하기 위한 사용자 입력을 수신하고,상기 사용자 입력이 수신됨에 따라, 상기 노출 시간 동안 상기 천체를 촬영하는 것인, 전자 디바이스.
- 제11 항에 있어서,상기 프로세서는 상기 하나 이상의 명령어들을 실행함으로써:상기 노출 시간동안 상기 천체를 촬영함으로써, 복수의 촬영 이미지 프레임들을 획득하고,상기 복수의 촬영 이미지 프레임들을 조합함으로써, 상기 촬영 결과 이미지를 생성하는, 전자 디바이스.
- 제12 항에 있어서,상기 노출 시간동안 상기 천체가 이동함에 따라, 상기 복수의 촬영 이미지 프레임들 내의 상기 천체의 위치들은 서로 상이하며,상기 프로세서는 상기 하나 이상의 명령어들을 실행함으로써, 상기 촬영 결과 이미지 내에서 상기 천체가 표시될 기준 위치에서, 상기 복수의 촬영 이미지 프레임들 내의 상기 천체들이 중첩되도록, 상기 복수의 촬영 이미지 프레임들을 조합하는, 전자 디바이스.
- 제13 항에 있어서,상기 촬영 결과 이미지 내에서 상기 천체가 표시될 상기 기준 위치는, 상기 촬영 결과 이미지 내에서 상기 천체의 위치 주변의 열화가 방지되도록, 상기 노출 시간, 상기 천체의 촬영 시작 위치 및 상기 천체의 촬영 종료 위치에 기초하여 결정되는 것인, 전자 디바이스.
- 제11 항에 있어서,상기 프로세서는 상기 하나 이상의 명령어들을 실행함으로써:상기 전자 디바이스가 고정됨을 판단하고,상기 전자 디바이스가 고정됨에 따라, 상기 천체의 가상 이미지가 표시될 상기 프리뷰 이미지 내의 좌표를 식별하고, 상기 프리뷰 이미지 내의 상기 천체의 위치 좌표를 상기 가상 이미지가 표시될 좌표와 비교하고,상기 비교 결과에 기초하여, 상기 전자 디바이스의 상기 IMU 센서의 센싱 값을 보정하는, 전자 디바이스.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202380073561.1A CN120113248A (zh) | 2022-10-21 | 2023-10-20 | 用于捕获天体对象的图像的电子装置和方法 |
| EP23880299.5A EP4589975A4 (en) | 2022-10-21 | 2023-10-20 | ELECTRONIC DEVICE AND METHOD FOR CAPTURED IMAGES OF CELESTIAL OBJECTS |
| US19/175,466 US20250240521A1 (en) | 2022-10-21 | 2025-04-10 | Electronic device and method for capturing image of celestial object |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2022-0136460 | 2022-10-21 | ||
| KR20220136460 | 2022-10-21 | ||
| KR1020220166343A KR20240056375A (ko) | 2022-10-21 | 2022-12-02 | 천체를 촬영하기 위한 전자 디바이스 및 방법 |
| KR10-2022-0166343 | 2022-12-02 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/175,466 Continuation US20250240521A1 (en) | 2022-10-21 | 2025-04-10 | Electronic device and method for capturing image of celestial object |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024085724A1 true WO2024085724A1 (ko) | 2024-04-25 |
Family
ID=90738281
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2023/016394 Ceased WO2024085724A1 (ko) | 2022-10-21 | 2023-10-20 | 천체를 촬영하기 위한 전자 디바이스 및 방법 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20250240521A1 (ko) |
| EP (1) | EP4589975A4 (ko) |
| CN (1) | CN120113248A (ko) |
| WO (1) | WO2024085724A1 (ko) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2026031695A1 (zh) * | 2024-08-09 | 2026-02-12 | 荣耀终端股份有限公司 | 图像的处理方法、电子设备及可读存储介质 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100531872B1 (ko) * | 2003-06-12 | 2005-11-29 | 엘지전자 주식회사 | 휴대 단말기를 이용한 천체관측 방법 |
| KR20060134434A (ko) * | 2005-06-22 | 2006-12-28 | 엘지전자 주식회사 | 별자리 출력 기능을 가지는 이동통신 단말기 및 그 방법 |
| JP2007089087A (ja) * | 2005-09-26 | 2007-04-05 | Casio Comput Co Ltd | 天体撮像装置 |
| KR20140033119A (ko) * | 2011-06-16 | 2014-03-17 | 리코 이메징 가부시키가이샤 | 천체 자동 추적 촬영 방법 및 천체 자동 추적 촬영 장치 |
| JP2015159510A (ja) * | 2014-02-25 | 2015-09-03 | オリンパス株式会社 | 撮像装置および撮像装置の制御方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5034343B2 (ja) * | 2006-07-06 | 2012-09-26 | カシオ計算機株式会社 | 撮像装置及びプログラム |
| JP5840189B2 (ja) * | 2013-10-02 | 2016-01-06 | オリンパス株式会社 | 撮像装置、画像処理装置、および画像処理方法 |
| JP2016076869A (ja) * | 2014-10-08 | 2016-05-12 | オリンパス株式会社 | 撮像装置、撮影方法、およびプログラム |
| KR20170014556A (ko) * | 2015-07-30 | 2017-02-08 | 삼성전자주식회사 | 이동체를 촬영하는 방법 및 촬영 장치. |
-
2023
- 2023-10-20 EP EP23880299.5A patent/EP4589975A4/en active Pending
- 2023-10-20 WO PCT/KR2023/016394 patent/WO2024085724A1/ko not_active Ceased
- 2023-10-20 CN CN202380073561.1A patent/CN120113248A/zh active Pending
-
2025
- 2025-04-10 US US19/175,466 patent/US20250240521A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100531872B1 (ko) * | 2003-06-12 | 2005-11-29 | 엘지전자 주식회사 | 휴대 단말기를 이용한 천체관측 방법 |
| KR20060134434A (ko) * | 2005-06-22 | 2006-12-28 | 엘지전자 주식회사 | 별자리 출력 기능을 가지는 이동통신 단말기 및 그 방법 |
| JP2007089087A (ja) * | 2005-09-26 | 2007-04-05 | Casio Comput Co Ltd | 天体撮像装置 |
| KR20140033119A (ko) * | 2011-06-16 | 2014-03-17 | 리코 이메징 가부시키가이샤 | 천체 자동 추적 촬영 방법 및 천체 자동 추적 촬영 장치 |
| JP2015159510A (ja) * | 2014-02-25 | 2015-09-03 | オリンパス株式会社 | 撮像装置および撮像装置の制御方法 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4589975A4 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2026031695A1 (zh) * | 2024-08-09 | 2026-02-12 | 荣耀终端股份有限公司 | 图像的处理方法、电子设备及可读存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4589975A1 (en) | 2025-07-23 |
| US20250240521A1 (en) | 2025-07-24 |
| EP4589975A4 (en) | 2025-12-24 |
| CN120113248A (zh) | 2025-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022097930A1 (ko) | 전자 장치 및 이의 디스플레이 방법 | |
| WO2022065827A1 (ko) | 무선 통신을 이용한 촬영 방법 및 이를 지원하는 전자 장치 | |
| WO2022124659A1 (ko) | 사용자 입력을 처리하는 전자 장치 및 방법 | |
| WO2024063380A1 (ko) | 플렉서블 디스플레이에 표시되는 화면을 제어하기 위한 전자 장치 및 방법 | |
| WO2024085724A1 (ko) | 천체를 촬영하기 위한 전자 디바이스 및 방법 | |
| WO2023048466A1 (ko) | 전자 장치 및 컨텐츠 표시 방법 | |
| WO2022145926A1 (ko) | 전자 장치 및 전자 장치의 센서 데이터 교정 방법 | |
| WO2024225788A1 (ko) | 카메라의 원격 제어를 요청하는 방법 및 전자 장치 | |
| WO2024085493A1 (ko) | 프리뷰 이미지를 표시하기 위한 전자 장치 및 방법 | |
| WO2022154440A1 (ko) | 오디오 데이터를 처리하는 전자 장치 및 그 동작 방법 | |
| WO2024262843A1 (ko) | 원격 촬영을 위한 피드백 정보를 제공하는 방법 및 그 전자 장치 | |
| WO2023229199A1 (ko) | 전자 장치의 화면 표시 모드를 결정하는 동작 방법 및 전자 장치 | |
| WO2024063564A1 (ko) | 폴더블 전자 장치 및 폴더블 전자 장치의 동작 방법 | |
| WO2025116336A1 (ko) | 전자 장치 및 전자 장치에서 객체를 공유하기 위한 방법 | |
| WO2026005186A1 (ko) | 이미지를 제공하는 방법 및 이를 지원하는 전자 장치 | |
| WO2026023817A1 (ko) | 이미지에 기능을 적용하는 전자 장치, 이의 동작 방법, 및 기록 매체 | |
| WO2023058892A1 (ko) | 위치 기반 서비스를 제공하기 위한 전자 장치 및 방법 | |
| WO2024080553A1 (ko) | 전자 장치 및 그 동작 방법 | |
| WO2025071026A1 (ko) | 카메라를 포함하는 전자 장치 및 그 동작 방법 | |
| WO2024025082A1 (ko) | 플렉서블 디스플레이를 통해 화면을 표시하기 위한 전자 장치 및 방법 | |
| WO2026049223A1 (ko) | 쓰리디 공간 내에서의 터치 입력을 위한 머리-착용 전자 장치, 방법, 및 비일시적 컴퓨터 판독 가능 저장 매체 | |
| WO2024155171A1 (ko) | 조작 입력을 전송하는 헤드 마운트 장치 및 그의 동작 방법 | |
| WO2024058458A1 (ko) | 웹페이지를 적응적으로 표시하는 전자 장치, 방법, 및 비일시적 컴퓨터 판독가능 저장 매체 | |
| WO2024034838A1 (ko) | 복수의 디스플레이들을 통해 화면을 표시하기 위한 전자 장치 및 방법 | |
| WO2025211693A1 (ko) | 복수의 카메라를 포함하는 전자 장치 및 이의 제어 방법 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23880299 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023880299 Country of ref document: EP Ref document number: 202380073561.1 Country of ref document: CN |
|
| ENP | Entry into the national phase |
Ref document number: 2023880299 Country of ref document: EP Effective date: 20250417 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202517045479 Country of ref document: IN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWP | Wipo information: published in national office |
Ref document number: 202517045479 Country of ref document: IN |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380073561.1 Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023880299 Country of ref document: EP |