WO2024031709A1 - 一种显示方法及装置 - Google Patents

一种显示方法及装置 Download PDF

Info

Publication number
WO2024031709A1
WO2024031709A1 PCT/CN2022/112309 CN2022112309W WO2024031709A1 WO 2024031709 A1 WO2024031709 A1 WO 2024031709A1 CN 2022112309 W CN2022112309 W CN 2022112309W WO 2024031709 A1 WO2024031709 A1 WO 2024031709A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
area
display area
display
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2022/112309
Other languages
English (en)
French (fr)
Inventor
李帅
夏沛
周锦
宋宪玺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to PCT/CN2022/112309 priority Critical patent/WO2024031709A1/zh
Priority to EP22954660.1A priority patent/EP4560455A4/en
Priority to CN202280009096.0A priority patent/CN117882075A/zh
Priority to JP2025507651A priority patent/JP2025530651A/ja
Publication of WO2024031709A1 publication Critical patent/WO2024031709A1/zh
Priority to US19/050,232 priority patent/US20250182657A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B60K35/235—Head-up displays [HUD] with means for detecting the driver's gaze direction or eye points
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/654—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the user being the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/656—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the user being a passenger
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/82—Protecting input, output or interconnection devices
    • G06F21/84—Protecting input, output or interconnection devices output devices, e.g. displays or monitors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/195—Blocking or enabling display functions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/741—Instruments adapted for user detection
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/08—Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2358/00—Arrangements for display data security
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/10—Automotive applications

Definitions

  • the present application relates to the field of human-computer interaction, and in particular, to a display method and device.
  • the number of human-computer interaction functions in the cockpit is gradually increasing, and the frequency of use of display devices is increasing.
  • display devices in the cockpit are mainly divided into two categories.
  • the first category is vehicle-mounted display screens;
  • the second category is projection displays, such as head-up display (HUD) devices.
  • HUD head-up display
  • HUD augmented reality-head up display
  • This application provides a display method and device, which can reduce the risk of privacy information leakage and improve users' sense of security.
  • a display method including: obtaining image information, the image information being used to determine the eye position and line of sight direction of a first user of the vehicle; and adjusting the display area according to the position and line of sight direction of the first user's eyes. How the first area is displayed.
  • the display area is a display area of the HUD, and the first area includes private information of the second user of the vehicle.
  • the vehicle-mounted terminal can obtain image information used to determine the eye position and line of sight direction of the first user of the vehicle, and can further adjust the display of the first area in the display area according to the position and line of sight direction of the first user's eyes. This method can reduce the possibility that the first user can view the second user's private information, thereby reducing the risk of private information leakage and improving the user's sense of security.
  • the image information may be an image directly obtained by the sensor, or may be information obtained after processing by the sensor, or may be information obtained by processing the image obtained by the sensor through a processor.
  • the image information may be, for example, a key point matrix, a key point set, etc. That is, the key points of the face are marked in the image information.
  • the face key points are points used to locate the key areas of the face in the face image.
  • the key areas include one or more of the eyebrows, eyes, nose, mouth, facial contour, etc. It should be understood that in this application, image information can be used to obtain the user's eye position.
  • the position of the first user's eyes is marked in the image information, and the position of the second user's eyes is also marked in the image information.
  • the first user may be a non-driver, for example, and the second user may be a driver, for example.
  • the position of the user's eyes may be, for example, the middle point between the centers of the two eyes, the center of the left eye, the center of the right eye, etc.
  • the eye center may be the center of the pupil of the eye, the center of the eyeball, the center of the cornea, or other locations of the eye.
  • the HUD may be, for example, one or more of an AR-HUD, a combined head-up display (combiner-HUD, C-HUD), a windshield-type head-up display (windshield-HUD, W-HUD), etc. indivual.
  • the first area may be part of the display area, or may be the entire display area.
  • the private information may include, for example, information in one or more forms such as text, pictures, videos, etc.
  • the first user is located in the non-driving position of the vehicle, and the second user is located in the driving position of the vehicle.
  • the first user is located in the non-driving seat of the vehicle, including: the first user is located in the passenger seat of the vehicle; or the first user is located in the rear area of the vehicle.
  • the first user can be in the second row left or the second row right of the vehicle.
  • the area in the car is divided into the driver's seat, the passenger seat, the second row left, the second row middle, and the second row right, the first user can be in the second row left, second row middle, or second row right of the vehicle.
  • adjusting the display mode of the first area in the display area according to the position and line of sight direction of the first user's eyes including: determining whether the position of the first user's eyes is within the viewing angle of the display area. Within the range; when the first condition is met, the display mode of the first area in the display area is adjusted to the first display mode.
  • the first condition includes at least one of the following: the position of the first user's eyes is within the viewing angle range of the display area; the first user's line of sight is directed toward the display area; or the first user's line of sight stays within the display area.
  • the time is greater than or equal to the preset time.
  • the first condition can be pre-agreed or standard defined, and is not limited here. It can be seen that when the first condition is met, the vehicle-mounted terminal adjusts the display mode of the first area in the display area to the first display mode. That is to say, after detecting that the first user may view the second area in the first area, When viewing the user's private information, the vehicle-mounted terminal adjusts the display mode of the first area in the display area to the first display mode, thereby reducing the possibility that the first user can view the second user's private information, thereby reducing the leakage of private information. risks and improve users’ sense of security.
  • the viewing angle range of the display area includes the angle range of the eyes of the screen of the display area that can be seen by the first user, and the boundary point can be determined by the maximum angle value and the minimum angle value of the eyes of the screen of the display area that can be seen by the first user.
  • the angle value is determined. That is to say, the viewing angle range of the display area may include an interval determined by the maximum angle value and the minimum angle value, and may also include boundary points, such as the maximum angle value and/or the minimum angle value, or may not include boundary points. It can be defined during the specific implementation process.
  • the viewing angle range of the display area is related to the position of the first user's eyes.
  • the preset time can be preset, or it can be obtained by the vehicle-mounted terminal from the cloud, or it can be determined by the user, which is not limited here.
  • the first display method includes at least one of the following: hiding the first area; hiding the second user's private information in the first area; diluting the first area; changing the first clarity of the first area. Switch to the second definition and display the second user's private information in the second definition, and the first definition is higher than the second definition; or switch the first resolution of the first area to the second resolution, and Display the second user's private information at a second resolution, where the first resolution is higher than the second resolution.
  • the clarity of the first area is the first definition, or the resolution of the first area is the first resolution
  • the user can clearly view the private information in the first area; when the first area When the resolution of the first area is the second resolution, or the resolution of the first area is the second resolution, the user cannot clearly view the private information, or even view the private information.
  • the method further includes: when the second condition is met, adjusting the display mode of the first area in the display area from the first display mode to the second display mode; wherein the second condition includes the following At least one item: the position of the first user's eyes exceeds the viewing angle range of the display area; the first user's line of sight is directed toward other areas outside the display area; the first user's line of sight stays in the display area for less than the preset time .
  • the second condition can be pre-agreed or standard defined, and is not limited here. It can be seen that when the second condition is met, the vehicle-mounted terminal adjusts the display mode of the first area in the display area from the first display mode to the second display mode.
  • the vehicle-mounted terminal adjusts the display mode of the first area in the display area from the first display mode to the second display mode, so that the second user can view the second user's private information.
  • the second display method includes at least one of the following: displaying the second user's private information in the first area; switching the second definition of the first area to the first definition, and displaying the second user's private information in the first area. Display the second user's private information with a first definition that is higher than the second definition; or switch the second resolution of the first area to the first resolution, and display the second user's private information with the first resolution. For private information, the first resolution is higher than the second resolution.
  • the image information is also used to determine the position of the second user's eyes and determine whether the position of the first user's eyes is within the viewing angle range of the display area, including: determining the position of the second user's eyes.
  • the first angle value is obtained by the angle formed by the line between the position of the eye and the first target point on the display area, and the line between the position of the first user's eye and the first target point;
  • the first angle value determines whether the position of the first user's eyes is within the viewing angle range of the display area. It can be seen that the vehicle-mounted terminal can determine whether the position of the first user's eyes is within the viewing angle range of the display area according to the first angle value, and prepare for subsequent adjustment of the display mode of the first area in the display area.
  • the cosine value of the first angle value is the first target point
  • P eye is the position of the first user's eye
  • P′ eye is the position of the second user's eye.
  • the method further includes: determining the position of the first user's eyes and the first target point on the display area. The angle between the connecting line and the sight direction of the first user is obtained to obtain the second angle value; based on the second angle value, it is determined whether the sight direction of the first user is towards the display area. It can be seen that the vehicle-mounted terminal can determine whether the first user's sight direction is toward the display area according to the second angle value, and prepare for subsequent adjustment of the display mode of the first area in the display area.
  • the cosine of the second angle value is the first target point
  • P eye is the position of the second user's eye
  • the first target point is the center point of the display area; or the first target point is the vertex of the display area; or the first target point is the center point of the side of the display area, and the display area
  • the side of includes the left, right, upper or lower side of the display area.
  • the method before acquiring the image information, also includes: turning on the privacy information protection mode when the third condition is met; the third condition includes at least one of the following: detecting that there is a Users other than the second user; detecting users other than the default user in the vehicle; detecting a mode setting instruction; wherein the mode setting instruction is used to turn on the privacy information protection mode.
  • the third condition can be pre-agreed or standard defined, and is not limited here. It can be seen that when the third condition is met, the vehicle-mounted terminal turns on the privacy information protection mode, so that the vehicle-mounted terminal can adjust the display mode of the first area in the display area.
  • the preset user may be preset, or may be obtained by the vehicle-mounted terminal from the cloud, or may be determined by the user, which is not limited here.
  • the default user may include, for example, a second user, and may also include the second user's family, the second user's friends, etc.
  • a display device including a receiving unit and a processing unit.
  • the receiving unit is used to obtain image information.
  • the image information is used to determine the position and line of sight direction of the eyes of the first user of the vehicle.
  • the processing unit is used to determine the eye position and line of sight direction of the first user of the vehicle.
  • the first user's eye position and line of sight direction adjust the display mode of the first area in the display area; wherein the display area is the display area of the HUD, and the first area includes the private information of the second user of the vehicle.
  • the first user is located in the non-driving position of the vehicle, and the second user is located in the driving position of the vehicle.
  • the first user is located in the non-driving seat of the vehicle, including: the first user is located in the passenger seat of the vehicle; or the first user is located in the rear area of the vehicle.
  • the processing unit when adjusting the display mode of the first area in the display area according to the position and sight direction of the first user's eyes, is configured to: determine whether the position of the first user's eyes is in Within the viewing angle range of the display area; when the first condition is met, the display mode of the first area in the display area is adjusted to the first display mode; wherein the first condition includes at least one of the following: the first user's eyes The position is within the viewing angle range of the display area; the first user's line of sight is directed toward the display area; or the time the first user's line of sight stays in the display area is greater than or equal to the preset time.
  • the first display method includes at least one of the following: hiding the first area; hiding the second user's private information in the first area; diluting the first area; changing the first clarity of the first area. Switch to the second definition and display the second user's private information in the second definition, and the first definition is higher than the second definition; or switch the first resolution of the first area to the second resolution, and Display the second user's private information at a second resolution, where the first resolution is higher than the second resolution.
  • the processing unit is also configured to adjust the display mode of the first area in the display area from the first display mode to the second display mode when the second condition is met; wherein the second condition includes At least one of the following: the position of the first user's eyes exceeds the viewing angle range of the display area; the first user's line of sight is directed toward other areas outside the display area; the first user's line of sight stays in the display area for less than the preset time time.
  • the second display method includes at least one of the following: displaying the second user's private information in the first area; switching the second definition of the first area to the first definition, and displaying the second user's private information in the first area. Display the second user's private information with a first definition that is higher than the second definition; or switch the second resolution of the first area to the first resolution, and display the second user's private information with the first resolution. For private information, the first resolution is higher than the second resolution.
  • the image information is also used to determine the position of the second user's eyes.
  • the processing unit is used to : Determine the size of the angle formed by the line between the position of the second user's eyes and the first target point on the display area, and the line between the position of the first user's eyes and the first target point, to obtain A first angle value; according to the first angle value, determine whether the position of the first user's eyes is within the viewing angle range of the display area.
  • the cosine value of the first angle value is the first target point
  • P eye is the position of the first user's eye
  • P′ eye is the position of the second user's eye.
  • the processing unit is further configured to: determine the angle formed by the connection line between the position of the first user's eyes and the first target point on the display area, and the direction of the first user's line of sight. size to obtain the second angle value; determine whether the first user's sight direction is toward the display area according to the second angle value.
  • the cosine of the second angle value is the first target point
  • P eye is the position of the second user's eye
  • the first target point is the center point of the display area; or, the first target point is the vertex of the display area; or, the first target point is the center point of the side of the display area, and the display area
  • the side of includes the left, right, upper or lower side of the display area.
  • the processing unit is also configured to turn on the privacy information protection mode when the third condition is met;
  • the third condition includes at least one of the following: detecting that there is a person other than the second user in the vehicle where the second user is located. other users; detecting that there are other users in the vehicle other than the default user; detecting a mode setting instruction; wherein the mode setting instruction is used to turn on the privacy information protection mode.
  • a third aspect provides an electronic device, the device is deployed in a vehicle, and the device includes a unit for performing any method in the first aspect.
  • the electronic device may be, for example, a display device, or may be a processing device that controls the display device, such as a vehicle-mounted terminal.
  • the electronic device may be, for example, a chip system in a display device or a chip system in a processing device.
  • the chip system may include at least one processor, memory and an interface circuit.
  • the interface circuit is used to provide information input/output for at least one processor.
  • a computer program is stored in the memory. When the computer program is run on one or more processors, The method of any one of the first aspects is implemented at runtime.
  • a fourth aspect provides an electronic device.
  • the device includes at least one processor and a communication interface.
  • the at least one processor is configured to call a computer program stored in at least one memory to execute any method as in the first aspect.
  • a fifth aspect provides a display system, including a vehicle-mounted terminal, and the vehicle-mounted terminal is used to implement any of the methods in the first aspect.
  • a sixth aspect provides a vehicle-mounted terminal, which is used to implement any of the methods in the first aspect.
  • a computer-readable storage medium is provided.
  • a computer program is stored in the computer-readable storage medium.
  • the computer program is run on one or more processors, the method of any one of the first aspects is implemented.
  • a computer program product is provided.
  • the computer program product When the computer program product is run on one or more processors, it implements any of the methods in the first aspect.
  • Figure 1 is a schematic diagram of a projection display of information on a windshield through a HUD provided by an embodiment of the present application;
  • Figure 2 is a schematic diagram of a HUD installation position provided by an embodiment of the present application.
  • Figure 3 is a schematic diagram of the imaging effect of an AR-HUD provided by an embodiment of the present application.
  • Figure 4 is a schematic diagram of a display system provided by an embodiment of the present application.
  • Figure 5 is a schematic diagram of the principle of a vehicle-mounted terminal controlling an AR-HUD display image provided by an embodiment of the present application
  • Figure 6 is a schematic flowchart of a display method provided by an embodiment of the present application.
  • Figure 7 is a schematic diagram of an interior area division provided by an embodiment of the present application.
  • Figure 8 is a maximum angle value of the picture of the display area that can be seen by the first user according to the embodiment of the present application.
  • Figure 9 is a minimum angle value of the picture of the display area that the first user can see provided by an embodiment of the present application.
  • Figure 10 is a first angle value provided by the embodiment of the present application.
  • Figure 11 is a second angle value provided by the embodiment of the present application.
  • Figure 12 is a schematic structural diagram of a display device 120 provided by an embodiment of the present application.
  • Figure 13 is a schematic structural diagram of a vehicle 130 provided by an embodiment of the present application.
  • FIG. 14 is a schematic structural diagram of an electronic device 140 provided by an embodiment of the present application.
  • HUD also known as head-up display
  • HUD can include components such as a projector, a reflector (also called a secondary reflector), and a projection mirror (also called a primary reflector).
  • the imaging principle of HUD is similar to slide projection, by projecting the image onto On the car windshield, the driver can obtain the image in front of the field of view.
  • the light information can generally be emitted through the projector, reflected to the projection mirror through the reflector, and then reflected to the windshield by the projection mirror.
  • the human eye can see What you see is a virtual image located about 2-2.5 meters in front of you, giving the impression that information is suspended on the road ahead.
  • the position of the image projected on the windshield is adjustable. Generally, the position of the image can be adjusted by changing the angle of the projection mirror.
  • the position of the image can be adjusted by changing the angle of the projection mirror.
  • HUD uses the principle of optical reflection to project speed warning, vehicle condition monitoring, fuel consumption, speed and other information on the windshield, allowing the driver to focus on the road ahead and achieving active driving safety. At the same time, it can also reduce the delay and discomfort caused by the constant adjustment of the eye focus.
  • FIG. 1 is a schematic diagram of displaying information through projection of a HUD on a windshield according to an embodiment of the present application.
  • the vehicle speed and distance to the vehicle in front can be displayed through the projection of the HUD on the windshield.
  • the HUD may be, for example, one or more of AR-HUD, C-HUD, W-HUD, etc.
  • HUD can include front-mounted and rear-mounted methods; from the perspective of installation location, HUD can be divided into hanging HUD and instrument table HUD.
  • Figure 2 shows an embodiment of the present application.
  • a schematic diagram of the HUD installation location is provided. 2-1 in Figure 2 is a hanging HUD, and 2-2 in Figure 2 is a dashboard HUD.
  • AR-HUD can integrate the images projected by HUD with real road information, enhance the driver's acquisition of road information, and realize AR navigation, AR warning and other functions. For example, it can realize following distance warning, line crossing warning, traffic light monitoring, advance warning, etc.
  • One or more functions such as lane change indication, pedestrian warning, road sign display, lane departure indication, forward obstacle warning, driver status monitoring, etc.
  • the display carrier of the AR-HUD may be a virtual screen, for example.
  • the virtual screen can be divided into a near screen and a far screen.
  • the near screen can be located, for example, 2.5 meters in front of the driver's field of view
  • the far screen can be located, for example, 7 to 15 meters in front of the driver's field of view.
  • FIG. 3 is a schematic diagram of the imaging effect of an AR-HUD provided by an embodiment of the present application.
  • the virtual image surface projected by AR-HUD onto the car windshield can be located directly in front of the driver's field of vision.
  • a 2.5-meter near screen located in the driver's front field of view a 15-meter far screen located in the driver's front field of view, etc.
  • Information such as driving speed and car battery capacity can be displayed on both the near and far screens.
  • Information such as AR navigation guidance arrows can also be displayed on the far screen to assist the driver in achieving more intelligent, comfortable and safer driving.
  • C-HUD is mostly used in the aftermarket.
  • a translucent resin plate can be installed on the top of the cockpit in a suspended manner or above the instrument panel.
  • the translucent resin plate can be used as a projection medium to reflect a virtual image.
  • the resin board usually undergoes special processing according to imaging conditions, such as making it into a wedge shape to avoid reflection ghosts and improve the display effect.
  • W-HUD can use the front windshield as the imaging medium for reflective imaging, which can support a larger imaging area and longer projection distance.
  • the windshield is usually a curved reflector, and W-HUD needs to adapt to the high-precision curved reflector according to the size and curvature of the windshield, resulting in a relatively high cost.
  • W-HUD is mostly used in the front-mounted market, and there are currently multiple technical routes: magnified imaging based on curved mirrors, magnified imaging based on holographic optical elements (HOE), and amplified imaging based on holographic optical waveguides (waveguide).
  • HOE and waveguide technologies are not yet mature, and the main applications are amplified imaging technologies based on curved mirrors.
  • Figure 4 is a schematic diagram of a display system provided by an embodiment of the present application.
  • the display system may include a display device.
  • the display device is used to display various types of information, such as the driver's private information.
  • the private information may include one or more forms of information such as text, pictures, videos, etc. It should be understood that private information is information that can be displayed through the display device after the user authorizes it.
  • the display device can also be used to display speed warning, vehicle condition monitoring, fuel consumption, speed and other information.
  • the display device can be installed above the center console of the vehicle cabin or inside the center console.
  • the display device may be, for example, a HUD or a device with a projection imaging function, and is not specifically limited.
  • the display system may also include a vehicle-mounted terminal.
  • a vehicle-mounted terminal is an electronic device with data processing capabilities and/or data sending and receiving capabilities.
  • the vehicle-mounted terminal can control the display device to display various types of information, such as the display of the driver's private information.
  • the vehicle-mounted terminal may be a display device with a processing function, or may be a processing device that controls the display device to display various types of information.
  • the vehicle-mounted terminal can also be used to perform one or more types of management on the vehicle, such as driving safety management, operation management, service quality management, intelligent centralized dispatch management, and electronic stop sign control management.
  • the vehicle-mounted terminal can be deployed on the vehicle.
  • the vehicle may be a car, a truck, a bus, a ship, an airplane, a helicopter, a tram, a golf cart, etc., and the embodiments of this application are not particularly limited.
  • the display system may also include an image acquisition device.
  • the image acquisition device can acquire one or more images of the vehicle's surrounding environment.
  • the image collection device can detect and collect one or more of the face, head, part of the torso (for example, arms) of the user in the car, and can also detect the human eye position and line of sight of the user in the car. Detect and collect one or more of the directions.
  • the image acquisition device may be, for example, one or more of a vehicle-mounted camera, a human eye detector, a sensor, etc.
  • the vehicle-mounted camera can be, for example, one or more of a driver monitoring system (driver monitoring system, DMS) camera, a vehicle camera-monitor system (CMS) camera, and the like.
  • driver monitoring system driver monitoring system
  • DMS vehicle camera-monitor system
  • the image acquisition device can be installed on the vehicle as required, for example, it can be installed in the area near the steering wheel or center console.
  • the image acquisition device may be one or multiple, and the location and
  • the communication link between the vehicle-mounted terminal and the display device, image acquisition device, etc. can be various types of media. Specifically, it can be a wired link, a wireless link, or a combination of wired link and wireless link. Combinations and more.
  • the wired link is, for example, an Ethernet-based bus, or one or more of the CAN bus, LIN bus, MOST bus, FlexRay, etc.
  • Wireless links are, for example, short-range connection technologies, including 802.11b/g, blue tooth, zigbee, vehicle-mounted short-range wireless communication technologies, etc., and long-range connection technologies, including the Global System for Mobile Communications.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • UMTS universal mobile telecommunications system
  • LTE long term evolution
  • 5G or 5G technology fifth generation mobile communication technology
  • the vehicle terminal control display device to display various types of information.
  • the following takes the display device as AR-HUD and the image collection device DMS camera as an example to explain the principle of the vehicle terminal controlling the AR-HUD to display images.
  • FIG. 5 is a schematic diagram of the principle of a vehicle-mounted terminal controlling an AR-HUD to display images according to an embodiment of the present application.
  • the vehicle-mounted terminal can obtain image information through the DMS camera.
  • the image information can include, for example, the user's eyes, such as the driver's eyes.
  • the user's eye position can be determined, and the eye position filtering can be performed to obtain the filtered Eye position.
  • the vehicle-mounted terminal can also generate graphics.
  • the vehicle-mounted terminal obtains the current location of the vehicle, the vehicle's driving route, the vehicle's speed, the road conditions ahead and other information from the advanced driving assist system (ADAS) interface to achieve graphics generation.
  • ADAS advanced driving assist system
  • the vehicle-mounted terminal obtains high-precision navigation information, such as instructions to go straight onto XX road, instructions to turn left onto XX road, instructions to turn right into XX road, instructions to make a U-turn, etc., to achieve graphics generation; the vehicle-mounted terminal obtains some car service information, such as video viewing Service information, music playback service information, etc., to achieve graphics generation; the vehicle-mounted terminal obtains POI information from the point of interest (POI) interface to achieve graphics generation; the vehicle-mounted terminal obtains fuel consumption, speed and other information from the instrument interface to achieve Graphic generation.
  • POI refers to a location identifier in a geographical area.
  • the location identifier is used to indicate the government departments, commercial institutions (gas stations, department stores, supermarkets, restaurants, hotels, convenience stores, hospitals, etc.), tourist attractions ( Parks, public toilets, etc.), historical sites, transportation facilities (various stations, parking lots, speed cameras, speed limit signs) and other places.
  • POI information may include one or more of name, type, location information, etc.
  • the location information may include, for example, one or more of longitude, latitude, altitude, etc., and the type may be catering, accommodation, etc. It should be understood that after the vehicle-mounted terminal obtains the generated graphics, it can sequentially perform coordinate transformation and perspective translation on the graphics, and perform perspective transformation on the graphics after the perspective translation based on the filtered eye position to obtain a perspective-transformed graphics.
  • the vehicle-mounted terminal can perform image rendering based on the perspective-transformed graphics and the graphics generated by the vehicle-mounted terminal to obtain image-rendered graphics. Then, the vehicle-mounted terminal sequentially performs anti-shake processing and optical distortion correction on the image-rendered graphics to transmit the corrected graphics to the AR-HUD, so that the AR-HUD can sequentially perform photosensitivity adjustment and scanning distortion correction on the corrected graphics. Then, the graphics display is realized through micro-electro-mechanical system (MEMS) driver and laser (laser diode, LD) driver.
  • MEMS micro-electro-mechanical system
  • LD laser diode
  • image distortion is due to the fact that the large field of view and short focal length optical system does not satisfy the pinhole model.
  • the focal height of the chief ray of different fields of view after passing through the optical system and the Gaussian image plane is not equal to the ideal image height, causing the actual image point to deviate from the ideal.
  • Image points so that the content in the image appears to be stretched, distorted and other geometric deformation distortions.
  • a wide-angle camera can obtain images with a larger field of view, but it can also easily introduce significant image distortion.
  • portraits located outside the image that is, with a larger field of view
  • image distortion can also be called optical distortion, lens distortion, camera distortion, camera distortion or lens distortion, etc.
  • image distortion correction can be performed using an image distortion correction algorithm.
  • the image distortion correction algorithm can be the Zhang Zhengyou camera calibration algorithm.
  • FIG. 6 is a schematic flowchart of a display method provided by an embodiment of the present application. It should be understood that the embodiment described in FIG. 6 can be applied to a display device or a processing device that controls a display device, such as a vehicle-mounted terminal. The following takes a vehicle-mounted terminal as an example, as shown in Figure 6. The method includes but is not limited to the following steps:
  • the vehicle-mounted terminal obtains image information, and the image information is used to determine the eye position and line of sight direction of the first user of the vehicle.
  • step 601 can be implemented in any of the following ways.
  • the specific way may depend on the implementation of the vehicle-mounted terminal, prior agreement, or standard definition.
  • Method 1.1 The vehicle-mounted terminal uses one or more of image quality enhancement processing and image distortion correction processing to process the source image to obtain image information.
  • image quality enhancement refers to processing one or more of the brightness, color, contrast, saturation, dynamic range, etc. of the image. It can also be called image enhancement, which is equivalent to improving the quality of the image to make the image clearer.
  • the source image may be an image acquired by the vehicle-mounted terminal through an image acquisition device, or may be an image acquired by the vehicle-mounted terminal from a database that stores images. It should be understood that in this application, the specific acquisition method of the source image is not limited.
  • Method 1.2 The vehicle-mounted terminal obtains image information through the image acquisition device.
  • the image acquisition device can use one or more of image quality enhancement processing and image distortion correction processing to process the source image collected by the image acquisition device to obtain image information, and then send the image information to the vehicle-mounted terminal.
  • the image information may be, for example, a key point matrix, a key point set, etc. That is, the key points of the face are marked in the image information.
  • the face key points are points used to locate the key areas of the face in the face image.
  • the key areas include one or more of the eyebrows, eyes, nose, mouth, facial contour, etc.
  • at least the position of the user's eyes is marked in the image information.
  • the position of the user's eyes can be, for example, the middle point of the two eye centers, the center of the left eye, the center of the right eye, etc.
  • the eye center may be the center of the pupil of the eye, the center of the eyeball, the center of the cornea, or other locations of the eye.
  • determining the position of the user's eyes through image information can be, for example, the following two implementations:
  • the position of the user's eyes may be determined by the vehicle-mounted terminal based on image information and a pre-built 3D face model, or may be obtained in other ways, which is not limited here.
  • the 3D face model can be obtained from the cloud by the vehicle-mounted terminal.
  • the position of the user's eyes can be obtained by the vehicle-mounted terminal from the cloud.
  • the vehicle-mounted terminal sends image information to the cloud, so that the cloud determines the user's eye position based on the image information and a pre-built 3D face model.
  • the position of the eyes is then sent to the vehicle terminal.
  • the position of the eyes of the first user of the vehicle can be marked in the image information, and the position of the eyes of the second user of the vehicle can also be marked.
  • the first user may be a non-driver, for example, and the second user may be a driver, for example. It should be understood that the first user and the second user have different locations within the vehicle.
  • the first user is located in a non-driving position of the vehicle, and the second user is located in a driving position of the vehicle.
  • the first user may be located in the passenger seat of the vehicle.
  • the first user may be in the rear area of the vehicle.
  • the first user can be in the second row left or the second row right of the vehicle. If the area in the car is divided into the driver's seat, the passenger seat, the second row left, the second row middle, and the second row right, the first user can be in the second row left, second row middle, or second row right of the vehicle.
  • the rear area of the vehicle is relative to the front area of the vehicle.
  • Figure 7 is a schematic diagram of an interior area division provided by an embodiment of the present application.
  • the front row area 71 of the vehicle may include a driver's seat 711 and a passenger's seat 712
  • the rear row area 72 of the vehicle may include a second row 721, a second row 722, and a second row 723.
  • the vehicle-mounted terminal can determine whether there are users in various areas in the vehicle (such as the driver's seat, the passenger seat, and the rear area) through one or more of the following methods.
  • the vehicle-mounted terminal determines whether there are users in various areas in the vehicle (such as the driver's seat, the passenger seat, and the rear area) through one or more of the following methods.
  • the user can be called the second user.
  • the user can be called the first user. It should be understood that how the vehicle-mounted terminal determines whether there are users in each area of the vehicle depends on the implementation of the vehicle-mounted terminal, pre-agreement or standard definition.
  • the vehicle-mounted terminal can obtain image information of each area in the vehicle through an image collection device, and determine whether there is a user in each area through the image information in each area. For example, if the vehicle-mounted terminal detects a human face from the image information of each area collected by the DMS camera, it determines that there is a user in the area. For another example, if the vehicle-mounted terminal obtains the iris information of the human eye from the image information of each area collected by the DMS camera, it determines that there is a user in the area.
  • Method 2.2 The vehicle-mounted terminal can detect whether there are users in each area through the pressure sensor under the seat. For example, when the pressure value detected by the pressure sensor on the seat in a certain area is greater than or equal to the preset value, it can be determined that there is a user in the area.
  • the vehicle-mounted terminal can determine the location of the sound source through the audio information obtained by the microphone array, so as to determine in which areas there are users based on the location of the sound source. For example, if the sound source position is the passenger seat, then there is a user in the passenger seat.
  • determining the user's line of sight direction through image information can be, for example, the following two implementations:
  • the gaze direction may be extracted from the image information by the vehicle-mounted terminal based on an eye tracking/gaze tracking model.
  • the gaze tracking model can be a machine learning model that estimates the gaze direction or gaze point of human eyes through images containing human eyes or faces. For example, neural network model, etc.
  • the gaze direction may be obtained by the vehicle-mounted terminal from the cloud.
  • the vehicle-mounted terminal sends image information to the cloud, so that the cloud extracts the gaze direction from the image information based on the gaze tracking model and sends it to the vehicle-mounted terminal.
  • the method may also include: when the third condition is met, the vehicle-mounted terminal turns on the privacy information protection mode.
  • the vehicle-mounted terminal when the vehicle-mounted terminal turns on the private information protection mode, it can be understood that the vehicle-mounted terminal performs steps 601 to 602. It can be seen that when the third condition is met, the vehicle-mounted terminal turns on the privacy information protection mode.
  • the third condition may include at least one of the following: the vehicle-mounted terminal detects that other users other than the second user are present in the vehicle where the second user is located; the vehicle-mounted terminal detects that other users other than the preset user are present in the vehicle; the vehicle-mounted terminal detects the mode setting command, this mode setting command is used to turn on the privacy information protection mode. It should be understood that the third condition can be pre-agreed or standard defined, and is not limited here.
  • the vehicle-mounted terminal when the vehicle-mounted terminal detects that there are users other than the second user in the vehicle where the second user is located, it can do so in one or more of the following ways.
  • the specific method used depends on the implementation of the vehicle-mounted terminal, pre-agreement or standard definition.
  • the vehicle-mounted terminal can obtain image information of other areas in the car except the driving position through the image acquisition device, and determine the presence of other users in the car except the second user through the image information of other areas. For example, if the vehicle-mounted terminal detects a human face from the image information of other areas collected by the DMS camera, it determines that there are other users in the vehicle except the second user. For another example, if the vehicle-mounted terminal obtains the iris information of the human eye from the image information of other areas collected by the DMS camera, it determines that there are other users in the vehicle except the second user. If the iris information of a certain user does not match the iris information of the second user, it means that there are other users besides the second user in the vehicle.
  • the iris information of the second user may be the iris information determined by the vehicle-mounted terminal based on the image information acquired in real time by the image collection device, or the iris information determined by the vehicle-mounted terminal based on the pre-stored face image of the second user, or the vehicle-mounted terminal.
  • the iris information obtained from the cloud may also be iris information determined by the vehicle-mounted terminal based on the face image of the second user sent by the cloud.
  • the cloud can be, for example, an original equipment manufacturer (OEM) cloud, etc.
  • the OEM cloud can also be called a car cloud.
  • Method 3.2 The vehicle-mounted terminal can determine the presence of other users in the vehicle except the second user through the pressure sensor under the seat. For example, when the pressure value detected by the pressure sensor on the passenger seat is greater than or equal to the preset value, it may be determined that there are other users in the car except the second user.
  • Method 3.3 The vehicle-mounted terminal can determine the location of the sound source through the audio information obtained by the microphone array, so as to determine the presence of other users in the vehicle except the second user based on the location of the sound source. It should be understood that the sound source location in method 3.3 does not include the driving position.
  • the vehicle-mounted terminal can determine the voiceprint information through the audio information obtained by the microphone array, so as to determine the presence of other users in the car except the second user based on the voiceprint information. If the voiceprint information does not match the voiceprint information of the second user, it indicates that there is another user other than the second user in the car. It should be understood that the voiceprint information of the second user can be the voiceprint information determined by the vehicle-mounted terminal based on the audio information obtained in real time by the microphone array, or the voiceprint information determined by the vehicle-mounted terminal based on the pre-stored audio information, or the vehicle-mounted terminal.
  • the voiceprint information obtained by the terminal from the cloud may also be the voiceprint information determined by the vehicle-mounted terminal based on the audio information of the second user sent by the cloud.
  • the vehicle-mounted terminal when the vehicle-mounted terminal detects that there are users other than the preset users in the vehicle, it can do so in one or more of the following ways.
  • the specific method depends on the implementation of the vehicle-mounted terminal, prior agreement, or standard definition.
  • the vehicle-mounted terminal can obtain the image information of each area in the vehicle through the image acquisition device, and determine the presence of other users in the vehicle other than the preset user through the image information of each area.
  • the vehicle-mounted terminal can perform face recognition through the image information of each area collected by the DMS camera to determine the presence of other users in the vehicle besides the preset user.
  • the vehicle-mounted terminal can determine the iris information of the human eye through the image information of each area collected by the DMS camera, so as to determine the presence of other users in the car besides the preset user based on the iris information of the human eye.
  • the iris information of a certain user is different from the preset user.
  • the iris information of the preset user can be the iris information determined by the vehicle-mounted terminal based on the pre-stored facial image of the preset user, or the iris information obtained by the vehicle-mounted terminal from the cloud, or the iris information sent by the vehicle-mounted terminal based on the cloud.
  • the iris information is determined from the face image.
  • the vehicle-mounted terminal can determine the voiceprint information through the audio information obtained by the microphone array, so as to determine the presence of other users in the car other than the preset user based on the voiceprint information. If the voiceprint information does not match the voiceprint information of the preset user, it means that there are other users in the car other than the preset user. It should be understood that the preset user's voiceprint information may be voiceprint information determined by the vehicle-mounted terminal based on pre-stored audio information.
  • the preset user can be preset, or can be obtained by the vehicle terminal from the cloud, or can be determined by the user, which is not limited here.
  • the default user may include, for example, a second user, and may also include the second user's family, the second user's friends, etc.
  • the vehicle-mounted terminal can detect the mode setting instruction through one or more of the following methods.
  • the specific method depends on the implementation of the vehicle-mounted terminal, prior agreement, or standard definition.
  • Method 5.1 The vehicle-mounted terminal recognizes the mode setting instruction based on the audio information obtained by the microphone array.
  • Method 5.2 The vehicle-mounted terminal detects the mode setting command through the central control screen.
  • the central control screen is a screen installed in the car between the driver's seat and the passenger seat.
  • the mode setting instruction can be understood as a gesture instruction.
  • Gesture commands are actions triggered on the central control screen by objects such as fingers, stylus or pens.
  • the on-board terminal can recognize the gesture commands to determine the operation represented by the gesture command, and respond according to the operation represented by the gesture command.
  • Gesture instructions may include, for example, click, long press, slide, rotate, double-click, shrink, etc. Gesture instructions may be executed with one hand, or may be executed with both hands at the same time.
  • gesture commands include touch gesture commands and floating gesture commands.
  • Touch gesture commands refer to gesture commands executed by touching the central control screen
  • floating gesture commands refer to gesture commands performed above the central control screen. Empty execution of gesture commands.
  • the gesture instructions include single-touch gesture instructions and multi-touch gesture instructions.
  • a multi-touch gesture instruction refers to a gesture instruction in which multiple points (eg, multiple fingers) touch, for example, multiple fingers at the same time point.
  • the method may also include step 602.
  • the vehicle-mounted terminal adjusts the display mode of the first area in the display area according to the position and sight direction of the first user's eyes.
  • the first area includes the private information of the second user of the vehicle.
  • the display area is the display area of the display device, for example, the display area is the display area of the HUD.
  • the display area may be, for example, the near screen and/or the far screen in FIG. 3 .
  • the first area may be a part of the display area or the entire display area.
  • step 602 may include: the vehicle-mounted terminal determines whether the position of the first user's eyes is within the viewing angle range of the display area; when the first condition is met, the vehicle-mounted terminal adjusts the display mode of the first area in the display area to First display mode.
  • the first condition can be pre-agreed or standard defined, and is not limited here. It can be seen that when the first condition is met, the vehicle-mounted terminal adjusts the display mode of the first area in the display area to the first display mode.
  • the vehicle-mounted terminal adjusts the display mode of the first area in the display area to the first display mode, thereby reducing the possibility that the first user can view the second user's private information, thereby reducing the leakage of private information. risks and improve users’ sense of security.
  • the viewing angle range of the display area includes the angle range of the eyes of the screen of the display area that can be seen by the first user, and the boundary point can be determined by the maximum angle value and the minimum angle value of the eyes of the screen of the display area that can be seen by the first user.
  • the angle value is determined. That is to say, the viewing angle range of the display area may include the interval determined by the maximum angle value and the minimum angle value, and may also include boundary points, such as the maximum angle value and/or the minimum angle value, or may not include boundary points. Determined during the specific implementation process. It should be understood that the viewing angle range of the display area is related to the position of the first user's eyes.
  • FIG. 8 For example, taking the position of the first user's eyes as the middle point between the centers of the two eyes, see FIG. 8 to illustrate the maximum angle value of the screen of the display area that the first user can see.
  • the maximum angle value is the angle formed by the line connecting the second target point on the display area and the target point on the eyebox, and the line connecting the second target point and the position of the first user's eyes. size.
  • the second target point is the center point of the intersection of the plane where the first user's eyes are located and the display area
  • the target point on the eye box is the center point of the intersection of the plane where the first user's eyes are located and the eye box.
  • the eye box may, for example, refer to the range within which the driver's eyes can see the entire displayed image.
  • the general eye box size is 130mmx50mm. Due to different driver heights, the eye box needs to have a movement range of approximately ⁇ 50mm in the vertical direction. In this application, human eyes can see clear HUD or AR-HUD imaging within the scope of the eye box. It should be understood that the line connecting the second target point and the position of the first user's eyes also intersects at point A with the intersection line of the plane where the first user's eyes are located and the eye box.
  • the cosine of the maximum angle value is the second target point
  • P eye is the position of the first user's eye
  • P box is the target point on the eye box.
  • the minimum angle value of the area's image is the angle formed by a line connecting the position of the second user's eyes and the first target point, and a line connecting the first target point and the position of the second user's ear.
  • the first target point is the center point of the display area; or, the first target point is the vertex of the display area; or, the first target point is the center point of the side of the display area, and the side of the display area includes the display area. The left, right, upper or lower side of the area.
  • the tangent value of the minimum angle value P hud is the first target point
  • P′ eye is the position of the second user's eyes
  • X is the width value of the second user's half face.
  • the first condition may include, for example, at least one of the following: the position of the first user's eyes is within the viewing angle range of the display area; the first user's line of sight is directed toward the display area; or the first user's line of sight stays within the display area.
  • the time of the zone is greater than or equal to the preset time.
  • the preset time can be preset, or it can be obtained by the vehicle-mounted terminal from the cloud, or it can be determined by the user, which is not limited here.
  • the first display method may include at least one of the following: hiding the first area; hiding the second user's private information in the first area; diluting the first area; switching the first clarity of the first area to second definition, and display the second user's private information in the second definition, and the first definition is higher than the second definition; or switch the first resolution of the first area to the second resolution, and display the second user's private information in the second definition.
  • the second resolution displays the second user's private information, and the first resolution is higher than the second resolution.
  • the vehicle-mounted terminal may switch the first definition of the first area to the second definition, and use the second definition to display the second user's private information because the first clarity is higher than the second clarity, and when the clarity of the first area is the second clarity, the first user cannot clearly view the private information, or even view it.
  • the vehicle-mounted terminal may switch the first resolution of the first area to the second resolution, and use the second resolution to The second user's private information is displayed because the first resolution is higher than the second resolution, and when the resolution of the first area is the second resolution, the user cannot clearly view the private information, or even view the privacy. information, so it can reduce the possibility that the first user can view the second user's private information, thereby reducing the risk of private information leakage and improving the user's sense of security.
  • the method may also include: when the second condition is met, the vehicle-mounted terminal adjusts the display mode of the first area in the display area from the first display mode to the second display mode.
  • the second condition can be pre-agreed or standard defined, and is not limited here. It can be seen that when the second condition is met, the vehicle-mounted terminal adjusts the display mode of the first area in the display area from the first display mode to the second display mode.
  • the vehicle-mounted terminal adjusts the display mode of the first area in the display area from the first display mode to the second display mode, so that the second user can view the second user's private information, so that Ensure the normal use and driving safety of the second user.
  • the second condition includes, for example, at least one of the following: the position of the first user's eyes exceeds the viewing angle range of the display area; the first user's line of sight is directed toward other areas outside the display area; the first user's line of sight stays within The time in the display area is less than the preset time.
  • the position of the first user's eyes exceeding the viewing angle range of the display area can be understood as: the position of the first user's eyes is not within the viewing angle range of the display area.
  • the first user's line of sight direction is directed toward other areas outside the display area, which can be understood as: the first user's line of sight direction is not toward the display area, for example, the first user's line of sight direction is toward the sunroof of the vehicle, etc.
  • the second display method includes, for example, at least one of the following: displaying the second user's private information in the first area; switching the second definition of the first area to the first definition, and displaying the second user's private information in the first area. Display the second user's private information with the first resolution being higher than the second resolution; or switch the second resolution of the first area to the first resolution and display the second user's private information with the first resolution, The first resolution is higher than the second resolution. It should be understood that when detecting that the first user cannot view the private information of the second user in the first area, the vehicle-mounted terminal may switch the second definition of the first area to the first definition, and display the second user's privacy information in the first area.
  • the second user's private information is displayed because the first definition is higher than the second definition, and when the definition of the first area is the first definition, the user can view the private information, so the second user can view the private information. this private information.
  • the vehicle-mounted terminal can switch the second resolution of the first area to the first resolution and display it in the first resolution.
  • the second user's private information because the first resolution is higher than the second resolution, and the user can view the private information when the resolution of the first area is the first resolution, so the second user can view the private information. Private information ensures the normal use and driving safety of the second user.
  • the image information is also used to determine the position of the second user's eyes.
  • the vehicle-mounted terminal determines whether the position of the first user's eyes is within the viewing angle range of the display area. This may include: the vehicle-mounted terminal determines the position of the second user's eyes. The angle between the line between the position and the first target point, and the angle between the position of the first user's eyes and the first target point, to obtain the first angle value; the vehicle-mounted terminal determines the angle value according to the first angle value , determine whether the position of the first user's eyes is within the viewing angle range of the display area. It can be seen that the vehicle-mounted terminal can determine whether the position of the first user's eyes is within the viewing angle range of the display area according to the first angle value, and prepare for subsequent adjustment of the display mode of the first area in the display area.
  • the first angle value is the angle formed by the line connecting the position of the second user's eyes and the first target point, and the line connecting the position of the first user's eyes and the first target point.
  • the cosine value of the first angle value P hud is the first target point
  • P eye is the position of the first user's eye
  • P′ eye is the position of the second user's eye.
  • the method may further include: the vehicle-mounted terminal determines a connection between the position of the first user's eyes and the first target point. , and the size of the angle formed by the line of sight direction of the first user to obtain the second angle value; the vehicle-mounted terminal determines whether the line of sight direction of the first user is toward the display area according to the second angle value. It can be seen that the vehicle-mounted terminal can determine whether the first user's sight direction is toward the display area according to the second angle value, and prepare for subsequent adjustment of the display mode of the first area in the display area.
  • the second angle value is the angle formed between the line connecting the position of the first user's eyes and the first target point and the line of sight of the first user.
  • the cosine value of the second angle value P hud is the first target point
  • P eye is the position of the second user's eye
  • the vehicle-mounted terminal can obtain image information to determine the position and line of sight of the first user's eyes based on the image information, and then adjust the display area according to the position and line of sight of the first user's eyes.
  • the display method of the first area reduces the possibility that the first user can view the second user's private information, reduces the risk of private information leakage, and improves the user's sense of security.
  • Embodiments of the present application also provide a device for implementing any of the above methods.
  • a display device is provided that includes a unit (or means) for implementing each step performed by a vehicle-mounted terminal in any of the above methods.
  • FIG. 12 is a schematic structural diagram of a display device 120 provided by an embodiment of the present application.
  • the display device 120 includes a processing unit 1201, a sending unit 1202, and a receiving unit 1203.
  • a processing unit 1201 for example, any implementation shown in FIG. 6 Example display method.
  • each unit in the above device is only a division of logical functions. In actual implementation, it can be fully or partially integrated into a physical entity, or it can also be physically separated.
  • the unit in the device can be implemented in the form of a processor calling software; for example, the device includes a processor, the processor is connected to a memory, instructions are stored in the memory, and the processor calls the instructions stored in the memory to implement any of the above methods.
  • the processor is, for example, a general-purpose processor, such as a central processing unit (CPU) or a microprocessor
  • the memory is a memory within the device or a memory outside the device.
  • the units in the device can be implemented in the form of hardware circuits, and some or all of the functions of the units can be implemented through the design of the hardware circuits, which can be understood as one or more processors; for example, in one implementation,
  • the hardware circuit is an application-specific integrated circuit (ASIC), which realizes the functions of some or all of the above units through the design of the logical relationships of the components in the circuit; for another example, in another implementation, the hardware circuit is It can be realized by programmable logic device (PLD), taking field programmable gate array (FPGA) as an example, which can include a large number of logic gate circuits, and the logic gate circuits are configured through configuration files. connection relationships, thereby realizing the functions of some or all of the above units. All units of the above device may be fully realized by the processor calling software, or may be fully realized by hardware circuits, or part of the units may be realized by the processor calling software, and the remaining part may be realized by hardware circuits.
  • PLD programmable logic device
  • FPGA field programmable gate
  • the processor is a circuit with signal processing capabilities.
  • the processor may be a circuit with the ability to read and run instructions, such as a central processing unit, a microprocessor, a graphics Processor (graphics processing unit, GPU) (can be understood as a microprocessor), or digital signal processor (digital signal processor, DSP), etc.; in another implementation, the processor can pass the logical relationship of the hardware circuit To achieve a certain function, the logical relationship of the hardware circuit is fixed or can be reconstructed, such as a hardware circuit implemented by a processor for ASIC or PLD, such as FPGA.
  • the process of the processor loading the configuration file and realizing the hardware circuit configuration can be understood as the process of the processor loading instructions to realize the functions of some or all of the above units.
  • it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), and a deep learning processing unit. (deep learning processing unit, DPU), etc.
  • NPU neural network processing unit
  • TPU tensor processing unit
  • DPU deep learning processing unit
  • each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA , or a combination of at least two of these processor forms.
  • processors or processing circuits
  • each unit in the above device may be integrated together in whole or in part, or may be implemented independently. In one implementation, these units are integrated together and implemented as a system-on-a-chip (SOC).
  • SOC may include at least one processor for implementing any of the above methods or implementing the functions of each unit of the device.
  • the at least one processor may be of different types, such as a CPU and an FPGA, a CPU and an artificial intelligence processor, CPU and GPU etc.
  • each unit corresponds to its own program code (or program instruction).
  • program codes corresponding to these units are run on the processor, the unit executes the corresponding process and implements the corresponding function. It should be noted that the implementation of each unit described below may correspond to the corresponding description with reference to the embodiment shown in FIG. 6 .
  • the display device 120 may be the vehicle-mounted terminal in the embodiment shown in FIG. 6 , or a module in the vehicle-mounted terminal, such as a chip or an integrated circuit.
  • the device includes a processing unit 1201 and a receiving unit 1203, where the descriptions of each unit are as follows:
  • the receiving unit 1203 is used to obtain image information, and the image information is used to determine the position and line of sight direction of the first user of the vehicle;
  • the processing unit 1201 is configured to adjust the display mode of the first area in the display area according to the position and line of sight direction of the first user's eyes;
  • the display area is a display area of the HUD, and the first area includes private information of the second user of the vehicle.
  • the first user is located in the non-driving position of the vehicle, and the second user is located in the driving position of the vehicle.
  • the first user is located in the non-driving seat of the vehicle, including: the first user is located in the passenger seat of the vehicle; or the first user is located in the rear area of the vehicle.
  • the processing unit 1201 when adjusting the display mode of the first area in the display area according to the position and sight direction of the first user's eyes, is configured to: determine whether the position of the first user's eyes is within an acceptable range of the display area. Within the viewing angle range; when the first condition is met, the display mode of the first area in the display area is adjusted to the first display mode; wherein the first condition includes at least one of the following: the position of the first user's eyes is in the display area within the viewing angle range; the first user's line of sight is directed toward the display area; or the first user's line of sight stays in the display area for a time greater than or equal to the preset time.
  • the first display method includes at least one of the following: hiding the first area; hiding the second user's private information in the first area; fading the first area; switching the first clarity of the first area to the second clarity degree, and display the second user's private information in a second definition, where the first definition is higher than the second definition; or switch the first resolution of the first area to a second resolution, and display the second user's private information in the second resolution.
  • the second user's private information is displayed, and the first resolution is higher than the second resolution.
  • the processing unit 1201 is also configured to adjust the display mode of the first area in the display area from the first display mode to the second display mode when the second condition is met; wherein the second condition includes at least one of the following: : The position of the first user's eyes exceeds the viewing angle range of the display area; the first user's sight direction is toward other areas outside the display area; the time the first user's sight stays in the display area is less than the preset time.
  • the second display method includes at least one of the following: displaying the second user's private information in the first area; switching the second definition of the first area to the first definition, and displaying the second definition in the first definition.
  • the second user's private information, the first resolution is higher than the second resolution; or switch the second resolution of the first area to the first resolution, and display the second user's private information in the first resolution, the first The resolution is higher than the second resolution.
  • the image information is also used to determine the position of the second user's eyes.
  • the processing unit 1201 is used to: determine the second user's eye position. The size of the included angle formed by the line connecting the position of the user's eyes and the first target point on the display area, and the line connecting the position of the first user's eyes and the first target point, to obtain the first angle value ; According to the first angle value, determine whether the position of the first user's eyes is within the viewing angle range of the display area.
  • the cosine of the first angle value is the first target point
  • P eye is the position of the first user's eye
  • P′ eye is the position of the second user's eye.
  • the processing unit 1201 is also configured to: determine the size of the angle formed by the connection between the position of the first user's eyes and the first target point on the display area and the first user's line of sight direction, to obtain A second angle value; determine whether the first user's sight direction is toward the display area according to the second angle value.
  • the cosine of the second angle value is the first target point
  • P eye is the position of the second user's eye
  • the first target point is the center point of the display area; or, the first target point is the vertex of the display area; or, the first target point is the center point of the side of the display area, and the side of the display area includes the display area.
  • the processing unit 1201 is also configured to turn on the privacy information protection mode when the third condition is met;
  • the third condition includes at least one of the following: detecting that other users other than the second user are present in the vehicle where the second user is located; A user other than the default user is detected in the vehicle; a mode setting instruction is detected; wherein the mode setting instruction is used to turn on the privacy information protection mode.
  • FIG. 13 is a schematic structural diagram of a vehicle 130 provided by an embodiment of the present application.
  • the vehicle 130 includes a vehicle-mounted terminal 1301, wherein:
  • a vehicle-mounted terminal in the vehicle is used to obtain image information, and the image information is used to determine the eye position and line of sight direction of the first user of the vehicle;
  • the vehicle-mounted terminal in the vehicle is also used to adjust the display mode of the first area in the display area according to the position and line of sight direction of the first user's eyes;
  • the display area is a display area of the HUD, and the first area includes private information of the second user of the vehicle.
  • the first user is located in the non-driving position of the vehicle, and the second user is located in the driving position of the vehicle.
  • the first user is located in the non-driving seat of the vehicle, including: the first user is located in the passenger seat of the vehicle; or the first user is located in the rear area of the vehicle.
  • the vehicle-mounted terminal in the vehicle is specifically used to: determine whether the first user's eye position is displayed Within the viewing angle range of the area; when the first condition is met, the display mode of the first area in the display area is adjusted to the first display mode.
  • the first condition includes at least one of the following: the position of the first user's eyes is within the viewing angle range of the display area; the first user's line of sight is directed toward the display area; or the first user's line of sight stays within the display area.
  • the time is greater than or equal to the preset time.
  • the first display method includes at least one of the following: hiding the first area; hiding the second user's private information in the first area; fading the first area; switching the first clarity of the first area to the second clarity degree, and display the second user's private information in a second definition, where the first definition is higher than the second definition; or switch the first resolution of the first area to a second resolution, and display the second user's private information in the second resolution.
  • the second user's private information is displayed, and the first resolution is higher than the second resolution.
  • the vehicle-mounted terminal in the vehicle is also used to: when the second condition is met, adjust the display mode of the first area in the display area from the first display mode to the second display mode; wherein the second condition includes the following At least one item: the position of the first user's eyes exceeds the viewing angle range of the display area; the first user's line of sight is directed toward other areas outside the display area; the first user's line of sight stays in the display area for less than the preset time .
  • the second display method includes at least one of the following: displaying the second user's private information in the first area; switching the second definition of the first area to the first definition, and displaying the second definition in the first definition.
  • the second user's private information, the first resolution is higher than the second resolution; or switch the second resolution of the first area to the first resolution, and display the second user's private information in the first resolution, the first The resolution is higher than the second resolution.
  • the image information is also used to determine the position of the second user's eyes.
  • the vehicle-mounted terminal in the vehicle is specifically used for: Determine the connection between the position of the second user's eyes and the first target point on the display area, and the size of the angle formed by the connection between the position of the first user's eyes and the first target point, to obtain the third An angle value; based on the first angle value, determine whether the position of the first user's eyes is within the viewing angle range of the display area.
  • the cosine of the first angle value is the first target point
  • P eye is the position of the first user's eye
  • P′ eye is the position of the second user's eye.
  • the vehicle-mounted terminal in the vehicle is also used to: determine the size of the angle formed by the connection between the position of the first user's eyes and the first target point on the display area and the direction of the first user's line of sight, To obtain the second angle value; according to the second angle value, determine whether the first user's sight direction is toward the display area.
  • the cosine of the second angle value is the first target point
  • P eye is the position of the second user's eye
  • the first target point is the center point of the display area; or, the first target point is the vertex of the display area; or, the first target point is the center point of the side of the display area, and the side of the display area includes the display area.
  • the vehicle-mounted terminal in the vehicle is also used to turn on the privacy information protection mode when the third condition is met;
  • the third condition includes at least one of the following: detecting that other than the second user exists in the vehicle where the second user is located. user; detecting that other users other than the preset user are present in the vehicle; detecting a mode setting instruction; wherein the mode setting instruction is used to turn on the privacy information protection mode.
  • Figure 14 is a schematic structural diagram of an electronic device 140 provided by an embodiment of the present application.
  • the device 140 may include at least one memory 1401 and at least one processor 1402.
  • bus 1403 can also be included.
  • a communication interface 1404 may also be included, wherein the memory 1401, the processor 1402 and the communication interface 1404 are connected through a bus 1403.
  • the memory 1401 is used to provide storage space, and data such as operating systems and computer programs can be stored in the storage space.
  • the memory 1401 may be a random access memory (RAM), a read-only memory (ROM), an erasable programmable read only memory (EPROM), or a portable read-only memory.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read only memory
  • portable read-only memory One or more combinations of memory (compact disc read-only memory, CD-ROM), etc.
  • the processor 1402 is a module that performs arithmetic operations and/or logical operations, and may specifically be a CPU, GPU, microprocessor unit (MPU), ASIC, FPGA, complex programmable logic device (CPLD), etc. One or a combination of multiple processing modules.
  • the communication interface 1404 is used to receive data sent from the outside and/or send data to the outside. It can be a wired link interface such as an Ethernet cable, or a wireless link (Wi-Fi, Bluetooth, general wireless transmission, etc.) interface. Optionally, the communication interface 1404 may also include a transmitter (such as a radio frequency transmitter, an antenna, etc.) or a receiver coupled to the interface.
  • a transmitter such as a radio frequency transmitter, an antenna, etc.
  • the processor 1402 in the device 140 is used to read the computer program stored in the memory 1401, and is used to execute the aforementioned display method, such as the display method described in any embodiment of Figure 6.
  • the electronic device 140 may be the vehicle-mounted terminal in the embodiment shown in FIG. 6 , or a module in the vehicle-mounted terminal, such as a chip or an integrated circuit.
  • the processor 1402 in the device 140 is used to read the computer program stored in the memory 1401 to perform the following operations:
  • the display area is a display area of the HUD, and the first area includes private information of the second user of the vehicle.
  • the first user is located in the non-driving position of the vehicle, and the second user is located in the driving position of the vehicle.
  • the first user is located in the non-driving seat of the vehicle, including: the first user is located in the passenger seat of the vehicle; or the first user is located in the rear area of the vehicle.
  • the processor 1402 when adjusting the display mode of the first area in the display area according to the position of the first user's eyes and the direction of sight, is specifically configured to perform the following operations: determine whether the position of the first user's eyes is displaying Within the viewing angle range of the area; when the first condition is met, the display mode of the first area in the display area is adjusted to the first display mode.
  • the first condition includes at least one of the following: the position of the first user's eyes is within the viewing angle range of the display area; the first user's line of sight is directed toward the display area; or the first user's line of sight stays within the display area.
  • the time is greater than or equal to the preset time.
  • the first display method includes at least one of the following: hiding the first area; hiding the second user's private information in the first area; fading the first area; switching the first clarity of the first area to the second clarity degree, and display the second user's private information in a second definition, where the first definition is higher than the second definition; or switch the first resolution of the first area to a second resolution, and display the second user's private information in the second resolution.
  • the second user's private information is displayed, and the first resolution is higher than the second resolution.
  • the processor 1402 is also configured to perform the following operations: when the second condition is met, adjust the display mode of the first area in the display area to the second display mode; wherein the second condition includes at least one of the following: The position of one user's eyes exceeds the viewing angle range of the display area; the first user's line of sight is directed toward other areas outside the display area; and the time for which the first user's line of sight stays in the display area is less than the preset time.
  • the second display method includes at least one of the following: displaying the second user's private information in the first area; switching the second definition of the first area to the first definition, and displaying the second definition in the first definition.
  • the second user's private information, the first resolution is higher than the second resolution; or switch the second resolution of the first area to the first resolution, and display the second user's private information in the first resolution, the first The resolution is higher than the second resolution.
  • the image information is also used to determine the position of the second user's eyes.
  • the processor 1402 is specifically configured to perform the following operations: Determine the connection between the position of the second user's eyes and the first target point on the display area, and the size of the angle formed by the connection between the position of the first user's eyes and the first target point, to obtain the third An angle value; based on the first angle value, determine whether the position of the first user's eyes is within the viewing angle range of the display area.
  • the cosine of the first angle value is the first target point
  • P eye is the position of the first user's eye
  • P′ eye is the position of the second user's eye.
  • the processor 1402 is also configured to perform the following operations: determine the size of the angle formed by the connection between the position of the first user's eyes and the first target point on the display area and the first user's line of sight direction, To obtain the second angle value; according to the second angle value, determine whether the first user's sight direction is toward the display area.
  • the cosine of the second angle value is the first target point
  • P eye is the position of the second user's eye
  • the first target point is the center point of the display area; or, the first target point is the vertex of the display area; or, the first target point is the center point of the side of the display area, and the side of the display area includes the display area.
  • the processor 1402 is also configured to perform the following operations: when the third condition is met, turn on the privacy information protection mode; the third condition includes at least one of the following: detecting that there are other than the second user's personal information in the vehicle where the second user is located. Other users; detecting that there are other users in the vehicle other than the default user; detecting a mode setting instruction; wherein the mode setting instruction is used to turn on the privacy information protection mode.
  • An embodiment of the present application provides an electronic device, which is deployed in a vehicle.
  • the device includes a unit for executing any method in the embodiment shown in FIG. 6 .
  • Embodiments of the present application provide an electronic device, which includes at least one processor and a communication interface.
  • the at least one processor is configured to call at least one computer program stored in a memory to execute any method in the embodiment shown in FIG. 6 .
  • Embodiments of the present application provide a display system, including a vehicle-mounted terminal.
  • the vehicle-mounted terminal is used to implement any one of the methods in the embodiments shown in FIG. 6 .
  • Embodiments of the present application provide a vehicle-mounted terminal, which is used to implement any one of the methods in the embodiments shown in FIG. 6 .
  • Embodiments of the present application provide a computer-readable storage medium.
  • a computer program is stored in the computer-readable storage medium.
  • the computer program is run on one or more processors, any one of the embodiments shown in Figure 6 is implemented. Methods.
  • Embodiments of the present application provide a computer program product.
  • the computer program product When the computer program product is run on one or more processors, it implements any of the methods in the embodiments shown in FIG. 6 .
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted over a computer-readable storage medium.
  • the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk (SSD)), etc.
  • Modules in the device embodiments of the present application can be merged, divided, and deleted according to actual needs.
  • system and “network” in the embodiments of this application can be used interchangeably.
  • “/” indicates that the related objects are in an "or” relationship.
  • A/B can represent A or B;
  • and/or in this application is only a way to describe related objects.
  • Association relationship means that there can be three relationships.
  • a and/or B can mean: A exists alone, A and B exist simultaneously, and B exists alone.
  • a and B can be singular or plural.
  • plural means two or more than two.
  • At least one of the following or similar expressions thereof refers to any combination of these items, including any combination of a single item (items) or a plurality of items (items).
  • at least one of a, b, or c can mean: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be one or more .
  • words such as “first” and “second” are used to distinguish identical or similar items with basically the same functions and effects. Those skilled in the art can understand that words such as “first” and “second” do not limit the number and execution order, and words such as "first” and “second” do not limit the number and execution order.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Instrument Panels (AREA)

Abstract

本申请提供了一种显示方法及装置，该方法包括：获取图像信息，图像信息包括第一用户的眼睛；根据图像信息，确定第一用户的眼睛的位置和视线方向；根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式。其中，显示区域为抬头显示器的显示区域或增强现实抬头显示器的显示区域，第一区域包括第二用户的隐私信息。实施本申请实施例，可以减少隐私信息泄露的风险，提高了用户的安全感。

Description

一种显示方法及装置 技术领域
本申请涉及人机交互领域，尤其涉及一种显示方法及装置。
背景技术
座舱内的人机交互功能逐步增多，显示装置的使用频率日益提高。目前座舱内的显示装置主要分为两类，第一类是车载显示屏；第二类是投影显示屏，例如抬头显示(head up display，HUD)装置。
近年来，随着HUD的快速发展，如增强现实抬头显示(augmented reality-head up display，AR-HUD)装置，通过HUD在挡风玻璃上的投影来显示车辆信息，大大保障了驾驶员的安全。
发明内容
本申请提供了一种显示方法及装置，可以减少隐私信息泄露的风险，提高了用户的安全感。
第一方面，提供一种显示方法，包括：获取图像信息，图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式。其中，显示区域为HUD的显示区域，第一区域包括车辆的第二用户的隐私信息。可以看出，车载终端可以获取用于确定车辆的第一用户的眼睛的位置和视线方向的图像信息，进而可以根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式，从而可以降低第一用户可以查看到第二用户的隐私信息的可能性，进而可以减少隐私信息泄露的风险，提高了用户的安全感。
在本申请中，图像信息可以是传感器直接获取到的图像，也可以是经过传感器处理后得到的信息，还可以是通过处理器对传感器获取到的图像处理后得到的信息。这里，图像信息例如可以是关键点矩阵、关键点集合等。即在图像信息中标注了人脸关键点。其中，人脸关键点为用于在人脸图像中定位出人脸面部的关键区域位置的点，关键区域包括眉毛、眼睛、鼻子、嘴巴、脸部轮廓等中一个或多个。应理解的，在本申请中，图像信息可以用于获取用户的人眼位置。示例性的，在图像信息中标注了第一用户的眼睛的位置，在图像信息中还标注了第二用户的眼睛的位置。第一用户例如可以是非驾驶员，第二用户例如可以是驾驶员。
可选的，用户的眼睛的位置例如可以为两眼中心的中间点、左眼中心、右眼中心等。这里，眼中心可以是眼睛的瞳孔中心、眼球中心、角膜中心或眼睛的其他位置。
应理解的，在本申请中，HUD可以例如是AR-HUD、组合型抬头显示(combiner-HUD，C-HUD)、风挡型抬头显示(windshield-HUD，W-HUD)等中的一个或多个。第一区域可以是显示区域的部分区域，也可以是显示区域的全部区域。
其中，隐私信息例如可以包括文字、图片、视频等中的一个或多个形式的信息。
可选的，结合第一方面，第一用户位于车辆的非驾驶位，第二用户位于车辆的驾驶位。
可选的，结合第一方面，第一用户位于车辆的非驾驶位，包括：第一用户位于车辆的副驾驶位；或，第一用户在车辆的后排区。具体的，若对车内区域划分为驾驶位、副驾驶位、 二排左和二排右，第一用户可以在车辆的二排左或二排右。若对车内区域分为驾驶位、副驾驶位、二排左、二排中和二排右，第一用户可以在车辆的二排左、二排中或二排右。
可选的，结合第一方面，根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式，包括：确定第一用户的眼睛的位置是否在显示区域的可视角度范围内；在满足第一条件时，将显示区域中第一区域的显示方式调整为第一显示方式。其中，第一条件包括以下至少一项：第一用户的眼睛的位置在显示区域的可视角度范围内；第一用户的视线方向朝向于显示区域；或第一用户的视线停留在显示区域的时间大于或等于预设时间。应理解的，第一条件可以预先的约定或者标准的定义，在此不做限定。可以看出，在满足第一条件时，车载终端将显示区域中第一区域的显示方式调整为第一显示方式，也就是说，在检测到第一用户可能会查看到第一区域中第二用户的隐私信息时，车载终端将显示区域中第一区域的显示方式调整为第一显示方式，从而可以降低第一用户可以查看到第二用户的隐私信息的可能性，进而可以减少隐私信息泄露的风险，提高了用户的安全感。
其中，显示区域的可视角度范围包括第一用户可以看到的显示区域的画面的眼睛的角度范围，边界点可以由第一用户可以看到的显示区域的画面的眼睛的最大角度值和最小角度值确定。也就是说，显示区域的可视角度范围可以包括由最大角度值和最小角度值所确定的区间，还可以包括边界点，如最大角度值和/或最小角度值，也可以不包括边界点，可以在具体实现过程中定义。
应理解的，显示区域的可视角度范围与第一用户的眼睛的位置有关。
可选的，预设时间可以是预先设定的，也可以车载终端从云端获取的，还可以是用户自行确定的，在此不做限定。
可选的，结合第一方面，第一显示方式包括以下至少一项：隐藏第一区域；隐藏第一区域中第二用户的隐私信息；淡化第一区域；将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。应理解的，当第一区域的清晰度为第一清晰度，或，第一区域的分辨率为第一分辨率时，用户可以清晰地查看到第一区域中的隐私信息；当第一区域的清晰度为第二清晰度，或，第一区域的分辨率为第二分辨率时，用户无法清晰地查看到该隐私信息，甚至无法查看到该隐私信息。
可选的，结合第一方面，该方法还包括：在满足第二条件时，将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式；其中，第二条件包括以下至少一项：第一用户的眼睛的位置超出显示区域的可视角度范围；第一用户的视线方向朝向显示区域之外的其他区域；第一用户的视线停留在显示区域的时间小于预设时间。应理解的，第二条件可以预先的约定或者标准的定义，在此不做限定。可以看出，在满足第二条件时，车载终端将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式，也就是说，在检测到第一用户无法查看到第一区域中第二用户的隐私信息时，车载终端将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式，使得第二用户可以查看到第二用户的隐私信息。
可选的，结合第一方面，第二显示方式包括以下至少一项：在第一区域显示第二用户的隐私信息；将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，结合第一方面，图像信息还用于确定第二用户的眼睛的位置，确定第一用户的 眼睛的位置，是否在显示区域的可视角度范围内，包括：确定第二用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小，以得到第一角度值；根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内。可以看出，车载终端可以根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内，为后续调整显示区域中第一区域的显示方式做准备。
可选的，结合第一方面，第一角度值的余弦值
Figure PCTCN2022112309-appb-000001
其中，P hud为第一目标点，P eye为第一用户的眼睛的位置，P′ eye为第二用户的眼睛的位置。
可选的，结合第一方面，将显示区域中第一区域的显示方式调整为第一显示方式之前，该方法还包括：确定第一用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的视线方向形成的夹角大小，以得到第二角度值；根据第二角度值，确定第一用户的视线方向是否朝向于显示区域。可以看出，车载终端可以根据第二角度值，确定第一用户的视线方向是否朝向于显示区域，为后续调整显示区域中第一区域的显示方式做准备。
可选的，结合第一方面，第二角度值的余弦值
Figure PCTCN2022112309-appb-000002
其中，P hud为第一目标点，P eye为第二用户的眼睛的位置，
Figure PCTCN2022112309-appb-000003
为第一用户的视线方向的单位向量。
可选的，结合第一方面，第一目标点为显示区域的中心点；或，第一目标点为显示区域的顶点；或，第一目标点为显示区域的侧边的中心点，显示区域的侧边包括显示区域的左侧、右侧、上侧或下侧。
可选的，结合第一方面，获取图像信息之前，该方法还包括：在满足第三条件时，开启隐私信息保护模式；第三条件包括以下至少一项：检测到第二用户所在车辆内存在除第二用户的其他用户；检测到车辆内存在除预设用户的其他用户；检测到模式设置指令；其中，模式设置指令用于开启隐私信息保护模式。应理解的，第三条件可以预先的约定或者标准的定义，在此不做限定。可以看出，在满足第三条件时，车载终端开启隐私信息保护模式，使得车载终端可以调整显示区域中第一区域的显示方式。
其中，预设用户可以是预先设定的，也可以车载终端从云端获取的，还可以是用户自行确定的，在此不做限定。在一可能的实施方式中，预设用户例如可以包括第二用户，还可以包括第二用户的家人、第二用户的朋友等。
第二方面，提供一种显示装置，包括接收单元和处理单元，接收单元，用于获取图像信息，图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；处理单元，用于根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式；其中，显示区域为HUD的显示区域，第一区域包括车辆的第二用户的隐私信息。
可选的，结合第二方面，第一用户位于车辆的非驾驶位，第二用户位于车辆的驾驶位。
可选的，结合第二方面，第一用户位于车辆的非驾驶位，包括：第一用户位于车辆的副驾驶位；或，第一用户在车辆的后排区域。
可选的，结合第二方面，在根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式时，处理单元，用于：确定第一用户的眼睛的位置是否在显示区域的可视角度范围内；在满足第一条件时，将显示区域中第一区域的显示方式调整为第一显示方式；其中，第一条件包括以下至少一项：第一用户的眼睛的位置在显示区域的可视角度范围内；第一用户的视线方向朝向于显示区域；或第一用户的视线停留在显示区域的时间大于或等于预设时间。
可选的，结合第二方面，第一显示方式包括以下至少一项：隐藏第一区域；隐藏第一区 域中第二用户的隐私信息；淡化第一区域；将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，结合第二方面，处理单元，还用于在满足第二条件时，将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式；其中，第二条件包括以下至少一项：第一用户的眼睛的位置超出显示区域的可视角度范围；第一用户的视线方向朝向显示区域之外的其他区域；第一用户的视线停留在显示区域的时间小于预设时间。
可选的，结合第二方面，第二显示方式包括以下至少一项：在第一区域显示第二用户的隐私信息；将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，结合第二方面，图像信息还用于确定第二用户的眼睛的位置，在确定第一用户的眼睛的位置，是否在显示区域的可视角度范围内时，处理单元，用于：确定第二用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小，以得到第一角度值；根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内。
可选的，结合第二方面，第一角度值的余弦值
Figure PCTCN2022112309-appb-000004
其中，P hud为第一目标点，P eye为第一用户的眼睛的位置，P′ eye为第二用户的眼睛的位置。
可选的，结合第二方面，处理单元，还用于：确定第一用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的视线方向形成的夹角大小，以得到第二角度值；根据第二角度值，确定第一用户的视线方向是否朝向于显示区域。
可选的，结合第二方面，第二角度值的余弦值
Figure PCTCN2022112309-appb-000005
其中，P hud为第一目标点，P eye为第二用户的眼睛的位置，
Figure PCTCN2022112309-appb-000006
为第一用户的视线方向的单位向量。
可选的，结合第二方面，第一目标点为显示区域的中心点；或，第一目标点为显示区域的顶点；或，第一目标点为显示区域的侧边的中心点，显示区域的侧边包括显示区域的左侧、右侧、上侧或下侧。
可选的，结合第二方面，处理单元，还用于在满足第三条件时，开启隐私信息保护模式；第三条件包括以下至少一项：检测到第二用户所在车辆内存在除第二用户的其他用户；检测到车辆内存在除预设用户的其他用户；检测到模式设置指令；其中，模式设置指令用于开启隐私信息保护模式。
第三方面，提供一种电子装置，装置部署在车辆中，该装置包括用于执行如第一方面中任一方法的单元。
在一可能的实施方式中，电子装置例如可以是显示设备，也可以是控制显示设备的处理装置，如车载终端。在另一可能的实施方式中，电子装置例如可以是显示设备中的芯片系统，也可以是处理装置中的芯片系统。其中，该芯片系统可以包括至少一个处理器，存储器和接口电路，接口电路用于为至少一个处理器提供信息输入/输出，存储器中存储有计算机程序，当计算机程序在一个或多个处理器上运行时实现如第一方面中任一项的方法。
第四方面，提供一种电子装置，该装置包括至少一个处理器和通信接口，至少一个处理器用于调用至少一个存储器中存储的计算机程序，以执行如第一方面中任一方法。
第五方面，提供一种显示系统，包括车载终端，车载终端用于实现如第一方面中任一项的方法。
第六方面，提供一种车载终端，车载终端用于实现如第一方面中任一项的方法。
第七方面，提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机程序，当计算机程序在一个或多个处理器上运行时，实现如第一方面中任一项的方法。
第八方面，提供一种计算机程序产品，计算机程序产品在一个或多个处理器上运行时，实现如第一方面中任一项的方法。
附图说明
下面将对实施例描述中所需要使用的附图作简单地介绍。
图1为本申请实施例提供的一种通过HUD在挡风玻璃上的投影显示信息的示意图；
图2为本申请实施例提供的一种HUD安装位置的示意图；
图3为本申请实施例提供的一种AR-HUD的成像效果示意图；
图4为本申请实施例提供的一种显示系统的示意图；
图5为本申请实施例提供的一种车载终端控制AR-HUD显示图像原理的示意图；
图6为本申请实施例提供的一种显示方法的流程示意图；
图7为本申请实施例提供的一种车内区域划分示意图；
图8为本申请实施例提供的一种第一用户可以看到的显示区域的画面的最大角度值；
图9为本申请实施例提供的一种第一用户可以看到的显示区域的画面的最小角度值；
图10为本申请实施例提供的一种第一角度值；
图11为本申请实施例提供的一种第二角度值；
图12是本申请实施例提供的一种显示装置120的结构示意图；
图13是本申请实施例提供的一种车辆130的结构示意图；
图14是本申请实施例提供的一种电子装置140的结构示意图。
具体实施方式
为了便于理解，先对本申请实施例涉及到的HUD进行简要说明。
HUD又可以称为平视显示器，是一种将图像投射到驾驶员前方视野中的显示装置。一般来说，HUD可以包括投影仪、反射镜(又可以称为次反射镜)和投影镜(又可以称为主反射镜等组件。HUD的成像原理类似于幻灯片投影，通过将图像投射到汽车挡风玻璃上，使得驾驶员可以获取视野前方的图像。具体地，一般可以先通过投影仪发出光信息，经过反射镜反射到投影镜上，再由投影镜反射到挡风玻璃，人眼看到的是位于眼前大约2-2.5米处的虚像，给人的感觉就是信息悬浮在前方路上。
需要说明的是，图像投射在挡风玻璃上位置是可调的，通常情况下可以通过改变投影镜的角度调节图像的位置。此外，可以理解的是，由于汽车的挡风玻璃是弯曲的，图像若是直接投射在弯曲的玻璃面上，会造成图像变形。这就需要一个纠正措施，因此，投影镜和反射镜往往会被设计成弯曲的。
如上所述，HUD利用光学反射原理，可以在挡风玻璃上投射显示超速预警、车况监控、油耗、时速等信息，能够让驾驶员的注意力集中在前方路面，实现主动的行车安全。同时还可以降低眼睛焦距需要不断调整产生的延迟与不适。
示例性的，参见图1，图1为本申请实施例提供的一种通过HUD在挡风玻璃上的投影显示信息的示意图。如图1所示，通过HUD在挡风玻璃上的投影可以显示车辆时速和与前方车辆的距离等。
应理解的，在本申请中，HUD可以例如是AR-HUD、C-HUD、W-HUD等中的一个或多个。另外，从安装方式上来看，HUD可以包括前装和后装方式；从安装位置上来看，HUD可以分为悬挂式HUD和仪表台式HUD，例如，可以参见图2，图2为本申请实施例提供的一种HUD安装位置的示意图。在图2的2-1为悬挂式HUD，在图2的2-2为仪表台式HUD。
AR-HUD可以将HUD投射的图像与真实路面信息融合起来，增强驾驶员对路面信息的获取，实现AR导航、AR预警等功能，例如可以实现跟车距离预警、压线预警、红绿灯监测、提前变道指示、行人预警、路标显示、车道偏离指示、前方障碍物预警、驾驶员状态监测等一个或多个功能。应理解的，AR-HUD的显示载体例如可以为虚拟屏幕。在本申请中，该虚拟屏幕可以分为近屏和远屏，近屏例如可以位于驾驶员前方视野的2.5米，远屏例如可以位于驾驶员前方视野的7至15米。
示例性的，参见图3，图3为本申请实施例提供的一种AR-HUD的成像效果示意图。在图3中，AR-HUD投射到汽车挡风玻璃上所呈的虚像面可以位于驾驶员视野正前方。如位于驾驶员前方视野的2.5米的近屏，位于驾驶员前方视野的15米的远屏等。在近屏和远屏上都可以显示驾驶时速和汽车电量等信息，在远屏上还可以显示AR导航指引箭头等信息，从而辅助驾驶员实现更加智能、舒适和安全的驾驶。
C-HUD多应用于后装市场，例如，可以在座舱顶部以悬挂方式或在仪表台上方加装半透明树脂板，以该半透明树脂板为投影介质反射出虚像。该树脂板通常会根据成像条件进行特殊处理，例如做成楔形来避免反射重影，提升显示效果。
W-HUD可以使用前挡风玻璃作为成像介质来反射成像，可以支持更大的成像区域和更远的投影距离。但挡风玻璃通常为曲面反射镜，W-HUD需要根据挡风玻璃的尺寸和曲率去适配高精度的曲面反射镜，导致成本相对较高。W-HUD多用于前装市场，目前存在多条技术路线：基于曲面反射镜放大成像、基于全息光学元件(holographic optical elements，HOE)放大成像和基于全息光波导(waveguide)放大成像。目前，HOE和waveguide技术尚未成熟，主要应用的为基于曲面反射镜放大成像技术。
下面对本申请实施例的系统架构和业务场景进行描述。需要说明的是，本申请描述的系统架构及业务场景是为了更加清楚的说明本申请的技术方案，并不构成对于本申请提供的技术方案的限定，本领域普通技术人员可知，随着系统架构的演变和新业务场景的出现，本申请提供的技术方案对于类似的技术问题，同样适用。
参见图4，图4为本申请实施例提供的一种显示系统的示意图。该显示系统可以包括显示设备。
显示设备用于实现各类信息的显示，如驾驶员的隐私信息的显示，在本申请中，隐私信息例如可以包括文字、图片、视频等中的一个或多个形式的信息。应理解的，隐私信息是用户授权后可以通过显示设备显示的信息。显示设备还可以用于实现超速预警、车况监控、油耗、时速等信息的显示。一般来说，显示设备可以安装于车辆座舱的中控台上方或中控台内部。在本申请中，显示设备例如可以为HUD或带有投影成像功能的设备等，具体不做限定。
该显示系统还可以包括车载终端。车载终端是具有数据处理能力和/或数据收发能力的电子设备。车载终端可以控制显示设备实现各类信息的显示，如驾驶员的隐私信息显示。本申 请实施例中，车载终端可以是具有处理功能的显示装置，也可以是处理装置，控制显示设备实现各类信息的显示。
可选的，车载终端还可以用于对车辆进行行车安全管理、运营管理、服务质量管理、智能集中调度管理、电子站牌控制管理等一种或多种管理。
在本申请中，车载终端可以部署在车辆上。该车辆可以为轿车、卡车、公共汽车、船、飞机、直升飞机、电车、高尔夫球车等，本申请实施例不做特别的限定。
可选的，该显示系统还可以包括图像采集设备。图像采集设备可以采集车辆周边环境的一个或多个图像。示例性的，图像采集设备可以对车内用户的脸部、头部、部分躯干(例如，手臂)等中的一个或多个进行检测和采集，还可以对车内用户的人眼位置、视线方向等中的一个或多个进行检测和采集。图像采集设备例如可以是车载摄像头、人眼检测仪、传感器等中的一个或多个。其中，车载摄像头例如可以为驾驶员检测系统(driver monitoring system，DMS)摄像头、车用摄像机监视器系统(camera-monitor system，CMS)摄像头等中的一个或多个。应理解的，图像采集设备可以按照需求设置车辆上，例如，可以设置在方向盘、中控台附近区域。图像采集设备可以是一台，也可以是多台，本申请对其位置和数量不做限定。
需要说明的是，车载终端与显示设备、图像采集设备等之间通信的链路可以是各种类型的介质，具体可以是有线链路、或者无线链路、或者有线链路与无线链路的组合等等。有线链路例如基于以太网的总线、也可以是CAN总线、LIN总线、MOST总线、FlexRay等等中的一个或者多个。无线链路例如为近距离连接技术，包括802.11b/g、蓝牙(blue tooth)、紫蜂(zigbee)、车载短距无线通信技术等，再如还可以为远距离连接技术包括全球移动通信系统(global system for mobile communications，GSM)、通用分组无线业务(gerneral packer radio service，GPRS)的缩写、通用移动通信系统(universal mobile telecommunications system，UMTS)、基于长期演进(long term evolution，LTE)的通信技术、第五代移动通信技术(5th generation mobile networks或5th generation wireless systems、5th-Generation，简称5G或5G技术)、车载无线通信技术等技术。当然，不排除还有其他技术可以用于支撑车载终端与显示设备、图像采集设备等进行通信。
为了更好的理解车载终端控制显示设备实现各类信息的显示。以下以显示设备为AR-HUD、图像采集设备DMS摄像头为例，说明车载终端控制AR-HUD显示图像的原理。
参见图5，图5为本申请实施例提供的一种车载终端控制AR-HUD显示图像原理的示意图。如图5所示，车载终端可以通过DMS摄像头获取图像信息，该图像信息例如可以包括用户的眼睛，如驾驶员的眼睛，进而可以确定用户的眼睛位置，并进行眼睛位置滤波，得到滤波后的眼睛位置。其次，车载终端还可以生成图形，如车载终端从高级驾驶辅助系统(advanced driving assistant system，ADAS)接口获取车辆的当前位置、车辆的行驶路线、车辆的速度、前方路况等信息，以实现图形生成；车载终端获取高精度导航信息，如指示直行进入XX道路，指示左转进入XX道路，指示右转进入XX道路，指示掉头等，以实现图形生成；车载终端获取一些汽车服务信息，如视频观看服务信息、音乐播放服务信息等，以实现图形生成；车载终端从兴趣点(point of interest，POI)接口获取POI信息，以实现图形生成；车载终端从仪表接口获取油耗、时速等信息，以实现图形生成。其中，POI指地理区域上的地点标识，地点标识用于标示出该地点标识所在地的政府部门、商业机构(加油站、百货公司、超市、餐厅、酒店、便利商店、医院等)、旅游景点(公园、公共厕所等)、古迹名胜、交通设施(各式车站、停车场、超速照相机、速限标示)等处所。POI信息可以包括名称、类型、位置信息等中的一个或多个，位置信息例如可以包括经纬度、海拔等中的一个或 多个，类型可以是餐饮、住宿等。应理解的，车载终端得到生成的图形后，可以对该图形依次进行坐标变换和视角平移，并基于滤波后的眼睛位置对视角平移后的图形进行透视变换，得到透视变换后的图形。进一步的，车载终端可以根据透视变换后的图形和车载终端生成的图形进行图像渲染，得到图像渲染的图形。接着，车载终端依次对图像渲染的图形进行防抖处理和光学畸变校正，以将校正后的图形传输至AR-HUD，使得AR-HUD可以依次对校正后的图形进行感光调节和扫描畸变校正，进而通过微机电系统(micro-electro-mechanical system，MEMS)驱动和激光(laser diode，LD)驱动实现图形的显示。
需要说明的，图像畸变是由于大视场短焦距光学系统不满足针孔模型，不同视场的主光线通过光学系统后与高斯像面的焦点高度不等于理想像高，使得实际像点偏离理想像点，从而图像中的内容出现拉伸、扭曲等几何形状的变形失真。例如，对于广角的摄像头，能获取较大视场的图像，但也容易引入显著的图像畸变，比如所拍摄图像中位于图像外侧(即视场角度较大)的人像会呈现更大的变形失真。因此，需要对出现图像畸变的图像进行图像畸变校正，使得图像符合人眼视觉。
在本申请中，图像畸变又可以称为光学畸变、透镜畸变、摄像畸变、相机畸变或镜头畸变等。应理解的，可以利用图像畸变校正算法进行图像畸变校正，图像畸变校正算法例如可以是张正友相机标定算法。
参见图6，图6为本申请实施例提供的一种显示方法的流程示意图。应理解的，图6所述的实施例可以应用于显示设备，也可以应用于控制显示设备的处理装置，如车载终端。下面以车载终端为例进行说明，如图6所示，该方法包括但不限于以下步骤：
601、车载终端获取图像信息，图像信息用于确定车辆的第一用户的眼睛的位置和视线方向。
可选的，步骤601可以通过以下任意一种方式实现，具体采用哪一方式可以取决于车载终端的实现、预先的约定或者标准的定义。
方式1.1、车载终端采用图像质量增强处理和图像畸变校正处理等中的一种或多种对源图像进行处理，以得到图像信息。其中，图像质量增强指对图像的亮度、颜色、对比度、饱和度、动态范围等中一个或多个进行处理，又可以称为图像增强，相当于提高图像的质量，使得图像更清晰。可选的，源图像可以是车载终端通过图像采集设备获取的图像，也可以是车载终端从存储图像的数据库中获取的图像。应理解的，在本申请中，源图像具体的获取方式不做限定。
方式1.2、车载终端通过图像采集设备获取图像信息。如图像采集设备可以采用图像质量增强处理和图像畸变校正处理等中的一种或多种对图像采集设备采集到的源图像进行处理，以得到图像信息，进而将图像信息发送给车载终端。
在本申请中，图像信息例如可以是关键点矩阵、关键点集合等。即在图像信息中标注了人脸关键点。其中，人脸关键点为用于在人脸图像中定位出人脸面部的关键区域位置的点，关键区域包括眉毛、眼睛、鼻子、嘴巴、脸部轮廓等中一个或多个。应理解的，在本申请中，在图像信息中至少标注了用户的眼睛的位置，用户的眼睛的位置例如可以为两眼中心的中间点、左眼中心、右眼中心等。这里，眼中心可以是眼睛的瞳孔中心、眼球中心、角膜中心或眼睛的其他位置。
需要说明的，在本申请中，通过图像信息确定用户的眼睛的位置例如可以是以下两种实施方式：
在一种可能的实施方式中，用户的眼睛的位置可以是车载终端根据图像信息和预先构建的3D人脸模型确定的，也可以是其他方式获得的，在此不做限定。其中，3D人脸模型可以是车载终端从云端获取的。
在另一种可能的实施方式中，用户的眼睛的位置可以是车载终端从云端获取的，如车载终端向云端发送图像信息，以使得云端根据图像信息和预先构建的3D人脸模型确定用户的眼睛的位置后发送给车载终端。
应理解的，在本申请中，在图像信息中可以标注车辆的第一用户的眼睛的位置，还可以标注该车辆的第二用户的眼睛的位置。第一用户例如可以是非驾驶员，第二用户例如可以是驾驶员。应理解的，第一用户和第二用户在车辆内的位置不同。在一可能的实施方式中，第一用户位于车辆的非驾驶位，第二用户位于该车辆的驾驶位。示例性的，第一用户可以位于车辆的副驾驶位。又示例性的，第一用户可以在车辆的后排区域。具体的，若对车内区域划分为驾驶位、副驾驶位、二排左和二排右，第一用户可以在车辆的二排左或二排右。若对车内区域分为驾驶位、副驾驶位、二排左、二排中和二排右，第一用户可以在车辆的二排左、二排中或二排右。
需要说明的，车辆的后排区域是相对于车辆的前排区域来说的。参见图7，图7为本申请实施例提供的一种车内区域划分示意图。车辆的前排区域71可以包括驾驶位711和副驾驶位712，车辆的后排区域72可以包括二排721、二排722和二排723。
其中，车载终端可以通过以下一种或多种方式确定车内各个区域(如驾驶位、副驾驶位以及后排区域)中是否有用户。当驾驶位有用户，该用户可以称为第二用户，当副驾驶位或后排区域有用户，该用户可以称为第一用户。应理解的，车载终端如何确定车内各个区域中是否有用户，取决于车载终端的实现、预先的约定或者标准的定义。
方式2.1、车载终端可以通过图像采集设备来获取车内各个区域的图像信息，并通过各个区域中的图像信息来确定各个区域中是否有用户。例如，若车载终端从DMS摄像头采集的各个区域的图像信息检测到人脸，则确定该区域中存在用户。又例如，若车载终端从DMS摄像头采集的各个区域的图像信息获取到人眼的虹膜信息，则确定该区域中存在用户。
方式2.2、车载终端可以通过座椅下的压力传感器来检测各个区域中是否存在用户。示例性的，当某个区域的座椅上的压力传感器检测到的压力值大于或者等于预设值时，可以确定该区域中存在用户。
方式2.3、车载终端可以通过麦克风阵列获取的音频信息来确定声源位置，以根据声源位置确定哪些区域中存在用户。如，该声源位置是副驾驶位，那么副驾驶位存在用户。
另外，本申请中，通过图像信息确定用户的视线方向例如可以是以下两种实施方式：
在一种可能的实施方式中，视线方向可以是车载终端基于视线追踪模型(eye tracking/gaze tracking model)从图像信息中提取的。其中，视线追踪模型可通过包含人眼或人脸的图像估计人眼注视方向或注视点的机器学习模型。例如，神经网络模型等。
在另一种可能的实施方式中，视线方向可以是车载终端从云端获取的，如车载终端向云端发送图像信息，以使得云端基于视线追踪模型从图像信息中提取视线方向后发送给车载终端。
可选的，在步骤601之前，该方法还可以包括：在满足第三条件时，车载终端开启隐私信息保护模式。在本申请中，车载终端开启隐私信息保护模式可以理解为车载终端执行步骤601-步骤602。可以看出，在满足第三条件时，车载终端开启隐私信息保护模式。
第三条件可以包括以下至少一项：车载终端检测到第二用户所在车辆内存在除第二用户 的其他用户；车载终端检测到车辆内存在除预设用户的其他用户；车载终端检测到模式设置指令，该模式设置指令用于开启隐私信息保护模式。应理解的，第三条件可以预先的约定或者标准的定义，在此不做限定。
可选的，车载终端检测到第二用户所在车辆内存在除第二用户的其他用户，可以通过以下一种或多种方式，具体采用什么方式取决于车载终端的实现、预先的约定或者标准的定义。
方式3.1、车载终端可以通过图像采集设备来获取车内除驾驶位的其他区域的图像信息，并通过其他区域的图像信息来确定车内存在除第二用户的其他用户。例如，若车载终端从DMS摄像头采集的其他区域的图像信息检测到人脸，则确定车内存在除第二用户的其他用户。又例如，若车载终端从DMS摄像头采集的其他区域的图像信息获取到人眼的虹膜信息，则确定车内存在除第二用户的其他用户。如某个用户的虹膜信息与第二用户的虹膜信息不匹配，则表示车辆内存在除第二用户的其他用户。第二用户的虹膜信息可以是车载终端根据图像采集设备实时获取的图像信息确定的虹膜信息，也可以是车载终端根据预先存储的第二用户的人脸图像确定的虹膜信息，还可以是车载终端从云端获取的虹膜信息，还可以是车载终端根据云端发送的第二用户的人脸图像确定的虹膜信息。云端例如可以为原始设备制造商(original equipment manufacturer，OEM)云等，OEM云又可以称为车云。
方式3.2、车载终端可以通过座椅下的压力传感器来确定车内存在除第二用户的其他用户。示例性的，当副驾驶位的座椅上的压力传感器检测到的压力值大于或者等于预设值时，可以确定车内存在除第二用户的其他用户。
方式3.3、车载终端可以通过麦克风阵列获取的音频信息来确定声源位置，以根据声源位置确定车内存在除第二用户的其他用户。应理解的，方式3.3中声源位置不包括驾驶位。
方式3.4、车载终端可以通过麦克风阵列获取的音频信息来确定声纹信息，以根据声纹信息确定车内存在除第二用户的其他用户。如该声纹信息与第二用户的声纹信息不匹配，则表明车内存在除第二用户的其他用户。应理解的，第二用户的声纹信息可以是车载终端根据麦克风阵列实时获取的音频信息确定的声纹信息，也可以是车载终端根据预先存储的音频信息确定的声纹信息，还可以是车载终端从云端获取的声纹信息，还可以是车载终端根据云端发送的第二用户的音频信息确定的声纹信息。
可选的，车载终端检测到车辆内存在除预设用户的其他用户，可以通过以下一种或多种方式，具体采用什么方式取决于车载终端的实现、预先的约定或者标准的定义。
方式4.1、车载终端可以通过图像采集设备来获取车内各个区域的图像信息，并通过各个区域的图像信息来确定车内存在除预设用户的其他用户。例如，车载终端可以通过DMS摄像头采集的各个区域的图像信息进行人脸识别，以确定车内存在除预设用户的其他用户。又例如，车载终端可以通过DMS摄像头采集的各个区域的图像信息确定人眼的虹膜信息，以根据人眼的虹膜信息确定车内存在除预设用户的其他用户，如某个用户的虹膜信息与预设用户的虹膜信息不匹配，则表示车辆内存在除预设用户的其他用户。预设用户的虹膜信息可以是车载终端根据预先存储的预设用户的人脸图像确定的虹膜信息，也可以是车载终端从云端获取的虹膜信息，还可以是车载终端根据云端发送的预设用户的人脸图像确定的虹膜信息。
方式4.2、车载终端可以通过麦克风阵列获取的音频信息来确定声纹信息，以根据声纹信息确定车内存在除预设用户的其他用户。如该声纹信息与预设用户的声纹信息不匹配，则表明车内存在除预设用户的其他用户。应理解的，预设用户的声纹信息可以是车载终端根据预先存储的音频信息确定的声纹信息。
其中，预设用户可以是预先设定的，也可以车载终端从云端获取的，还可以是用户自行 确定的，在此不做限定。在一可能的实施方式中，预设用户例如可以包括第二用户，还可以包括第二用户的家人、第二用户的朋友等。
可选的，车载终端检测到模式设置指令，可以通过以下一种或多种方式，具体采用什么方式取决于车载终端的实现、预先的约定或者标准的定义。
方式5.1、车载终端根据麦克风阵列获取的音频信息，识别到模式设置指令。
方式5.2、车载终端通过中控屏检测到模式设置指令。中控屏是汽车在驾驶位和副驾驶位之间的位置设置的屏幕。其中，在方式5.2中，模式设置指令可以理解为手势指令。手势指令是通过手指、手写笔或钢笔等物体对中控屏触发的动作，车载终端可以对手势指令进行识别，以确定手势指令代表的操作，从而根据手势指令代表的操作进行响应。手势指令例如可以包括点击、长按、滑动、旋转、双击、收缩等，手势指令可以是通过一只手执行的，也可以是通过双手同时执行的。从是否接触中控屏的角度来说，手势指令包括触控手势指令和悬浮手势指令，触控手势指令是指通过触摸中控屏执行的手势指令，悬浮手势指令是指在中控屏上方隔空执行的手势指令。从手势指令对应的触摸点数量的角度来说，手势指令包括单点触控手势指令和多点触控手势指令。多点触控手势指令是指在同一时间点有多点(例如多个手指)触碰例如多个手指的手势指令。
可选的，该方法还可以包括步骤602。
602、车载终端根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式，第一区域包括车辆的第二用户的隐私信息。
其中，显示区域为显示设备的显示区域，如显示区域为HUD的显示区域。当显示区域为AR-HUD的显示区域时，显示区域例如可以是图3中的近屏和/或远屏。应理解的，第一区域可以是显示区域中的部分区域，也可以是显示区域的全部区域。
可选的，步骤602可以包括：车载终端确定第一用户的眼睛的位置是否在显示区域的可视角度范围；在满足第一条件时，车载终端将显示区域中第一区域的显示方式调整为第一显示方式。应理解的，第一条件可以预先的约定或者标准的定义，在此不做限定。可以看出，在满足第一条件时，车载终端将显示区域中第一区域的显示方式调整为第一显示方式，也就是说，在检测到第一用户可能会查看到第一区域中第二用户的隐私信息时，车载终端将显示区域中第一区域的显示方式调整为第一显示方式，从而可以降低第一用户可以查看到第二用户的隐私信息的可能性，进而可以减少隐私信息泄露的风险，提高了用户的安全感。
其中，显示区域的可视角度范围包括第一用户可以看到的显示区域的画面的眼睛的角度范围，边界点可以由第一用户可以看到的显示区域的画面的眼睛的最大角度值和最小角度值确定。也就是说，显示区域的可视角度范围可以包括最大角度值和最小角度值确定的区间，还可以包括边界点，如最大角度值和/或最小角度值，也可以不包括边界点，可以在具体实现过程中确定。应理解的，显示区域的可视角度范围与第一用户的眼睛的位置有关。
示例性的，以第一用户的眼睛的位置为两眼中心的中间点为例，参见图8说明第一用户可以看到的显示区域的画面的最大角度值。最大角度值为显示区域上的第二目标点与眼盒(eyebox)上的目标点之间的连线，和第二目标点与第一用户的眼睛的位置之间的连线形成的夹角大小。第二目标点为第一用户的眼睛的位置所在平面与显示区域的交线的中心点，眼盒上的目标点为第一用户的眼睛的位置所在平面与眼盒的交线的中心点。其中，眼盒例如可以是指驾驶员的眼睛能够看到全部显示图像的范围。例如，一般眼盒尺寸大小是130mmx50mm。由于不同驾驶员的身高，需要满足眼盒在垂直方向上有约±50mm的移动范围。在本申请中，人眼在眼盒范围可以看到清晰的HUD或AR-HUD的成像。应理解的，第 二目标点与第一用户的眼睛的位置之间的连线还与第一用户的眼睛的位置所在平面与眼盒的交线相交于点A。
可选的，该最大角度值的余弦值
Figure PCTCN2022112309-appb-000007
其中，P′ hud为第二目标点，P eye为第一用户的眼睛的位置，P box为眼盒上的目标点。
又示例性的，以第一用户的眼睛的位置为两眼中心的中间点、显示区域上的第一目标点为显示区域的中心点为例，参见图9说明第一用户可以看到的显示区域的画面的最小角度值。最小角度值为第二用户的眼睛的位置与第一目标点之间的连线，和第一目标点与第二用户的耳朵的位置之间的连线形成的夹角大小。可选的，第一目标点为显示区域的中心点；或，第一目标点为显示区域的顶点；或，第一目标点为显示区域的侧边的中心点，显示区域的侧边包括显示区域的左侧、右侧、上侧或下侧。
可选的，该最小角度值的正切值
Figure PCTCN2022112309-appb-000008
P hud为第一目标点，P′ eye为第二用户的眼睛的位置，X为第二用户半脸的宽度值。
其中，第一条件例如可以包括以下至少一项：第一用户的眼睛的位置在显示区域的可视角度范围内；第一用户的视线方向朝向于显示区域；或第一用户的视线停留在显示区域的时间大于或等于预设时间。预设时间可以是预先设定的，也可以车载终端从云端获取的，还可以是用户自行确定的，在此不做限定。
在本申请中，第一显示方式例如可以包括以下至少一项：隐藏第一区域；隐藏第一区域中第二用户的隐私信息；淡化第一区域；将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。应理解的，当第一区域的清晰度为第一清晰度，或，第一区域的分辨率为第一分辨率时，用户可以清晰地查看到第一区域中的隐私信息；当第一区域的清晰度为第二清晰度，或，第一区域的分辨率为第二分辨率时，用户无法清晰地查看到该隐私信息，甚至无法查看到该隐私信息。也就是说，在检测到第一用户可能会查看到第一区域中第二用户的隐私信息时，车载终端可以将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，因为第一清晰度高于第二清晰度，且当第一区域的清晰度为第二清晰度时第一用户无法清晰地查看到该隐私信息，甚至无法查看到该隐私信息，所以可以降低第一用户可以查看到第二用户的隐私信息的可能性，进而可以减少隐私信息泄露的风险，提高了用户的安全感。同理，在检测到第一用户可能会查看到第一区域中第二用户的隐私信息时，车载终端可以将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，因为第一分辨率高于第二分辨率，且当第一区域的分辨率为第二分辨率时用户无法清晰地查看到该隐私信息，甚至无法查看到该隐私信息，所以可以降低第一用户可以查看到第二用户的隐私信息的可能性，进而可以减少隐私信息泄露的风险，提高了用户的安全感。
可选的，该方法还可以包括：在满足第二条件时，车载终端将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式。应理解的，第二条件可以预先的约定或者标准的定义，在此不做限定。可以看出，在满足第二条件时，车载终端将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式，也就是说，在检测到第一用户无法查看到第一区域中第二用户的隐私信息时，车载终端将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式，使得第二用户可以查看到第二用户的隐私信息，这样可以保障第二用户的正常使用和驾驶安全。
其中，第二条件例如包括以下至少一项：第一用户的眼睛的位置超出显示区域的可视角度范围；第一用户的视线方向朝向显示区域之外的其他区域；第一用户的视线停留在显示区域的时间小于预设时间。
需要说明的，第一用户的眼睛的位置超出显示区域的可视角度范围可以理解为：第一用户的眼睛的位置不在显示区域的可视角度范围内。第一用户的视线方向朝向显示区域之外的其他区域可以理解为：第一用户的视线方向未朝向于显示区域，例如第一用户的视线方向朝向于车辆的天窗等。
在本申请中，第二显示方式例如包括以下至少一项：在第一区域显示第二用户的隐私信息；将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。应理解的，在检测到第一用户无法查看到第一区域中第二用户的隐私信息时，车载终端可以将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，因为第一清晰度高于第二清晰度，且当第一区域的清晰度为第一清晰度时用户可以查看到该隐私信息，所以使得第二用户可以查看到该隐私信息。同理，在检测到第一用户无法查看到第一区域中第二用户的隐私信息时，车载终端可以将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，因为第一分辨率高于第二分辨率，且当第一区域的分辨率为第一分辨率时用户可以查看到该隐私信息，所以使得第二用户可以查看到该隐私信息，保障第二用户的正常使用和驾驶安全。
可选的，图像信息还用于确定第二用户的眼睛的位置，车载终端确定第一用户的眼睛的位置是否在显示区域的可视角度范围，可以包括：车载终端确定第二用户的眼睛的位置与第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小，以得到第一角度值；车载终端根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内。可以看出，车载终端可以根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内，为后续调整显示区域中第一区域的显示方式做准备。
示例性的，以第一用户的眼睛的位置和第二用户的眼睛的位置为两眼中心的中间点、第一目标点为显示区域的中心点为例，参见图10说明第一角度值。可以看出，第一角度值为第二用户的眼睛的位置与第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小。
其中，第一角度值的余弦值
Figure PCTCN2022112309-appb-000009
P hud为第一目标点，P eye为第一用户的眼睛的位置，P′ eye为第二用户的眼睛的位置。
可选的，车载终端将显示区域中第一区域的显示方式调整为第一显示方式之前，该方法还可以包括：车载终端确定第一用户的眼睛的位置与第一目标点之间的连线，和第一用户的视线方向形成的夹角大小，以得到第二角度值；车载终端根据第二角度值，确定第一用户的视线方向是否朝向于显示区域。可以看出，车载终端可以根据第二角度值，确定第一用户的视线方向是否朝向于显示区域，为后续调整显示区域中第一区域的显示方式做准备。
示例性的，以第一用户的眼睛的位置为两眼中心的中间点、第一目标点为显示区域的中心点为例，参见图11说明第二角度值。可以看出，第二角度值为第一用户的眼睛的位置与第一目标点之间的连线，和第一用户的视线方向形成的夹角大小。
其中，第二角度值的余弦值
Figure PCTCN2022112309-appb-000010
P hud为第一目标点，P eye为第二用户的 眼睛的位置，
Figure PCTCN2022112309-appb-000011
为第一用户的视线方向的单位向量。
可以看出，上述方案中，车载终端可以获取图像信息，以根据图像信息，确定第一用户的眼睛的位置和视线方向，进而可以根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式，以降低第一用户可以查看到第二用户的隐私信息的可能性，可以减少隐私信息泄露的风险，提高了用户的安全感。
上述详细阐述了本申请实施例的方法，下面提供了本申请实施例的装置。
本申请实施例还提供用于实现以上任一种方法的装置，例如，提供一种显示装置包括用以实现以上任一种方法中车载终端所执行的各步骤的单元(或手段)。
例如，可以参见图12，图12是本申请实施例提供的一种显示装置120的结构示意图，该显示装置120包括处理单元1201、发送单元1202和接收单元1203，例如图6所示任意一个实施例的显示方法。
应理解以上装置中各单元的划分仅是一种逻辑功能的划分，实际实现时可以全部或部分集成到一个物理实体上，也可以物理上分开。此外，装置中的单元可以以处理器调用软件的形式实现；例如装置包括处理器，处理器与存储器连接，存储器中存储有指令，处理器调用存储器中存储的指令，以实现以上任一种方法或实现该装置各单元的功能，其中处理器例如为通用处理器，例如中央处理单元(central processing unit，CPU)或微处理器，存储器为装置内的存储器或装置外的存储器。或者，装置中的单元可以以硬件电路的形式实现，可以通过对硬件电路的设计实现部分或全部单元的功能，该硬件电路可以理解为一个或多个处理器；例如，在一种实现中，该硬件电路为专用集成电路(application-specific integrated circuit，ASIC)，通过对电路内元件逻辑关系的设计，实现以上部分或全部单元的功能；再如，在另一种实现中，该硬件电路为可以通过可编程逻辑器件(programmable logic device，PLD)实现，以现场可编程门阵列(field programmable gate array，FPGA)为例，其可以包括大量逻辑门电路，通过配置文件来配置逻辑门电路之间的连接关系，从而实现以上部分或全部单元的功能。以上装置的所有单元可以全部通过处理器调用软件的形式实现，或全部通过硬件电路的形式实现，或部分通过处理器调用软件的形式实现，剩余部分通过硬件电路的形式实现。
在本申请实施例中，处理器是一种具有信号的处理能力的电路，在一种实现中，处理器可以是具有指令读取与运行能力的电路，例如中央处理单元、微处理器、图形处理器(graphics processing unit，GPU)(可以理解为一种微处理器)、或数字信号处理器(digital singnal processor，DSP)等；在另一种实现中，处理器可以通过硬件电路的逻辑关系实现一定功能，该硬件电路的逻辑关系是固定的或可以重构的，例如处理器为ASIC或PLD实现的硬件电路，例如FPGA。在可重构的硬件电路中，处理器加载配置文档，实现硬件电路配置的过程，可以理解为处理器加载指令，以实现以上部分或全部单元的功能的过程。此外，还可以是针对人工智能设计的硬件电路，其可以理解为一种ASIC，例如神经网络处理单元(neural network processing unit，NPU)张量处理单元(tensor processing unit，TPU)、深度学习处理单元(deep learning processing unit,DPU)等。
可见，以上装置中的各单元可以是被配置成实施以上方法的一个或多个处理器(或处理电路)，例如：CPU、GPU、NPU、TPU、DPU、微处理器、DSP、ASIC、FPGA，或这些处理器形式中至少两种的组合。
此外，以上装置中的各单元可以全部或部分可以集成在一起，或者可以独立实现。在一种实现中，这些单元集成在一起，以片上系统(system-on-a-chip，SOC)的形式实现。该SOC 中可以包括至少一个处理器，用于实现以上任一种方法或实现该装置各单元的功能，该至少一个处理器的种类可以不同，例如包括CPU和FPGA，CPU和人工智能处理器，CPU和GPU等。
无论这些功能模块是进行了细分还是组合，装置120在显示的过程中所执行的大致流程是相同的。例如，上述装置120中的接收单元1203、发送单元1202也可以合并为通信单元。通常，每个单元都对应有各自的程序代码(或者说程序指令)，这些单元各自对应的程序代码在处理器上运行时，使得该单元执行相应的流程从而实现相应功能。需要说明的，下述各个单元的实现可以对应参照图6所示的实施例的相应描述。
在一可能的实现方式中，该显示装置120可以为图6所示实施例中的车载终端，或者车载终端中的一个模块，例如芯片或者集成电路等。该装置包括处理单元1201和接收单元1203，其中，各个单元的描述如下：
接收单元1203，用于获取图像信息，图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；
处理单元1201，用于根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式；
其中，显示区域为HUD的显示区域，第一区域包括车辆的第二用户的隐私信息。
可选的，第一用户位于车辆的非驾驶位，第二用户位于车辆的驾驶位。
可选的，第一用户位于车辆的非驾驶位，包括：第一用户位于车辆的副驾驶位；或，第一用户在车辆的后排区域。
可选的，在根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式时，处理单元1201，用于：确定第一用户的眼睛的位置是否在显示区域的可视角度范围内；在满足第一条件时，将显示区域中第一区域的显示方式调整为第一显示方式；其中，第一条件包括以下至少一项：第一用户的眼睛的位置在显示区域的可视角度范围内；第一用户的视线方向朝向于显示区域；或第一用户的视线停留在显示区域的时间大于或等于预设时间。
可选的，第一显示方式包括以下至少一项：隐藏第一区域；隐藏第一区域中第二用户的隐私信息；淡化第一区域；将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，处理单元1201，还用于在满足第二条件时，将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式；其中，第二条件包括以下至少一项：第一用户的眼睛的位置超出显示区域的可视角度范围；第一用户的视线方向朝向显示区域之外的其他区域；第一用户的视线停留在显示区域的时间小于预设时间。
可选的，第二显示方式包括以下至少一项：在第一区域显示第二用户的隐私信息；将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，图像信息还用于确定第二用户的眼睛的位置，在确定第一用户的眼睛的位置，是否在显示区域的可视角度范围内时，处理单元1201，用于：确定第二用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小，以得到第一角度值；根据第一角度值，确定第一用户的眼睛的位置是否在显 示区域的可视角度范围内。
可选的，第一角度值的余弦值
Figure PCTCN2022112309-appb-000012
其中，P hud为第一目标点，P eye为第一用户的眼睛的位置，P′ eye为第二用户的眼睛的位置。
可选的，处理单元1201，还用于：确定第一用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的视线方向形成的夹角大小，以得到第二角度值；根据第二角度值，确定第一用户的视线方向是否朝向于显示区域。
可选的，第二角度值的余弦值
Figure PCTCN2022112309-appb-000013
其中，P hud为第一目标点，P eye为第二用户的眼睛的位置，
Figure PCTCN2022112309-appb-000014
为第一用户的视线方向的单位向量。
可选的，第一目标点为显示区域的中心点；或，第一目标点为显示区域的顶点；或，第一目标点为显示区域的侧边的中心点，显示区域的侧边包括显示区域的左侧、右侧、上侧或下侧。
可选的，处理单元1201，还用于在满足第三条件时，开启隐私信息保护模式；第三条件包括以下至少一项：检测到第二用户所在车辆内存在除第二用户的其他用户；检测到车辆内存在除预设用户的其他用户；检测到模式设置指令；其中，模式设置指令用于开启隐私信息保护模式。
参见图13，图13是本申请实施例提供的一种车辆130的结构示意图，该车辆130包括车载终端1301，其中：
车辆内的车载终端，用于获取图像信息，图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；
车辆内的车载终端，还用于根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式；
其中，显示区域为HUD的显示区域，第一区域包括车辆的第二用户的隐私信息。
可选的，第一用户位于车辆的非驾驶位，第二用户位于车辆的驾驶位。
可选的，第一用户位于车辆的非驾驶位，包括：第一用户位于车辆的副驾驶位；或，第一用户在车辆的后排区。
可选的，在根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式时，车辆内的车载终端，具体用于：确定第一用户的眼睛的位置是否在显示区域的可视角度范围内；在满足第一条件时，将显示区域中第一区域的显示方式调整为第一显示方式。其中，第一条件包括以下至少一项：第一用户的眼睛的位置在显示区域的可视角度范围内；第一用户的视线方向朝向于显示区域；或第一用户的视线停留在显示区域的时间大于或等于预设时间。
可选的，第一显示方式包括以下至少一项：隐藏第一区域；隐藏第一区域中第二用户的隐私信息；淡化第一区域；将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，车辆内的车载终端，还用于：在满足第二条件时，将显示区域中第一区域的显示方式由第一显示方式调整为第二显示方式；其中，第二条件包括以下至少一项：第一用户的眼睛的位置超出显示区域的可视角度范围；第一用户的视线方向朝向显示区域之外的其他区域；第一用户的视线停留在显示区域的时间小于预设时间。
可选的，第二显示方式包括以下至少一项：在第一区域显示第二用户的隐私信息；将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，图像信息还用于确定第二用户的眼睛的位置，在确定第一用户的眼睛的位置，是否在显示区域的可视角度范围内时，车辆内的车载终端，具体用于：确定第二用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小，以得到第一角度值；根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内。
可选的，第一角度值的余弦值
Figure PCTCN2022112309-appb-000015
其中，P hud为第一目标点，P eye为第一用户的眼睛的位置，P′ eye为第二用户的眼睛的位置。
可选的，车辆内的车载终端，还用于：确定第一用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的视线方向形成的夹角大小，以得到第二角度值；根据第二角度值，确定第一用户的视线方向是否朝向于显示区域。
可选的，第二角度值的余弦值
Figure PCTCN2022112309-appb-000016
其中，P hud为第一目标点，P eye为第二用户的眼睛的位置，
Figure PCTCN2022112309-appb-000017
为第一用户的视线方向的单位向量。
可选的，第一目标点为显示区域的中心点；或，第一目标点为显示区域的顶点；或，第一目标点为显示区域的侧边的中心点，显示区域的侧边包括显示区域的左侧、右侧、上侧或下侧。
可选的，车辆内的车载终端，还用于在满足第三条件时，开启隐私信息保护模式；第三条件包括以下至少一项：检测到第二用户所在车辆内存在除第二用户的其他用户；检测到车辆内存在除预设用户的其他用户；检测到模式设置指令；其中，模式设置指令用于开启隐私信息保护模式。
参见图14，图14是本申请实施例提供的一种电子装置140的结构示意图，该装置140可以包括至少一个存储器1401和至少一个处理器1402。可选的，还可以包含总线1403。进一步可选的，还可以包括通信接口1404，其中，存储器1401、处理器1402和通信接口1404通过总线1403相连。
其中，存储器1401用于提供存储空间，存储空间中可以存储操作系统和计算机程序等数据。存储器1401可以是随机存储记忆体(random access memory，RAM)、只读存储器(read-only memory，ROM)、可擦除可编程只读存储器(erasable programmable read only memory，EPROM)、或便携式只读存储器(compact disc read-only memory，CD-ROM)等等中的一种或者多种的组合。
处理器1402是进行算术运算和/或逻辑运算的模块，具体可以是CPU、GPU、微处理器(microprocessor unit，MPU)、ASIC、FPGA、复杂可编程逻辑器件(Complex programmable logic device，CPLD)等处理模块中的一种或者多种的组合。
通信接口1404用于接收外部发送的数据和/或向外部发送数据，可以为包括诸如以太网电缆等的有线链路接口，也可以是无线链路(Wi-Fi、蓝牙、通用无线传输等)接口。可选的，通信接口1404还可以包括与接口耦合的发射器(如射频发射器、天线等)，或者接收器等。
该装置140中的处理器1402用于读取存储器1401中存储的计算机程序，用于执行前述 的显示方法，例如图6任意一个实施例所描述的显示方法。
在一些可能的实现方式中，该电子装置140可以为图6所示实施例中的车载终端，或者车载终端中的一个模块，例如芯片或者集成电路等。该装置140中的处理器1402用于读取存储器1401中存储的计算机程序，以执行以下操作：
通过通信接口1404获取图像信息，图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；
根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式；
其中，显示区域为HUD的显示区域，第一区域包括车辆的第二用户的隐私信息。
可选的，第一用户位于车辆的非驾驶位，第二用户位于车辆的驾驶位。
可选的，第一用户位于车辆的非驾驶位，包括：第一用户位于车辆的副驾驶位；或，第一用户在车辆的后排区。
可选的，在根据第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式时，处理器1402具体用于执行以下操作：确定第一用户的眼睛的位置是否在显示区域的可视角度范围内；在满足第一条件时，将显示区域中第一区域的显示方式调整为第一显示方式。其中，第一条件包括以下至少一项：第一用户的眼睛的位置在显示区域的可视角度范围内；第一用户的视线方向朝向于显示区域；或第一用户的视线停留在显示区域的时间大于或等于预设时间。
可选的，第一显示方式包括以下至少一项：隐藏第一区域；隐藏第一区域中第二用户的隐私信息；淡化第一区域；将第一区域的第一清晰度切换为第二清晰度，并以第二清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第一分辨率切换为第二分辨率，并以第二分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，处理器1402还用于执行以下操作：在满足第二条件时，将显示区域中第一区域的显示方式调整为第二显示方式；其中，第二条件包括以下至少一项：第一用户的眼睛的位置超出显示区域的可视角度范围；第一用户的视线方向朝向显示区域之外的其他区域；第一用户的视线停留在显示区域的时间小于预设时间。
可选的，第二显示方式包括以下至少一项：在第一区域显示第二用户的隐私信息；将第一区域的第二清晰度切换为第一清晰度，并以第一清晰度显示第二用户的隐私信息，第一清晰度高于第二清晰度；或将第一区域的第二分辨率切换为第一分辨率，并以第一分辨率显示第二用户的隐私信息，第一分辨率高于第二分辨率。
可选的，图像信息还用于确定第二用户的眼睛的位置，在确定第一用户的眼睛的位置，是否在显示区域的可视角度范围内时，处理器1402具体用于执行以下操作：确定第二用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的眼睛的位置与第一目标点之间的连线形成的夹角大小，以得到第一角度值；根据第一角度值，确定第一用户的眼睛的位置是否在显示区域的可视角度范围内。
可选的，第一角度值的余弦值
Figure PCTCN2022112309-appb-000018
其中，P hud为第一目标点，P eye为第一用户的眼睛的位置，P′ eye为第二用户的眼睛的位置。
可选的，处理器1402还用于执行以下操作：确定第一用户的眼睛的位置与显示区域上的第一目标点之间的连线，和第一用户的视线方向形成的夹角大小，以得到第二角度值；根据第二角度值，确定第一用户的视线方向是否朝向于显示区域。
可选的，第二角度值的余弦值
Figure PCTCN2022112309-appb-000019
其中，P hud为第一目标点，P eye为第二用户的眼睛的位置，
Figure PCTCN2022112309-appb-000020
为第一用户的视线方向的单位向量。
可选的，第一目标点为显示区域的中心点；或，第一目标点为显示区域的顶点；或，第一目标点为显示区域的侧边的中心点，显示区域的侧边包括显示区域的左侧、右侧、上侧或下侧。
可选的，处理器1402还用于执行以下操作：在满足第三条件时，开启隐私信息保护模式；第三条件包括以下至少一项：检测到第二用户所在车辆内存在除第二用户的其他用户；检测到车辆内存在除预设用户的其他用户；检测到模式设置指令；其中，模式设置指令用于开启隐私信息保护模式。
本申请实施例提供一种电子装置，装置部署在车辆中，该装置包括用于执行如图6所示实施例中任一方法的单元。
本申请实施例提供一种电子装置，该装置包括至少一个处理器和通信接口，至少一个处理器用于调用至少一个存储器中存储的计算机程序，以执行如图6所示实施例中任一方法。
本申请实施例提供一种显示系统，包括车载终端，车载终端用于实现如图6所示实施例中任一项的方法。
本申请实施例提供一种车载终端，车载终端用于实现如图6所示实施例中任一项的方法。
本申请实施例提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机程序，当计算机程序在一个或多个处理器上运行时，实现如图6所示实施例中任一项的方法。
本申请实施例提供一种计算机程序产品，计算机程序产品在一个或多个处理器上运行时，实现如图6所示实施例中任一项的方法。
在计算机上加载和执行该计算机指令时，可以全部或部分地实现本申请实施例所描述的流程或功能。该计算机可以是通用计算机、专用计算机、计算机网络、或其它可编程装置。该计算机指令可以存储在计算机可读存储介质中，或通过计算机可读存储介质进行传输。该计算机可读存储介质可以是计算机能够存取的任何可用介质或是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或半导体介质(例如，固态硬盘(solid state disk，SSD))等。
本申请方法实施例中的步骤可以根据实际需要进行顺序调整、合并和删减。
本申请装置实施例中的模块可以根据实际需要进行合并、划分和删减。
其中，本申请实施例中的术语“系统”和“网络”可被互换使用。除非另有说明，“/”表示前后关联的对象是一种“或”的关系，例如，A/B可以表示A或B；本申请中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况，其中A,B可以是单数或者复数。并且，在本申请的描述中，除非另有说明，“多个”是指两个或多于两个。“以下至少一项(个)”或其类似表达，是指的这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a，b，或c中的至少一项(个)，可以表示：a，b，c，a-b，a-c，b-c，或a-b-c，其中a，b，c可以是一个，也可以是多个。另外，为了便于清楚描述本申请实施例的技术方案，在本申请的实施例中，采用了“第一”、“第二”等字样对功能和作用基本相同的相同项或相似项进行区分。本领域技术人员可以理解“第一”、“第二”等字样并不对数量和执行次序进行限定，并且“第一”、“第二”等字样也并不限定一定不同。
在本申请实施例中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
上述的具体实施方式，对本申请的目的、技术方案和有益效果进行了进一步详细说明，所应理解的是，上述仅为本申请的具体实施方式而已，并不用于限定本申请的保护范围，凡在本申请的技术方案的基础之上，所做的任何修改、等同替换、改进等，均应包括在本申请的保护范围之内。
在本申请的各个实施例中，如果没有特殊说明以及逻辑冲突，不同的实施例之间的术语和/或描述具有一致性、且可以相互引用，不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。

Claims (32)

  1. 一种显示方法，其特征在于，包括：
    获取图像信息，所述图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；
    根据所述第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式；
    其中，所述显示区域为抬头显示器的显示区域，所述第一区域包括所述车辆的第二用户的隐私信息。
  2. 根据权利要求1所述的方法，其特征在于，所述第一用户位于所述车辆的非驾驶位，所述第二用户位于所述车辆的驾驶位。
  3. 根据权利要求2所述的方法，其特征在于，所述第一用户位于所述车辆的非驾驶位，包括：
    所述第一用户位于所述车辆的副驾驶位；或，所述第一用户在所述车辆的后排区域。
  4. 根据权利要求1-3任意一项所述的方法，其特征在于，所述根据所述第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式，包括：
    确定所述第一用户的眼睛的位置是否在所述显示区域的可视角度范围内；
    在满足第一条件时，将所述显示区域中所述第一区域的显示方式调整为第一显示方式；
    其中，所述第一条件包括以下至少一项：
    所述第一用户的眼睛的位置在所述显示区域的可视角度范围内；
    所述第一用户的视线方向朝向于所述显示区域；或
    所述第一用户的视线停留在所述显示区域的时间大于或等于预设时间。
  5. 根据权利要求4所述的方法，其特征在于，所述第一显示方式包括以下至少一项：
    隐藏所述第一区域；
    隐藏所述第一区域中所述第二用户的隐私信息；
    淡化所述第一区域；
    将所述第一区域的第一清晰度切换为第二清晰度，并以所述第二清晰度显示所述第二用户的隐私信息，所述第一清晰度高于所述第二清晰度；或
    将所述第一区域的第一分辨率切换为第二分辨率，并以所述第二分辨率显示所述第二用户的隐私信息，所述第一分辨率高于所述第二分辨率。
  6. 根据权利要求4所述的方法，其特征在于，所述方法还包括：
    在满足第二条件时，将所述显示区域中所述第一区域的显示方式由所述第一显示方式调整为第二显示方式；
    其中，所述第二条件包括以下至少一项：
    所述第一用户的眼睛的位置超出所述显示区域的可视角度范围；
    所述第一用户的视线方向朝向所述显示区域之外的其他区域；
    所述第一用户的视线停留在所述显示区域的时间小于所述预设时间。
  7. 根据权利要求6所述的方法，其特征在于，所述第二显示方式包括以下至少一项：
    在所述第一区域显示所述第二用户的隐私信息；
    将所述第一区域的第二清晰度切换为第一清晰度，并以所述第一清晰度显示所述第二用户的隐私信息，所述第一清晰度高于所述第二清晰度；或
    将所述第一区域的第二分辨率切换为第一分辨率，并以所述第一分辨率显示所述第二用户的隐私信息，所述第一分辨率高于所述第二分辨率。
  8. 根据权利要求4所述的方法，其特征在于，所述图像信息还用于确定所述第二用户的 眼睛的位置，所述确定所述第一用户的眼睛的位置，是否在所述显示区域的可视角度范围内，包括：
    确定所述第二用户的眼睛的位置与所述显示区域上的第一目标点之间的连线，和所述第一用户的眼睛的位置与所述第一目标点之间的连线形成的夹角大小，以得到第一角度值；
    根据所述第一角度值，确定所述第一用户的眼睛的位置是否在所述显示区域的可视角度范围内。
  9. 根据权利要求8所述的方法，其特征在于，所述第一角度值的余弦值
    Figure PCTCN2022112309-appb-100001
    其中，P hud为所述第一目标点，P eye为所述第一用户的眼睛的位置，P′ eye为所述第二用户的眼睛的位置。
  10. 根据权利要求4所述的方法，其特征在于，所述将所述显示区域中所述第一区域的显示方式调整为第一显示方式之前，所述方法还包括：
    确定所述第一用户的眼睛的位置与所述显示区域上的第一目标点之间的连线，和所述第一用户的视线方向形成的夹角大小，以得到第二角度值；
    根据所述第二角度值，确定所述第一用户的视线方向是否朝向于所述显示区域。
  11. 根据权利要求10所述的方法，其特征在于，所述第二角度值的余弦值
    Figure PCTCN2022112309-appb-100002
    Figure PCTCN2022112309-appb-100003
    其中，P hud为所述第一目标点，P eye为所述第二用户的眼睛的位置，
    Figure PCTCN2022112309-appb-100004
    为所述第一用户的视线方向的单位向量。
  12. 根据权利要求8-11任意一项所述的方法，其特征在于，
    所述第一目标点为所述显示区域的中心点；或，
    所述第一目标点为所述显示区域的顶点；或，
    所述第一目标点为所述显示区域的侧边的中心点，所述显示区域的侧边包括所述显示区域的左侧、右侧、上侧或下侧。
  13. 根据权利要求1所述的方法，其特征在于，所述获取图像信息之前，所述方法还包括：
    在满足第三条件时，开启隐私信息保护模式；
    所述第三条件包括以下至少一项：
    检测到所述第二用户所在车辆内存在除所述第二用户的其他用户；
    检测到所述车辆内存在除预设用户的其他用户；
    检测到模式设置指令；
    其中，所述模式设置指令用于开启所述隐私信息保护模式。
  14. 一种显示装置，其特征在于，包括接收单元和处理单元，
    所述接收单元，用于获取图像信息，所述图像信息用于确定车辆的第一用户的眼睛的位置和视线方向；
    所述处理单元，用于根据所述第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式；
    其中，所述显示区域为抬头显示器的显示区域，所述第一区域包括所述车辆的第二用户的隐私信息。
  15. 根据权利要求14所述的装置，其特征在于，所述第一用户位于所述车辆的非驾驶位，所述第二用户位于所述车辆的驾驶位。
  16. 根据权利要求15所述的装置，其特征在于，所述第一用户位于所述车辆的非驾驶位，包括：
    所述第一用户位于所述车辆的副驾驶位；或，所述第一用户在所述车辆的后排区域。
  17. 根据权利要求14-16任意一项所述的装置，其特征在于，在根据所述第一用户的眼睛的位置和视线方向，调整显示区域中第一区域的显示方式时，所述处理单元，用于：
    确定所述第一用户的眼睛的位置是否在所述显示区域的可视角度范围内；
    在满足第一条件时，将所述显示区域中所述第一区域的显示方式调整为第一显示方式；
    其中，所述第一条件包括以下至少一项：
    所述第一用户的眼睛的位置在所述显示区域的可视角度范围内；
    所述第一用户的视线方向朝向于所述显示区域；或
    所述第一用户的视线停留在所述显示区域的时间大于或等于预设时间。
  18. 根据权利要求17所述的装置，其特征在于，所述第一显示方式包括以下至少一项：
    隐藏所述第一区域；
    隐藏所述第一区域中所述第二用户的隐私信息；
    淡化所述第一区域；
    将所述第一区域的第一清晰度切换为第二清晰度，并以所述第二清晰度显示所述第二用户的隐私信息，所述第一清晰度高于所述第二清晰度；或
    将所述第一区域的第一分辨率切换为第二分辨率，并以所述第二分辨率显示所述第二用户的隐私信息，所述第一分辨率高于所述第二分辨率。
  19. 根据权利要求17所述的装置，其特征在于，所述处理单元，还用于在满足第二条件时，将所述显示区域中所述第一区域的显示方式由所述第一显示方式调整为第二显示方式；
    其中，所述第二条件包括以下至少一项：
    所述第一用户的眼睛的位置超出所述显示区域的可视角度范围；
    所述第一用户的视线方向朝向所述显示区域之外的其他区域；
    所述第一用户的视线停留在所述显示区域的时间小于所述预设时间。
  20. 根据权利要求19所述的装置，其特征在于，所述第二显示方式包括以下至少一项：
    在所述第一区域显示所述第二用户的隐私信息；
    将所述第一区域的第二清晰度切换为第一清晰度，并以所述第一清晰度显示所述第二用户的隐私信息，所述第一清晰度高于所述第二清晰度；或
    将所述第一区域的第二分辨率切换为第一分辨率，并以所述第一分辨率显示所述第二用户的隐私信息，所述第一分辨率高于所述第二分辨率。
  21. 根据权利要求17所述的装置，其特征在于，所述图像信息还用于确定所述第二用户的眼睛的位置，在确定所述第一用户的眼睛的位置，是否在所述显示区域的可视角度范围内时，所述处理单元，用于：
    确定所述第二用户的眼睛的位置与所述显示区域上的第一目标点之间的连线，和所述第一用户的眼睛的位置与所述第一目标点之间的连线形成的夹角大小，以得到第一角度值；
    根据所述第一角度值，确定所述第一用户的眼睛的位置是否在所述显示区域的可视角度范围内。
  22. 根据权利要求21所述的装置，其特征在于，所述第一角度值的余弦值
    Figure PCTCN2022112309-appb-100005
    Figure PCTCN2022112309-appb-100006
    其中，P hud为所述第一目标点，P eye为所述第一用户的眼睛的位置，P′ eye为所述第二用户的眼睛的位置。
  23. 根据权利要求17所述的装置，其特征在于，所述处理单元，还用于：
    确定所述第一用户的眼睛的位置与所述显示区域上的第一目标点之间的连线，和所述第一用户的视线方向形成的夹角大小，以得到第二角度值；
    根据所述第二角度值，确定所述第一用户的视线方向是否朝向于所述显示区域。
  24. 根据权利要求23所述的装置，其特征在于，所述第二角度值的余弦值
    Figure PCTCN2022112309-appb-100007
    Figure PCTCN2022112309-appb-100008
    其中，P hud为所述第一目标点，P eye为所述第二用户的眼睛的位置，
    Figure PCTCN2022112309-appb-100009
    为所述第一用户的视线方向的单位向量。
  25. 根据权利要求21-24任意一项所述的装置，其特征在于，
    所述第一目标点为所述显示区域的中心点；或，
    所述第一目标点为所述显示区域的顶点；或，
    所述第一目标点为所述显示区域的侧边的中心点，所述显示区域的侧边包括所述显示区域的左侧、右侧、上侧或下侧。
  26. 根据权利要求14所述的装置，其特征在于，所述处理单元，还用于在满足第三条件时，开启隐私信息保护模式；
    所述第三条件包括以下至少一项：
    检测到所述第二用户所在车辆内存在除所述第二用户的其他用户；
    检测到所述车辆内存在除预设用户的其他用户；
    检测到模式设置指令；
    其中，所述模式设置指令用于开启所述隐私信息保护模式。
  27. 一种电子装置，其特征在于，所述装置部署在车辆中，所述装置包括用于执行如权利要求1-13中任一所述方法的单元。
  28. 一种电子装置，其特征在于，所述装置包括至少一个处理器和通信接口，所述至少一个处理器用于调用至少一个存储器中存储的计算机程序，以执行如权利要求1-13中任一所述方法。
  29. 一种显示系统，其特征在于，包括车载终端，所述车载终端用于实现如权利要求1-13中任一项所述的方法。
  30. 一种车载终端，其特征在于，所述车载终端用于实现如权利要求1-13中任一项所述的方法。
  31. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有计算机程序，当所述计算机程序在一个或多个处理器上运行时，实现如权利要求1-13中任一项所述的方法。
  32. 一种计算机程序产品，其特征在于，所述计算机程序产品在一个或多个处理器上运行时，实现如权利要求1-13中任一项所述的方法。
PCT/CN2022/112309 2022-08-12 2022-08-12 一种显示方法及装置 Ceased WO2024031709A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
PCT/CN2022/112309 WO2024031709A1 (zh) 2022-08-12 2022-08-12 一种显示方法及装置
EP22954660.1A EP4560455A4 (en) 2022-08-12 2022-08-12 DISPLAY METHOD AND DEVICE
CN202280009096.0A CN117882075A (zh) 2022-08-12 2022-08-12 一种显示方法及装置
JP2025507651A JP2025530651A (ja) 2022-08-12 2022-08-12 表示方法及び装置
US19/050,232 US20250182657A1 (en) 2022-08-12 2025-02-11 Display Method and Apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/112309 WO2024031709A1 (zh) 2022-08-12 2022-08-12 一种显示方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/050,232 Continuation US20250182657A1 (en) 2022-08-12 2025-02-11 Display Method and Apparatus

Publications (1)

Publication Number Publication Date
WO2024031709A1 true WO2024031709A1 (zh) 2024-02-15

Family

ID=89850395

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/112309 Ceased WO2024031709A1 (zh) 2022-08-12 2022-08-12 一种显示方法及装置

Country Status (5)

Country Link
US (1) US20250182657A1 (zh)
EP (1) EP4560455A4 (zh)
JP (1) JP2025530651A (zh)
CN (1) CN117882075A (zh)
WO (1) WO2024031709A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240118691A1 (en) * 2022-10-06 2024-04-11 GM Global Technology Operations LLC Augmented reality experience for passenger control of autonomous vehicle
WO2026055569A1 (en) * 2024-09-06 2026-03-12 The Regents Of The University Of Michigan Secure display of content for confidential viewing
CN119225000B (zh) * 2024-11-14 2025-09-26 重庆赛力斯凤凰智创科技有限公司 一种显示屏的显示模式的调节方法和系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105389527A (zh) * 2015-10-27 2016-03-09 努比亚技术有限公司 移动终端的防偷窥装置和方法
US20180203412A1 (en) * 2017-01-16 2018-07-19 International Business Machines Corporation Holographic projections for securing content
CN111737774A (zh) * 2020-06-23 2020-10-02 广东小天才科技有限公司 一种隐私防窥方法和智能设备
CN114056344A (zh) * 2020-08-03 2022-02-18 奥迪股份公司 车内信息显示系统及相应车辆、方法、计算机设备和介质
CN114647319A (zh) * 2022-03-28 2022-06-21 重庆长安汽车股份有限公司 一种用户车内屏幕显示信息流转的方法、系统及存储介质

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8957847B1 (en) * 2010-12-28 2015-02-17 Amazon Technologies, Inc. Low distraction interfaces
JP2016045623A (ja) * 2014-08-21 2016-04-04 ソニー株式会社 情報処理装置および制御方法
US9787812B2 (en) * 2014-08-28 2017-10-10 Honda Motor Co., Ltd. Privacy management
US10366219B2 (en) * 2016-11-16 2019-07-30 Bank Of America Corporation Preventing unauthorized access to secured information using identification techniques
JP2018101311A (ja) * 2016-12-21 2018-06-28 矢崎総業株式会社 車両用表示装置
US10311249B2 (en) * 2017-03-31 2019-06-04 Google Llc Selectively obscuring private information based on contextual information
JP7043845B2 (ja) * 2018-01-17 2022-03-30 トヨタ自動車株式会社 車両用表示連携制御装置
DE102018004401B4 (de) * 2018-05-31 2024-09-26 Sioptica Gmbh Verfahren zur Korrektur von Bilddaten für einen Bildschirm
DE102018128706A1 (de) * 2018-11-15 2020-05-20 Bayerische Motoren Werke Aktiengesellschaft Dynamischer Informationsschutz für Anzeigeeinrichtungen
KR102764266B1 (ko) * 2019-06-17 2025-02-07 현대자동차주식회사 차량용 사용자 인터페이스 시스템 및 방법
JP7532143B2 (ja) * 2020-08-06 2024-08-13 アルプスアルパイン株式会社 表示制御装置および表示制御方法
DE102021120998A1 (de) * 2021-08-12 2023-02-16 Bayerische Motoren Werke Aktiengesellschaft Steuerung einer Anzeige auf einem Display eines Infotainmentsystems eines Fahrzeugs

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105389527A (zh) * 2015-10-27 2016-03-09 努比亚技术有限公司 移动终端的防偷窥装置和方法
US20180203412A1 (en) * 2017-01-16 2018-07-19 International Business Machines Corporation Holographic projections for securing content
CN111737774A (zh) * 2020-06-23 2020-10-02 广东小天才科技有限公司 一种隐私防窥方法和智能设备
CN114056344A (zh) * 2020-08-03 2022-02-18 奥迪股份公司 车内信息显示系统及相应车辆、方法、计算机设备和介质
CN114647319A (zh) * 2022-03-28 2022-06-21 重庆长安汽车股份有限公司 一种用户车内屏幕显示信息流转的方法、系统及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4560455A4 *

Also Published As

Publication number Publication date
EP4560455A4 (en) 2026-01-07
US20250182657A1 (en) 2025-06-05
EP4560455A1 (en) 2025-05-28
JP2025530651A (ja) 2025-09-17
CN117882075A (zh) 2024-04-12

Similar Documents

Publication Publication Date Title
US20250225690A1 (en) Ar display apparatus and ar display method
US20240087491A1 (en) Projection Method and Apparatus, Vehicle, and AR-HUD
CN109923855B (zh) 图像处理装置、图像处理方法和程序
US20250182657A1 (en) Display Method and Apparatus
WO2021197190A1 (zh) 基于增强现实的信息显示方法、系统、装置及投影设备
CN112750206A (zh) 用于车辆乘员的增强现实可穿戴系统
CN113661495A (zh) 视线校准方法及装置、设备、计算机可读存储介质、系统、车辆
JPWO2009144994A1 (ja) 車両用画像処理装置、車両用画像処理方法
CN106338828A (zh) 车载增强现实系统、方法和设备
JP2015092237A (ja) 表示制御装置、表示制御方法、表示制御プログラムおよび投影装置
EP4528356A1 (en) Virtual image display apparatus, method and apparatus for generating image data, and related device
JP6620977B2 (ja) 表示制御装置、投影装置、および表示制御プログラム
CN115665400B (zh) 增强现实抬头显示成像方法、装置、设备以及存储介质
JP2022002117A (ja) Ａｒ表示装置、ａｒ表示方法、およびプログラム
CN115035499A (zh) 用于确定注视区域的方法、车辆控制方法及装置
CN116483302A (zh) 一种投影图像的显示方法、装置及车辆
CN111241946B (zh) 一种基于单dlp光机增大fov的方法和系统
CN116736540A (zh) 一种基于视线追踪的车辆信息显示方法及系统
TWI738239B (zh) 車載顯示方法、設備及車輛
CN115534822A (zh) 控制显示的方法、装置和移动载体
US20260110900A1 (en) Reflective display on the edge of a windshield
WO2025241738A1 (zh) 辅助驾驶方法、画面采集方法、装置、设备、介质及产品
CN115097628A (zh) 一种行车信息显示方法、装置及系统
CN117360391A (zh) 基于ar的数字后视镜系统、车辆及显示方法
JP2024093234A (ja) 表示制御装置、移動体、表示制御方法、及びコンピュータプログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 202280009096.0

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22954660

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2025507651

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2022954660

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022954660

Country of ref document: EP

Effective date: 20250219

NENP Non-entry into the national phase

Ref country code: DE

WWP Wipo information: published in national office

Ref document number: 2022954660

Country of ref document: EP