WO2024253867A4 - Devices, methods, and graphical user interfaces for presenting content - Google Patents

Devices, methods, and graphical user interfaces for presenting content Download PDF

Info

Publication number
WO2024253867A4
WO2024253867A4 PCT/US2024/030858 US2024030858W WO2024253867A4 WO 2024253867 A4 WO2024253867 A4 WO 2024253867A4 US 2024030858 W US2024030858 W US 2024030858W WO 2024253867 A4 WO2024253867 A4 WO 2024253867A4
Authority
WO
WIPO (PCT)
Prior art keywords
media item
displaying
display
display position
dimensional environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2024/030858
Other languages
French (fr)
Other versions
WO2024253867A1 (en
Inventor
Chia Yang Lin
Timothy T. Chong
Danielle M. PRICE
Israel PASTRANA VICENTE
William A. Sorrentino III
Hugo D. Verweij
James J. OWEN
Miquel Estany Rodriguez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US18/615,944 external-priority patent/US20240402870A1/en
Application filed by Apple Inc filed Critical Apple Inc
Priority to EP24734648.9A priority Critical patent/EP4705862A1/en
Priority to CN202480037644.XA priority patent/CN121285790A/en
Publication of WO2024253867A1 publication Critical patent/WO2024253867A1/en
Publication of WO2024253867A4 publication Critical patent/WO2024253867A4/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038Indexing scheme relating to G06F3/038
    • G06F2203/0381Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04804Transparency, e.g. transparent or translucent windows
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04806Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for presenting content.

Claims

AMENDED CLAIMS received by the International Bureau on 06 December 2024 (06.12.2024)
1. A method, comprising: at a computer system that is in communication with one or more display generation components and one or more input devices: displaying, via the one or more display generation components, a first object of a plurality of objects at a first display position; while displaying the first object, detecting, via the one or more input devices, a first user input corresponding to a user request to navigate within the plurality of objects; and in response to detecting the first user input: displaying, via the one or more display generation components, movement of the first object from the first display position to a second display position different from the first display position while reducing a visual prominence of the first object by modifying an opacity of the first object relative to a background over which the first object is displayed, wherein: reducing the visual prominence of the first object includes decreasing an opacity of the first object; the background over which the first object is displayed includes a three-dimensional environment; while the first object is displayed at the first display position, the first object has a first level of opacity relative to the three-dimensional environment; and while the first object is moving from the first display position towards the second display position, the first object has a second level of opacity that is lower than the first level of opacity such that the three-dimensional environment is more visible through the first object than it was when it was displayed at the first display position.
2. The method of claim 1, wherein: the first object is displayed within a display region; the first display position is closer to a center of the display region than the second display position; and the second display position is closer to a first edge of the display region than the first display position.
130
AMENDED SHEET (ARTICLE 19)
3. The method of claim 2, further comprising: in response to detecting the first user input, while displaying movement of the first object from the first display position to the second display position, displaying movement of a second object of the plurality of objects from a third display position different from the first display position to the first display position.
4. The method of claim 3, further comprising: in response to detecting the first user input, while displaying movement of the second object from the third display position to the first display position, increasing a visual prominence of the second object by modifying an opacity of the second object relative to the background over which the first object is displayed.
5. The method of any of claims 1-4, wherein reducing the visual prominence of the first object further includes feathering a first edge of the first object that is furthest from the first display position and closest to the second display position.
6. (Cancelled).
7. (Cancelled).
8. The method of claim 1, wherein the three-dimensional environment is a virtual three- dimensional environment.
9. The method of claim 8, wherein the three-dimensional environment includes a representation of a passthrough environment.
10. The method of any of claims 1-9, wherein reducing the visual prominence of the first object further includes reducing a size of the first object.
11. The method of any of claims 1-10, wherein reducing the visual prominence of the first object further includes moving the first object relative to the viewpoint of the user.
12. The method of any of claims 1-11, wherein: displaying the first object at the first display position comprises displaying the first
131
AMENDED SHEET (ARTICLE 19) object at the first display position with a first set of visual characteristics; and the method further comprises: displaying the first object at the second display position with a second set of visual characteristics different from the first set of visual characteristics; while displaying the first object at the second display position with the second set of visual characteristics, detecting, via the one or more input devices, a second user input; and in response to detecting the second user input: displaying, via the one or more display generation components, a collection user interface that includes the first object and a plurality of other objects, wherein the first object is displayed within the collection user interface with the first set of visual characteristics.
13. The method of any of claims 1-12, wherein: the first user input includes: a first input portion that includes movement in a first input direction; a second input portion that includes movement in a second input direction different from the first input direction; and a third input portion that includes movement in the first input direction; and displaying movement of the first object from the first display position to the second display position includes: in response to detecting the first input portion that includes movement in the first input direction, displaying movement of the first object away from the first display position and toward the second display position; in response to detecting the second input portion that includes movement in the second input direction, displaying movement of the first object toward the first display position and away from the second display position; and in response to detecting the third input portion that includes movement in the first input direction, displaying movement of the first object away from the first display position and toward the second display position.
14. The method of any of claims 1-13, further comprising: while displaying the first object at the first display position, displaying, via the one or more display generation components, a first set of controls; and
132
AMENDED SHEET (ARTICLE 19) while displaying movement of the first object from the display position to the second display position, fading out at least a portion of the first set of controls.
15. The method of any of claims 1-14, further comprising: while displaying the first object at the first display position, displaying, via the one or more display generation components, a scrubber that includes representations of a first plurality of objects arranged in a first order, including a representation of the first object, wherein, while the first object is displayed at the first display position, the representation of the first object is displayed at a first scrubber position along the scrubber; while displaying movement of the first object from the first display position to the second display position, displaying, via the one or more display generation components, a change in appearance of the scrubber including displaying an indication in the scrubber that the second object is currently selected instead of the first object.
16. The method of claim 15, further comprising: while displaying the first object at the first display position, detecting, via the one or more input devices, a scrubber interaction user input corresponding to a user request to scroll the scrubber; and in response to detecting the scrubber interaction user input, navigating through the objects in accordance with the input.
17. The method of any of claims 15-16, wherein a first edge of the scrubber is visually deemphasized.
18. The method of any of claims 1-17, further comprising: in response to detecting the first user input, outputting first non-visual feedback in conjunction with moving one or more of the objects.
19. The method of claim 18, wherein: displaying the first object at the first display position comprises displaying the first object at the first display position at a first size; and the method further comprises: displaying the first object concurrently with a second plurality of objects within a collection user interface, wherein the first object has a second size, smaller than the
133
AMENDED SHEET (ARTICLE 19) first size, in the collection user interface, including displaying the first object at a first position within the collection user interface; while displaying the first object at the first position within the collection user interface, detecting, via the one or more input devices, a second user input corresponding to a user request to navigate the collection user interface; and in response to detecting the second user input, displaying movement of the first object within the collection user interface from the first position within the collection user interface to a second position within the collection user interface, without outputting the first non-visual feedback in conjunction with moving one or more of the objects.
20. The method of claim 18, wherein displaying the first object at the first display position comprises displaying the first object at the first display position at a first size; and the method further comprises: displaying the first object concurrently with a second plurality of objects within a collection user interface, wherein the first object has a second size, smaller than the first size, in the collection user interface, including displaying the first object a first position within the collection user interface; while displaying the first object at the first position within the collection user interface, detecting, via the one or more input devices, a second user input corresponding to a user request to navigate the collection user interface; and in response to detecting the second user input: displaying movement of the first object within the collection user interface from the first position within the collection user interface to a second position within the collection user interface, without outputting the first non-visual feedback in conjunction with moving one or more of the objects; and outputting second non-visual feedback different from the first non- visual feedback in conjunction with moving one or more of the objects.
21. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for performing the method of any of claims 1-20.
134
AMENDED SHEET (ARTICLE 19)
22. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 1-20.
23. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: means for performing the method of any of claims 1-20.
24. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for performing the method of any of claims 1-20.
25. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for: displaying, via the one or more display generation components, a first object of a plurality of objects at a first display position; while displaying the first object, detecting, via the one or more input devices, a first user input corresponding to a user request to navigate within the plurality of objects; and in response to detecting the first user input: displaying, via the one or more display generation components, movement of the first object from the first display position to a second display position different from the first display position while reducing a visual prominence of the first object by modifying an opacity of the first object relative to a background over which the first object is displayed, wherein: reducing the visual prominence of the first object includes decreasing an opacity of the first object; the background over which the first object is displayed includes a three-dimensional environment;
135
AMENDED SHEET (ARTICLE 19) while the first object is displayed at the first display position, the first object has a first level of opacity relative to the three-dimensional environment; and while the first object is moving from the first display position towards the second display position, the first object has a second level of opacity that is lower than the first level of opacity such that the three-dimensional environment is more visible through the first object than it was when it was displayed at the first display position.
26. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the one or more display generation components, a first object of a plurality of objects at a first display position; while displaying the first object, detecting, via the one or more input devices, a first user input corresponding to a user request to navigate within the plurality of objects; and in response to detecting the first user input: displaying, via the one or more display generation components, movement of the first object from the first display position to a second display position different from the first display position while reducing a visual prominence of the first object by modifying an opacity of the first object relative to a background over which the first object is displayed, wherein: reducing the visual prominence of the first object includes decreasing an opacity of the first object; the background over which the first object is displayed includes a three-dimensional environment; while the first object is displayed at the first display position, the first object has a first level of opacity relative to the three-dimensional environment; and while the first object is moving from the first display position towards the second display position, the first object has a second level of opacity that is lower than the first level of opacity such that the three-dimensional environment is more visible through the first object than it was when it was displayed at the first display position.
27. A computer system configured to communicate with one or more display generation
136
AMENDED SHEET (ARTICLE 19) components and one or more input devices, the computer system comprising: means for displaying, via the one or more display generation components, a first object of a plurality of objects at a first display position; means for, while displaying the first object, detecting, via the one or more input devices, a first user input corresponding to a user request to navigate within the plurality of objects; and means for, in response to detecting the first user input: displaying, via the one or more display generation components, movement of the first object from the first display position to a second display position different from the first display position while reducing a visual prominence of the first object by modifying an opacity of the first object relative to a background over which the first object is displayed, wherein: reducing the visual prominence of the first object includes decreasing an opacity of the first object; the background over which the first object is displayed includes a three-dimensional environment; while the first object is displayed at the first display position, the first object has a first level of opacity relative to the three-dimensional environment; and while the first object is moving from the first display position towards the second display position, the first object has a second level of opacity that is lower than the first level of opacity such that the three-dimensional environment is more visible through the first object than it was when it was displayed at the first display position.
28. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication one or more display generation components and one or more input devices, the one or more programs including instructions for: displaying, via the one or more display generation components, a first object of a plurality of objects at a first display position; while displaying the first object, detecting, via the one or more input devices, a first user input corresponding to a user request to navigate within the plurality of objects; and in response to detecting the first user input: displaying, via the one or more display generation components, movement of the first object from the first display position to a second display position different from the
137
AMENDED SHEET (ARTICLE 19) first display position while reducing a visual prominence of the first object by modifying an opacity of the first object relative to a background over which the first object is displayed, wherein: reducing the visual prominence of the first object includes decreasing an opacity of the first object; the background over which the first object is displayed includes a three-dimensional environment; while the first object is displayed at the first display position, the first object has a first level of opacity relative to the three-dimensional environment; and while the first object is moving from the first display position towards the second display position, the first object has a second level of opacity that is lower than the first level of opacity such that the three-dimensional environment is more visible through the first object than it was when it was displayed at the first display position.
29. A method, comprising: at a computer system that is in communication with one or more display generation components and one or more input devices: receiving, via the one or more input devices, a sequence of one or more inputs corresponding to a request to change a display state of a first media item relative to a three- dimensional environment; and in response to receiving the sequence of one or more inputs, displaying, via the one or more display generation components, a first media item, in a respective display state in the three-dimensional environment, including: in accordance with a determination that a camera that captured the first media item had a first field of view with a first value for a respective size parameter when capturing the first media item, displaying the first media item at a first size in the three- dimensional environment; and in accordance with a determination that a camera that captured the first media item had a second field of view with a second value for the respective size parameter different from the first value for the respective size parameter when capturing the first media item, displaying the first media item at a second size in the three-dimensional environment, wherein the second size is different from the first size.
30. The method of claim 29, wherein:
138
AMENDED SHEET (ARTICLE 19) the first field of view with the first value for the respective size parameter is a narrower field of view than the second field of view with the second value for the respective size parameter; and the first size is smaller than the second size.
31. The method of claim 29, wherein: the first field of view with the first value for the respective size parameter is a wider field of view than the second field of view with the second value for the respective size parameter; and the first size is larger than the second size.
32. The method of any of claims 29-31, wherein: displaying the first media item at the first size in the three-dimensional environment includes displaying the first media item in the respective display state in the three- dimensional environment at a first distance from a viewpoint of a user of the computer system; and the first size is determined based on the first value for the respective size parameter and the first distance.
33. The method of any of claims 29-32, wherein: displaying the first media item in the respective display state in the three-dimensional environment comprises displaying the first media item in the respective display state in the three-dimensional environment at a first distance from a viewpoint of a user of the computer system.
34. The method of claim 33, wherein the first distance is selected to be greater than a threshold distance.
35. The method of any of claims 29-34, wherein displaying the first media item in the respective display state in the three-dimensional environment includes displaying the first media item as though it is being projected onto a simulated curved surface.
36. The method of claim 35, wherein the first media item curves based on a curvature of the simulated curved surface and a length of the first media item.
139
AMENDED SHEET (ARTICLE 19)
37. The method of any of claims 29-36, wherein the first media item is a panoramic image.
38. The method of any of claims 29-37, wherein the first media item is a landscape photograph.
39. The method of any of claims 29-38, wherein the three-dimensional environment is part of an extended reality environment.
40. The method of any of claims 29-39, wherein: while receiving the sequence of one or more user inputs corresponding to the request to change the display state of the first media item relative to the three-dimensional environment, the three-dimensional environment is displayed with a first set of visual characteristics; and the method further comprises: in response to receiving the sequence of one or more inputs, reducing a visual prominence of the three-dimensional environment in which the first media item is displayed by modifying at least some visual characteristics of the first set of visual characteristics.
41. The method of claim 40, wherein reducing the visual prominence of the three- dimensional environment comprises: for a first region of the three-dimensional environment that immediately surrounds the first media item, modifying at least some visual characteristics of the first set of visual characteristics by a first amount; and for a second region of the three-dimensional environment that is different from the first region, modifying at least some visual characteristics of the first set of visual characteristics by a second amount different from the first amount, wherein the first amount is greater than the second amount.
42. The method of any of claims 29-41, wherein displaying the first media item in the respective display state in the three-dimensional environment comprises displaying a first visual effect that extends from an edge of the first media item outside of the first media item.
140
AMENDED SHEET (ARTICLE 19)
43. The method of any of claims 29-42, further comprising: receiving, via one or more input devices, a second sequence of one or more inputs corresponding to a request to change a display state of a respective media item relative to the three-dimensional environment; and in response to receiving the second sequence of one or more inputs: in accordance with a determination that the respective media item is a media item of a first type, displaying, via the one or more display generation components, the respective media item in a first display state in the three-dimensional environment; and in accordance with a determination that the respective media item is a media item of a second type different from the first type, displaying, via the one or more display generation components, the respective media item in a second display state in the three- dimensional environment, wherein the second display state is different from the first display state.
44. The method of claim 43, wherein: the first type of media item is panoramic media item; and the second type of media item is a non-panoramic media item.
45. The method of claim 43, wherein: the first type of media item is a spatial media item; and the second type of media item is a panoramic media item.
46. The method of any of claims 29-45, further comprising: prior to displaying the first media item in the respective display state in the three- dimensional environment, displaying, via the one or more display generation components, the first media item in a collection display state different from the respective display state, wherein: in the respective display state, the first media item is displayed at a first distance from a viewpoint of a user of the computer system; and in the collection display state, the first media item is displayed at a second distance from the viewpoint of the user of the computer system, wherein the second distance is closer to the viewpoint of the user of the computer system than the first distance.
47. The method of claim 46, wherein, in the collection display state, the first media item
141
AMENDED SHEET (ARTICLE 19) is displayed at a third size in the three-dimensional environment, and the third size is independent of a field of view of a camera that captured the first media item.
48. The method of any of claims 46-47, further comprising: while displaying the first media item in the collection display state, receiving, via the one or more input devices, a first navigation input that includes movement in a first direction; and in response to receiving the first navigation input, navigating from the first media item to a second media item, wherein: the first media item is a first type of media item; and the second media item is a second type of media item different from the first type of media item.
49. The method of any of claims 46-48, further comprising: while displaying the first media item in the collection display state, receiving, via the one or more input devices, a first selection input; and in response to receiving the selection input, expanding the first media item.
50. The method of any of claims 29-49, further comprising: receiving, via the one or more input devices, a third sequence of one or more inputs corresponding to a request to change a display state of a first respective media item relative to the three-dimensional environment; and in response to receiving the third sequence of one or more inputs, displaying, via the one or more display generation components, the first respective media item in the respective display state in the three-dimensional environment, including displaying the first respective media item at a first respective size, wherein: the first respective media item was captured by a first camera that had a first respective field of view with a first respective value for a first respective size parameter when the first respective media item was captured; the first respective media item was cropped by a first crop amount after being captured by the first camera; and the first respective size is determined based on the first respective value and the first crop amount.
142
AMENDED SHEET (ARTICLE 19)
51. The method of any of claims 29-50, further comprising: in response to receiving the sequence of one or more inputs, outputting first nonvisual feedback in conjunction with displaying the first media item, in the respective display state in the three-dimensional environment; and while displaying the first media item in the respective display state in the three- dimensional environment, receiving, via the one or more input devices, a subsequent sequence of one or more inputs corresponding to a request to change the display state of the first media item from the respective display state to a second respective display state different from the respective display state; and in response to receiving the subsequent sequence of one or more inputs: displaying the first media item in the second respective display state; and outputting second non-visual feedback different from the first non-visual feedback in conjunction with displaying the first media item in the second respective display state.
52. The method of any of claims 29-51, further comprising: displaying, via the one or more display generation components, a representation of the first media item in a first media collection user interface; while displaying the representation of the first media item in the first media collection user interface, receiving, via the one or more input devices, a first user input corresponding to a user request to display the first media item in a first expanded view; in response to receiving the first user input: displaying, via the one or more display generation components, the first media item in a first expanded view that is different from the first media collection user interface; and outputting third non-visual feedback in conjunction with displaying the first media item in the first expanded view; while displaying the first media item in the first expanded view, receiving, via the one or more input devices, a second user input corresponding to a user request to display the first media item in the respective display state in the three-dimensional environment; and in response to receiving the second user input: displaying, via the one or more display generation components, the first media item in the respective display state in the three-dimensional environment; and outputting fourth non-visual feedback that is different from the third non-
143
AMENDED SHEET (ARTICLE 19) visual feedback in conjunction with displaying the first media item in the respective display state.
53. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for performing the method of any of claims 29-52.
54. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 29-52.
55. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: means for performing the method of any of claims 29-52.
56. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and one or more display generation components, the one or more programs including instructions for performing the method of any of claims 29-52.
57. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for: receiving, via the one or more input devices, a sequence of one or more inputs corresponding to a request to change a display state of a first media item relative to a three- dimensional environment; and in response to receiving the sequence of one or more inputs, displaying, via the one or more display generation components, a first media item, in a respective display state in the
144
AMENDED SHEET (ARTICLE 19) three-dimensional environment, including: in accordance with a determination that a camera that captured the first media item had a first field of view with a first value for a respective size parameter when capturing the first media item, displaying the first media item at a first size in the three-dimensional environment; and in accordance with a determination that a camera that captured the first media item had a second field of view with a second value for the respective size parameter different from the first value for the respective size parameter when capturing the first media item, displaying the first media item at a second size in the three-dimensional environment, wherein the second size is different from the first size.
58. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: receiving, via the one or more input devices, a sequence of one or more inputs corresponding to a request to change a display state of a first media item relative to a three- dimensional environment; and in response to receiving the sequence of one or more inputs, displaying, via the one or more display generation components, a first media item, in a respective display state in the three-dimensional environment, including: in accordance with a determination that a camera that captured the first media item had a first field of view with a first value for a respective size parameter when capturing the first media item, displaying the first media item at a first size in the three- dimensional environment; and in accordance with a determination that a camera that captured the first media item had a second field of view with a second value for the respective size parameter different from the first value for the respective size parameter when capturing the first media item, displaying the first media item at a second size in the three-dimensional environment, wherein the second size is different from the first size.
59. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising:
145
AMENDED SHEET (ARTICLE 19) means for receiving, via the one or more input devices, a sequence of one or more inputs corresponding to a request to change a display state of a first media item relative to a three-dimensional environment; and means for, in response to receiving the sequence of one or more inputs, displaying, via the one or more display generation components, a first media item, in a respective display state in the three-dimensional environment, including: in accordance with a determination that a camera that captured the first media item had a first field of view with a first value for a respective size parameter when capturing the first media item, displaying the first media item at a first size in the three-dimensional environment; and in accordance with a determination that a camera that captured the first media item had a second field of view with a second value for the respective size parameter different from the first value for the respective size parameter when capturing the first media item, displaying the first media item at a second size in the three-dimensional environment, wherein the second size is different from the first size.
60. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for: receiving, via the one or more input devices, a sequence of one or more inputs corresponding to a request to change a display state of a first media item relative to a three- dimensional environment; and in response to receiving the sequence of one or more inputs, displaying, via the one or more display generation components, a first media item, in a respective display state in the three-dimensional environment, including: in accordance with a determination that a camera that captured the first media item had a first field of view with a first value for a respective size parameter when capturing the first media item, displaying the first media item at a first size in the three-dimensional environment; and in accordance with a determination that a camera that captured the first media item had a second field of view with a second value for the respective size parameter different from the first value for the respective size parameter when capturing the first media item, displaying the first media item at a second size in the three-dimensional environment,
146
AMENDED SHEET (ARTICLE 19) wherein the second size is different from the first size.
147
AMENDED SHEET (ARTICLE 19)
PCT/US2024/030858 2023-06-04 2024-05-23 Devices, methods, and graphical user interfaces for presenting content Ceased WO2024253867A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP24734648.9A EP4705862A1 (en) 2023-06-04 2024-05-23 Devices, methods, and graphical user interfaces for presenting content
CN202480037644.XA CN121285790A (en) 2023-06-04 2024-05-23 Apparatus, method and graphical user interface for presenting content

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202363470927P 2023-06-04 2023-06-04
US63/470,927 2023-06-04
US18/615,944 US20240402870A1 (en) 2023-06-04 2024-03-25 Devices, methods, and graphical user interfaces for presenting content
US18/615,944 2024-03-25

Publications (2)

Publication Number Publication Date
WO2024253867A1 WO2024253867A1 (en) 2024-12-12
WO2024253867A4 true WO2024253867A4 (en) 2025-01-23

Family

ID=91586048

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2024/030858 Ceased WO2024253867A1 (en) 2023-06-04 2024-05-23 Devices, methods, and graphical user interfaces for presenting content

Country Status (1)

Country Link
WO (1) WO2024253867A1 (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DK201670609A1 (en) * 2016-06-12 2018-01-02 Apple Inc User interfaces for retrieving contextually relevant media content
US20180157381A1 (en) * 2016-12-02 2018-06-07 Facebook, Inc. Systems and methods for media item selection within a grid-based content feed
US10290152B2 (en) * 2017-04-03 2019-05-14 Microsoft Technology Licensing, Llc Virtual object user interface display
EP3928228B1 (en) * 2019-03-24 2024-09-11 Apple Inc. User interfaces for a media browsing application
CN111314770B (en) * 2020-03-06 2022-03-04 网易(杭州)网络有限公司 In-game list display method and device and terminal equipment
WO2022147146A1 (en) * 2021-01-04 2022-07-07 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Also Published As

Publication number Publication date
WO2024253867A1 (en) 2024-12-12

Similar Documents

Publication Publication Date Title
US11972530B2 (en) Rendering virtual objects in 3D environments
JP4500632B2 (en) Virtual reality presentation apparatus and information processing method
JP6611501B2 (en) Information processing apparatus, virtual object operation method, computer program, and storage medium
EP3311249B1 (en) Three-dimensional user input
CN116719413A (en) Methods for manipulating objects in the environment
JP6057396B2 (en) 3D user interface device and 3D operation processing method
KR101171660B1 (en) Pointing device of augmented reality
JP7026825B2 (en) Image processing methods and devices, electronic devices and storage media
JP2008129775A (en) Display control device, display device, and display control method
WO2014016987A1 (en) Three-dimensional user-interface device, and three-dimensional operation method
US20160334884A1 (en) Remote Sensitivity Adjustment in an Interactive Display System
US12412354B2 (en) Information processing apparatus, information processing method, and non-transitory computer readable medium
JP6739847B2 (en) Image display control device and image display control program
WO2025256318A1 (en) Auxiliary image display method and apparatus for working machine, medium, and electronic device
JP2021135776A (en) Information processing equipment, information processing methods, and programs
WO2024253867A4 (en) Devices, methods, and graphical user interfaces for presenting content
JP7513262B2 (en) Terminal device, virtual object operation method, and virtual object operation program
CN111352510B (en) Virtual model creation method, system and device and head-mounted equipment
JP2025028130A (en) DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND PROGRAM
WO2020235539A1 (en) Method and device for specifying position and posture of object
JP2024163628A (en) Information Processing System
JP6373546B2 (en) Information processing apparatus, information processing method, and program
JP4828395B2 (en) 3D map display device
JP7608510B2 (en) DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND PROGRAM
JP2025015093A (en) Information processing device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24734648

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024734648

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

ENP Entry into the national phase

Ref document number: 2024734648

Country of ref document: EP

Effective date: 20251202

WWP Wipo information: published in national office

Ref document number: 2024734648

Country of ref document: EP