Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
USER INTERFACES THAT INCLUDE REPRESENTATIONS OF THE ENVIRONMENT
Document Type and Number:
WIPO Patent Application WO/2024/064180
Kind Code:
A4
Abstract:
In some embodiments, the present disclosure includes techniques and user interfaces for interacting with virtual objects in an extended reality environment. In some embodiments, the techniques and user interfaces are for interacting with virtual objects in an extended reality environment, including repositioning virtual objects relative to the environment. In some embodiments, the techniques and user interfaces are for interacting with virtual objects, in an extended reality environment, including virtual objects that aid a user in navigating within the environment. In some embodiments, the techniques and user interfaces are for interacting with virtual objects, including objects displayed based on changes in a field-of-view of a user, in an extended reality environment, including repositioning virtual objects relative to the environment. In some embodiments, the techniques and user interfaces are for interacting with virtual objects in an extended reality environment, including virtual objects that provide a different perspective on the environment.

Inventors:
NIE YIQIANG (US)
AGNOLI GIOVANNI M (US)
CHALMERS DEVIN W (US)
DRYER ALLISON W (US)
SALTER THOMAS G (US)
YERKES GIANCARLO (US)
YOKOKAWA YUTAKA (US)
Application Number:
PCT/US2023/033208
Publication Date:
May 10, 2024
Filing Date:
September 20, 2023
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
APPLE INC (US)
International Classes:
G06F3/01; G06F3/0346; G06F3/0481
Attorney, Agent or Firm:
HO, Brian B. (US)
Download PDF:
Claims:
AMENDED CLAIMS received by the International Bureau on 18 Mar. 2024 (18.03.2024)

1. A method comprising : at a computer system that is in communication with a display generation component: while a field-of-view of a user is a first field-of-view, displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object is displayed in a first display mode that includes being environment-locked; while displaying the first virtual object, detecting a change in the field-of-view of the user from the first field-of-view to a second field-of-view; and in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of-view: in accordance with a determination that a first set of criteria are met, wherein the first set of criteria includes a criterion that is met when, while the field-of-view of the user is the second field-of-view and while the first virtual object remains environment- locked, a threshold amount of the first virtual object would remain within the field-of-view of the user, continuing to display the first virtual object in the first display mode that includes being environment-locked; and in accordance with a determination that the first set of criteria are not met, displaying the first virtual object in a second display mode that includes repositioning the first virtual object relative to the three-dimensional environment based on changes of the field-of-view of the user.

2. The method of claim 1, wherein displaying the first virtual object in the second display mode includes changing a visual appearance of the first virtual object from a first visual appearance that the first virtual object is displayed with while in the first display mode to a second visual appearance that is different from the first visual appearance.

3. The method of claim 2, wherein the first virtual object has a first level of opacity when displayed with the first visual appearance and a second level of opacity that is different from the first level of opacity when displayed with the second visual appearance.

4. The method of any one of claims 2-3, wherein the first virtual object has a first type of drop shadow when displayed with the first visual appearance and a second type of drop

121

AMENDED SHEET (ARTICLE 19) shadow that is different from the first type of drop shadow when displayed with the second visual appearance.

5. The method of any one of claims 1-4, further comprising: while the first virtual object is being displayed in the second display mode, detecting that a level of stability of the field-of-view of the user satisfies a set of stability criteria; and in response to detecting that the level of stability of the field-of-view of the user satisfied the set of stability criteria, displaying the first virtual object in the first display mode.

6. The method of claim 5, wherein the level of stability of the field of view-of-the user is based on a determination of a level of stability of a head of the user of the computer system.

7. The method of any one of claims 5-6, further comprising: while the first virtual object is being displayed in the second display mode, displaying a first indication that the first virtual object can be transitioned to being displayed in the first display mode that includes being environment-locked.

8. The method of claim 7, wherein the first indication includes a second version of the first virtual object, wherein the second version of the first virtual object has a dimmer appearance than the first virtual object.

9. The method of any one of claims 7-8, wherein the first indication includes an outline of at least a portion of the first virtual object.

10. The method of any one of claims 1-9, further comprising: while the first virtual object is being displayed in the second display mode: detecting a change in the field-of-view of the user from a third field-of-view to a fourth field-of-view that occurs at a first speed and in a first direction; and in response to detecting the change in the field-of-view of the user from the third field-of-view to the fourth field-of-view, shifting a position at which the first virtual object is displayed in the field-of-view of the user in a second direction that is based on the first direction and at a second speed that is different than the first speed.

11. The method of any one of claims 1-10, wherein: continuing to display the first virtual object in the first display mode that includes being environment-locked in response to detecting the change in the field-of-view of the user

122

AMENDED SHEET (ARTICLE 19) from the first field-of-view to the second field-of-view includes ceasing to display a first subportion of the first virtual object while continuing to display a second sub-portion of the first virtual object.

12. The method of claim 11, further comprising: while displaying the second sub-portion of the first virtual object without displaying the first sub-portion of the first virtual object, detecting a change in the field-of-view of the user from the second field-of-view to a fifth field-of-view; and in response to detecting the change in the field-of-view of the user from the second field-of-view to the fifth field-of-view: in accordance with a determination that the first set of criteria are not met, displaying the first virtual object in the second display mode, including displaying the first sub-portion of the first virtual object.

13. The method of any one of claims 1-12, wherein: the first virtual object is displayed concurrently with a plurality of virtual objects that includes a second virtual object and a third virtual object; and the first virtual object, the second virtual object, and the third virtual object have a predetermined spatial relationship with respect to each other that is maintained as the first virtual object, the second virtual object, and third virtual object continue to be displayed within the field-of-view of the user.

14. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for performing the method of any of claims 1-13.

15. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 1-13.

123

AMENDED SHEET (ARTICLE 19)

16. A computer system configured to communicate with a display generation component, the computer system comprising: means for performing the method of any of claims 1-13.

17. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for performing the method of any of claims 1-13.

18. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: while a field-of-view of a user is a first field-of-view, displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object is displayed in a first display mode that includes being environment- locked; while displaying the first virtual object, detecting a change in the field-of-view of the user from the first field-of-view to a second field-of-view; and in response to detecting the change in the field-of-view of the user from the first field- of-view to the second field-of-view: in accordance with a determination that a first set of criteria are met, wherein the first set of criteria includes a criterion that is met when, while the field-of-view of the user is the second field-of-view and while the first virtual object remains environment-locked, a threshold amount of the first virtual object would remain within the field-of-view of the user, continuing to display the first virtual object in the first display mode that includes being environment-locked; and in accordance with a determination that the first set of criteria are not met, displaying the first virtual object in a second display mode that includes repositioning the first virtual object relative to the three-dimensional environment based on changes of the field-of- view of the user.

19. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and

124

AMENDED SHEET (ARTICLE 19) memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while a field-of-view of a user is a first field-of-view, displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object is displayed in a first display mode that includes being environment-locked; while displaying the first virtual object, detecting a change in the field-of-view of the user from the first field-of-view to a second field-of-view; and in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of-view: in accordance with a determination that a first set of criteria are met, wherein the first set of criteria includes a criterion that is met when, while the field-of-view of the user is the second field-of-view and while the first virtual object remains environment- locked, a threshold amount of the first virtual object would remain within the field-of-view of the user, continuing to display the first virtual object in the first display mode that includes being environment-locked; and in accordance with a determination that the first set of criteria are not met, displaying the first virtual object in a second display mode that includes repositioning the first virtual object relative to the three-dimensional environment based on changes of the field-of-view of the user.

20. A computer system configured to communicate with a display generation component, the computer system comprising: means, while a field-of-view of a user is a first field-of-view, for displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object is displayed in a first display mode that includes being environment-locked; means, while displaying the first virtual object, for detecting a change in the field-of- view of the user from the first field-of-view to a second field-of-view; and means, in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of-view, for: in accordance with a determination that a first set of criteria are met, wherein the first set of criteria includes a criterion that is met when, while the field-of-view of the user is the second field-of-view and while the first virtual object remains environment-locked, a

125

AMENDED SHEET (ARTICLE 19) threshold amount of the first virtual object would remain within the field-of-view of the user, continuing to display the first virtual object in the first display mode that includes being environment-locked; and in accordance with a determination that the first set of criteria are not met, displaying the first virtual object in a second display mode that includes repositioning the first virtual object relative to the three-dimensional environment based on changes of the field-of- view of the user.

21. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: while a field-of-view of a user is a first field-of-view, displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object is displayed in a first display mode that includes being environment- locked; while displaying the first virtual object, detecting a change in the field-of-view of the user from the first field-of-view to a second field-of-view; and in response to detecting the change in the field-of-view of the user from the first field- of-view to the second field-of-view: in accordance with a determination that a first set of criteria are met, wherein the first set of criteria includes a criterion that is met when, while the field-of-view of the user is the second field-of-view and while the first virtual object remains environment-locked, a threshold amount of the first virtual object would remain within the field-of-view of the user, continuing to display the first virtual object in the first display mode that includes being environment-locked; and in accordance with a determination that the first set of criteria are not met, displaying the first virtual object in a second display mode that includes repositioning the first virtual object relative to the three-dimensional environment based on changes of the field-of- view of the user.

22. A method comprising: at a computer system that is in communication with a display generation component: displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object indicates a first element of a

126

AMENDED SHEET (ARTICLE 19) route to a destination and wherein the first virtual object corresponds to a first location in the three-dimensional environment, wherein displaying the first virtual object includes: in accordance with a determination that the first location is a location that is within a field-of-view of a user, displaying the first virtual object as an environment- locked object; and in accordance with a determination that the first location is a location that is not within the field-of-view of the user, displaying the first virtual object as a viewpoint-locked object.

23. The method of claim 22, further comprising: while displaying the first virtual object: detecting a change in the field-of-view of the user from a first field-of-view to a second field-of-view that is different from the first field-of-view; and in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of-view: in accordance with a determination that the first virtual object is currently an environment-locked object, shifting the displayed position of the first virtual object so that the first virtual object maintains a substantially fixed position with respect to a first portion of the three-dimensional environment and/or first object in the three-dimensional environment; and in accordance with a determination that the first virtual object is currently a viewpoint-locked object, maintaining the displayed position of the first virtual object within the field-of-view of the user.

24. The method of any one of claims 22-23, further comprising: detecting a first change in a distance between the computer system and the first location in the three-dimensional environment; and in response to detecting the first change in the distance between the computer system and the first location in the three-dimensional environment: in accordance with a determination that a first set of one or more criteria are met, wherein the first set of one or more criteria includes a first criterion that is met when a determination is made that the first change in the distance between the computer system and the first location in the three-dimensional environment reduced the distance between the computer system and the first location in the three-dimensional environment and wherein the

127

AMENDED SHEET (ARTICLE 19) first set of one or more criteria includes a second criterion that is met when the first location is a location that is currently within the field-of-view of a user, modifying a visual appearance of the first virtual object from a first visual appearance to a second visual appearance different from the first visual appearance; and in accordance with a determination that the first set of one or more criteria are not met, forgoing modifying the visual appearance of the first virtual object from the first visual appearance to the second visual appearance.

25. The method of claim 24, wherein modifying the visual appearance of the first virtual object from the first visual appearance to the second visual appearance includes modifying a size of the first virtual object from a first size to a second size.

26. The method of any one of claims 24-25, wherein modifying the visual appearance of the first virtual object from the first visual appearance to the second visual appearance includes changing a visual characteristic of the first virtual object from a first value to a second value.

27. The method of any one of claims 24-26, wherein modifying the visual appearance of the first virtual object from the first visual appearance to the second visual appearance includes modifying text content of the first virtual object.

28. The method of any one of claims 24-27, wherein the first change in the distance between the computer system and the first location in the three-dimensional environment decreased the distance between the computer system and the first location in the three- dimensional environment and wherein the first virtual object had the first visual appearance when the first change in the distance between the computer system and the first location in the three-dimensional environment was detected, the method further comprising: in response to detecting the first change in the distance between the computer system and the first location in the three-dimensional environment and in accordance with a determination that the first location is a location that is not within the field-of-view of the user, maintaining the first visual appearance of the first virtual object.

128

AMENDED SHEET (ARTICLE 19)

29. The method of any one of claims 22-28, further comprising: displaying, via the display generation component and concurrently with displaying the first virtual object, a map virtual object that depicts at least a portion of the route to the destination.

30. The method of claim 29, wherein the map virtual object is a viewpoint-locked object.

31. The method of any one of claims 29-30, wherein the map virtual object includes a location virtual object that corresponds to the first location, the method further comprising: detecting a first input corresponding to the location virtual object; and in response to detecting the first input, displaying, via the display generation component, a second virtual object that includes information about the first location.

32. The method of claim 31, wherein the first location is within the field-of-view of the user and the second virtual object is initially environment-locked to the first location, the method further comprising: while displaying the second virtual object is environment-locked to the first location, detecting a change in the field-of-view of the user from a first field-of-view to a second field- of-view; and in response to detecting the change in the field-of-view of the user: in accordance with a determination that a second set of one or more criteria are met, wherein the second set of one or more criteria includes a third criterion that is met when, while the field-of-view of the user is the second field-of-view and while the second virtual object remains environment-locked, a threshold amount of the second virtual object would remain within the field-of-view of the user, continuing to display the second virtual object as being environment-locked to the first location; and in accordance with a determination that the second set of one or more criteria are not met, shifting the displayed position of the second virtual object relative to the three-dimensional environment based on the change in the field of the user so that at least the threshold amount of the of the second virtual object remains within the field-of-view of the user.

129

AMENDED SHEET (ARTICLE 19)

33. The method of claim 32, wherein: the second virtual object is concurrently displayed with a connector virtual object having a first end that is environment-locked to the first location and a second end that is connected to the second virtual object; and shifting the displayed position of the second virtual object relative to the three- dimensional environment based on the change in the field of the user includes maintaining the first end of the connector virtual object as environment-locked to the first location.

34. The method of any one of claims 29-33, wherein the map virtual object has one or more visual characteristics that reduce an amount of the three-dimensional environment that is partially and/or completely obstructed by the map virtual object.

35. The method of any one of claims 22-34, further comprising: while displaying the first virtual object at a first displayed position in the field-of- view of the user: in accordance with a determination that the first displayed position satisfies a set of repositioning criteria that includes a fourth criterion that is satisfied when the first displayed position is not a first predetermined display position, shifting the displayed position of at least a portion of the first virtual object towards the first predetermined display position; and in accordance with a determination that the first displayed position does not satisfy the set of repositioning criteria, maintaining display of the first virtual object at the first displayed position.

36. The method of any one of claims 22-35, wherein the first element of the route is selected from the group consisting of a navigation operation and a place -of-intere st.

37. The method of any one of claims 22-36, further comprising: displaying, via the display generation component and concurrently with displaying the first virtual object, a speed virtual object that includes an indication of a movement speed.

38. The method of claim 37, wherein the speed virtual object is viewpoint-locked.

39. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in

130

AMENDED SHEET (ARTICLE 19) communication with a display generation component, the one or more programs including instructions for performing the method of any of claims 22-38.

40. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 22-38.

41. A computer system configured to communicate with a display generation component, the computer system comprising: means for performing the method of any of claims 22-38.

42. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for performing the method of any of claims 22-38.

43. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: displaying, via the display generation component, a first virtual object in a three- dimensional environment, wherein the first virtual object indicates a first element of a route to a destination and wherein the first virtual object corresponds to a first location in the three- dimensional environment, wherein displaying the first virtual object includes: in accordance with a determination that the first location is a location that is within a field-of-view of a user, displaying the first virtual object as an environment-locked object; and in accordance with a determination that the first location is a location that is not within the field-of-view of the user, displaying the first virtual object as a viewpoint- locked object.

44. A computer system configured to communicate with a display generation component, the computer system comprising:

131

AMENDED SHEET (ARTICLE 19) one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object indicates a first element of a route to a destination and wherein the first virtual object corresponds to a first location in the three-dimensional environment, wherein displaying the first virtual object includes: in accordance with a determination that the first location is a location that is within a field-of-view of a user, displaying the first virtual object as an environment- locked object; and in accordance with a determination that the first location is a location that is not within the field-of-view of the user, displaying the first virtual object as a viewpoint-locked object.

45. A computer system configured to communicate with a display generation component, the computer system comprising: means for displaying, via the display generation component, a first virtual object in a three-dimensional environment, wherein the first virtual object indicates a first element of a route to a destination and wherein the first virtual object corresponds to a first location in the three-dimensional environment, wherein displaying the first virtual object includes: in accordance with a determination that the first location is a location that is within a field-of-view of a user, displaying the first virtual object as an environment-locked object; and in accordance with a determination that the first location is a location that is not within the field-of-view of the user, displaying the first virtual object as a viewpoint- locked object.

46. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: displaying, via the display generation component, a first virtual object in a three- dimensional environment, wherein the first virtual object indicates a first element of a route to a destination and wherein the first virtual object corresponds to a first location in the three- dimensional environment, wherein displaying the first virtual object includes:

132

AMENDED SHEET (ARTICLE 19) in accordance with a determination that the first location is a location that is within a field-of-view of a user, displaying the first virtual object as an environment-locked object; and in accordance with a determination that the first location is a location that is not within the field-of-view of the user, displaying the first virtual object as a viewpoint- locked object.

47. A method comprising: at a computer system that is in communication with a display generation component: while a field-of-view of a user of the computer system is a first field-of-view and the field-of-view of the user includes a representation of a physical environment that includes a first location within the physical environment, detecting a change in an orientation of the field-of-view of the user from the first field-of-view to a second field-of-view, different from the first field-of-view, that also includes the first location within the physical environment; in response to detecting the change in orientation of the field-of-view of the user from the first field-of-view to the second field-of-view, displaying, via the display generation component, a set of one or more virtual objects with a respective spatial orientation relative to at least a first portion of a body of the user; after displaying the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user, ceasing to display the set of one or more virtual objects; after ceasing to display the set of one or more virtual objects, detecting movement of the user in the physical environment; after detecting movement of the user in the physical environment, detecting a change in orientation of the field-of-view of the user to a second orientation; and in response to detecting the change in orientation of the field-of-view of the user to the second orientation, displaying, via the display generation component, the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user.

48. The method of claim 47, wherein the set of one or more virtual objects includes a first virtual object that corresponds to a system control.

133

AMENDED SHEET (ARTICLE 19)

49. The method of any one of claims 47-48, wherein the set of one or more virtual objects are displayed at a first position in the field-of-view of the user that corresponds to the first location within the physical environment.

50. The method of any one of claims 47-49, wherein the first portion of the body of the user is a torso of the user of the computer system.

51. The method of any one of claims 47-50, wherein the first set of virtual objects, when displayed, are displayed at a location and/or position in the field-of-view that corresponds to a location in the physical environment that is determined to be a first predetermined distance from the first portion of the body of the user of the computer system.

52. The method of any one of claims 47-51, wherein: the first set of one or more virtual objects, when displayed in response to detecting the change in orientation of the field-of-view of the user from the first field-of-view to the second field-of-view, are displayed at a second position in the field-of-view of the user that corresponds to a second location in the physical environment and with the respective spatial orientation relative to the first portion of the body of the user; and the first set of one or more virtual objects, when displayed in response to detecting movement of the user in the physical environment, are displayed at a third position in the field-of-view of the user that corresponds to a third location in the physical environment that is different from the second location and with the respective spatial orientation relative to the first portion of the body of the user.

53. The method of any one of claims 47-52, the method further comprising: while the field-of-view of the user is orientated to the second field-of-view and while displaying the set of one or more virtual objects, detecting a change in orientation of the field-of-view of the user from the second field-of-view to a third field-of-view; and in response to detecting the change in orientation of the field-of-view of the user from the second field-of-view to a third field-of-view, displaying, via the display generation component, a second set of one or more virtual objects while maintaining display of at least a second virtual object of the first set of one or more virtual objects.

54. The method of any one of claims 47-53, further comprising: while displaying the first set of one or more virtual objects are displayed at a third position in the field-of-view of the user that corresponds to a third location in the physical

134

AMENDED SHEET (ARTICLE 19) environment, detecting a change in the orientation of the first portion of the body of the user that causes a change in the field-of-view of the user to a fourth field-of-view; and in response to detecting the change in the orientation of the first portion of the body of the user that causes the change in the field-of-view of the user to the fourth field-of-view: displaying the first set of one or more virtual objects at a fourth position in the field-of-view of the user that is different from the third position and that corresponds to the third location in the physical environment.

55. The method of claim 54, wherein while the first set of one or more virtual objects are displayed at the fourth position in the field-of-view of the user, the first set of one or more virtual objects do not have the respective spatial orientation relative to at least the first portion of the body of the user, the method further comprising: after displaying the first set of one or more virtual objects at the fourth position in the field-of-view of the user, ceasing to display the first set of one or more virtual objects; while the first set of one or more virtual objects are not displayed, detecting a change in the field-of-view of the user to a fifth field-of-view; and in response to detecting the change in the field-of-view of the user to the fifth field-of- view, displaying the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user and at a fifth position in the field- of-view of the user that does not correspond to the third location in the physical environment.

56. The method of any one of claims 47-55, further comprising: while the first set of one or more virtual objects includes a first set of control virtual objects; detecting, a request to customize the first set of one or more virtual objects; in response to detecting the request to customize the first set of one or more virtual objects, customizing the first set of one or more virtual objects by updating the first set of one or more virtual objects to include a second set of control virtual objects, wherein the second set of control virtual objects is different from the first set of control virtual objects.

57. The method of claim 56, wherein a composition of the first set of control virtual objects is user-customizable and wherein the relative positions of control virtual objects in the first set of control virtual objects is not user-customizable.

135

AMENDED SHEET (ARTICLE 19)

58. The method of any one of claims 47-57, wherein the first set of one or more virtual objects are orientated so as to be substantially perpendicular to a direction of view of the user of the computer system.

59. The method of any one of claims 47-58, further comprising: while displaying the first set of one or more virtual objects, detecting a first input that corresponds to a third virtual object of the first set of one or more virtual objects; in response to detecting the first input, performing a first operation.

60. The method of any one of claims 47-59, wherein the first set of one or more virtual objects includes a fourth virtual object, the method further comprising: while displaying the first set of one or more virtual objects and while the fourth virtual object is environment-locked, detecting a change in the field-of-view of the user to a sixth field-of-view; and in response to detecting a change in the field-of-view of the user to a sixth field-of- view: in accordance with a determination that a first set of criteria are met, wherein the first set of criteria includes a criterion that is met when the change in the field-of-view of the user to a sixth field-of-view would cause at least a threshold amount of the fourth virtual object to fall outside of the sixth field-of-view, reducing a displayed size of the fourth virtual object.

61. The method of any one of claims 47-60, wherein displaying the first set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of-view includes displaying the first set of one or more virtual objects at a first height relative to a height in the physical environment of a viewpoint of the user, the method further comprising: prior to displaying the first set of one or more virtual objects in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of- view, receiving a first set of one or more inputs that includes an input that sets a value for the first height.

136

AMENDED SHEET (ARTICLE 19)

62. The method of claim 61, further comprising: while displaying the first set of virtual objects at the first height relative to the height in the physical environment of the viewpoint of the user and at a second height relative to the physical environment, detecting a change in the height in the physical environment of the viewpoint of the user; and in response to detecting the change in the height in the physical environment of the viewpoint of the user, changing a height at which the first set of virtual objects are displayed in the physical environment to a third height, different from the second height, wherein changing the height at which the first set of virtual objects are displayed in the physical environment to the third height causes the first set of one or more virtual objects to be displayed at the first height relative to the height in the physical environment of the viewpoint of the user.

63. The method of any one of claims 47-62, wherein displaying the first set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user in response to detecting the change in the field-of-view of the user from the first field-of-view to the second field-of-view includes: in accordance with a determination that the user of the computer system is performing a first type of activity when the change in the field-of-view of the user from the first field-of- view to the second field-of-view was detected, the first set of one or more virtual objects includes a first set of content; and in accordance with a determination that the user of the computer system is performing a second type of activity, different from the first type of activity, when the change in the field-of-view of the user from the first field-of-view to the second field-of-view was detected, the first set of one or more virtual objects includes a second set of content, different from the first set of content.

64. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for performing the method of any of claims 47-63.

65. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and

137

AMENDED SHEET (ARTICLE 19) memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 47-63.

66. A computer system configured to communicate with a display generation component, the computer system comprising: means for performing the method of any of claims 47-63.

67. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for performing the method of any of claims 47-63.

68. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: while a field-of-view of a user of the computer system is a first field-of-view and the field-of-view of the user includes a representation of a physical environment that includes a first location within the physical environment, detecting a change in an orientation of the field-of-view of the user from the first field-of-view to a second field-of-view, different from the first field-of-view, that also includes the first location within the physical environment; in response to detecting the change in orientation of the field-of-view of the user from the first field-of-view to the second field-of-view, displaying, via the display generation component, a set of one or more virtual objects with a respective spatial orientation relative to at least a first portion of a body of the user; after displaying the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user, ceasing to display the set of one or more virtual objects; after ceasing to display the set of one or more virtual objects, detecting movement of the user in the physical environment; after detecting movement of the user in the physical environment, detecting a change in orientation of the field-of-view of the user to a second orientation; and in response to detecting the change in orientation of the field-of-view of the user to the second orientation, displaying, via the display generation component, the set of one or

138

AMENDED SHEET (ARTICLE 19) more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user.

69. A computer system configured to communicate with a display generation component, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while a field-of-view of a user of the computer system is a first field-of-view and the field-of-view of the user includes a representation of a physical environment that includes a first location within the physical environment, detecting a change in an orientation of the field-of-view of the user from the first field-of-view to a second field-of-view, different from the first field-of-view, that also includes the first location within the physical environment; in response to detecting the change in orientation of the field-of-view of the user from the first field-of-view to the second field-of-view, displaying, via the display generation component, a set of one or more virtual objects with a respective spatial orientation relative to at least a first portion of a body of the user; after displaying the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user, ceasing to display the set of one or more virtual objects; after ceasing to display the set of one or more virtual objects, detecting movement of the user in the physical environment; after detecting movement of the user in the physical environment, detecting a change in orientation of the field-of-view of the user to a second orientation; and in response to detecting the change in orientation of the field-of-view of the user to the second orientation, displaying, via the display generation component, the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user.

70. A computer system configured to communicate with a display generation component, the computer system comprising: means, while a field-of-view of a user of the computer system is a first field-of-view and the field-of-view of the user includes a representation of a physical environment that

139

AMENDED SHEET (ARTICLE 19) includes a first location within the physical environment, for detecting a change in an orientation of the field-of-view of the user from the first field-of-view to a second field-of- view, different from the first field-of-view, that also includes the first location within the physical environment; means, in response to detecting the change in orientation of the field-of-view of the user from the first field-of-view to the second field-of-view, for displaying, via the display generation component, a set of one or more virtual objects with a respective spatial orientation relative to at least a first portion of a body of the user; means, after displaying the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user, for ceasing to display the set of one or more virtual objects; means, after ceasing to display the set of one or more virtual objects, for detecting movement of the user in the physical environment; means, after detecting movement of the user in the physical environment, for detecting a change in orientation of the field-of-view of the user to a second orientation; and means, in response to detecting the change in orientation of the field-of-view of the user to the second orientation, for displaying, via the display generation component, the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user.

71. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component, the one or more programs including instructions for: while a field-of-view of a user of the computer system is a first field-of-view and the field-of-view of the user includes a representation of a physical environment that includes a first location within the physical environment, detecting a change in an orientation of the field-of-view of the user from the first field-of-view to a second field-of-view, different from the first field-of-view, that also includes the first location within the physical environment; in response to detecting the change in orientation of the field-of-view of the user from the first field-of-view to the second field-of-view, displaying, via the display generation component, a set of one or more virtual objects with a respective spatial orientation relative to at least a first portion of a body of the user;

140

AMENDED SHEET (ARTICLE 19) after displaying the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user, ceasing to display the set of one or more virtual objects; after ceasing to display the set of one or more virtual objects, detecting movement of the user in the physical environment; after detecting movement of the user in the physical environment, detecting a change in orientation of the field-of-view of the user to a second orientation; and in response to detecting the change in orientation of the field-of-view of the user to the second orientation, displaying, via the display generation component, the set of one or more virtual objects with the respective spatial orientation relative to at least the first portion of the body of the user.

72. A method comprising: at a wearable computer system that is in communication with a display generation component and a set of one or more cameras that includes a first camera: while a user is wearing the wearable computer system and the user has a first field-of-view that includes a first representation of a physical environment at a location of the user from a first perspective, displaying, via the display generation component, a first virtual object that includes a representation of a portion of a field-of-view of the first camera, wherein the representation of the portion of the field-of-view of the first camera includes a second representation of the physical environment at the location of the user from a second perspective that is different from the first perspective.

73. The method of claim 72, wherein the first field-of-view is oriented in a first direction and wherein the field-of-view of the first camera is oriented in a second direction that is different from the first direction.

74. The method of claim 73, wherein the second perspective is from the perspective of a primary direction of motion of a first vehicle and the second direction is rearwards of the primary direction of motion of the first vehicle.

75. The method of any one of claims 72-74, the second perspective is substantially at the same position or near the same position in the physical environment as the first perspective.

76. The method of any one of claims 72-75, wherein the set of one or more cameras includes a second camera, the method further comprising:

141

AMENDED SHEET (ARTICLE 19) while the user is wearing the wearable computer system and the user has a second field-of-view that includes a third representation of the physical environment at the location of the user from a third perspective, displaying, via the display generation component, a second virtual object that includes a representation of a portion of a field-of-view of the second camera, wherein the representation of the portion of the field-of-view of the second camera includes a fourth representation of the physical environment at the location of the user from a fourth perspective that is different from the third perspective.

77. The method of claim 76, wherein the second virtual object is displayed concurrently with the first virtual object.

78. The method of claim 76, wherein the second virtual object is displayed after ceasing to display the first virtual object.

79. The method of any one of claims 72-78, further comprising: prior to displaying the first virtual object and while the user has a third field-of-view, different from the first field-of-view, detecting a change in the orientation of a field-of-view of the user from the third field-of-view to the first field-of-view, wherein displaying the first virtual object occurs in response to detecting the change in the orientation of a field-of-view of the user from the third field-of-view to the first field-of-view.

80. The method of any one of claims 72-79, wherein the set of one or more cameras includes a third camera, the method further comprising: while displaying the first virtual object, detecting a change in the orientation of a field-of-view of the user from the first field-of-view to a fourth field-of-view, different from the first field-of-view; and in response to detecting the change in the orientation of a field-of-view of the user from the first field-of-view to the fourth field-of-view, displaying, via the display generation component, a third virtual object that includes a representation of a portion of a field-of-view of the third camera, wherein the representation of the portion of the field-of-view of the third camera includes a fifth representation of the physical environment at the location of the user from a fifth perspective that is different from the second perspective.

142

AMENDED SHEET (ARTICLE 19)

81. The method of any one of claims 72-80, further comprising: displaying, concurrently with the first virtual object, a fourth virtual object that includes first content; while displaying the first virtual object and the fourth virtual object, detecting a change in the orientation of a field-of-view of the user from the first field-of-view to a fifth field-of-view, different from the first field-of-view; in response to detecting the change in the orientation of a field-of-view of the user from the first field-of-view to the fifth field-of-view: shifting a position at which the first virtual object is displayed within the field- of-view of the user; and shifting a position at which the fourth virtual object is displayed within the field-of-view of the user.

82. The method of claim 81, wherein the first content includes map content.

83. The method of any one of claims 81-82, wherein the first content includes content corresponding to an element of a route to a destination.

84. The method of any one of claims 81-83, wherein the first content includes an indication of a movement speed.

85. The method of any one of claims 72-84, wherein the first virtual object is displayed at a first height relative to a height in the physical environment of a viewpoint of the user, the method further comprising: receiving a set of one or more inputs that correspond to a request to configure the computer system to display the first virtual object at a second height, different than the first height, relative to a height in the physical environment of the viewpoint of the user; in response to the set of one or more inputs, configuring the computer system to display the first virtual object at the second height relative to a height in the physical environment of the viewpoint of the user; and after configuring the computer system to display the first virtual object at the second height relative to a height in the physical environment of the viewpoint of the user, displaying the first virtual object at the second height relative to a height in the physical environment of the viewpoint of the user.

143

AMENDED SHEET (ARTICLE 19)

86. The method of claim 85, further comprising: prior to displaying the first virtual object at the second height relative to a height in the physical environment of the viewpoint of the user and while the user has a sixth field-of- view, detecting a change in an orientation of a field-of-view of the user from the sixth field- of-view to a seventh field-of-view, different from the sixth field-of-view, wherein displaying the first virtual object at the second height relative to a height in the physical environment of the viewpoint of the user occurs in response to detecting the change in the orientation of a field-of-view of the user from the sixth field-of-view to the seventh field-of-view.

87. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a set of one or more cameras that includes a first camera, the one or more programs including instructions for performing the method of any of claims 72-86.

88. A computer system configured to communicate with a display generation component and a set of one or more cameras that includes a first camera, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 72-86.

89. A computer system configured to communicate with a display generation component and a set of one or more cameras that includes a first camera, the computer system comprising: means for performing the method of any of claims 72-86.

90. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a set of one or more cameras that includes a first camera, the one or more programs including instructions for performing the method of any of claims 72-86.

91. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a wearable computer system that is in

144

AMENDED SHEET (ARTICLE 19) communication with a display generation component and a set of one or more cameras that includes a first camera, the one or more programs including instructions for: while a user is wearing the wearable computer system and the user has a first field-of- view that includes a first representation of a physical environment at a location of the user from a first perspective, displaying, via the display generation component, a first virtual object that includes a representation of a portion of a field-of-view of the first camera, wherein the representation of the portion of the field-of-view of the first camera includes a second representation of the physical environment at the location of the user from a second perspective that is different from the first perspective.

92. A wearable computer system configured to communicate with a display generation component and a set of one or more cameras that includes a first camera, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while a user is wearing the wearable computer system and the user has a first field-of-view that includes a first representation of a physical environment at a location of the user from a first perspective, displaying, via the display generation component, a first virtual object that includes a representation of a portion of a field-of-view of the first camera, wherein the representation of the portion of the field-of-view of the first camera includes a second representation of the physical environment at the location of the user from a second perspective that is different from the first perspective.

93. A wearable computer system configured to communicate with a display generation component and a set of one or more cameras that includes a first camera, the computer system comprising: means, while a user is wearing the wearable computer system and the user has a first field-of-view that includes a first representation of a physical environment at a location of the user from a first perspective, for displaying, via the display generation component, a first virtual object that includes a representation of a portion of a field-of-view of the first camera, wherein the representation of the portion of the field-of-view of the first camera includes a second representation of the physical environment at the location of the user from a second perspective that is different from the first perspective.

145

AMENDED SHEET (ARTICLE 19)

94. A wearable computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with a display generation component and a set of one or more cameras that includes a first camera, the one or more programs including instructions for: while a user is wearing the wearable computer system and the user has a first field-of- view that includes a first representation of a physical environment at a location of the user from a first perspective, displaying, via the display generation component, a first virtual object that includes a representation of a portion of a field-of-view of the first camera, wherein the representation of the portion of the field-of-view of the first camera includes a second representation of the physical environment at the location of the user from a second perspective that is different from the first perspective.

146

AMENDED SHEET (ARTICLE 19)