Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
IMMERSIVE AND MERGED REALITY EXPERIENCE / ENVIRONMENT AND DATA CAPTURE VIA VIRTURAL, AGUMENTED, AND MIXED REALITY DEVICE
Document Type and Number:
WIPO Patent Application WO/2018/039076
Kind Code:
A1
Abstract:
Methods of collecting data include providing immersive and merged reality environments to participants and collecting data from the participants during the environments. Some embodiments include prompting participants with questions during the immersive and merged reality environment and collecting responses to the questions and some embodiments include monitoring viewing or interaction behavior of participants during the immersive and merged reality environment and collecting the behavior. Various embodiments include reporting the data from the participants. Some embodiments include providing a device app to participants and certain acts are performed using the device app. Further, some embodiments include using an application programming interface (API) as a channel. Various embodiments include collecting demographic information on the participants or screening the participants. Some embodiments include a 360 video or photograph or three-dimensional geometry or positional data. In different embodiments, the immersive and merged reality environments include VR, AR, MR, XR, or a combination thereof.

Inventors:
ZIEGLER ALAN READ JR (US)
BUZZELL JOHN COLBY (US)
MALUDA ALYSSIA THIEN NGA (US)
Application Number:
PCT/US2017/047633
Publication Date:
March 01, 2018
Filing Date:
August 18, 2017
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
VANTEDGE GROUP LLC (US)
International Classes:
G06Q50/30; G06Q30/02; G06Q99/00; G06T19/00
Foreign References:
US20130117377A12013-05-09
US20140253743A12014-09-11
US20120223943A12012-09-06
US20130083011A12013-04-04
US20160019717A12016-01-21
Attorney, Agent or Firm:
WATTS, Allan (US)
Download PDF:
Claims:
Claims

What is claimed is:

1. A method of collecting data comprising:

providing an immersive and merged reality environment to multiple participants; and collecting the data from the multiple participants during the immersive and merged reality environment.

2. The method of claim 1 further comprising prompting the multiple participants with questions during the immersive and merged reality environment; and collecting responses to the questions.

3. The method of claim 1 further comprising monitoring viewing behavior of the multiple participants during the immersive and merged reality environment; and collecting the viewing behavior.

4. The method of claim 3 further comprising:

prompting the multiple participants with questions during the immersive and merged reality environment;

collecting responses to the questions; and

reporting the data from the multiple participants.

5. A method of collecting data comprising:

providing a device app to multiple participants;

providing an immersive and merged reality environment to the multiple participants; and collecting the data from the multiple participants during the immersive and merged reality environment; wherein the providing the immersive and merged reality environment to the multiple participants and the collecting the data from the multiple participants during the immersive and merged reality environment are performed using the device app.

6. The method of claim 5 wherein the collecting the data comprises, using the device app, prompting the multiple participants with questions during the immersive and merged reality environment; and, using the device app, collecting responses to the questions.

7. The method of claim 5 wherein the collecting the data comprises, using the device app, monitoring viewing and interaction behavior of the multiple participants during the immersive and merged reality environment; and, using the device app, collecting the viewing behavior.

8. The method of claim 5 further comprising reporting the data from the multiple participants using the device app.

9. A method of collecting data comprising using an application programming interface to act as a channel to call the content to conduct research questionnaires on multiple participants within an immersive and merged reality environment hosted by a third-party publisher.

10. The method of any of claims 1 to 9 further comprising collecting demographic information on the multiple participants; and screening the multiple participants based on the demographic information.

11. The method of claim 10 wherein providing the immersive and merged reality environment to the multiple participants is based on the screening of the multiple participants based on the demographic information.

12. The method of any of claims 1 to 9 wherein providing the immersive and merged reality environment to the multiple participants comprises proactively pushing the immersive and merged reality environment to the multiple participants.

13. The method of any of claims 1 to 9 wherein providing the immersive and merged reality environment to the multiple participants comprises providing a virtual reality experience to the multiple participants.

14. The method of any of claims 1 to 9 wherein collecting the data comprises displaying questions during the immersive and merged reality environment; and measuring responses to the questions.

15. The method of any of claims 1 to 9 further comprising publishing the data from the multiple participants.

16. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises a 360° video.

17. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises a 360° photograph.

18. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises three-dimensional geometry.

19. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises three-dimensional positional data.

20. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises VR.

21. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises AR.

22. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises MR.

23. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises XR.

24. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises a real-time view of the real world that is combined with digital elements.

25. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises using a device's camera viewfinder with an overlay showing nearby points of interest.

26. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises merging real and virtual objects in a single presentation.

27. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises digital presentations of virtual objects that interact with the real world.

28. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises a virtual ball that rolls along a real floor and bounces off of a real wall.

29. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises one or more human-machine interactions generated by computer technology.

30. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises one or more human-machine interactions generated by a wearable device.

31. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises one or more human-machine interactions generated by an IoT device.

32. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises at least one of VR, AR, and MR.

33. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises at least two of VR, AR, and MR.

34. The method of any of claims 1 to 9 wherein the immersive and merged reality environment comprises VR, AR, and MR.

35. The method of any of claims 1 to 8 further comprising using an application programming interface to conduct research questionnaires within the immersive and merged reality environment.

36. The method of claim 35 wherein the immersive and merged reality environment is hosted by a third-party.

Description:
IMMERSIVE AND MERGED REALITY EXPERIENCE / ENVIRONMENT AND DATA CAPTURE VIA VIRTURAL, AGUMENTED, AND MIXED REALITY DEVICE

Related Patent Applications

[0001] This international patent application, filed under the Patent Cooperation Treaty (PCT), claims priority to United States Provisional Patent Application Serial Number 62377833, Virtual Experience and Data Capture via Mobile Device, filed on August 22, 2016, and has the same assignee and at least one inventor in common. The contents of the priority provisional patent application are incorporated herein by reference.

Field of the Invention

[0002] Various embodiments of this invention relate to Virtual, Augmented, and Mixed Reality technology. Further, many embodiments concern software and computer implemented methods. Still further, certain embodiments relate to systems and methods for collecting, organizing, and analyzing information such as response data from participants.

Background of the Invention

[0003] Computer systems have been used to collect and manage data, including feedback from many individuals. Further, Virtual, Augmented, and Mixed Reality has been used for various purposes ranging from entertainment to conveying information including for planning retail store space layout, for example. Various examples of use of immersive and merged realities are described in U.S. Patent Application publication numbers 2012/0223943 and 20160019717, for instance. These documents also describe examples of needs and benefits of such systems and the use of immersive and merged reality. Needs and opportunities for improvement exist for partially or fully providing one or more of these needs or potential benefits. Room for improvement exists over the prior art in these and various other areas that may be apparent to a person of ordinary skill in the art having studied this document.

Summary of Particular Embodiments of the Invention

[0004] This invention provides, among other things, various systems and methods for collecting data. Specific embodiments include various methods of collecting data that include providing an immersive and merged reality environment to multiple participants and collecting the data from the multiple participants during the immersive and merged reality environment. Some embodiments, for example, include prompting the multiple participants with questions during the immersive and merged reality environment and collecting responses to the questions. Further, some embodiments include monitoring viewing or other passive interaction behavior of the multiple participants during the immersive and merged reality environment and collecting the viewing behavior. Still further, certain embodiments include, reporting the data from the multiple participants. Further specific embodiments include various methods of collecting data that include providing a device app to multiple participants, providing an immersive and merged reality environment to the multiple participants, and collecting the data from the multiple participants during the immersive and merged reality environment. Moreover, in a number of such embodiments, the providing of the immersive and merged reality environment to the multiple participants and the collecting of the data from the multiple participants during the immersive and merged reality environment are performed using the device app. Further, in some (e.g., such) embodiments, the collecting of the data includes (e.g., using the device app), prompting the multiple participants with questions during the immersive and merged reality environment (e.g., using the device app), collecting responses to the questions, or both. Still further, in some embodiments, the collecting the data includes (e.g., using the device app), monitoring viewing behavior of the multiple participants during the immersive and merged reality environment (using the device app), collecting the viewing behavior, or both. Further still, certain embodiments include reporting the data from the multiple participants (e.g., using the device app). Further, some embodiments include using an application programming interface, for example, to act as a channel to call the content to conduct research questionnaires, for instance, within the immersive and merged reality environment. Further still, in certain embodiments, the immersive and merged reality environment is hosted by a third-party publisher. Even further specific embodiments include, for example, various methods of collecting data that include using an application programming interface to conduct research questionnaires on multiple participants within an immersive and merged reality environment (e.g., hosted by a third-party publisher).

[0005] Various embodiments (e.g., previously described) further include collecting demographic information on the multiple participants, screening the multiple participants based on the demographic information, or both. Further, in particular embodiments, the providing of the immersive and merged reality environment to the multiple participants is based on the screening of the multiple participants (e.g., based on the demographic information). Still further, in some embodiments, the providing of the immersive and merged reality environment to the multiple participants includes proactively pushing the immersive and merged reality environment to the multiple participants. Further still, in many embodiments, the providing of the immersive and merged reality environment to the multiple participants includes providing a virtual reality experience to the multiple participants. Even further, in some embodiments, the collecting of the data includes displaying questions (e.g., during the immersive and merged reality environment), measuring responses to the questions, or both. Even further still, various embodiments include publishing the data from the multiple participants. In particular embodiments, the immersive and merged reality environment includes a 360° video, a 360° photograph., three-dimensional geometry, three-dimensional positional data, or a combination thereof, as examples.

[0006] Various embodiments provide, for example, as an objective or benefit, that they partially or fully address or satisfy one or more of the needs, potential areas for benefit, or opportunities for improvement described herein or known in this area of technology, as examples. In addition, various other embodiments are also described herein, and other benefits of certain embodiments may be apparent to a person of skill in the field of this invention.

Brief Description of the Drawings

[0007] FIG. 1 is a flow chart illustrating various examples of (e.g., computerized) methods of collecting data during or within an immersive and merged reality environment.

[0008] The drawing provided herewith illustrates, among other things, examples of certain aspects of particular embodiments. Other embodiments may differ. Various embodiments may include aspects shown in the drawing, described in the specification (including the claims), known in the art, or a combination thereof, as examples.

Detailed Description of Examples of Embodiments

[0009] This patent application describes, among other things, examples of certain embodiments, and certain aspects thereof. Other embodiments may differ from the particular examples described in detail herein. Various embodiments include systems and methods for creating immersive or merged experience environments, for example, that allow participants to engage and interact with rich immersive and/or merged reality content. Further, in a number of embodiments, a customer purchases, stores, or reserves data, or a combination thereof. Still further, various embodiments include: virtual reality, augmented reality, mixed reality, immersive reality, merged reality, "X" reality (e.g., XR,) or a combination thereof, for instance, on a device (e.g., a mobile device or a stationary device). Even further, various embodiments include analysis (e.g., of obtained data). As used herein, an "immersive and merged reality environment" includes VR, AR, MR, XR, or a combination thereof. Different embodiments include, one, two, three, or all of VR, AR, MR, or XR. Even further still, certain embodiments include one, two, or all of VR, AR, or MR. Some embodiments further include other digital experiences that include a digital addition (e.g., visual, aural, haptic, inertial, positional, or other sensory addition) to an experience of physical reality. Still further, as used herein, "immersive" can include audio/aural, touch/haptic, positional, inertial, or other sensory stimulation (e.g., provided digitally).

[0010] Various embodiments include systems and methods for collecting data. Particular embodiments, for example, include various methods of collecting data that include providing an immersive and merged reality environment to multiple participants and collecting the data from the multiple participants during the immersive and merged reality environment. FIG. 1, for example, illustrates method 10, which is an example of a method of collecting data that includes providing an immersive and merged reality environment (e.g., in act 14), for instance, to multiple participants. In the embodiment illustrated, method 10 also includes act 16 of collecting data, for example, from the multiple participants, for instance, during the immersive and merged reality environment. In this context, "collecting" includes recording, for example, in a database. In some embodiments, collecting can also (or instead) include sending (e.g., the data), for example, via a computer network. Further, in particular embodiments, collecting includes detecting, measuring, compiling, etc. FIG. 1 illustrates an example of an order in which certain acts can be performed, but in other embodiments, acts may be performed in a different feasible order. Some examples are described herein, or may be apparent from the description herein, but other embodiments may differ. In some embodiments, some acts may be performed concurrently or some methods may alternate (e.g., back and forth) between certain acts and some or all acts may be repeated, for example, with different participants, content, questions, etc. In the embodiment shown, method 10 further includes act 15 of providing questions (e.g., prompting the multiple participants with questions), for instance, during the immersive and merged reality environment (e.g., provided in act 14). In various embodiments, act 16 includes collecting responses to the questions (e.g., provided in act 15). Further, some embodiments include (e.g., in act 16) monitoring or collecting

(or both) viewing or interaction behavior, or both, for example, of the multiple participants, for instance, during the immersive and merged reality environment (e.g., provided in act 14). Still further, in the embodiment shown, method 10 includes act 17 of reporting the data, for example, from the multiple participants. In some embodiments, for instance, data is presented in one or more document types (e.g., reports, etc.), document contents (e.g., data, images, video, etc.), a presentation format (e.g., lists, graphs, charts, animations, videos, etc.), recommendations, etc.

[0011] Many embodiments are computer implemented and some or all of the acts described herein are contemplated as being performed or implemented with a device or computer, for example, through software. Further, FIG. 1 and method 10, for example, illustrate various methods of collecting data that include providing a device app, for example, in act 13, for instance, to the multiple participants. In some embodiments, for example, the device app is software that is loaded (e.g., in act 13) on the device. In various embodiments, the device is a mobile phone, tablet computer, laptop computer, desktop computer, server, or other computer, for example, with a processor and memory or storage. Still further, various devices are or include other multifunctional portable or wearable electronic devices for example, with a visual display, computing, and networking functions, or a combination thereof, for instance, that are assembled for use as a mobile networked computing device. Further, in particular embodiments, the device app is delivered (e.g., in act 13) to the device via a computer network (e.g., the Internet), a mobile phone network, or both, for example. Various embodiments that include act 13 also include, for example, act 14 of providing an immersive and merged reality environment (e.g., to the multiple participants), act 16 of collecting the data (e.g., from the multiple participants, for instance, during the immersive and merged reality environment), or both. Moreover, in a number of embodiments, act 14 of providing of the immersive and merged reality environment (e.g., to the multiple participants), act 16 of collecting of the data (e.g. , from the multiple participants, during the immersive and merged reality environment, or both), or both such acts, are performed using the device app (e.g., provided in act 13).

[0012] Further, in some embodiments that include act 13 of providing a device app, act 16 of collecting the data includes using the device app provided in act 13. Where an act is described herein as including, or being accomplished, using the device app, in various embodiments, the device app includes computer code, that when executed, performs the act or causes a computer or processor (e.g., within the device) to perform the act. In addition, in some embodiments, act 15 of providing questions or prompting the multiple participants, for example, with questions, for instance, during the immersive and merged reality environment, includes using the device app provided in act 13. Moreover, in some embodiments, act 16 of collecting data or collecting responses to questions (e.g., provided in act 15) includes using the device app provided in act 13. Still further, in some embodiments, the collecting of the data (e.g., in act 16) includes (e.g., using the device app provided in act 13), monitoring viewing behavior, for example, of the multiple participants, for instance, during the immersive and merged reality environment, collecting the viewing behavior, or both. In particular embodiments, some or all of these acts or act 16 can be performed, for example, using the device app (e.g., provided in act 13). Further still, certain embodiments that include act 13 further include act 17 of reporting the data, for example, from the multiple participants, for instance, using the device app (e.g., provided in act 13).

[0013] Further still, some embodiments include (e.g., in act 15 of method 10) using an application programming interface (API), for example, to act as a channel to call the content from the cloud to the app. Still further, in certain embodiments, such an immersive and merged reality environment (e.g., provided in act 14) is hosted by a third-party, for example, storing the content and data for use by software (unseen) or people (seen). In some embodiments, Amazon Web Services or Microsoft Azure can be used, as examples. Even further embodiments that are illustrated by method 10 include, for example, various methods of collecting data that include using an application programming interface (e.g., in act 15) to conduct research questionnaires on multiple participants, for example, within an immersive and merged reality environment (e.g., provided in act 14), for instance, hosted by a third-party.

[0014] Even further, various embodiments include collecting demographic information (e.g., act 11 of method 10), for example, on the multiple participants. In the embodiment illustrated, method 10 also includes act 12 of screening the (e.g., multiple) participants, for instance, based on the demographic information (e.g., collected in act 11). Further, in particular embodiments, the providing of the immersive and merged reality environment (e.g., in act 14), for instance, to the multiple participants, is based on, or selected based on, the screening (e.g. , in act 12), for example, of the multiple participants (e.g., based on the demographic information, for instance, collected in act 11). Still further, in some embodiments, act 14 of providing of the immersive and merged reality environment (e.g., to the multiple participants) includes proactively pushing the immersive and merged reality environment (e.g., to the multiple participants). In some embodiments, for example, proactively pushing includes sending new immersive environments or other stimuli to empaneled participants. Further still, in many embodiments, the providing of the immersive and merged reality environment (e.g., in act 14, for instance, to the multiple participants) includes providing a virtual reality experience (e.g., to the multiple participants). Even further, in some embodiments, the method (e.g., 10) or the act (e.g., 16) of collecting the data includes displaying questions (e.g., in act 15, for instance, during the immersive and merged reality environment provided in act 14), measuring (e.g., in act 16) responses to the questions, or both. Even further still, various embodiments include (e.g., in act 17 of method 10) publishing the data (e.g., from the multiple participants). In particular embodiments, for example, the immersive and merged reality environment (e.g., provided in act 14) includes a 360° video, a 360° photograph., three- dimensional geometry, three-dimensional positional data, or a combination thereof. Each different possible combination is a different embodiment. In various embodiments, "three-dimensional geometry" includes computer generated shapes or volumes, for example, that inhabit an immersive or merged reality experience. For example, in particular embodiments, a virtual 3D can of Coca- Cola is shown on a desk and a participant is asked if he or she likes the way it looks. In this example, the virtual cylinder and associated geometric data provides stimuli to which the reaction of the participant can be measured. Further, in various embodiments, "three-dimensional positional data" includes or refers to the participant's position, for example, in space relative to an origin point in space (e.g., x,y,z). For instance, in particular embodiments, a virtual car is shown on the ground in front of a participant, and observations are made as to whether the participant walked closer to it, how close, walked around it, etc.. Various embodiments track the participant's changing position, for example, as a measure of engagement.

[0015] Various embodiments specifically include providing a virtual experience (e.g., in act 14), for example, to multiple participants and collecting data (e.g., in act 16) from the multiple participants (e.g., during the virtual experience). Further, some embodiments include prompting the participants with questions (e.g., in act 15), for instance, within the virtual experience, and (e.g., in act 16) collecting responses to the questions, monitoring the participants viewing behavior during the virtual experience (e.g., within the immersive and merged reality environment) and collecting the participants viewing behavior, or both. For example, in certain embodiments, a method for collecting data (e.g., 10) includes providing (e.g., in act 13) a device app to multiple participants, providing a virtual experience (e.g., in act 14) to the multiple participants via the device app, and collecting data (e.g., in act 16) from the multiple participants during the virtual experience (e.g., using the device app). In some embodiments, the act (e.g., 16) of collecting data includes, or is preceded by, prompting the participants with questions (e.g., in act 15), for instance, during the virtual experience (e.g., within the immersive and merged reality environment provided in act 14) and collecting responses (e.g., in act 16) to the questions. Further, in some embodiments, the act of collecting data (e.g., 16) includes monitoring the participants viewing behavior, for example, during the virtual experience (e.g., within the immersive and merged reality environment) and collecting the participants viewing behavior. Further still, in some embodiments, the method further includes reporting the data (e.g., in act 17, for instance, from the multiple participants (e.g., using the device app provided in act 13).

[0016] In various embodiments, Augmented Reality or AR includes a real-time view of the real world that is combined with digital elements meant to enhance or "augment" its presentation. For instance, in particular embodiments, a mobile app for tourism uses a device's camera viewfinder with an overlay showing nearby points of interest. This is an example of AR. Further, in a number of embodiments, Mixed Reality" includes merging of real and virtual objects, for example, in a single presentation. Examples of MR include digital presentations of virtual objects that can interact with the real world. For instance, a virtual ball that rolls along a real floor and bounces off of a real wall is an example of MR. Further still, in different embodiments, Extended Reality includes various combinations of real and virtual environments and human-machine interactions generated by computer technology, for example, wearables, or IoT devices. In various embodiments, XR includes, but is not limited to, Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), or a combination thereof.

[0017] Various embodiments are or include a system or method for managing, enabling, displaying, capturing, authenticating, storing, analyzing, or a combination thereof, prompted or unprompted interaction data, or both, for instance, related to immersive or merged (or both) reality experiences, environments, or both. Method 10 is an example. Systems can include, for example, hardware, software, or both, for instance, that implement a method (e.g., method 10). In various embodiments, selection of specific hardware, specific software code, or both, are within the capabilities of a person of ordinary skill in the art. Many embodiments include an application display, and various embodiments ingest VR, AR, MR, or XR content, or a combination thereof, for example, for users to overlay (e.g., prompted) questions, for instance, at designated locations

(e.g., within the VR, AR, MR, or XR environment, for instance, provided in act 14). Further, many embodiments include content management. For example, in some embodiments, interactive (e.g., VR, AR, MR, or XR) environments are created and managed (e.g., in act 14). Still further, in some embodiments, "XR" stands for "extended Reality".

[0018] Still further, some embodiments are enabled by API. For example, in some embodiments, API calls for interactive (e.g., VR, AR, MR, or XR) environments, (e.g., via a VR, AR, MR, or XR app, for instance, Google Cardboard application or another platform). Even further, some embodiments include participant authentication (e.g., in act 12). In some embodiments, for example, participants verify identity with a verification code, for instance, before accessing an (e.g., immersive digital) environment (e.g., provided in act 14). Further still, various embodiments include data capture (e.g., act 16). For example, in some embodiments, responses are collected (e.g., in act 16) in real time. Even further still, a number of embodiments include data storage (e.g., in act 16). For instance, in some embodiments participant information (e.g., collected in act 11), collected data (e.g., collected in act 16), or both, are stored in a database (e.g., on the device or on a server). Moreover, certain embodiments include data analysis, visualization, or both (e.g., in act 16 or 17). For example, in some embodiments, captured data is aggregated into reports, visualization dashboards are made available, for instance, for further analysis in an admin panel, or both. In particular embodiments, for example, third party apps call the API of the embodiment, for example, to inject certain technology into their experience. In many embodiments, the third party would pay to retrieve the data, for instance.

[0019] Various embodiments include content management, are API enabled, or both. For example, in some embodiments, a user (e.g., not necessarily the participants previously described) uploads VR, AR, mixed, or "X" reality content, as examples, to an admin panel, for instance, on a site. Further, in various embodiments, the site or system generates an interactive, immersive, or merged reality environment, as examples (e.g., provided in act 14). Still further, in some embodiments, API calls for the environment from an AR, VR, MR, or XR app (or a combination thereof), for instance, and delivers (e.g., in act 14) the environment to participants (e.g., participants described in the claims and prior paragraphs). Even further, in a number of embodiments, the participant engages with the environment, for example, through prompted questions (e.g., provided in act 15). Even further still, in particular embodiments, unprompted or passive behavior (e.g., eye movement, head movement, idle time for head movement, etc.) is (e.g., also) recorded (e.g., in act 16). For example, some embodiments track the XI, Yl of where the participant looks. Other versions track the X2,Y2 of where the participant looks and the X3,Y3,Z3, for instance, of where the participant moves. Further, certain embodiments track the positions of arms, elbows, wrists, hands or fingers, or a combination thereof, heart beat, blood pressure, blood glucose levels, other biometric indicators, etc. Various embodiments include display (e.g., act 14), authentication, data capture (e.g., act 16), data storage, data analysis and visualization, or a combination thereof (e.g., in act 16 or 17).

[0020] In some embodiments, participant identity is verified (e.g., in act 12), for example, via a verification code, for instance, before entering or being provided with the environment (e.g., in act 14). Various methods of authentication include, as examples, activation code, user name and password, password alone, unique link, QR code or other digital code, biometric scan, location, IP address, etc. In a number of embodiments, for example, responses are recorded and aggregated (e.g. , in act 16), for instance, in real time, collected participant information and responses are stored in a database, aggregated data is synthesized and prepared as reports or dashboards with visualizations (e.g., in act 17, for instance, for further analysis), or a combination thereof. Further, various embodiments include an app, for example, an AR, VR, MR, or XR app (e.g., provided in act 13). In some embodiments, for example, a participant downloads an AR, VR, or MR app, or an XR app, as another example, (e.g. the Google Cardboard app), for instance, in act 13. In various embodiments, a "code" is or includes a unique participant or study code (or both), for example, that instructs the app to load a particular immersive environment or other stimuli.

[0021] Various embodiments (e.g., of method 10) can be used for: store design, customer experience, venue design, product design, or a combination thereof, as examples. Further, various methods include acts of store design, customer experience evaluation or design, venue design, product design, or a combination thereof, as examples. In a number of embodiments, for example, a user will upload VR, AR, MR, or XR content, for example, or 360 video images. Further, some embodiments include AR, MR, or both. Particular embodiments include, for example, interacting with an AR environment and tagging locations for AR interactions. In some embodiments, for example, within a site, a user will overlay question prompts (e.g. , for act 15) onto designated areas of the content (e.g., to be provided in act 14) for participant response (e.g., collected in act 16). In different embodiments, question types (e.g., for act 15) may include: scale ranking (e.g., 1-5), multiple choice (e.g. Choose 3 of the 5...), conditional questions, or a combination thereof, as examples. Some embodiments include demo videos within questions (e.g., provided in act 15), as another example. Further still, in certain embodiments, capabilities within the content upload environment include progress functionality, for instance, to indicate complete or incomplete tasks. Still further, some embodiments include flat or 3D preview functionality. Even further, in various embodiments, from the created content, an interactive environment is generated for participant engagement (e.g., in act 14). Even further still, various embodiments include content upload, question creation (e.g., for act 15), a preview function, participant engagement, or a combination thereof.

[0022] In many embodiments, a participant downloads a VR/AR/MR/XR app (e.g. Google Cardboard application, for instance, in act 13) to access the environment (e.g., provided in act 14). Further, API is enabled, in some embodiments, for instance, through the VR/AR/MR/XR app (e.g. , provided in act 13). Still further, in some embodiments, the API calls the interactive environment (e.g., provided in act 14). Further still, some embodiments include participant authentication (e.g., in act 12). For example, in particular embodiments, participants must verify their identity before entering the environment (e.g., provided in act 14). Even further, in some embodiments, participants use compatible accessories to engage with the interactive environment (e.g., provided in act 14), for example, for VR, participants may use Google Cardboard, Samsung Gear, Google Daydream, Oculus Rift, HTC Vive, etc. For AR, a code may be used (e.g., in act 12), for example, a headset such as the Microsoft HoloLens or an external accessory may be used. In some embodiments, for example, the participant uses the AR app and content populates either per placed geo tags or brings in content (e.g. brings in a chair into an empty room). Even further still, in some embodiments, an external accessory may be used. Moreover, in a number of embodiments, for MR or XR, participants use compatible accessories to engage with the interactive environment (e.g., provided in act 14).

[0023] In various embodiments, for data capture (e.g., act 16), within the environment (e.g., provided in act 14), prompted questions appear (e.g., provided in act 15) and participants choose answers, confirm final choices, or both (e.g., in act 16). Some embodiments, also monitor unaided behavior (e.g. heat mapping), for instance, in act 16. Concerning data storage, in some embodiments, participant information and responses are collected (e.g., in act 16) and stored within a database. Further, concerning data analysis and visualization, in some embodiments, recorded responses are aggregated, presented, or both, for example, in exportable reports or dashboards, for instance, for further analysis (e.g., in act 17). Various embodiments are or provide a platform designed to ingest content, for example, including 360 video and questions (e.g., aided or unaided), for instance, for participant use (e.g., provided to participants in acts 14 and 15). Still further, various embodiments collect data in real time (e.g., in act 16). Certain embodiments include aback end with data capture and analysis capabilities.

[0024] In various embodiments, software, such as an app for a device (e.g. , provided in act 13), is a core component of the solution. In some embodiments, for example, the software provides for the (e.g., virtual experience) content to be securely delivered (e.g., in act 14) to specific recipients, for instance, via smartphones, tablets, or other "smart" devices (e.g., iOS or Android). Other examples (e.g., of various devices) are described herein (e.g., in paragraph 0011). Further, in some embodiments, once recipients or participants are qualified (e.g., based on demographic, psychographic, or behavioral criteria, or a combination thereof, for instance, in act 12), they are permitted or facilitated to download the content, or the content is provided to them (e.g., in act 14), for example, via the software or app (e.g., provided in act 13). Still further, in certain embodiments, participants then use Google Cardboard or some other similar immersive and/or merged experience platform or device to fully engage with the content (e.g., provided in act 14). Even further, in a number of embodiments, for instance, during a viewing session, participants are prompted with questions (e.g., in act 15, for instance, via the app provided in act 13) respond to prompted questions, pose questions, make comments of their own, or a combination thereof. Further still, in various embodiments, the software or app (e.g., provided in act 13) collects the response/input and profile data (e.g., in act 16), pushes it (e.g., in act 17) to a cloud-based server for storage and analysis, or both, as examples.

[0025] In a number of embodiments, an app is provided (e.g., in act 13) via a common app marketplace such as Apple App Store/iTunes or Google App Store/Google Play, as examples.

Further, in some embodiments, once downloaded (e.g., in act 13), the app prompts or allows for participants or members to sign-up to be part of a community. Moreover, in particular embodiments, members are prompted (e.g., in act 11) to create a member profile which, in some embodiments, contains various demographic, psychographic, and behavioral information, as examples. Still further, in some embodiments, member sign-ups and profiles (e.g., collected in act

11) are pushed to a central cloud-based server which stores the (e.g., all) profile information. Even further, in certain embodiments, the app (e.g., provided in act 13) invites qualified members (e.g., screened in act 12) to participate in specific immersive and merged reality experiences (e.g., provided in act 14). In some embodiments, additional screening questions may also be asked (e.g., in act 12, for instance, by or through the app provided in act 13) before members are provided certain content or granted permission to download content (e.g., provided in act 14). In some embodiments, answers to such questions may be required (e.g., in act 12) in order for a participant to proceed. In a number of embodiments, once approved, immersive and/or merged experience (VR, AR, etc.) content is made available for members to download (e.g., in act 14). Further still, in various embodiments, instructions are provided (e.g., in act 14) to help members walk through the download process. In various embodiments, Google Cardboard (or equivalent) is provided to members so that they may fully engage and interact with the content (e.g., provided in act 14).

[0026] Data capture is accomplished in a number of embodiments (e.g., in act 16). For example, in some embodiments, the app (e.g., provided in act 13) prompts participants or members for response input/feedback, for instance, during the immersive and merged reality experience session (e.g., in act 15). In some embodiments, prompts may solicit close-end or open-ended responses, as examples, or other input such as preferences, selections, reservation/purchase information, or a combination thereof. In particular embodiments, (e.g., all) response/input data is captured (e.g., in act 16) and transferred (e.g., in act 17), for example, to a cloud-based server, where it can be accessed and analyzed, for instance, for each immersive and/or merged reality experience session (e.g., provided in act 14). Various embodiments provide tracking, incentives, or both. For example, in some embodiments, the app (e.g., provided in act 13) provides member usage and participation metrics (e.g., specific sessions, frequency, completion, or a combination thereof). Further, in some embodiments, the metrics may be used for performance and efficiency optimization, to provide participation incentives to members, or both. Even further, in some embodiments, the app (e.g., in act 13) captures member-specific participation and performance metrics (e.g., in act 11), supports a points-based system of incentives, or both, for example.

[0027] In various embodiments, potential applications or use-cases for the app (e.g., provided in act 13) include, as examples: education, market research, brand image positioning (e.g., in environment testing), creative concept testing (e.g., advertising, signage, activation, etc.), retail environment simulation (e.g., shopper), hotel & hospitality (e.g., guest), product innovation and concepting (e.g., new product ideas, etc.), product assessment and enhancement (e.g., pre, during, or post development), buyer education and engagement, transportation (e.g., auto, aviation, yachts/boats, rv, commercial transport), recreation and travel (e.g., golf courses, resorts (e.g., beach, ski, etc.), parks, amusement parks, cruises, etc.), tourism (e.g., city tours, convention centers, tradeshows, etc.), hotel and hospitality (e.g., guest room viewing/selection, events, etc.), sports and entertainment (e.g., venue assessment, seat selection, etc.), fashion and apparel (e.g., fashion shows, buyer shows/markets, etc.), real estate assessment (e.g., commercial, residential, warehouse, apartments, assisted living), and architecture and design (e.g., build process, option assessment, etc.). These are examples and some embodiments include, or are used for, other acts or combinations thereof.

[0028] In a number of embodiments, a immersive and merged reality experience (e.g., provided in act 14) provides a presentation plus an ability for data capture (e.g., responses, etc., for instance, in act 16). Further, in certain embodiments, an integrated (e.g., smartphone) app (e.g., provided in act 13) allows for pushing immersive and merged reality experiences to end- participants (e.g., provided in act 14) and capturing response data (e.g., in act 16). Still further, various embodiments provide screening of participants (e.g., in act 12), for example, based on demographics or other information (e.g., age, income, geography, etc., for instance, collected in act 11 ). Even further, a number of embodiments prompt (e.g. , in act 15) for interaction or response, for instance, while engaging in the immersive and merged reality experience (e.g., provided in act 14). Further still, some embodiments include proactively pushing immersive and merged reality experiences and content (e.g., in act 14) to recipients based, for example, on a certain set of attributes, demographics, or recipient criteria (e.g., collected in act 11, screened in act 12, or both). Certain embodiments download content (e.g., provided in act 14) through the app (e.g., provided in act 13, for instance, reactively) and some embodiments include a proactive "intelligent push" capability as well or instead (e.g., in act 14). In some embodiments, this can be a point of distinction versus other alternatives.

[0029] In various embodiments, the app (e.g., provided in act 13) provides for a quick initial load. In some embodiments, for example, with AR, a space is taken and then areas are tagged with questions (e.g., for act 15). In certain embodiments, the user views the space (e.g., through their device) and questions then appear through this lens (e.g., provided in act 15). Further, a number of embodiments provide an intuitive, easy-to-use application (e.g., provided in act 13) with simple UIs, for example, consistent with best practices. Further still, various embodiments include a high- quality media viewer, for example, for 360° media (e.g., photos, videos, or both). Still further, some embodiments include high-performance UI screen loading and frame rate within compatible devices. Even further, some embodiments include a gamification system, for instance, where participants' participation is tracked, for example, with tiered incentives. Even further still, in some embodiments a questionnaire is provided (e.g., provided in act 11 or 15) as part of the core experience (e.g., provided in act 14), for example, with text entry via a device keyboard.

[0030] Various embodiments, for example, provide an unauthenticated experience (e.g., provided in act 14), for instance, for casual use with public or demo content. Further, various embodiments provide an authenticated experience, for example, providing members-only content (e.g. , provided in act 14). Further still, some embodiments link out to (e.g. , up to 36) website URLs. In a number of embodiments, for example, the URLs lead to the device, for instance, as configured by the participant or user. Some embodiments use WebVR" technology. For instance, some embodiments link out to (e.g., up to 36) website URLs, displaying, for example, a rendering of HTML, CSS, JavaScript and/or WebVR markup or code. In certain embodiments, WebVR is an example of an alternative delivery mechanism for VR. Some embodiments provide app-delivered experiences, but in other embodiments, apps are not required or not used. For instance, in particular embodiments, a website provides an app-like experience. Many embodiments, however, are accessed through an app, (e.g., provided in act 13) for example, rather than a mobile browser. Still further, in some embodiments, the app provides (e.g., 360°) image, video, or both, for instance, or related content, for example, delivered in free-to-download "packs" to authenticated participants, for instance, based on user permissions. In some embodiments, user-friendly content publishing tools are used (e.g. , for staff, for instance, CMS or equivalent). Even further, in some embodiments, an (e.g., branded) "Google Cardboard" (tm) viewer is offered, for example, which can be distributed to participants (e.g., in act 13).

[0031] In a number of embodiments, authentication includes Sign-Up, Sign-In, Log Out, and Forgot Password options or commands (e.g., in act 11). Further, in a number of embodiments, industry-standard account security can be used, for example. Still further, data capture (e.g., in act 16) can be performed, in some embodiments, for instance, with a users' questionnaire (e.g., provided in act 15, for instance, form fields, free text entry, audio, video, or a combination thereof). Even further, data capture (e.g., in act 16) can be performed, in a number of embodiments, by capturing participants' viewing behavior. Further still, measurement can be accomplished, in a number of embodiments, actively, for example, via questionnaire data (e.g., completion percent, entries, or free text), or passively, for example, via viewing behavior, for instance, via viewing location, dwell time, or both (e.g., in act 16). [0032] Further, in some embodiments, metrics can include unique participants, session length, content downloads (e.g., per participant, total, or both). Even further, in some embodiments, reporting (e.g., in act 17) can be via a responsive web dashboard, for example, that aggregates analytics for client view. Still further, in some embodiments, questionnaire data can be viewed as bar graph, for example. Further still, in some embodiments, viewing behavior for a piece of content (e.g., provided in act 14) can be exported or displayed as a "heat map" (e.g., per participant, per segment, total, or a combination thereof). Even further still, in some embodiments, questionnaire data (e.g., collected in act 16) can be exported (e.g., in act 17) to common format (e.g., CSV, etc.). still further, in some embodiments, questionnaire data is collected and aggregated in real time (e.g., in act 16). Moreover, in some embodiments, distribution (e.g., in act 13) can be accomplished my making the App available on Apple iTunes app store, Google Play app store, or both, as examples.

[0033] In particular embodiments, compatibility is with iOS version 8.0 & later, Google Cardboard-compatible iOS devices, Android version v4.1 and up, or a combination thereof. Additionally, in some embodiments, devices include Google Cardboard-compatible Android devices. Further, various embodiments of the subject matter described herein include various combinations of the acts, structure, components, and features described herein, or that are known in the art. Moreover, certain procedures can include acts such as manufacturing, obtaining, or providing components that perform functions described herein or in any documents that are incorporated by reference. The subject matter described herein also includes various means for accomplishing the various functions or acts described herein, or that are apparent from the structure and acts described. Each function described herein is also contemplated as a means for accomplishing that function, or where appropriate, as a step for accomplishing that function. Further, as used herein, the word "or", except where indicated otherwise, does not imply that the alternatives listed are mutually exclusive. Even further, where alternatives are listed herein, it should be understood that in some embodiments, fewer alternatives may be available, or in particular embodiments, just one alternative may be available, as examples.