WO/2002/005168 | METHOD AND SYSTEM FOR QUICK READING PRACTICE USING INTERNET |
WO/2018/204977 | EDUCATIONAL AID |
JPH07114457 | SCENARIO GENERATING SYSTEM |
PETRICK TINA MARIE (CA)
PENNEY SEAN CHARLES (CA)
COBURN DANNY GORDON (CA)
LEE LESTER YONG-JIUNG (CA)
WOODALL JASON (CA)
KUICH LOREN JOSEPH (CA)
MIELCARSKI SCOTT WILLIAM (CA)
AGBA UCHECHUKWU LINUS (CA)
DHILLON DILPREET SINGH (CA)
RADFORD SARAH (CA)
ANDERSON KATRIANNA DORA (CA)
LINK BRYAN (CA)
YAP ZHAN HUI (CA)
CHEUNG LAWRENCE LI TUNG (CA)
PRATT IAN RAY (CA)
SLATER CHRISTOPHER ALAN (CA)
COMEAU LINDSAY MARIE (CA)
CAMPBELL CLAYTON DONALD (CA)
MACDONALD BRADEN (CA)
HU WEI (CA)
KVANBECK PER ALBERT WAGNER (US)
KRUPA JOEL RUSSELL (CA)
CHEN TE-YUAN (CA)
SZILAGYI DANIEL NICHOLAS (CA)
US20130004929A1 | 2013-01-03 |
ABU-SHUKHAIDEM ET AL.: "EECS - 571 Software Engineering Term Report Product Requirement Specification of Distance Learning NET (DL-NET 1.0)", ELECTRONIC VISUALIZATION LABORATORY (EVL) AT THE UNIVERSITY OF ILLINOIS AT CHICAGO (UIC, 24 July 2010 (2010-07-24), XP055542408, Retrieved from the Internet
Claims We claim: 1. A system for generating one or more location-based learning tools that are missions, and providing at least one of the one or more missions to one or more users via the one or more users' mobile devices, comprising: (a) a platform operable by one or more builders on one or more computing devices, said platform being operable to generate the one or more missions; (b) a server connected to the platform operable to store the one or missions and information relating thereto, and further being operable to transfer at least one of the one or more missions to the one or more users' mobile devices; and (c) the one or more users' mobile devices being operable to receive one or more of the one or more missions from the server via the Internet, said one or more user's mobile devices further being operable for each of the one or more users to operate the one or more missions. 2. The system of claim 1, wherein application software operable to operate the one or more missions is downloaded from the platform to at least one of the one or more users' mobile devices. 3. The system of claim 2, wherein the application software is operable to generate user performance analytics of interaction of each of the one or more users with at least one of the one or more missions through the user's mobile device, and to transfer the user performance analytics to the platform. 4. The system of claim 1, wherein the builder operates the platform to generate one or more challenges and incorporates at least one of the one or more challenges in each of the one or more missions. 5. The system of claim 4, wherein the one or more challenges cause the user to engage in one or more of the following: visual identification; sound identification; location identification; geo-location focused scavenger hunt; augmented reality object recognition; and classification of objects. 6. The system of claim 1, wherein the one or more missions engage at least one of the one or more users in educational requirements of an educational institution or school board. 7. The system of claim 1, wherein the one or more missions are transferred to the one or more users' mobile devices via an Internet connection. 8. The system of claim 1, wherein each builder can share missions by storing said missions in one or more shared content libraries, each of the one or more shared content libraries being accessible by one or more builders. 9. The system of claim 8, wherein each of the missions accessed by the one or more builders from the one or more shared content libraries is operable by a builder as a template to be modified to generate a new mission through operation of the platform. 10. The system of claim 1, wherein one of the one or more users' mobile devices is a master device operable to control the use of at least one or more of the one or more users' devices that are slave devices, and the use of the mission by users on said slave devices. 11. The system of claim 10, wherein the master device is operable to track the geo- location of each of the slave devices while the users of the slave devices engage in missions through the slave devices. 12. The system of claim 1, wherein the users' mobile devices of two or more users are linked and the use of one of the one or more missions by said two or more users is coordinated through said two or more users' mobile devices. 13. The system of claim 1, wherein only the one or more missions relating to the geo- location of a user will be transferred to a mobile device of said user. 14. The system of claim 1, wherein: (a) at least one of the one or more users' mobile devices is operable to capture location content relating to a geo-location and transfer said location content to the platform or to a builder that transfers the location content to the platform; and (b) the platform being operable by at least one of the one or more builders to incorporate the location content in one or more missions. 15. The system of claim 1, wherein the platform is operable by one of the one or more builders to modify one of the one or more missions, and for said builder to view the modified mission in an application software format in real time or virtually real time and to make additional modifications to said mission through operation of the platform. 16. A method for generating one or more missions that are location-based learning tools and providing at least one of the one or more missions to one or more users via the one or more user's mobile devices, characterized in that it comprises the following steps: (a) a builder utilizing a platform operable on a computing device to generate the one or more missions; (b) storing the one or more missions and information relating thereto on a server connected to the platform; (c) transferring one or more of the one or more missions and related information via the Internet from the server to the one or more user's mobile devices; (d) the one or more user's mobile devices receiving the one or more of the one or more missions and related information via the Internet from the server; and (e) the one or more users each operating one of the one or more user's mobile devices further to undertake one or more of the one or more missions. 17. The method of claim 16, characterized in that it comprises the further step of one or more of the one or more user's mobile devices transferring mission information to the server via the Internet. 18. The method of claim 17, characterized in that it comprises the further steps of: the platform analyzing the mission information received from one or more users; and the platform generating statistical output based upon such analysis. 19. The method of claim 16, characterized in that it comprises the further step of categorizing at least one of the one or more missions as relating to a specific geo- location. 20. The method of claim 16, characterized in that it comprises the further step of generating at least one of the one or more missions to be compliant with educational requirements and relating to a specific geo-location. |
This application claims the benefit of United States Provisional Patent Application Serial No. 62/482,419 filed April 6, 2017. Field of Invention
This invention relates in general to the field of location-based learning tools and more particularly to building and providing location-based learning tools.
Background of the Invention
Gaming provided through a computer device, such as a desktop computer, a laptop, a computer console attached to a display screen, a mobile device, a smartphone, a tablet, or other computer devices is known in the prior art. Some examples of gaming can also utilize location-based information, such as the following examples.
U.S. Patent No. 9,226,106 granted to Niantic, Inc. on December 29, 2015, discloses a system and method for filtering communication with a location-based game. The method incorporates receiving communication data for a plurality of players associated with the location-based game at a computing device. Such communication data is then filtered for each player based on one or more signals associated with such player.
U.S. Patent No. 9,155,964 granted to Steelseries APS and SteelSeries HQ on October 13, 2015, discloses a server device operable to map the boundary and topographical information of a first and second player to a virtual gaming space. The server device is further operable to generate first and second virtual players corresponding to the first and second players and superimpose a representation of the first and second players onto a transparent viewing apparatus for viewing of the virtual gaming space.
Prior art methods also exist whereby, within a particular environment, augmented reality elements can be incorporated into visuals as viewed by a user through a mobile device screen. Some such prior art incorporates virtual or augmented reality elements into a gaming experience. The following are examples of this type of prior art. U.S. Patent No. 9,443,382 granted to Bally Gaming Inc. on September 13, 2016, discloses a method for enabling a user in an augmented reality gaming venue to use an augmented reality gaming venue component and a mobile device to find a particular game or gaming machine. The method incorporates controlling a camera on the mobile device using the augmented reality gaming venue component. Several steps occur once the augmented reality gaming venue component is activated: the location and orientation of the mobile device are determined; data is retrieved for the augmented reality gaming venue; a list of gaming machines and other objects visible to the camera is generated; a camera-captured image is rendered on the display of the mobile device; and icons are overlaid on the image for each visible object to display additional visual information to a user on the display in response to the user aiming the mobile device at gaming machines or other objects of interest in the augmented reality gaming venue.
U.S. Patent No. 8,550,909 granted to Microsoft Technology Licensing LLC on October 8, 2013, discloses a method whereby a user takes multiple pictures of specific points of interest in a geographical location. Augmented reality games cause shooting targets to be associated with the points of interest. The game has the effect that the user is motivated to achieve data accumulation relating to the location.
U.S. Patent No. 8,730, 156 granted to Sony Interactive Entertainment Inc. on May 20, 2014, discloses a way to control a virtual-scene view in a portable device. The device is synchronized through a signal to cause the location of the device to be a reference point in a three-dimensional (3D) space. A virtual scene incorporating virtual related elements is generated around the reference point, taking into account the position of the device. The created view is displayed on the device, and the scene is changed as the device is moved within the 3D space. Multiple players may share the virtual reality and interact with each other in the virtual reality.
There is a need for location-based learning tools that incorporate educational activities: that can be provided to one or more users through a computing device, when said users are positioned in a particular location. Summary of the Invention
In one aspect, the present disclosure relates to a system for generating one or more location-based learning tools (missions) and providing at least one of the one or more missions to one or more users via the one or more user's mobile devices, comprising: a platform operable by one or more builders on a computing device to generate the one or more missions; a server connected to the platform operable to store the one or missions and information relating thereto, and further being Internet-connected and operable to transfer one or more of the one or more missions and related information via the Internet; and the one or more user's mobile devices being connectible to the Internet and operable to receive one or more of the one or more missions from the server via the Internet, said one or more user's mobile devices further being operable for each of the one or more users to operate the one or more missions.
In this aspect the present disclosure further relates to a system wherein application software is operable to operate the one or more missions is downloaded from the platform to at least one of the one or more users' mobile devices.
In this aspect the present disclosure further relates to a system wherein application software is operable to generate user performance analytics of interaction of each of the one or more users with at least one of the one or more missions through the user's mobile device, and to transfer the user performance analytics to the platform. In this aspect the present disclosure further relates to a system wherein the builder operates the platform to generate one or more challenges and incorporates at least one of the one or more challenges in each of the one or more missions.
In this aspect the present disclosure further relates to a system wherein one or more challenges cause the user to engage in one or more of the following: visual identification; sound identification; location identification; geo-location focused scavenger hunt; augmented reality object recognition; and classification of objects. In this aspect the present disclosure further relates to a system wherein the one or more missions engage at least one of the one or more users in educational requirements of an educational institution or school board.
In this aspect the present disclosure further relates to a system wherein the one or more missions is transferred to the one or more users' mobile devices via an Internet connection.
In this aspect the present disclosure further relates to a system wherein each builder shares missions by storing said missions in one or more shared content libraries, each of the one or more shared content libraries being accessible by one or more builders. In this aspect the present disclosure further relates to a system wherein each of the missions is accessed by the one or more builders from the one or more shared content libraries is operable by a builder as a template to be modified to generate a new mission through operation of the platform.
In this aspect the present disclosure further relates to a system wherein one of the one or more users' mobile devices is a master device operable to control the use of at least one or more of the one or more users' devices that are slave devices, and the use of the mission by users on said slave devices.
In this aspect the present disclosure further relates to a system wherein the master device is operable to track the geo-location of each of the slave devices while the users of the slave devices engage in missions through the slave devices.
In this aspect the present disclosure further relates to a system wherein the users' mobile devices of two or more users is linked and the use of one of the one or more missions by said two or more users is coordinated through said two or more users' mobile devices.
In this aspect the present disclosure further relates to a system wherein only the one or more missions relate to the geo-location of a user will be transferred to a mobile device of said user. In this aspect the present disclosure further relates to a system wherein: (a) at least one of the one or more users' mobile devices is operable to capture location content relating to a geo-location and transfer said location content to the platform or to a builder that transfers the location content to the platform; and (b) the platform being operable by at least one of the one or more builders to incorporate the location content in one or more missions.
In this aspect the present disclosure further relates to a system wherein the platform is operable by one of the one or more builders to modify one of the one or more missions, and for said builder to view the modified mission in an application software format in real time or virtually real time and to make additional modifications to said mission through operation of the platform.
In another aspect, the present disclosure relates to a method for generating one or more missions that are location-based learning tools and providing at least one of the one or more missions to one or more users via the one or more user's mobile devices, characterized in that it comprises the following steps: a builder utilizing a platform operable on a computing device to generate the one or more missions; storing the one or more missions and information relating thereto on a server connected to the platform; transferring one or more of the one or more missions and related information via the Internet from the server to the one or more user's mobile devices; the one or more user's mobile devices receiving the one or more of the one or more missions and related information via the Internet from the server; and the one or more users each operating one of the one or more user's mobile devices further to undertake one or more of the one or more missions.
In this aspect the present disclosure further relates to a method characterized in that it comprises the further step of one or more of the one or more user's mobile devices transferring mission information to the server via the Internet.
In this aspect the present disclosure further relates to a method characterized in that it comprises the further steps of: the platform analyzing the mission information received from one or more users; and the platform generating statistical output based upon such analysis.
In this aspect the present disclosure further relates to a method that comprises the further step of categorizing at least one of the one or more missions as relating to a specific geo- location.
In this aspect the present disclosure further relates to a method that comprises the further step of generating at least one of the one or more missions to be compliant with educational requirements and relating to a specific geo-location.
In this respect, before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and to the arrangements of the components set forth in the following description or illustrated in the drawings. The invention is capable of other embodiments and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting.
Brief Description of the Drawings
The invention will be better understood and objects of the invention will become apparent when consideration is given to the following detailed description thereof. Such description makes reference to the annexed drawings wherein:
FIG. 1 is a systems diagram of an embodiment of the present invention.
FIG. 2 is a systems diagram of an embodiment of the present invention, whereby multiple location-based learning tools may be generated by multiple builders.
FIG. 3 is a systems diagram of an embodiment of the present invention, whereby multiple users are provided with one or more location-based learning tools. FIG. 4 is a systems diagram of an embodiment of the present invention, whereby multiple users are provided with a location-based learning tool and a master device may wholly or partially control the use of the location-based learning tool by the users.
FIG. 5 is a flowchart of a method of an embodiment of the present invention.
FIG. 6 is a screen shot showing user statistics displayed to a user in an embodiment of the present invention.
FIG. 7 is a screen shot showing badges earned by a user being displayed to a user in an embodiment of the present invention.
FIG. 8 is a screen shot showing user statistics displayed to a user in an embodiment of the present invention.
FIG. 9 is a screen shot showing a character used to achieve calibration of an element of the user's mobile device in an embodiment of the present invention.
FIG. 10 is a diagram indicating motions to facilitate calibration of the compass of the device based upon accelerometer roll, pitch and yaw applicable in an embodiment of the present invention.
FIG. 11 is a screen shot showing indicators integrated with a scene and a menu that is a "gadget" menu of an embodiment of the present invention.
FIG. 12 is an example of a scene that may be displayed on a user's mobile device that incorporates options that a user may choose in an embodiment of the present invention.
FIG. 13 is a screen shot showing a message provided by the mission suite to a user in an embodiment of the present invention.
FIG. 14 is an example of a message to a user that may be displayed to a user via the user's mobile device in an embodiment of the present invention.
FIG. 15 is an example of a message to a user that may be displayed to a user via the user's mobile device in an embodiment of the present invention. FIG. 16 is a screen shot showing a challenge start screen indicating information relating to the challenge displayed to a user via the user's mobile device in an embodiment of the present invention.
FIG. 17 is a screen shot showing a message displayed to a user relating to progress in a challenge in an embodiment of the present invention.
FIG. 18 is a screen shot showing a mission directional aid indicating where a challenge of the mission may be located, as displayed to a user via the user's mobile device in an embodiment of the present invention.
FIG. 19 is a screen shot showing mission instructions for a challenge of the mission, as displayed to a user via the user's mobile device in an embodiment of the present invention.
FIG. 20 is a systems diagram of the platform as used by multiple builders to create missions and other app content in an embodiment of the present invention.
FIG. 21 is a systems diagram of the platform and app whereby a builder can view app content developed by the builder in an embodiment of the present invention.
FIG. 22 is a systems diagram of a private publish-subscribe server in an embodiment of the present invention.
FIG. 23 is a systems diagram of an embodiment of the present invention incorporating a trainer service.
FIG. 24 is a systems diagram of an embodiment of the present invention incorporating an augmented learning outcome.
FIG. 25 is a systems diagram of an embodiment of the present invention incorporating an object of interest in a real world location.
In the drawings, embodiments of the invention are illustrated by way of example. It is to be expressly understood that the description and drawings are only for the purpose of illustration and as an aid to understanding, and are not intended as a definition of the limits of the invention.
Detailed Description of the Preferred Embodiment
The present invention is a method and system operable for building one or more location- based learning tools (i.e., missions) and providing said one or more missions to one or more users. The one or more missions may be built by one or more builders, and said one or more builders may wholly or partially share one or more missions with each other for the purpose of creating other missions. The one or more missions may each relate to a specific geographical location. The one or more users may implement a mission while located at any geographical location that relates to the mission.
The builders may create missions using a mission building platform, as described herein. The platform further generates additional elements, as discussed herein, that are transferred with one or more missions to a user's mobile device, for example as an app. The user can engage in the mission(s) from the user's mobile device. Each mission may incorporate multiple challenges that constitute specific activities or content with which the user engages. The missions and the additional content of the app collectively constitute a mission suite.
The term "mission" as used herein references a location-based learning tool that is built by a builder through use of a platform for building missions. A mission may be a location-based learning tool that is geo-location based and incorporates one or more interactive activities to be performed by a user on a mobile device. Each mission is developed for use in a specific geographic location (geo-location) by a user on an Internet-connectable mobile computing device that may be any of the following: a smartphone, a cellphone, a tablet, wearable technology incorporating a display and an input element, or any other mobile computing device. (Any reference herein to "mobile computing device" or "mobile device" are interchangeable to reference any of the mobile computing devices discussed herein. Any reference herein to "computer device" or "computing device" includes any mobile device as well as any laptop, desktop, or other computing device.) Each mission may incorporate one or more activities or challenges to be performed by a user, as described herein.
The term "challenge" as used herein references location-based content contained within a mission (e.g., mission content) that can be created through different means; including being made by a builder, automatically generated through a computer, or a combination of both.
The term "builder" as used herein references a person who accesses the platform of the present invention, whereby the builder can create, develop and generate a mission, through use of a computing device, such as a laptop, desktop computing device, smartphone, cellphone, tablet or any other computing device.
The term "user" as used herein references a person who is provided with a mission through a mobile computing device (of any of the types discussed herein), such as by way of a download of the mission to the user's mobile computing device, and who can operate the mobile computing device to undertake the mission steps. A user can also be a builder and a builder can be a user.
The term "library" as used herein references a live, expandable list of partial or whole content to aid builders in creating a mission. All libraries exist in, and are accessible by builders from, the mission building platform. The library content can include challenges, templates, or media or text selections that a user can choose and utilize in the creation of missions. A library can contain builder-specific content, whereby parts of the library may be made available to the builder through a subscription or other directed means. A library may be searchable, whereby a builder can browse and search through the content available to a builder from the library.
One embodiment of the present invention incorporates a web-based platform operable to generate missions. The platform may be operable as computer software incorporating instructions that are processed by one or more computer processors of a computer device. Such a platform may be utilized to create, develop and generate a variety of missions. Each mission may require activities or other participation to be engaged in by the user. These activities or participation required by the user (challenges) constitute mission content. Below are some examples of types of mission content, including some challenges, that may be incorporated individually or in combination in a mission. i. Visual Identification: Missions may be built to require the identification of elements in a geographical location, such as, for example, flora or fauna, monuments, landmarks, retail establishments, historical figures, extinct species, artwork, astronomical items, or museum artifacts. A user may be required to identify such elements based on images shown to the user and/or photos taken by the user as provided and/or required by the mission instructions. In some embodiments of the present invention, the app may perform image recognition (such as facial recognition), such that a photo taken by a user on a mobile device may be analyzed to determine if the photo incorporates particular fauna or flora, exhibits, landmarks, monuments, retail establishment, astronomical items (including but not limited to, stars, constellations, planets, comets, asteroids, black holes), general items, street names, or artwork, that the user is tasked with photographing as part of a mission. Visual identification may also involve the capture of flora, fauna or other elements by the user. ii. Sound Identification: Missions may be built to include identification of sounds relating to elements located in a particular geographic location, such as, for example, fauna, musical compositions, national anthems, composers, speeches, historical periods, historical figures, political figures, historical events, or historical periods based on sounds (including but not limited to, bird calls, animal cries, or other nature sounds, musical compositions or musical clips, clips from speeches, musical composition clips) that are provided to the user and/or recorded by the user as required by the mission instructions. In embodiments of the present invention, the app may perform sound recognition, such that the user may record a sound on the mobile device and the app may analyze the sound to determine if the sound is that of specific fauna to be found and recorded by the user as part of a mission, or to identify a national state (i.e., national anthem sound clips). iii. Location Identification: Missions may be built to require the identification of landmarks, tourist destinations or monuments based on location data provided to the user. iv. Activity Elements: Missions may be built to include a variety of activity elements, including scavenger hunts relating to a geo-location, stories relating to a specific geo-location, or other activity elements relating to the natural environment or urban environment of a geo-location. As an example, urban environments may include any of the following, exhibits in art galleries, museums, science centers, zoos, aquariums, planetariums, urban architecture, corporations, retail sites, social infrastructure, or any other urban environment elements. v. Augmented Reality: Missions may be built to involve augmented reality characters or other augmented reality elements that are displayed to a user through the user's mobile computing device. Vuforia™, custom software, or other relevant software may be utilized to generate the augmented reality elements into missions. The system may recognize that an augmented reality character or object should be displayed to a user in accordance with any of the following: QR codes, specific object recognition, colour block recognition, full 3D object recognition, or other options. The augmented reality may rely upon image recognition and frame of reference elements integrated in the mission. A user may be required to find and capture augmented reality items, including: flora and fauna; extinct species; historical items or figures; artwork or museum artifacts; landmarks or monuments; general items; and astronomical items; vi. Classifications: Missions may be built to require the finding of and capture of, or sorting and classification of, flora/fauna, extinct species, historical items or historical figures artwork or museum artifacts, landmarks or monuments, general items, and astronomical items. Such items may be presented in augmented reality.
One or more of these types of mission content can be included in a mission, and other mission content may also be included in a mission. The mission suite is operable so that a mission can be selected by a user of the mobile device and the mission can be performed by the user.
In an embodiment of the present invention that is utilized by an organization, missions may be built to conform to requirements of such organization, or to particular institutions within or related to the organization. For example, an organization may be an educational organization, such as a school and/or a board of education. Missions may be built to support requirements of a school or a board of education, such as educational grade requirements or education standard requirements. In such an embodiment of the present invention the missions may be built to represent curriculum content, whereby a user may receive educational credit for completing such a mission. Content of the mission may be built to support other organizations, including standards, messaging, and training requirements of such organizations.
The one or more missions may be transferred or otherwise made available to a user's mobile device in a variety of formats. In one embodiment of the present invention, the one or more missions are transferred to the user's mobile device as a software application (an "app") for operation on the mobile device. The information provided to or accessible by a user's mobile device is operable for a user to select a mission on the mobile device and to perform or otherwise undertake the mission. (The steps involved in performing or undertaking a mission will depend on the mission content that may be of various types, as discussed herein.) The mobile device may further operate with: (i) the app, and with the one or more missions and the other information provided to the mobile device with the one or more missions (the "mission suite"); and (ii) other information available to or generated by the mobile device, to include any of the following steps: i. Geo-location: The geo-location of the mobile device may be identified (i.e., through a global positioning system (GPS) of the mobile device, or some other geo-locator element). The geo-location of the mobile device may further be tracked and made available to other users, to builders of missions, a master device, or administrators through the mission suite sending information to the platform (via the Internet and the server), depending on the configuration of the mission suite. Furthermore, the availability of particular missions to a user may depend on the geo-location of the user (i.e., missions relating to a specific geo- location may only be offered to a user who is located in or near that geo-location) and/or other criteria. Missions may be built by using geo-location to search geo- tagged content allowing a user to find and use content (including but not limited to, images, sound clips, information, challenges created by other users) that is geographically relevant (i.e., near the user, or near the user's Mission); Performance: The mission suite may be operable to transmit information relating to the user's performance in one or more missions back to the platform (via the Internet and the server). In an embodiment of the present invention, information may be transferred from the user's mobile device relating to the mission. For example, a mission may be built through a builder using the platform, and the mission may be stored in a server or other storage device connected to the platform (either through a wired or wireless connection). A mission (and related information) that has been sent from the server may be received and stored by a user's mobile device. The user's mobile device may further send information relating to the user's use of the mission to the server. The platform may access such user's information relating to a mission and may analyze such information to generate outputs that may be displayed and or stored, such as statistics relating to the mission and/or the user's use of the mission. Such statistics and information may be displayed in a variety of forms including graphs, tables, numeric representations, graphic representations, written reports, etc. In an embodiment of the present invention, user information may be collected from multiple users relating to one or more missions, and the platform may collectively analyze such user information to produce results relating to any of the user's use of the one or more missions. The results may be displayed to show results relating to each of the one or more missions, or the missions collectively. Other types of analysis and results may further be undertaken by the platform based upon the information that the platform generates and receives from one or more users relating to one or more missions. iii. Character Personality: The app may use natural language parsing ( LP), text-to- speech, and speech-to-text, to build an interactive personality into the various characters in a mission or other portion of the app such that a user can ask an interactive personality various questions and the interactive personality can assist the user with performing various functions, such as functions of the mission suite.
The mission suite may further incorporate one or more of the following elements and/or functions as supported by the operability of the platform: a. The mission suite may be content agnostic or brand agnostic, for example, to allow a variety of organizations to use the same missions, such as to allow educators from any school board to use educational missions in any subject; b. Missions may be built that require the development of critical thinking skills by users performing said missions, or the demonstration of understanding of mathematical principles or physics principles in augmented reality; c. Missions may be built by searching content, created by other users of the platform, for example searches may be by keyword, curriculum code, subject, grade level, or popularity; and d. Mission information content that is uploaded by users of the platform to the platform (via the Internet and the server) may be automatically tagged by visual recognition technology, such as image recognition technology to enhance searchability.
Multiple facilities, functionalities and modules may be available to builders through the platform that assist with the building of missions. Builders who create missions may build missions in collaboration with other builders, for example, such as informal educators and formal educators. Builders may be educators, in the formal or informal sector, students, or other types of builders. Builders using the platform may tag other builders' content or rate content;
The platform may permit one or more builders to share the missions and mission content they have built with one or more other builders. For example, one or more missions that have been built previously, or portions of mission content thereof, may be shared with one or more other builders and thereby integrated into new missions that are being built. This may facilitate continuity between missions.
The mission experience may also be shared amongst users through the app. The configuration of the mission suite may be one or more types of configurations. For example, the mission suite may be provided to a user as a member of a group, such as a class of students, or some other group. In such a configuration the mission suite may function such that the members of the group are recognized as inter-related. In such an embodiment the geo-location and/or progress with the missions of the users may be tracked by a central body, such as the platform, an administrator, a teacher or some other central body. This embodiment of the present invention may further analyze mission information from the users of the group individually and collectively. For example, if the group is a class of students, the mission information of the users who are students may be analyzed to determine standing in the class in accordance with the performance of each user in relation to the one or more missions, the performance of the class as a collective, or some other type of analysis may be undertaken relating to the participation of the users as students in a class.
It is also possible that the device of one member of the group may further be configured to act as a master device that can wholly or partially control the mobile devices of the other users as relates to the missions. For example, the master device may control the screen displayed to the users, when the users can start a mission, or which mission the users will undertake. This type of control can be helpful to ensure that all members of a group keep at a coordinated pace in relation to the performance of missions or challenges within a mission. The geo-location and/or progress within the missions and/or challenges by users, or other information relating to the users' performance of the missions, may further be provided to the master device. The master device may be operable to send messages to all of the users in the group, such as reminders, additional information required for a mission, or other messages. A master device may wholly or partially control the use of the mission suite by the users, and may receive geo-location tracking information and/or mission progress information relating to the users in the group. This has the benefit that a group of users, such as a class, may engage in missions simultaneously, and possibly interactively, and the user of the master device can enhance this experience by increasing the collaboration amongst the group of users, provide information to all of the users and/or help coordinate the progress of the users' relating to the missions. Group learning can therefore be achieved through such an embodiment of the present invention.
The mission suite may be operable such that multiple iOS™, Android™ or other types of devices may communicate without the use of Wi-Fi, data or Bluetooth™ technology, allowing for group engagement in missions.
Another example of a type of configuration of a mission suite is provided to an individual, isolated user. In such a configuration the mission suite is utilized by a user who is unrelated to any other users. The mission suite may be operable to geo-track the user and to feed this information to the platform (via the Internet and the server), but it may not geo-track the user in some uses of the missions suite. Geo-tracking of an individual user may be useful if the user is undertaking a trial-run of a mission and the geo-tracking and any progress information relating to the user's use of the mission is transferred to a mission builder, who may amend or modify the mission in the platform based upon such information. Yet another example of a type of configuration of a mission suite is that two or more users may be linked, such that the provision of the missions to the linked users is coordinated, either wholly or partially. For example, the same mission displays may be shown to all linked users simultaneously, or mission displays may start at the same time for all users but will progress individually in accordance with the speed of a particular user in performing the mission. Linked users may also engage: (i) in missions that are built for use by two or more users interactively; and/or (ii) in real-time augmented reality gaming experiences.
The present invention offers a user educational content, and not merely a gaming experience as is provided by the prior art. Therefore, the present invention can be developed and utilized for purposes that include use in an educational curriculum, a certification program, on-site training, or other educational and attainment of standards and qualifications uses.
The present invention further permits collaborative development of location-based learning tools (missions). The present invention permits the whole or a portion of a previously developed mission to be shared by a builder with one or more other builders to create other missions. In this manner a mission created for one location can be partially utilized by another builder to create a mission for another location. The locations of the original and the copied mission may have similarities, or the locations may be dissimilar. By sharing mission elements there will be similarities in the activities that occur at the two locations. For example, a mission created for a park in Ontario can be partially utilized to create a mission for a park in Alberta. As another example, a mission relating to astronomy, such as a mission that involves viewing a particular constellation, may be copied to occur at a dissimilar location to the location where the mission was first created to occur, but both missions will involve viewing the constellations. Partially utilizing the mission may involve keeping the same types of activities in the mission (such as sound recognition, image recognition, etc.), but changing elements relating to those activities (such as the types of items and sounds that are to be recognized, so that these are indigenous to the location of the mission). In this manner sharing of the whole or portions of missions can offer builders benefits over the prior art.
Missions may also each be tailored for a specific location, and such missions may only be available to users located in or near the specific location that is related to a mission. In this manner, a user may receive access to one or more missions that are specifically created for use in the location of the user. The experience of the user of the present invention is thereby tailored to only be utilized in a specific geo-location. For example, the present invention can create missions that are created to relate only to sounds, flora, fauna, or other elements that appear in a discrete and specific location. This can offer an enhanced learning opportunity for the user to interact with, and be educated about, a particular geo-location.
Examples of the Platform and the App
An example of a system of the present invention is shown in FIG. 1, whereby a platform for building missions may be accessed by a builder through a computing device 16. The platform may be stored either on the computing device or in a server 14. The platform may be operable by the one or more computer processors of the computing device.
The server 14 may be accessed by the computing device 16 either directly or via a connection to the Internet 12. Information may be passed bi-directionally between the server and the computing device (either directly or via the Internet). The builder may utilize the computing device to create missions. Once a mission is created it may be available for a user to obtain, by downloading the mission to the user's mobile device.
A user may obtain one or more missions by downloading a mission suite to the user's mobile device 10. To effect this download the device accesses the mission suite from the server via the Internet. Once the mission suite is downloaded to the user's mobile device the user may utilize the mission suite (that may incorporate one or more missions and other related content, information and functions as described herein) either when connected to the Internet or when disconnected from the Internet, depending on the requirements of the mission suite and the one or more missions (e.g., some missions and some functions of the mission suite may require an Internet connection).
The method of an embodiment of the present invention is shown at FIG. 5, whereby a builder utilizing a platform operable on a computing device may generate one or more missions, at step 50. The one or more missions and information relating thereto may be stored on a server connected to the platform, at step 52. One or more of the one or more missions and related information may be transferred via the Internet from the server to the mobile devices of the one or more users as mission suites, at step 54. The mobile devices of the one or more users each receive a mission suite via the Internet from the server, at step 56. The one or more users each operate the mission suite on the user's mobile device to undertake one or more of the one or more missions, at step 58.
A variety of configurations of the platform and the user mobile device(s) may be incorporated in embodiments of the present invention.
In one embodiment, as shown in FIG. 2, multiple computing devices 16a, 16b, 16c, may connect to the server 14. Information may be transferred bi-directionally between the computing devices and the server. The server is connected to the Internet 12 as is a user's mobile device. The mission suite may be transmitted from the server via the Internet to the user's mobile device 10, as may any upgrades or additional information relating thereto. The platform may either be: (i) downloaded and stored on the multiple computing devices and information generated by the platform may be stored in the server; or (ii) stored on the server and accessed therefrom by the multiple computing devices. Information received from the user's mobile device may be transferred to the server via the Internet and stored on the server. Such stored information from the user's mobile device is accessible and utilizable by the platform. In one embodiment, as shown in FIG. 3, a computing device 16 may connect to the server 14. Information may be transferred bi-directionally between the computing device and the server. The server is connected to the Internet 12, as are multiple users' mobile devices 10a, 10b, 10c, lOd. The mission suite may be transmitted from the server via the Internet to the users' mobile devices, as may any upgrades or additional information relating thereto.
In one embodiment, as shown in FIG. 4, a computing device 16 may connect to the server 14. Information may be transferred bi-directionally between the computing device and the server. The server is connected to the Internet 12 as are multiple users' mobile devices. The mission suite may be transmitted from the server via the Internet to the users' mobile devices, as may any upgrades or additional information relating thereto. A master mobile device 18 may further be connected to each of the multiple users' mobile devices. Information may be transferred bi-directionally between the master mobile device and each of the multiple users' mobile devices. The master mobile device may be utilized to control information displayed on the users' mobile devices, or to control the progress of the user's use of the mission suite on the users' mobile devices. For example, the master mobile device may be utilized by a teacher of a class and each of the students may be utilizing one of the users' mobile devices. The master mobile device may be used to provide information to the students through their mobile devices, such as how much more class-time is left, or instructions to start a mission or a challenge. The master device may further be utilized to ensure that students cannot start a challenge until all of the students have completed a prior challenge. The master device may still further be utilized to monitor the progress of each of the users' mobile devices through a mission and/or a challenge. Information may be transferred bi-directionally between the master mobile device and the server (via the Internet).
Other variations of these configurations are possible such as multiple computing devices and multiple users' mobile devices being connected to the server, connections to the server of one or more computing devices being via the Internet, one or more users' mobile devices connecting directly to the server, and/or the master mobile device connecting directly to the server.
Platform
The platform may be utilized to build missions and may incorporate various programming elements to facilitate the building of missions. For example, the platform may build missions for use on a PC, use on a web-connected device, use on an Xbox™ or other gaming console, or use on any other computer implemented hardware. Building may utilize an engine operable to build missions that incorporate graphics, augmented reality elements, etc., for example, such as a Unity™ 3D game engine, or any other engine that has the necessary functionability, including a custom engine. Specific features for a mobile device may be obtained through a library, for example, such as a Unity™ library, another third party library, or a custom library. The library may be utilized for content in the missions, including audio content. 3D elements may be created through the use of software specific to 3D building, for example, such as Maya™ 3D animation and modelling software, or any other custom or third party software. The mission suite, including the missions and challenges, may be developed by use of a variety of types of programming inputs, including any of custom programming inputs, Marmalade™, C++™, Unity™, Vuforia™, SQL™ and other programming inputs. The mission suite may be developed for use on a variety of types of mobile devices, such as iOS™ and Android™ devices. Elements of a user's mobile device may also be accessed and utilized by the mission suite, including GPS features, QR code reader features, a compass, an accelerometer, a camera and image capture features, and a flashlight. These elements of the mobile device and their functions may be utilized by the mission suite, as described herein.
The builder may build specific missions to incorporate one or more challenges, but the mission suite will be created to include content in addition to the one or more missions, including login facilities, menu screens, and other facilities, functions and information, as discussed herein in relation to the user's use of the mission suite.
A builder may login to the platform through a computer device that is linked (wirelessly or wired) to a server where mission suite information is stored. The connection to the server from the computer device may be through the cloud or via the Internet. The builder may be recognized upon login (based upon the builder's profile) as one of several types of builders such as the following: a global administrator (who can access any mission); a mission manager (who can access missions that they build or that their affiliated mission challenge content builders have built and/or missions shared to a library, and can approve challenges built by affiliated mission challenge content builders for publication in the mission suite); or a mission challenge content builder (who can build challenge content for a mission but such challenge content will not be published until approved by a mission manager). As an example, the mission challenge content builder has particular uses for organizations that engage volunteers, students, or other temporary members, such as members with limited or no affiliation with an organization ("limited builders"). The mission challenge content builder offers the ability for limited builders to create challenge content for a mission. It also allows for an organization to control and manage the publication of the challenge content, as such publication will only occur after the content is reviewed and approved by a member of the organization. The organization also has the ability to evaluate its challenge content prior to publication. The public will not be able to view any challenge content prior to publication. The mission challenge content builder therefore allows for limited builders to have challenge content input in a limited manner, with overview by members of the organization, and the mission manager in particular. Other types of builders, not just limited builders, can also use the mission challenge content builder, as described herein.
A builder may set-up a profile prior to initially logging-in to the platform, or the builder may login on a trial basis. Information relating to the builder may be requested and the platform may require that some of this information be provided by a builder in order for the builder to utilize the platform (e.g., the builder's name, the builder's affiliation(s), and the builder's email, phone number, address, etc.). The builder's type may be determined by the platform, as a mission manager may indicate the mission challenge content builders affiliated with the mission manager. The builder's type may be stored by the platform as builder profile information.
A builder's profile information will be reviewed upon login by the platform, and the options available to the builder for use of aspects of the platform may be determined by the platform based upon the builder's profile. For example, the option to approve and publish missions may only be available to a mission manager. Missions relating to the builder's affiliation will be available for editing or review by the mission manager and mission challenge content builders (and by global administrators). Missions and/or challenges in one or more shared libraries may also be available to the mission manager and builders of content, as discussed herein. Options relating to global administration of the missions generally will only be available to global administrators. Other variations of options may be available to each type of builder.
A tutorial may be offered to builders to explain details of use of the platform and the steps to build and/or approve and publish missions. The builder may further have the option of accessing help information relating to the use of aspects of the platform. For example, pop-ups may be displayed beside elements of the platform (e.g., information fields, drawing tools, image download tools, screen builder tools, etc.) when such elements are accessed by the builder. As another example, help information may appear to a user when the builder moves a cursor to hover over an element in the platform (e.g., an information field, an image, etc.). Alternatively, no help information may be displayed to a builder.
In some embodiments of the invention, a mission may be auto-generated based upon one or more indicators provided by a builder and/or options chosen by a builder. For example, the indicators may include a mission category (or theme), or responses to certain queries. The information provided that triggers auto-population of a mission will be utilized by the system to identify information or a set of information that can be auto-filled or auto- populated to create a mission or a portion of a mission. The system may auto-fill or auto- populate one or more information fields in a mission in this manner. The system will identify the information that is to be filled-in to the one or more information fields in accordance with a logical process that it employs to identify the appropriate information to be filled-in to the one or more information fields.
As example, in one embodiment of the present invention, a builder may enter the mission name and choose a category for the mission (e.g., nature, water, culture, or any other category). (In some embodiments of the present invention themes may be applied as well as, or instead of, categories.) The system may be programmed to auto-fill or auto- populate one or more information fields in a mission based upon the combination of the mission name and the category. The system may store the information, or the source for such information, pertaining to information fields that will auto-fill or auto-populate in a mission creation process based upon the combination of mission name and category identified by the builder.
As shown in FIG. 20, one or more builders 200a, 200b, 200c, 200d may access the platform, such as by operating the platform on their computing devices. Builders 200a, 200b may create a mission, a challenge or some other content 204a, 204b that can be utilized in a mission. The mission, challenge or other content can be created by the builder by operation of the platform and can be transferred via the Internet 12 to a shared content library 206 where the mission, challenge or other content can be stored and can be accessed by the builder and other builders. Other builders 200c, 200d may access the platform and from the platform access the shared content library 206 via the Internet 12 to obtain content. The content may be copied by the builder from the shared content library and transferred back to the platform accessed by the builder. The builder can then use the content to edit a mission 204c, 204d that the builder has created through operation of the platform. The mission can be transferred via the Internet to the shared content library 206 where it can be stored and can be accessed by the builder and other builders. Each mission 204c and 204d can be published by the builder that created by the builder to a server 208. A user 202 can access the mission from the server, or can download the mission from the server to the user's mobile device. In accordance with this embodiment of the present invention, one or more builders can create one or more pieces of content that may be a mission, a challenge or other content. The builder can choose to share the content they create with other builders by storing the content in the shared content library. When a builder chooses to share content a complete copy is of the content is created and stored in the shared content library. The stored content may be marked as shared but will not be marked as approved until the content is approved in accordance with the processes described herein.
Content stored in the shared content library is accessible by multiple builders. The content may need to be approved via one or more approval processes before that content will be becoming available to some or all builders from the library. Alternatively, content may not require any approval before it is accessible to some or all builders from the library. The approval processes may be implemented in operation of steps coded in software that is stored in the library or on the platform, or approval may be undertaken by a human, such as one or more administrators. Once content is approved it is marked as approved in the library. Approved content is available to all builders from the library. When content is accessed by a builder from the library a copy of the content is made available to the builder. If either the builder who created the content, or any other builder, accesses content from a library and modifies the content, the version of that content stored in the library will not be affected, as the content accessed and modified by the builder is a copy of the content stored in the library. Any content that a builder accesses from the library may be modified by that builder without modifying the content stored in the library. Edits can be made to parts or all of the content accessed from a library by a builder. For example, edits to content can include additions or modifications to text, audio-visual or other media, identification of a geo- position, augmented reality objects, or other content. Once a builder creates or modifies content the builder can opt to share that content with other builders by storing the content in the shared content library.
Once a builder creates a mission, the builder can publish the mission for use by one or more users by storing the mission in the server. A global administrator may be able to identify one or more mission name and category combinations and identify the information fields to be auto-populated in the mission upon such a selection. The administrator may further identify the information or source of the information that will be auto-populated into the information fields. The administrator may further amend the information fields and or the source of the content for auto-filling such information fields upon a particular selection of a combination of mission name and category by the builder (or other information or query responses identified as auto- populate triggers). The administrator may further delete a combination (or other information or query responses identified as auto-populate triggers) thereby revoking the ability of the system to auto-populate any fields upon the selection of such a combination by a builder in the future. The administrator may also define a new combination of mission name and category (or other information or query responses identified as auto- populate triggers) and the information fields that will auto-populate upon such a selection, and the source of the information that will be auto-populated into such information fields.
As an example, upon the selection of a particular mission name and category by the builder, the following fields may be auto-populated: the splash image (i.e., the load screen), the representative image (e.g., the image that will represent the mission in the mission list), the field character, and the welcome message. Other information fields can be set to auto-populate based upon an identified combination of mission name and category or other auto-populate trigger.
As discussed herein, once one or more information fields are filled-in (whether by auto- population or otherwise) the builder will be asked to create a map for the mission that the builder is creating. The map may be a map that is obtained by the builder from a map source (e.g., a Google™ map, or another map source), or may be a map drawn by the builder, or any other map that is obtained or created by the builder that shows the mission location. The builder may be given the option to populate the map with pre-existing challenges. A list of possible challenges may be populated by the system and displayed to the builder. The list of possible challenges may reflect challenges that have been created previously by the builder for other missions in the same mission category. The list of possible challenges may additionally, or alternatively, reflect challenges that have been created by other builders who have indicated that they will share the challenges such builders have created with other builders. Possible methods of achieving sharing of challenges amongst builders is described herein and includes story challenges in a shared content library. The shared challenges on the list of possible challenges may have the same mission category as the mission that the builder is presently creating. The list of possible challenges may additionally, or alternatively, reflect challenges from a library of challenges that have the same mission category as the mission that the builder is presently creating. The list of possible challenges may be limited to display only a set number of challenges. Other criteria may be applied to either limit or organize the list of possible challenges displayed to a builder, such as the most relevant challenges based upon one or more identified criteria, the challenges that are most chosen by builders, or any other criteria. In some embodiments of the present invention, a global administrator may set the criteria and cause the platform to provide to a builder the option to choose the type of list that is displayed to the builder.
Once the builder chooses one or more challenges, the builder may position the challenges on the map. The position on the map indicates the geo-location where a user should engage in a challenge. For example, in some embodiments of the present invention the builder may drop the challenge onto the map, such as by double-clicking on the challenge and then clicking on the position for the challenge on the map, or by dragging and dropping the challenge onto a particular location on the map, or any other method for indicating the positioning of a challenge upon the map. An icon may be related to the challenge, and such icon may appear on the map at the location of the challenge. Once the mission is defined and all challenges for the mission are positioned on the map and defined, the builder may proceed to the publication or further customization of the mission, as described herein.
A builder who experiences auto-population of information fields relating to a mission, as described herein, will have the option to accept the auto-populated information fields. The builder will have the option to edit the auto-populated information fields. The builder will also have the option to edit any information field, including adding further or additional information in any information field in the mission or challenge, and to delete any information from any information field. In this manner the builder can change and customize the mission content, or the builder can accept the mission with the filled-in information fields generated by the system. The challenge information fields may be auto-populated in a manner similar to that applied to a mission.
The main menu available to the builders may include several options, including access to navigational pages that include one or more of: a home page, a mission builder section, a challenge builder section, a review section, a content creation section, a library section and a marketplace section. The main menu may also offer one or more of the following: tutorial notes; a support section; and a settings section.
In embodiments of the present invention it may be possible to access a library directly or through a challenge section available from the main menu. If direct access to a library is provided to a builder, the builder may be able to passively review library content. The builder would not be required to add any library content to a mission.
In an embodiment of the present invention that offers a marketplace section as an option from the main menu, or from any menu in the app, a mission manager can choose the marketplace section option to access particular functions. The functions may include one or more of the following: upgrades to the mission manager's subscription; commissioning customized art to be available for use in the building of missions, such as a map or a character; or purchasing additional functionality to be available for use in the building of missions, such as a grade delineation, or more challenges. Grade delineation may be applied to one or more challenges in an embodiment of the present invention. A mission manager or the administrator may identify school grades into groupings, such as groupings by grade ranges. As an example, a grade grouping may be created to include kindergarten through to grade 3, while another grade grouping may be identified to include grade 4 through grade 6, and yet another grade grouping may be identified to include grade 7 through grade 9. Other grade groupings may be created, such as grade groupings that include senior grades and junior grades (for example, a grade grouping that includes kindergarten, grade 1 and grade 9). A grade grouping that includes both junior and senior grades may expect that challenges will be performed collectively by students, and that each collection of students undertaking a challenge will include at least one member of a senior grade and at least one member of a junior grade identified in the grade grouping.
A user using the app may have grade delineation enabled in the app, such that the user will be delivered challenges that include the user's grade in the grade grouping identified as related to the challenge. For example, if the user is in grade three only challenges that include grade three in the grade grouping identified as related to the challenge will be delivered to the user.
If the builder selects the mission builder section, a list of existing missions may be provided to the builder. The builder may have the option to edit a mission, delete a mission, change the map relating to a mission (e.g., if the mission map is for a particular location, for example such as Toronto, Ontario, Canada, the map may be altered to some other location, for example such as New York City, New York, U.S.A.), publish a test version of the mission, or publish the mission.
If the mission builder publishes a test version of the mission the test mission will only be accessible from a mobile device running the app that is set to activate test missions. In this manner a test version of a mission will only be visible and accessible to users who have the activate test missions setting operating on their device. Such users will be able to access, activate and perform the test mission. This will allow such users to try out the test mission and thereby test the functionality and other aspects of the test mission to identify bugs, flaws, and possible improvements to the mission, if any. Once testing is completed, the mission builder can "un-publish" the test mission. This means that the test mission will be set at the builder platform to be removed from the app (and the device) upon the next download to the app upon the device. The test mission can then be published by the mission builder to the app as a mission (after it is approved, in the manner described herein), or it can be edited by the mission builder to correct any bugs or flaws identified during testing, or to otherwise improve or change the mission prior to the mission being published. Once the mission is published it will be available to a user in a non-test mode through the app on a user's mobile device. Instead of amending and/or publishing the test mission, it may also be deleted by the mission builder. From the mission builder section a builder may further have the option to create a new mission. A new mission can be created entirely through input of the mission builder, or may be created through the use of an auto-fill process, as described herein. When a builder is creating a new mission, the builder may be provided with a series of prompts requiring the builder to provide information or content relating to the new mission including any of the following: the name of the mission; the location where the mission is to be performed (this may be indicated as map coordinates and a map may be generated to be incorporated in the mission, or a map may be obtained by the builder, a location within a map may be marked by the builder to be incorporated in the mission); the challenge mode (e.g., Bluetooth, QR code, GPS, or any combination thereof); the category of mission (e.g., urban, nature, cultural, etc.); the one or more characters to be incorporated in the mission; any "splash" image or video to be displayed during download (e.g., branding information relating to the organization that the mission is created by or for); any "preview" image to be shown to indicate or represent the mission; a welcome message to appear to a user and other information about performing the mission (that may be information that is provided to the user by a character); directions to download the mission that may be provided to a user, and any safety messaging (i.e., messages to provide any safety advice or cautions to the user relating to the mission and/or challenges); navigational information (e.g., travel directions about how the user can arrive at the location where the mission is to be performed); a preview option that will allow the user to preview the mission as it will appear to a user on a mobile device; • an upload option, whereby media to be incorporated in a mission may be uploaded (e.g., a splash image or video, a preview image, images and/or video to be incorporated in challenges, sounds to be incorporated in challenges, audio content for a character or otherwise for a mission, etc.). In some embodiments a library of content may be provided and media inputs may be obtained from such library;
• a type of currency to be earned by the user if any currency is to be awarded during any challenges and/or the mission; and/or
• a reward screen, whereby text or an image will be displayed to the user upon the user achieving the mission.
In embodiments of the present invention, if a reward screen is incorporated in a mission by a mission builder the reward screen may be developed to include a QR code, scannable barcode, or a digital badge that the user may present to a vendor before receiving a tangible or intangible reward. As an example, a tangible reward that may be redeemed via a QR code or a scannable barcode may include a sticker, a patch (to be adhered to clothing or another object), a coupon redeemable at a store or elsewhere, or an admission pass for a theatre, a museum or some other location requiring admission.
The builder will also be provided with an option to build challenges by creating a new challenge for the mission, editing challenges of the mission, reviewing challenges of the mission, or deleting challenges from the mission. The builder will further have the option to share challenges to a library or copy challenges to another mission, as discussed herein.
If a builder chooses to create a new challenge in a mission, information such as the following may be requested from the builder: the challenge name, the challenge type (e.g., an image challenge, a text challenge, a comparison challenge, or any other challenge type), the challenge location (that must be within the mission location), any indicators within the location (to be shown as integrated with the map, as discussed herein), any radius of the location (to be the scan radius, as discussed herein), a challenge level, information appearing to a user prior to the start of a challenge (such as directions for completing a challenge 190, and one or more images 192 to support this information, as shown in FIG. 19, or the name and type of challenge 160, as shown in FIG. 16), information appearing to a user during the challenge (as shown in FIGs. 13 and 17, such as information confirming a correct answer 130, 170), an image or video to be displayed before the player starts the challenge that may be related to the challenge content, and information to appear to a user after a challenge is completed 150 (as shown in FIG. 15). Questions may be incorporated in each challenge, and a builder may provide questions and answers thereto to be incorporated in a challenge to the platform. If any currency is to be awarded for the completion of the challenge the amount of currency is indicated by the builder. The type of currency to be awarded must be a currency that is supported by the mission builder platform. For example, the mission builder platform may support digital currencies, monetized currencies, or any other currency that is recognized as having a specific relation to monetary values. Alternatively, the mission builder platform may support one or more currencies that are developed specifically for one or more missions, or for use in other manners in relation to the platform. Currency must have a value such that accumulated currency is exchangeable for either monetary value, goods or services. For example, currency accumulated by a user of the app may be exchangeable by such user for access to additional challenges or missions. A currency may be represented to a user in any manner. For example, the representation of the currency may be relevant to the type of missions with which such currency is utilized, such as a "bee" currency for nature related missions, or "star" currency for space related missions. Currency may be exchangeable (i.e., spendable) by a user for a tangible or intangible reward through one or more vendors in the app.
The platform will utilize the information provided to generate a challenge. The generated challenge can be saved, canceled, or reviewed by the builder. The mission manager has the authority to approve or reject challenges, as discussed herein. The mission manager may provide comments to the builder of the challenge when the challenge is approved or rejected. Once approved, a challenge can be published to the app and/or shared to the library as discussed herein.
A builder may also be provided with the option to copy a mission or a challenge created by another builder, or created by the builder, as the starting point for creating a new mission or a new challenge for a mission. The mission and/or challenges available to a builder to be copied may be missions and/or challenges that other builders have indicated are available to be copied, missions or challenges created previously by the builder, other missions or challenge that are for similar user levels or for an organization that the new mission and/or challenge is to be provided for, or other missions and/or challenges made available by a global administrator to a builder to be copied.
Once copied the mission and/or challenge(s) will need to be edited and amended, for example, to be for a new location, to have different indicators within a map for the location, to be for a different user level, a mission may be edited to remove some challenges and/or add new challenges, or in any other manner at the whim of the builder and allowed by the platform. For example, the copy option may be utilized if a mission has been created for a school board in California, U.S.A. and it is to be copied for a school board in British Columbia, Canada. Once copied the location of the mission would need to be amended and other content of the mission and challenges of the mission would need to be amended to meet the school board requirements of the school board in British Columbia, Canada. Copying will save the builder time in creating missions and/or challenges.
Missions may be built relating to a specific geo-location in accordance with requirements of educational institutions or school boards. For example, an educational institution or school board may require that education relating to salmon spawning in a river be part of a curriculum. A mission may be built to provide the educational elements required by the educational institution or school board, and the mission may be built to be related to a particular river location where salmon are known to spawn. The builder will identify the geo-location that will permit the educational requirements of the educational institution or school board to be taught and one or more objects in that location to be used in providing the education. The builder will create content relating to the geo-location and the educational requirements through use of the mission builder platform. The builder may incorporate content gathered from the geo-location, such as images, audio, or other content. The builder will identify the geo-location (through Google Maps or another mapping service). The mission built in relation to the geo-location, and the content of all challenges incorporated in the mission, will provide the learning outcomes that are educational requirements of the educational institution or school board.
The mission can be approved and published so that it will be available to be downloaded to a user as an app, for use by the user on the user's mobile device. The user can use the mission when the user is located at the geo-location, and thereby attain the learning objectives of the educational requirements.
Users can also capture content (e.g., images, audio, etc.) when a user is at a geo-location. The user can provide this content to a builder. The builder can transfer the content to the mission builder platform, whereby the content can be utilized by builders to create challenges, missions and other content used in the app. A user can evaluate the content they provided, and the content provided by other users, through use of that content embedded in challenges that the user engages in. The evaluation can occur either through feedback of the user that the user provides to the app, that is then uploaded to the mission builder platform, or through the user providing an evaluation to a builder, and the builder then uploading the evaluation of the user to the mission builder platform.
One or more libraries of challenges that may be shared between builders may be incorporated in the platform. A challenge may be copied from a library into another mission, and the copy of the challenge may be amended to relate to the mission to which the copy was added, as discussed herein. A library may be filtered for some builders, for example by challenge level, by the affiliation of the creator of the challenge (e.g., the organization the creator is affiliated with and users are expected to be related to, such as for example junior firefighters, school board, etc.), the category of challenges (e.g., nature, cultural, urban, etc.), or other filters. For example, particular categories and types of filters can be defined and identified by builders or included in the platform, such as grade level filters, subject filters, curriculum code filters, and phenomena filters. These example filters may be included as types of filters for use with organizations that are involved in the formal education section. Other filters may be appropriate to other builders and incorporated in the platform. Filters for the library may be set by the builder, or may be set by the mission manager or the global administrator. The library may also be ordered in accordance with particular criteria, such as most copied challenges, highest rated challenges, geographical locations for challenges, etc. A builder may indicate whether the challenge the builder creates is to be added to the library. The library will be searchable by a builder. A similar library of missions may also be available to a builder. If a mission is copied a copy of the mission, and all of the corresponding challenges in the mission, will be created. This library of missions may be filtered and ordered in a similar manner to the library of challenges.
In one embodiment of the present invention, when a mission and/or a challenge is copied the aspects of the mission and/or challenge that will need to be amended may not be included in the copy (e.g., the location, the name, etc.), and such aspects will need to be completed by the builder who copied the mission and/or challenge. Alternatively, all of the aspects of the challenge may be included in the copy, and the builder will need to delete aspects and add new information for such deleted aspects. In one embodiment of the present invention, when challenges are copied, aspects may be deleted by the platform during the copy process, and these aspects may be auto-populated by the platform in accordance with information incorporated in the mission that the copy of the challenge is to be incorporated in, such as location, etc.
Historical data may be stored with a challenge. Historical data may include information relating to any copies made of such challenge. Historical data may also be stored with the copy of the challenge indicating the challenge that it was copied from.
Specific templates for missions and/or challenges may be provided relating to particular organizations. For example, templates for missions and/or challenges may be provided for the curriculum requirements of a particular school board. Any organization that has specific training, standard levels, messaging, information or other requirements that are to be met by its members may create a set of templates for missions and/or challenges. Builders may use the templates to cause missions and challenges they create to meet the requirements incorporated in the templates.
Not all of the options described herein will be provided to all builders. Each builder may only see the options appropriate to the builder's type (e.g., mission manager, limited builder, administrator, etc.). For example, a mission manager will be provided with the option to review challenge as well as to approve or reject challenges. The mission manager may also have the option to provide comments for the mission challenge content builder when a challenge is either approved or rejected.
The system may store comments in a database. The comments may be accessible by a builder including information relating to the comment, such as the date of the comment, the status of the challenge (e.g., draft, submitted for review, approved, rejected, or some other status), and the username of the mission manager who reviewed the challenge.
An embodiment of the present invention may incorporate a notification page, or a notification window. The notification page or window will display a live feed of notifications for the builder. For example, notifications may include any of the following: a notification that a challenge was submitted for review; a notification that a challenge was approved; a notification that a mission manager commented on a challenge submitted by the builder; or other notifications. In embodiments of the present invention a builder may opt to receive an email containing a notification when any notification is generated.
A builder of a challenge may edit a challenge after it has been reviewed by the mission manager. When a challenge has been approved by a mission manager and it is amended by the builder post approval, the status of the challenge is changed by the system to a pre- approval status. This has the result that the challenge, as amended, must be reviewed and approved by a mission manager before the amended version of the challenge can be published (and thereby made available to a user in the app). The status of a challenge may be displayed to a builder in any of the ways discussed herein, including within a list of challenges.
Thus, prior to approval, after rejection, or after approval, a mission challenge content builder will have the option to edit a challenge. As an example, the edits to a challenge after a rejection may reflect any of the comments that a mission manager provided to the mission challenge content builder, if any comments were provided. A challenge that was rejected can be resubmitted for approval.
Once a mission manager approves a challenge it will be added to the mission, and will be part of the mission suite that is available for download to a user's mobile device. Once a challenge is used by a user, information relating to such use of the challenge will be transmitted from the user's mobile device to the platform, for use by the platform.
A challenge will not be available to a user until the mission that the challenge is incorporated in is also approved by a mission manager. Also, as discussed herein, a mission manager can approve a mission for testing, whereby it will only be available to one or more users who have a test mode activated in the app on their mobile device. When a mission is approved the platform will validate the map relating to the mission (e.g., the map of the area (geo-location and the surrounding radius) where the mission and the challenges incorporated therein are to be performed). When a challenge is approved the platform will validate the location of the challenge in relation to the map of the corresponding mission, and will also ensure that all required challenge information has been provided by the user. The platform will build the challenge into a format that is transmittable to a user's mobile device for use on the user's mobile device. Missions and corresponding challenges, and all information relating thereto, can be stored by the platform on one or more servers or other storage elements. The platform may provide an issue reporting module, whereby builders can convey issues encountered when building missions and/or challenges to administrators of the platform. If there is any response to a reported issue, the response may be sent via the platform to the builder who submitted the issue report. The platform may incorporate a notification scheduler whereby administrators may personalize messages to be sent to builders. For example, a customized message may be sent to new builders, such as an email with customized content.
As shown in FIG. 21, a builder 210 logged into a computer device may access the mission builder platform 212 and the mission builder platform is operable to permit the builder to create and/or edit challenges or missions. Should a builder utilize the mission builder platform to edit a mission, the builder may submit the edited mission for approval via the mission builder platform. Once the edited mission is approved a user logged into an app 214 via a mobile device, may either request, or automatically receive, the updated mission from the mission builder platform. Alternatively, the mission or challenge may be identified as being in draft or development mode. A draft or development mode mission or challenge will not be available for download to a user's app, but can be downloadable to an app used by the builder for the purpose of reviewing a mission or challenge the builder has built as it will appear to a user in the app. For example, the app may automatically initiate a connection via the Internet 12, to the mission builder platform 212 and once connected the mission builder platform may be operated to search for updated missions, or draft or development mode missions or challenges, and to download any updated missions, or any draft or development mode missions or challenges, found to be used by the builder I nthe app. Alternatively, a user may request one or more updated missions through operation of the app, and upon such a request the app will initiate a connection via the Internet 12, to the mission builder platform 212 and once connected the mission builder platform may be operated to search for updated missions, or missions or challenges in draft or development mode, and to download to the app any such mission or challenge found. A builder 210 may also have an option to login to the app 214 and thereby see in the app a new or modified version of a mission created by the builder through operation of the mission builder platform 212. A builder creating missions through operation of the mission building platform can use this method to view and/or play that mission or any portion thereof in the app. The mission builder platform will incorporate operability whereby it offers the builder the option to 'live edit' that mission that the builder has created or modified. When the live editing is chosen builder will be logged into the app, and the app that the builder is logged into will request that the mission that the builder has just modified or created will be downloaded to the app. The app will then be operable to allow the builder to initiate a live session whereby the downloaded mission is active. The newly created mission or the modified mission will be reflected in the content available to the builder in the app. The builder can thereby test aspects of the mission in the app. If the builder determines that modifications to the mission are required, the builder can modify the mission through operation of the mission builder platform, and then have the modified version of the mission downloaded to the app, so the builder can operate a version of the app with the modifications therein.
The bidirectional communication between mobile device whereby the app is operated, and the mission building platform, that is stored on a server or on a computing device, will be enabled through a distributed, secure, publish-subscribe messaging system. The system will operate to allow untrusted devices (that the app may be operable upon), such as mobile phones and web browsers, to connect to a publish-subscribe server (as the mission builder platform may be stored and operable upon) using a traditional web application as proxy. The system is operable with web applications distributed across multiple computers behind a load balancer. A load balancer is a server which redirects requests from clients to one of multiple servers running an identical application. This system allows web applications to handle many simultaneous requests and is common among high traffic web applications. Using the web application as a proxy allows the web application to apply existing authorization and authentication mechanisms to communications between the publish-subscribe server and untrusted client devices.
The app may also be incorporated in the same device that the builder is using to operate the mission builder platform. The builder may therefore be able to build missions, challenges and other content, and view the missions, challenges and other content as it will be provided to a user in an app in real time or virtually in real time.
The publishing of a mission or a challenge to an app may occur through a publish- subscribe server 220, such as is shown in FIG. 22. One or more clients 222a, 222b, 222c may each login to a web server 226a, 226b, 226c via a public facing load balancer 224. If client 222b requests a subscription from the system, the request is directed to web server 226b, that approves the request, accepts the connection, and subscribes to the topic requested by client 222b with the private publish-subscribe server 220. If client 222c makes a similar request the request is handled by web server 226c. If client 222a sends a publish request it is directed to web server 226a, that approves the request and publishes the message to the private publish-subscribe server 220. The private publish-subscribe server 220 distributes the message to subscribers via web servers 226b and 226c. Web servers 226b and 226c send the messages they received to clients 222b and 222c respectively.
The system shown in FIG. 22 uses websockets to connect clients to web application servers. The websocket standard is a common system for bidirectional communication between a single client and single server. The web application servers will connect to the publish-subscribe server through whichever mechanism is required by the publish- subscribe server, usually a TCP connection.
A publish-subscribe server provides publish and subscribe functionality. A subscriber can make a subscription on a certain named topic with the server. A publisher publishes events to one or more topics. Subscribers to that topic will be sent the published event.
A client will subscribe to a topic by requesting a websocket connection from the web application, sending the topic it is interested in along with any authentication data. If the topic and authentication data are valid the server will accept the websocket connection with the client and at the same time subscribe to the requested topic with the publish- subscribe server. Whenever the web server receives a message from the publish-subscribe server for the client's requested topic it will forward that message to the client through the websocket connection. This system allows for secure, controlled access to a private publish-subscribe server that can be scaled across multiple web servers. From the perspective of the client applications it provides nearly direct access to a publish- subscribe server, facilitating low latency communication between a variety of devices. Setting up a live editing session with this mechanism will entail the app utilized by the builder to subscribe to a content change topic through operation of the publish-subscribe system. When the builder modifies a mission, the mission building platform will publish an event to the publish-subscribe system on the same content change topic. The app will receive this message. Smaller changes, such as a change to the name of some content, can be contained inside the event itself. Larger changes, such as uploading and using a new image, would not be contained inside the event. These events would cause the app to retrieve additional information from the mission building platform. In either case, the app would eventually retrieve the updated information and display it to the builder. The platform may generate a variety of types of analytics and statistics. For example, analytics and statistics may be generated in relation to building and/or use of the missions and the challenges incorporated in the missions, including information transmitted from the user's mobile devices relating to use of the missions and challenges. The information tracked by the mission suite downloaded to a user's mobile device, that is available to the platform, may include the number of downloads of the mission suite and/or each mission downloaded, the mission suites or missions that are started and not completed, fully completed missions, the amount of time that a user spent using a mission, the distance a user walked when using a mission (e.g., determined by GPS or by a step tracker of the mobile device), the status of completed challenges and/or challenges that are started but not completed, the number of augmented reality characters that are located by a user, the amount of currency awarded to and spent by a user, the rewards awarded to a user (including badges), the path traversed by a user during a challenge and/or a mission in relation to a map, the real-time performance of a user in a challenge and/or a mission, etc.
Embodiments of the present invention may generate data in a format that can be integrated with existing software, such as software utilized by educational institutions whereby information from the present invention can be used in the generation of student grades, or in the tracking of student performance. Examples of such software include Illuminate™ or Powerschool™. Information from the system may also be transferred to other software and utilized for other purposes relating to information about user performance in one or more missions and/or challenges relating to an organization. Analytics and statistics may be generated by the platform for all missions and users, or for users of specific missions, for specific users, for types or categories of missions, for types or categories of challenges, for users having specific affiliations, and for any other individual or combination of missions, users and challenges. As shown in FIGs 6 and 8, analytics and statistics relating to the user's use of the mission suite, or the use of the mission suite by multiple users in a group or an organization (e.g., a school class, etc.) 62, 80, may be displayed to a user on a screen 60 available to the user on a mobile device, and/or through a website that is connected to the mobile device and/or the platform. Other user information may also be available through such a website, and a user may be able to modify their profile information, settings, and user generated challenges, etc. from such a website. The information entered into the website will be stored by the platform and/or the mobile device. If the information is only stored by the platform such information will only be available to the mobile device once the information is transmitted from the platform to the mobile device while the mobile device is connected to the Internet.
A global administrator will be provided with certain options not available to other types of builders, including managing all builders (including trial basis builders). Access to the platform may be provided to builders on a subscription basis, or on some other basis. A global administrator may further undertake the following activities: · determining the types of access bases that are available to builders; determining any grouping of organizations (e.g., schools within a school board, etc.); altering, adding or deleting categories of missions or challenges (e.g., urban, nature, cultural, etc.) that are options to be selected by builders; adding, deleting, or changing characters that a builder may integrate in a mission and/or a challenge; generating any bills or invoices to be transmitted to any builders; and • managing all missions and challenges.
Other functions and activities may also be available to a global administrator.
The global administrator may use an auto-fill option as described herein, in some embodiments of the present invention, to add, delete or change content of a mission or a challenge.
The platform may incorporate an asset library, whereby media to be included in a mission and/or a challenge is accessible to builders. For example, images, video or audio content that may be incorporated in a mission and/or a challenge may be available from the asset library. A builder may also upload to the asset library or directly to a mission and/or challenge being built, content to be incorporated in a mission and/or challenge. For example, sounds of indigenous birds of a location where a mission is to be performed may be incorporated in a corresponding audio challenge, images of indigenous wildlife may be incorporated in a corresponding image challenge, etc.
The asset library (content library) may be filtered and ordered in accordance with criteria such as location, assets most often incorporated in missions and/or challenges, alphabetical order, etc. The terms "asset" and "content" as used herein reference content and information that can be incorporated in the app, including in missions, challenges, mission suites, and the app generally. The asset library is searchable by a builder, and search results may be provided to indicate the level of matches with the search request (e.g., full matches, partial matches, etc.). Assets in the asset library may be collected by the administrator (e.g., from licensed libraries, and/or a collection of the administrator's owned content), and individual builders may also indicate that they agree to provide uploaded content to the library to be shared and used by other builders. (The platform may require evidence of ownership or license rights of such builder providing assets prior to adding such assets to the library, in accordance with relevant laws.)
Once integrated into a mission and/or challenge a visual asset, such as an image or a video, may be sized in accordance with the requirements of the mission and/or challenge display to a user. This resizing of images may also involve alteration of the data retained relating to an asset, which will affect the download size of such asset that will be integrated in the mission suite downloaded to the user. Sounds integrated in a mission and/or challenge may be altered in a similar manner.
Embodiments of the present invention may further permit bulk uploading and processing of assets. Such assets may be created by the owner of the platform, and therefore may have common data, such as the name of the owner and creator of the asset, the date of creation, the date of upload to the library, etc.
Assets in the library may be tagged to permit ease of searching. For example, library assets relating to a particular curriculum may be tagged. Other tagging options are also possible. In embodiments of the present invention, the platform may integrate a review of tags and other information relating to the assets for the purpose of vetting such content.
An asset curator may review the information of any asset that the platform identifies as being possibly problematical. This will facilitate consistency in the tags, keywords, identification of the source of the asset, and the ability to modify images for incorporation in missions and/or challenges displayed to users. Information about the curator may be stored with the asset information, so that the curator of images can be tracked. Such tracking information may be utilized by an analytics and statistics module of the platform. This tracking information may further permit a history for the asset to be stored and accessible to builders. A challenge curator may review aspects of challenges in a similar manner to the asset curator's review of the assets. The platform may undertake an initial review of challenges to identify possibly problematical challenges (e.g., challenges that do not meet certain criteria required for challenges to be recognized by the platform). The curator may then review the potentially problematical challenges to facilitate a standard for the challenges. Multiple challenge curators and platform challenge criteria reviews may be utilized in the present invention, each being directed to a type of challenge, an organization that the challenge relates to, or other aspects of the challenge that require a level of conformity. A mission platform review and curator review may also be applied to missions in some embodiments of the present invention. If the deletion of an asset is requested from a library the platform will identify the missions and challenges that such asset is incorporated in. In this manner an asset cannot be deleted if an issue will arise because such asset is still incorporated in missions and/or challenges. For example, if rights to use of the asset end, then the asset may need to be removed and replaced in the identified missions and challenges. The platform may send a message to the builder and/or owner of such missions and challenges with an alert about the removal/replacement requirement for such asset.
Tags, keywords and other identifying information used for ease of search-ability are stored in the system and may be applied in any library of the platform, including libraries for assets, challenges, missions, etc. Such tags, keywords and other identifying information may be user-generated. Tags, keywords and other identifying information may also be displayable to a builder.
One benefit of libraries permitting the sharing of challenges, missions and assets is that less storage may be required for such challenges, missions and assets. This is because in one embodiments of the present invention, the copied elements that are used within multiple missions and challenges may be accessed from the library and therefore multiple versions of the same elements may not need to be stored. This will reduce the overall storage size required for the platform storage (e.g., the server storage size required for storage of the information relating to the missions and challenges created through the use of the platform).
Sharing of missions between builders also allows builders to generate a new mission using information from a previously built mission if the geo-location of the previous mission and the new mission have similarities. The new mission will incorporate content from the previous mission. Builders can create a location-based experience (a mission) through the mission builder platform, and the mission will be stored on a server connected to the platform. A builder can choose whether or not to share any mission that the builder creates, including the positioning of challenges and content of challenges within the mission. A builder can create a template from a previous mission stored on the server that is indicated to be allowed for sharing. The template can be copied into a new mission that is being built by a builder. A builder can edit and customize the template to create a new mission. For example, the new mission may be created through amendments to the template to cause the content to be related to a specific location (e.g., modification of the GPS locations of items, images, mission splash, challenge content, audio, video, etc.). The new mission can be published, and if the builder identifies the new mission as shareable, that new mission can be used as a template for yet another new mission by a builder.
The present invention is also operable to permit sharing of challenges by builders, or sharing of location-based content within a challenge. A builder may create location-based content (including artificial reality content or augmented reality content) through use of the mission builder platform. The challenge content can be saved to a server connected to the platform. For example, challenge content can include artificial reality challenges or augmented reality challenges, such as customized three dimensional (3D) assets accessed and copied from a sharing content library or a third party library, text, images, or other content incorporated in a challenge. An artificial reality challenge can provide a unique artificial reality experience and/or augmented reality experience in a real world location. The 3D assets will be placed in a virtual world that corresponds to a real world location.
The builder can share the challenged content by storing a copy in the content sharing library through the mission building platform. Builders can search for challenge content in the library and incorporate the content into new challenges and missions. The challenge content can be modified by users for incorporation in other challenges and missions.
The analytics and statistics module of the present invention may be utilized in some embodiments of the present invention to generate personalized success data for users of the mission suite. Such data may be generated in accordance with the requirements for organizations with which the user is affiliated. For example, if the user is a student with a school board, the data may indicate the success of the user in relation to educational requirements of the school board that are met through the completion of missions and/or challenges of the mission suite. The platform may generate different versions of missions and/or challenges based upon the capabilities of various user mobile devices. Thus, the information stored with a missions and/or challenges may include the types of mobile device and/or the elements that must be incorporated in a mobile device that the missions and/or challenges can be utilized upon. Missions and/or challenges that cannot be utilized on certain types of mobile devices may either not be downloaded in the mission suite downloaded to a particular type of mobile device, or may not appear as options to be selected by a user of a mobile device that cannot operate such missions and/or challenges.
In some embodiments of the present invention, missions and/or challenges may have stored information that indicate that such missions and/or challenges may only be available for use by a user during a particular period of time. For example, missions and/or challenges relating to a season or a holiday may only be available to a user during a time period relating to such season or holiday. Such missions and/or challenges may be downloaded to a user's mobile device with the mission suite generally, and the mission suite will only make such missions and/or challenges available to the user during the relevant time period. Alternatively, missions and/or challenges may only be available for download to a user's mobile device during a particular period of time, and may only be stored on the mobile device during the relevant period of time.
A facility or module whereby builders can log information relating to challenges may be provided. This facility will allow builders to provide comments relating to the function of challenges, and the applicability of challenges to particular organizations or locations, as well as other comments or information relating to challenges. This logged information may be utilized by the global administrators, the mission managers, or may be made available generally to all builders. Options for elements to be included in a mission or a challenge may be provided to a builder as a drop down menu, a grid, or a free-form field, whereby the builder may provide information to the platform to be used in the generation of a mission or challenge. Mission Suite
Once the mission suite is downloaded to the user's mobile device, the user may start the mission suite. The user will have the option to download further mission suite content (e.g., missions or other related information that has not been downloaded previously). If the user chooses to download further mission suite content the mobile device will send this request via the Internet to the server, and the server will identify any mission suite content that has not been downloaded to the user's mobile device and will instigate the download of such content to the user's mobile device via the Internet. The server may utilize a query that incorporates information relating to the user, such as the date of the most recent previous download to the user's mobile device, the user's geo-location, any group that the user is part of, or other user information that is uploaded to the server along with the query transferred from the user's mobile device, or that the server has stored in a user profile or other information relating to the user. Such a query may select only the mission suite content that is relevant to the user that has not already been downloaded to the user's mobile device to be downloaded to the user's mobile device. Such mission suite content may include updates, upgrades or modifications to missions or related information already downloaded to the user's mobile device, and/or new missions not previously downloaded to the user's mobile device. Information, missions, challenges or other mission content that has been deleted at the platform level may also be deleted from the mobile device during an update. The server stores information relating to any content downloaded to the user's mobile device and the date of the download.
A user may choose not to download information to the mobile device. Such an option may be provided to the user as a "skip" button in the mission suite display provided to the user on the user's mobile device. Interaction between the user and the mobile device may be by voice command, touch screen, keyboard, or any other input element whereby a user can indicate certain information to the user's mobile device for use by the mission suite.
An update and download can only occur when the mobile device is connected to the server via the Internet. If an Internet connection is not available to the mobile device a message 140, as shown in FIG. 14, indicating the lack of Internet service may be incorporated in a screen displayed to a user.
The download to the user's mobile device, including the initial download and any subsequent downloads, will include information whereby the one or more missions that are downloaded can be performed by the user. The download will also include information relating to other functions of the mission suite, such as the function of selection screens whereby character information is selected. The download information will further include a list of mission suites, geo-locations, image data and/or 3D art data as well as other information discussed herein.
Each time the mission suite is initiated from a mobile device a login to the device as the last user who logged into the same device immediately occurs automatically. If a different user is now to be using the mobile device that user will need to log out and log back in as themselves (the actual user). The first time that the mission suite is initiated a login screen will be provided to the user, whereby the user can login as a new user, or as a guest. Login information will be captured, such as a user identification and a password, and other information may be optionally collected from the user, such as the year of the user's birth, the user's gender, the user's accessibility and disability requirements (e.g., requirements relating to blindness, visual impairment, deafness, hearing impairment, colour blindness, etc.) if any, and the user's education and/or certification level (e.g., grade, certification level, etc., depending on the organization or group the user belongs to and the type of application and goals for which the mission suite is created).
For example, a mission suite can be created for use by organizations to support training. As another example, mission suites can be created for education organizations, such as boards of education, to enhance grade level learning and curriculum requirements. As yet another example, a mission suite can be created to apply non-organization based learning and other goals.
For a user's accessibility and disability requirements a user may add a description of any disability or accessibly issue that the user has into the system and the system may generate the appropriate accessibility and disability requirements relevant to the user (e.g., use of the mission suite with a braille keyboard if the user indicated blindness, large text display if the user identified visual impairment, specific colour contrasts display if the user identified visual impairment, increased volume if the user indicated hearing impairment, text descriptions of displays relating to audio content if the user indicated deafness, etc.).
The information collected from a user at the login stage or otherwise during use of the mission suite may be uploaded to the server of the platform (via the Internet) and stored, including guest user information. Guest information will be stored and can be utilized later if the guest decides to login as a new user, such that the information may be utilized to populate the login fields for quicker login by the new user.
The mission suite will be downloaded to the mobile device, including missions and related information, and information relating to the function of the mission suite, prior to a user logging-in to the mission suite for the first time. Different embodiments of the present invention may download different missions to the mobile device as part of the mission suite. For example, all missions may be downloaded, only missions relating to specific types of locations may be downloaded, only missions relating to a group or organization that the user is identified as being included in may be downloaded, only missions relating to a geo-location near the user's present geo-location may be downloaded, or any combination of these possible sets of missions may be downloaded. The geo-location of the device may be sent from the mobile device with the request to download the mission suite. The geo-location may be used to determine some of the options for possible types of missions that will be downloaded.
A GPS location of the mobile device may be detected when the mission suite is initiated on the mobile device, or use of the mission suite is otherwise indicated to the mobile device. (This may occur at the point of login if there is a login step or when the user accesses the app on the device at any time.)
A main screen is shown to the user of the mission suite on the display of the user's mobile device. The user may utilize known gestures and commands to operate the mission suite on the mobile device, including typed or spoken commands, gestures such as swiping and tapping, or other commands to cause the mission suite to function. The applicable gestures and commands that can be utilized with the mission suite may be indicated in the training available to be provided to the user by the mission suite. The main screen provides one or more options specific to the user who is logged-in to the mission suite. The main screen may display a background, such as a 3D scene. An example of a scene 122 that may be integrated in a screen is shown in FIG. 12. The scene may incorporate a variety of options 120a, 120b, 120c, 120d that may be chosen by a user. A scene may be integrated in a main screen or in other screens in embodiments of the present invention.
The main screen will provide the user with function options, such as moving or rotating a camera relating to the scene shown on the display. For example, the camera may be used to zoom into portions of the 3D scene, such that if the scene shows a building the camera can be used to zoom towards the building to more clearly show details of the building, such as the name of the building. A user may click on a portion of the screen to progress into portions of the screen, such as on a portion of a building in a scene to go into the building. Other types of scenes may be shown, such as a treehouse, a landscape, a skyline, or any other types of scene. Zoom features may be integrated with such scenes, as well as the ability to move within the scene, such as to move into a wooded area or inside a building. Movement within a scene may be utilized to choose options in a menu. For example certain menu options may be shown to a user outside a building, such as the option to engage in training or the option to progress to choosing missions. As an example, by choosing to move inside the building a user may indicate to the mission suite a choice to bypass training and to move to choosing missions. As another example, a view of a tree may be utilized to indicate the categories of missions (e.g., nature, water, change, technology, culture, space, planet earth, plants, animal Kingdom, matter, etc.), and rooms in the interior of the tree are shown to indicate each category wherein additional options relating to the chosen category are shown to the a user, and a user may move between rooms via slides that interconnect the rooms. A variety of different types and combinations of scenes, menu options, and ways of indicating a selection of one or more menu items can be made available to a user in embodiments of the present invention.
The main screen may further display a "gadget" menu, such as in a format of a menu option wheel, or some other format. The gadget menu may incorporate any of the following, or may incorporate other options:
• a list of missions a user can select;
• a training camp option;
• a tutorial that will provide a static screen with information about how the mission suite functions;
• user profile access, whereby the user information can be amended, statistics relating to the user's use of the mission suite can be viewed, and settings for functions of the mission suite (e.g., music, sound effects, voices of characters, and other settings) can be chosen and set;
• a soundboard, whereby a user may listen to sound clips and may alter the pitch of sounds (mission currency may be required to access this option); and
• a flashlight, whereby the camera flash of the mobile device may be engaged (mission currency may be required to access this option).
Other menus showing the same or similar options may be incorporated in other embodiments of the present invention, or embodiments of the present invention may incorporate both gadget menus and other types of menus on the various screens of the invention.
The main screen may further incorporate one or more characters that will move, for example such as by walking around and waving sporadically. Such characters may have the function in other portions of the mission suite of guiding or assisting the user. The app may incorporate a trophy room, which may be a portion of the app that is individualized to reflect the user's progress and accomplishments relating to the user's performance of the missions and challenges. A user may be able to customize the trophy room that is displayed to that user. For example, customization may include selecting colours, furniture and other elements to be displayed in the trophy room.
A "trophy" in embodiments of the present invention need not be a traditional trophy, but can include animated characters (e.g., avatars or other characters). The user can interact with the animated characters in the trophy room. The animated characters may be earned by a user when the user achieves a milestone identified in the app. For example milestones may include any of the following: completing a set number of missions; or earning a certain amount of mission currency. By achieving milestones in the app the user may further unlock options to customize the user's trophy room. For example, options to customize the trophy room may include an option to add more furniture, or more characters to exist in the trophy room. The app will document the user's achievements, such as the user's personal statistics based on interaction with the app (e.g., activities relating to missions and/or challenges, etc.), the milestones the user achieves, and digital badges that are awarded to the user. All of these aspects that are related to the user's achievements, such as badges and statistics, will be available in the trophy room. Furthermore, documentation of a user's achievements may be identified as a "mission book". The mission book may function as a digital scrap book, card collecting book and/or a stamp book. The mission book is an interactive tool that allows a user of the app to review past accomplishments, trait cards collected and personal statistics, as well as to interact with virtual rewards (such as 3D virtual rewards), preview missing rewards or missions, share content, and/or link to other parts of the app.
A mission list will be shown to a user upon selection by the user of a mission list option. The list of missions may be in a scrollable format or shown on a 3D map space that relates to a user's current GPS location. The missions shown will be all active and/or available missions. The missions may further be sorted, such as by alphabetical order, or by the mission that has the nearest location to the geo-location of the user (as is detected by the mission suite utilizing the GPS or other geo-locator element of the mobile device). Other filters may also be applied to the list of missions, such as will display previously downloaded missions, missions that have not been downloaded (this list of names of un- downloaded missions can be requested from the server), particular types of missions, missions for a particular group of which the user is a member, or other filters. The sorting of missions may be in any direction, such as A-Z or Z-A, nearest to farthest or farthest to nearest, etc. The sorting and/or filters are applied to assist a user to locate a particular mission more easily. If un-downloaded missions are shown in the mission list, and the mobile device is connected to the server and/or platform (via the Internet), if an un-downloaded mission is selected by the user that mission and all related information may be downloaded from the server to the mobile device.
This is but one example of possible different functions of the mission suite available when the device is and isn't connected to the server (via the Internet). The mission suite can be used by a user both when the device is connected to the server and when it is not connected to the server, provided the mission suite was previously downloaded from the server.
A user may further be identified in the user's profile as being a member of one or more organizations, such as a student of a particular school board, a member of an association (e.g., a junior fire-fighter, an air cadet, etc.), a member of a sports organization (e.g., a local, regional or national sports team or association), or a member of some other organization. Missions relating to the affiliation of the user with the one or more organizations may be recognized by the mission suite and the missions relating to the user's affiliation(s) may be indicated to the user in the mission list. For example, missions having a relation to an affiliation may be shown in a particular colour or style of text. Alternatively, the mission list may be filtered to only show missions related to one or more affiliations of the user. As missions may be identified as being of different categories (e.g., cultural missions that are performed in museums, cultural sites, art galleries, etc.; nature missions that are performed in natural locations such as provincial, state or national parks, or other outdoor locations; urban missions that are performed in an urban environment, such as downtown in a city or town, and may be performed indoors, outdoors or a combination of both; etc.), the list of missions may show various categories of missions in a particular colour or style of text. Alternatively, the mission list may be filtered to only show one or more categories of missions to the user.
Filters or specific indicators of categories or affiliations of missions shown to a user may be set by a user, or may be set within the mission suite at the platform level.
Various missions may require particular inputs or functions of the mobile device to be enabled. For example, some missions require a quick response code (QR code) function, some missions require a GPS function, and some missions require a combination of Bluetooth, QR code and GPS functions. In embodiments of the present invention the list of missions may be filtered in accordance with the available functions of the mobile device, such that if any required function is not available on the mobile device, such as QR codes and/or GPS, then missions that require such functions will not be displayed to the user. In other embodiments of the present invention all of the missions will be displayed in the list to a user, including missions for which the mobile device lacks the requisite functions. In still other embodiments of the present invention, the user will be able to choose any one or more filters to be applied to the list of missions displayed to the user.
A user may select a mission from the mission list, and upon a selection the mission site (an area or geo-location) for such mission will be displayed. If the download option was skipped at the point of login or initiating of the mission suite session, then the mission suite may either automatically check for and download any available updates, upgrades or modifications to the mission (if the mobile device is connected to the server and/or to the Internet), may provide the mission without any recent updates, upgrades or modifications (i.e., in the form that the mission is available from the local storage of the mobile device), or may provide the user with an option to check for and download any available updates, upgrades or modifications to the mission (if the mobile device is connected to the server and/or to the Internet).
In some embodiments of the present invention if the user selects a mission for which a requisite function of the mobile device is not available (such as a QR code and/or GPS function), then the mission suite may attempt to provide the mission.
The screen that provides the mission may incorporate a gadget menu that offers different options from the gadget menu available at the main site. For example, the gadget menu at the mission site may incorporate a compass option (that utilizes the compass feature of the mobile device), a statistic option that provides information about the user activities at the physical mission location (e.g., steps walked by the user at the location, the number of challenges the user has completed, etc.), a QR scanner operable to scan QR codes from the site (which can be used to find QR codes at a physical site). An example of a gadget menu 110 is shown in FIG. 11. If an option to use a compass is chosen and the compass is not calibrated the user may be directed by information appearing on the screen of the mobile device (or audio instructions) to move the mobile device in a particular series of movements. To cause the user to engage in such movements, the mission suite may also incorporate a game that requires the user to engage in such movements. These movements will create motions 100 that facilitate calibration of the compass of the device through the application of controls based upon accelerometer roll, pitch and yaw, as shown in FIG. 10.
As shown in FIG. 9, a character 92 in the game may be related to the movement of the mobile device, such as a rotating the camera may permit a look at the sides of the character, whereas moving the mobile device downwards may cause the character to dive, and shaking the mobile device may cause the character to shake its head. The direction and type of motion required for the mobile device may be indicated in a text message 94 and/or by a direction indicator, such as an arrow 92. A variety of character movements can be programmed to be displayed in accordance with various motions relating to the mobile device. In embodiments of the present invention, a user may be directed to undertake other motions relating to the mobile device, or other activities relating to the mobile device that may be required to calibrate, refresh, or initiate elements of the device that are utilized in the mission suite. Bluetooth Missions & Challenges
If a mission requires a Bluetooth connection then a map will appear on the display for the user. For example, the map may be drawn by a builder, may be a Google map, or may be some other third party map. Markers indicating the locations of Bluetooth beacons will be shown on the map. The Bluetooth beacons can be of any frequency, including low frequency beacons. The user may click on the Bluetooth beacons one at a time. Bluetooth beacons may operate with proximity services, whereby information will be delivered to and displayed to a user on a user's mobile device when the user is near the beacon, and may connect to the Internet to download additional information to the user's mobile device. (The user must therefore be located at the physical site of the Bluetooth beacon to achieve this function, and the map shown on the display will help the user locate the Bluetooth beacon location in the physical environment.) When the camera of the mobile device is pointed onto the physical Bluetooth beacon, information about the mission will be displayed on the device. After the user locates a few of the Bluetooth beacons indicated on the map, information about the challenge types that are part of the mission will be displayed for the user.
Challenges may include various types of activities and/or challenges. Examples of challenges include:
• image challenges that are multiple choice or single choice, and whereby images provided to the user are matched, or an image captured by the user through the camera of the user's mobile device is attempted to be matched to an image provided to the user (through the application of an image recognition process);
• text challenges that are multiple choice or single choice; comparison challenges, whereby two items, sounds, or words are compared, for example, sounds provided to the user may be compared, or a sound captured by the user though use of the user's mobile device may be compared to a sound provided to the user. (Sounds may be compared through an audio recognition process.); colour matching challenges, whereby colours are matched to images, or colours can be changed in images; sound and image matching challenge, whereby images are matched to sounds (e.g., an image of a bird is matched to a sound of the bird's call); augmented reality challenge, whereby a representation of flora or fauna, or a character, will be viewable through the display, and the user will need to achieve a function in relation to the representation (e.g., a representation of bees may be viewable through the camera of the mobile device and the user must fire honeycomb forward to contact the bees); detective challenge, whereby a user must fill-in letters into partially spelled words to complete the words; photo hunt challenge, whereby a list of items to photograph is provided and a user must match a photograph (photo) the user generates (captures) to an image of the same object that is one of multiple face down cards displayed to the user, by turning the cards face up one at a time; hangman challenge, whereby the user must fill-in letters into spaces indicating the letters of words or phrases, and a body part of a character upon a gallows is added each time an incorrect letter is chosen for a space, until either all of the body parts are drawn and the game is ended, or the user correctly enters all of the letters in the word or phrase to complete the challenge; who's best challenge, that two players can play simultaneously, whereby questions are provided to the user pairs and the users must select the right answer in order to obtain points (or deductions of points are awarded for wrong answers); and
• scavenger hunt challenge, whereby a user is required to find objects and to put the objects in containers (e.g., such as a recycling object being required to be put in the right bin), and in this challenge the user may move objects appearing on the screen to locate objects underneath (e.g., by swiping on the screen, or other user movements, voice commands, or text commands). In some embodiments an augmented reality aspect may be added to this challenge whereby the view from the mobile device is shown on the screen and a 3D character or object is shown as integrated in the view when the device is aimed at a character or object (the character or object appears when a symbol in front of the camera is recognized by the mission suite). The character or object is spatially positioned so that the character or object doesn't remain central to the camera view as the camera is moved. This challenge may be timed. The objects to be found may be fully virtual, or may be a combination of real and virtual objects. If real objects are to be found the user may be required to generate a photograph of the object once it is located by using the camera of the mobile device. The generated photograph will be compared to an image of the object stored in the mission suite through an image recognition process.
Whether Bluetooth, QR Codes, or GPS based missions are available to a user, other types of challenges may also be provided as part of a mission. The number of challenges incorporated in a mission may vary. Moreover, some of the challenges may be provided to the user as timed challenges, whereby a user must complete the challenge within a set period of time.
Builders can train their own image recognition machine learning models in the mission building platform and incorporate these in challenges that are included in missions. The image recognition machine learning models are then distributed to users for use in geo- located educational challenges when a user accesses a challenge through use of an app. As shown in FIG. 23, a builder 230 logged into a computer device that connects the user to a mission building platform 232 via the Internet 12, can operate the mission building platform to search for content (assets) in the mission building platform, such as content stored in the server or content stored in a content sharing library. This content may be images that contain a particular subject (such as a type of plant, a type of animal, a landmark, or some other subject). A builder 230 who is also logged-in to the app 232 on a mobile device can alternatively upload images captured by the app to the builder's computer device from the app, and then transfer the images to the mission building platform. The images may be transferred to a trainer service 236 that is connected to the mission building platform. The training service is operable to train a model to recognize the subject shown in the images, and will return a trained model to the mission building platform once the training is completed. The trained model may be integrated into a mission by operation of the mission building platform. The mission incorporating the trained model is downloaded by the mission building platform to the app. The trained model incorporated in the mission is operable to identify the subject the model is trained to recognize in any images generated by the app or generated by the mobile device.
The trained model utilized in the present invention may be a machine learning model that is a reusable code object that has been created and trained by the mission building platform to be able to do a specific job. For example, the job a model is trained to achieve may be to recognize one or more subjects (e.g., real world objects) in an image without any guidance from a human.
An example of software that a training service may utilize to assist in its training function is TensorFlow™. TensorFlow is an open source machine learning platform built by Google™. The trainer service of the mission building platform may be a microservice operable to train one or more models through the application of TensorFlow, and to send the one or more trained models back to the mission building platform.
When a new model is trained to identify a subject, the trainer service downloads thousands of images containing the subject in question, and collects comparison data. TensorFlow then uses these images to teach the model about the subject in question so that the models can identify the subject in an image. Once it is finished, a model is generated and sent back to the mission building platform. TensorFlow is integrated into the app to use the models generated by the trainer service to identify the subject in images generated by, or otherwise provided to, or accessed by, the app. The models can easily be trained in the mission building platform via two different methods. Builders can either: search a database of images available on, or via, the mission building platform to identify images that incorporate the subject they want to train a model to identify; or upload photos and/or video that incorporate the subject from the app directly. The subject of such images can consist of a category of items, such as a species of plant or animal, or specific items such as a specific landmark in a geo-location. If a model has already been trained to recognize a subject, it does not need to retrain for the same subject.
Builders may use their own training data (e.g., images) to train a model. For example, the builder can operate the app to capture or otherwise generate photos of a real world object of interest and provide additional information, such as metadata information, for example, such as the name of the object. Using the gyroscope, the app guides the builder to generate photos of the object from multiple angles. The object is the subject of the training. Once the builder has collected enough images, the images are saved onto the device whereby the app is operated. Once the device is connected to the Internet, the images are synchronized with the builder's mission builder account, and the training service then has access to the images via the mission builder account. The mission builder account is connected to or incorporated in the mission builder platform. The training service may utilize the location data that is incorporated in the metadata relating to the images, and use such location data to train a model to recognize common objects in the geo-location (e.g., as certain species of flora and/or fauna, landmarks, etc.) in order to create a customized and accurate model. Such model will be trained to recognize multiple objects and/or subjects existing in a specific location. To better improve accuracy of the model when it identifies one or more subjects in an image, the trainer service may purposely create a distorted copy of an image so that the model knows how to account for possible errors in the images (e.g., overexposure, blurred images, etc.). The mission building platform can thereby utilize the trainer service to train a custom model based on the builder's images. Once training is completed, the custom model can be bundled with a mission, and the mission content thereof (e.g., text and images) that is sent to the app when a user utilizes the app. When the user accesses a challenge within a mission that incorporates a trained model, the challenge is able to utilize the trained model to review one or more images (photos) captured or accessed by the user, and cause the model to identify the subject matter in the images that the model is trained to recognize. This process can be used to validate the accuracy of the training of the model. As an example, if the user is tasked in a challenge with capturing an image (i.e., by generating a photo) of a certain species of flower, once the user finds the flower and generates a photo an image of the flower, the trained model can verify whether the user had indeed generated a photo of the flower as instructed. The trained model is operated through the app. Another use of the trained models in an app may be to use real world objects as virtual anchors for content, whereby additional information may be displayed in augmented reality beside the object that has been identified by the model.
OR Code Missions & Challenges
If a mission requires a QR code then a map will appear on the display for the user. For example, the map may be drawn by a builder or may be a Google map, or some other third party map. Markers indicating the locations of QR codes will be shown on the map. The user may click on the QR codes one at a time. The user may point the camera of the mobile device onto a physical QR code that the user locates at the physical site (real world location, geo-location) shown on the map. (The user must therefore be located at the physical site of the QR code to achieve this function, and the map shown on the display will help the user locate the QR code location in the physical environment.) When the camera of the mobile device is pointed onto the physical QR code, information about the mission will be displayed on the screen of the mobile device. After the user locates a few of the QR codes indicated on the map, information about the challenge types that are part of the mission will be displayed for the user. Challenges may include various types of activities and/or challenges including the types described for Bluetooth, QR codes, and other challenges.
GPS Missions and Challenges
A mission that requires GPS functionability will require the user to go to the geo-location that the mission is to be performed at, and to walk around that location. The user should use the scanner on their mobile device which will detect the radius around the user and will thereby detect challenges within the radius. As shown in FIG. 18, directional aid information 180 and/or navigation directions 182 may displayed to a user on a screen to help the user move towards the location where a challenge is to begin. The missions that require GPS can identify the location of the user and can thereby recognize the location of a user within a geographical area. This information is used in the displays provided to the user in the GPS missions and challenges, as described therein.
GPS missions may include the types of challenges described for Bluetooth as well as other types of challenges. Mission Suite
For Bluetooth, QR code and GPS based missions, upon completion of a challenge a user may be awarded mission currency. A different amount of mission currency may be awarded to a user for different missions.
For Bluetooth, QR code and GPS based missions, the mobile device may store information locally in the mobile device relating to the user's use of the mobile device for the mission suite. Such information can relate to the user performing specific missions and challenges. The mission suite may analyze this locally stored information to generate statistics relating to a user's use of the mission suite. For example, information relating to a user's performance relating to a challenge may be stored (e.g. the time to complete a challenge, the number of challenge attempts, whether a user has achieved success, partial success, or has been unsuccessful in relation to a challenge). Changes to settings and information relating to the user selecting one or more missions from the mission list (even if challenges relating thereto were not performed) will also be stored locally. Due to this local storage by the mission suite, a user can: utilize the mission suite and information relating to use of the mission suite; and store setting changes, without having to access the server or the platform. When the mobile device is connected to the server and/or platform, the mission suite may recognize this connection and may cause all of the locally stored information about the user's user of the mission suite, or some of such information, to be transferred to the server and/or platform.
In some embodiments of the present invention, an initial scene may be displayed on the user's mobile device when a mission and/or challenge is selected. A character may appear on the screen to provide an introduction to the mission and/or one or more challenges, and to explain the location where the mission is to be performed. A map may then be displayed to the user on the user's mobile device with indicators relating to the mission shown thereupon. For example, the indicators may be a two dimensional image shown on the map, or a two dimensional image that is overlaid upon the map and thereby shown as integrated with the map. As shown in FIG. 11, an indicator may be a sign, such as a sign that indicates a location (i.e., a parking lot 112), a sign that indicates directions, a sign that indicates a road name, or another geographical indicator, and/or indicators may mark specific locations in the map, such as locations where a user must be positioned for a challenge to begin, or a location on a map related to the performance of a mission or a challenge. The mission suite may provide other methods of showing the map and indictors to the user. A user may zoom in and zoom out of a map (such that the map becomes larger and smaller). This feature may be used to read text on an indicator such as a sign in the map.
An indicator may be a circle shown upon the map that indicates the radius of the location where the mission is to be performed. The character may be shown as positioned within the map at the geo-location where the user is presently located. The character may also be shown within the map at a location where a challenge is to commence at the start of a challenge. This indicates to the user where the user should be located to start each challenge. In some challenges the character may further be located upon the map to show where the user should be located for certain aspects of a challenge, if the user is required to move to specific locations during the challenge. The menu, that may be a gadget menu, may be displayed to a user or the screen displaying the map or another screen, and may incorporate a scout feature. If the scout feature is chosen by a user, a character may be displayed to the user in relation to the map. The character may be heading in the direction of the nearest challenge. If the challenge is within the map displayed to the user, then the character may leave a marker upon the map at the location of the start of a challenge. This will indicate to the user the location where the user should be located to start a challenge. The user may choose to engage in a challenge other than the nearest challenge.
Information about the challenges relating to a particular mission may be displayed to the user, for example, such as the total number of challenges that are included in a mission. As challenges are attempted or completed by the user, information regarding the completed or attempted challenges may also be displayed to the user, such as the number challenges that are completed and/or the number of challenges that have been started but not completed. The scanner of the mobile device may be utilized to reveal some challenges to a user. Once a challenge is revealed, the user may start the challenge. For some challenges the user may be required to be positioned close to the location where the challenge is to begin before the user will be able to start the challenge. The GPS function of the mobile device will be utilized to recognize the geo-location of the user and to determine whether the user is in the location required for the challenge to begin.
A direction finder may be displayed to the user in a portion of the screen of the user's mobile device. The direction finder may indicate information relating to how far away the nearest challenge or a challenge selected by the user is located from the geo-location of the user. The direction finder may further indicate if the mobile device is pointed in the direction of the nearest or selected challenge. (This information may be derived by use of the compass of the mobile device.) The direction finder may further indicate whether a user should turn left or right to reach the nearest, or a selected, challenge, or give information about where the nearest, or a selected, challenge is located. Maps
In the challenges that show maps, including either QR code or GPS challenges, a mapping tool may be available to a user. The mapping tool may utilize a map feature available on the user's mobile device outside of the mission suite. The mapping tool may thereby identify a map generated by the mobile device and utilize this map in the mission suite.
When a map is loaded by the mission suite, indicators and/or positions relating to that map that can be used in one or more challenges may be incorporated in the map. These indicators and/or positions may be overlaid upon the map or otherwise integrated with the map. All or some of the indicators and/or positions integrated with the map may be invisible to the user. As the scanner of the mobile device is utilized by the user to scan the radius of a location any indicators and/or positions that are within the scanned radius may then be visible to the user upon the screen of the mobile device.
Training A training option may be provided to a user through a menu. Alternatively, the training may automatically start at a point after the user initially logs-in to the mission suite. It may be possible for a user to skip training before or after it has started.
A character may be displayed to a user on the display of the user's mobile device. The character may provide information to a user, for example, such as by telling a story to the user. A training camp screen may then be displayed to the user. The training camp may provide options to the user in the form of information relating to the use of the mission suite, or the training camp may provide such information in a particular order to the user. For example, the training camp may provide information to a user about how to use the options shown on the menus of the site, how to use the various types of challenges, how to find QR code sites to start challenges, how to use the GPS scanner and scout feature, how to calibrate the compass, how to utilize the menu (e.g., such as a gadget menu), how to find challenges, and other information relating to use of the mission suite and its various features. Levels of Challenges
Challenges and missions may be created for specific levels of users. For example, the levels may be related to the school grade of a user, the age of a user, the skills of the user, or some other attributes of the user that indicate the level of mission and/or challenge that a user should engage with in the mission suite. A mission may be created to incorporate challenges at various levels. Hierarchies of the levels can be set for the missions and challenges. For example, a grade level may incorporate two or more different levels of difficulty, so that challenges and missions of multiple levels of difficulty may be provided to users of a particular grade level. The mission suite may determine the level of a user from a review of the user's information (such as the user's profile information). When a user views a list of missions and challenges this list may be filtered to show only missions and challenges of a level relevant to a user, or of a lower level than the level of the user.
If a mission incorporates challenges at a variety of levels, a user will be identified as having completed all of the challenges in the mission when the user has completed all of the challenges at the user's level. Once a user completes all of the challenges at the user's level, if the completion of these challenges causes a user to move up a level, then the challenges at the next level may be displayed to a user.
For example, if the user's level is indicated by the user's school grade (and there is no hierarchy of levels for that grade level), then the user will not move up a level upon the user completing challenges at a certain level. The user will only move up a level when the user proceeds to the next school grade. However, if the user's level is determined by the user's exposure to the challenges, such that that user starts at the lowest level when starting to use the mission suite (or the lowest level within the applicable hierarchy of levels, e.g., the lowest level for a grade level), as the user completes the challenges in a mission at a particular level this completion may cause the user to progress to the next level. The user's level may progress to the next highest level upon the completion of challenges in a mission. The advancement of levels will be indicated in the mission information, as set by a builder. Other Features of the Mission Suite
Embodiments of the present invention may incorporate a variety of features and functions, as discussed herein.
Characters displayed in the mission suite may have a variety of uses and may impart information in a variety of ways. The information imparted by a character may be through text, audio or some other way of providing information to the user. One or more characters may be displayed in the mission suite, a mission and/or a challenge. The character(s) may be shown in 2D or 3D, and the information that is imparted to the user may be related to a narrative that is created for the mission and/or a challenge by the builder. For example, a character may provide a backstory for a mission and/or challenge, or provide secrets relating to the mission and/or challenge, that will assist the user in engaging with the mission and/or challenge. The character(s) may further provide information about the mission suite, its elements and/or its function that is not available through the menus offered to the user. The mission suite may incorporate a mission currency that is a type of currency awarded to a user, or spent by a user, in accordance with the user's interaction with the mission suite. For example, currency may be awarded to a user upon completion of one or more missions, challenges and/or games. A user may spend currency to utilize elements of the mobile device (e.g., the flashlight, etc.), to attain elements to be used in the missions or challenges (e.g., sounds, characters, clues, etc.), and/or to be provided with one or more games.
The mission suite may also incorporate a type of reward other than mission currency that is awarded to a user in accordance with the user's interaction with the mission suite. For example, a reward may be awarded to a user upon completion of one or more missions, challenges and/or games. A user may apply the reward to utilize elements of the mobile device, to attain elements to be used in the missions or challenges, and/or to be provided with one or more games, in accordance with the specific reward which may state that the reward is a particular reward (e.g., the change of a skin type for a character), or that the reward is for a category of element, such as a game, an element of the mobile device, or an element to be used in missions or challenges. A reward may not be exchangeable for any specific element of the mission suite or the mobile device. For example, a reward may be a badge, a trophy, or another type of award. As shown in FIG. 7, one or more badges 70a, 70b may be provided by an organization coordinator or instructor to prove that the user has achieved a milestone in such organization's training program.
The mission suite may provide for a photo wall, whereby images and sound files captured by the user in the course of a mission and/or a challenge may be shared with the platform, and possibly shared with other users. Such images and sound files may be marked for sharing by the user in a settings section, or during the mission and/or challenge. Images and sound files that are marked for sharing may be transmitted from the user's mobile device to the platform (via the server), and the platform may add the images and sound files to one or more libraries for use by builders, and/or may otherwise make such images and sound files available to other users.
One or more games may be provided to a user. These games may be education-based, or may not have any educational content. One or more characters may be associated with a game. Games can be generated by builders through use of the platform, and games can be incorporated in the app, a mission suite, missions, or challenges.
Embodiments of the present invention may incorporate trait cards. Trait cards may be generated by the system, or by a third party system that delivers the trait cards to the present invention. Trait cards may be similar to trading cards, such as sports trading cards, but the trait cards will be created for animal and plant species. For example, trait cards may include an image of an animal or plant species and may further incorporate information relating to the specific species that is depicted. Alternatively, trait cards may include information about historical figures, notable artwork, landmarks, or other information. In an embodiment of the present invention the trait cards may be generated by builders, and such an embodiment of the present invention may incorporate a card creator module that can be used by the builders to assist with the creation of trait cards.
A trait card game can be accessible by a user as a type of game available in the mission suite. The trait game will use the trait cards. The game may be played using a physical gameboard. Digital files may be provided to a user whereby the user can print trait cards, a gameboard, and a set of rules and instructions for the board game. For example, the user who receives and prints the digital files may be an instructor and the players may be students. The game can be co-operative, relating to a project, such as saving an aspect of the environment within a set time period.
A version of the trait game may also be available to be played online in the mission suite connected to the Internet. In the online version one or more trait cards may be printed by a user that incorporate a scannable element (such a QR code). The user will scan the trait card and will collect the cards in the user's mission book. The rules for the online game will be available to the users playing the game through the app.
The rules for the trait card game may be developed by builders, and such rules may be shared amongst builders through the platform. The rules may be edited and amended by the builders and the amended versions of the rules may also be shared amongst builders through the platform. The rules will be related to the physical gameboard. The physical gameboard may therefore be used to play games based upon a variety of different rule sets. As an example, sections differentiated on the gameboard may be identified by a rule set to represent different ecosystems (e.g., riparian, ocean, dessert, etc.). The rule set may identify different animal and/or plant species that exist within the gameboard area generally, or within each specific section of the gameboard (e.g., within different ecosystems). Trait cards may be identified by the rule set to relate to different ecosystems defined on the gameboard.
Alternatively, the a leader of a group of players of the game, such as a teacher if the players are students, may select the ecosystems that the gameboard will represent, any species therein, and how species relate either to the gameboard generally or to specific ecosystems represented on the gameboard. There may be sets of trait cards identified for printing, and the leader may select a specific set of trait cards to be printed and used in the game, in accordance with the identification of eco-systems and species relating to the gameboard. The leader may also be able to access some or all of the multiple rule sets that have been created by the builders, and the leader may select the rule set that will be applied to the game to be played by the players.
Geo-Locations and Builders
Builders use the platform to create location based learning experiences, as described herein. The builders may gather content to be incorporated in the app, mission suites, missions or challenged directly from a geo-location, from users at a geo-location, or through other means. The geo-location that is the focus of a mission may further be chosen in relation to outcomes prescribed by an educational institution or by school board requirements that a mission is to meet. As a first step in mission building, a builder will identify a geo-location where an educational experience can be directed. The geo-location may incorporate a specific object, such as a landmark, a signpost, a juncture of two rivers, or another object, or be within a specific area, such as a specific area within a national park, or any other location. As shown in FIG. 24, the builder 240 logs into a computer device to access the mission building platform 248, and operates the mission building platform to create a mission relating to that geo-location or area. For example, the builder may gather information about the geo-location, images of the geo-location, or any other virtual content 246 relating to the geo-location. This virtual content may be incorporated by the builder into the mission, challenge or other content that the builder creates suing the mission builder platform. The geo-location or area can be identified on a map that is incorporated into the mission, challenge or other content created by the builder. The builder builds the mission, challenge and/or other content to be included in the app 244 provided to a user, to fulfill the required educational goals using information relating to the geo-location or area. Once the mission, challenge and/or other content creation, review and approval process is complete, the builder publishes the mission, challenge and/or other content whereby it can be downloaded for use by a user in an app 244.
Content utilized by builder to build the mission, challenge or other content through use of the mission builder platform may have a geographic location associated with it, such as GPS coordinates incorporated as metadata in any of the content. The GPS coordinates may be utilized to generate a map indicating the geo-location (and radius therefrom wherein a mission and challenges are to be performed) to be incorporated in the mission, challenge or other content generated by the builder through operation of the mission building platform. The app and the mobile device whereby a user uses the app, uses the geo-location information embedded in a mission, challenge or other content downloaded to the app, along with the mobile device's GPS location, to indicate objects near the user of mission, challenge or other content relating to locations near the user. This embedding of location specific information in missions, challenges and other content downloaded to an app causes the user to view the mission, challenge and other content that is relevant to the geo-location of the user when using the app.
When a user utilizes the app to operate a mission, challenge or other content relating to a specific geo-location where the user is located, the challenges the user accesses in the app can contain one or more learning outcomes 242 (e.g., images, video, text augmented reality digital content, audio content, or other content), that relate to that specific geo- location. The learning outcomes will have been previously identified by the builder and transferred by the user to the mission builder platform, so that such learning outcomes were integrated into the missions, challenges, and other content created by the builder. For example, integrated learning outcomes can be integrated into a mission, challenge or other content such that integrated learning outcomes can be viewed by a user through an app, and possibly may be viewed by the user as overlaid upon real world objects.
When a user engages in a challenge through the app that incorporates learning outcomes specific to the geo-location where the user is using the app, the user takes in real world information along with digital content provided specifically for that location. This can reinforce the educational outcomes as experienced by a user. A user may interact with the real world location and digital content in any of the following ways: a combination of real world location objects and augmented reality objects corresponding to the real world location (e.g. augmented reality fish in a real world river) may be viewed and studied by a user; - the app may pose questions to the user about the real world location, and require the user to observe what is around them and provide answers;
- the app may pose questions to the user, and the user will be required to capture photos, videos, other images, or audio of the real world in order to answer the questions;
- the app may present one or more images or other information to a user and require the user to correlate similarities or differences between the images or information provided, with the real world surroundings of the user; or
- the app may require the user to perform physical actions to interact with an augmented reality world displayed to a user on a screen of the mobile device via the app (e.g. shaking the user's device, blowing on the screen of the user's device, moving around while holding the device, rotating the device, or interacting with any sensors available on the device).
During or after engaging in a mission via the app, a user may also review the mission they engaged with, either at the mission's location or in a classroom or similar setting elsewhere. The user can see how well they engaged in the mission, and review the challenges they engaged in. By engaging in a mission and challenges, the user is exposed to the content of the app in many different settings, such as learning with repetition and seeing the same concepts in many different settings.
As discussed herein, a builder may login to an app and thereby engage in missions and challenges. In this manner a user may be a builder, and a builder may be a user. The experiences of a builder in a geo-location may influence the mission, challenge or other content the builder builds through operation of the mission builder platform.
A user who is not a builder may also provide content to a builder for the builder to use in building a mission, challenge or other content. For this to occur the user must have a means of transferring information, images, audio, or other data directly from the user's mobile device to the builder. As shown in FIG. 25, a user 256 may utilize a mobile device to view an object 260 in a geo-location 250, and capture an image, or other data relating to that object 260. The image or other data may be captured on the user's mobile device. The user may transfer such image or other data to the builder 258 via the builder's computer device.
The builder may also capture or otherwise collect or create virtual content 254 relating to the location where the user captured the image or other data the user transferred to the builder, and that virtual content may be transferred to the builder's computer device. The virtual content and the image or other data provided by the user may be transferred by the builder from the builder's computer device to the mission builder platform 252. The builder may operate the mission builder platform to integrate the virtual content and user's image or other content into a mission, challenge or other content generated by the builder. The mission, challenge or other content, that incorporate the virtual content and the user's image or other content, can be downloaded to an app on the user's mobile device, and thereby be utilized by the user.
The present invention promotes the creation and consumption of content by one or more users (most likely in the same group). One or more users can travel to a real world location and identify objects in that location that may interest or be educational to other users. If images or other data relating to the objects are provided to a builder, the builder can utilize the images or other data to generate missions, challenges or other content that will be incorporated in an app utilized by a user. After the mission is live and downloaded on one or more user's devices, the users can visit the real world location relating to the mission and engage with content that the user generated themselves, as well as content generated by other users. If multiple users capture images or other data relating to a location, and provide these images or other data to a builder, a mission can incorporate images or other data generated by multiple users, and the users can thereby share the images and other data they have generated through engaging in one or more missions. Furthermore, a group of users and builders can collaborate in the creation of missions, challenges or other content, and/or the process of engaging in the missions, challenges or other content, to thereby share their experiences with each other relating to one or more geo-locations. The mission building platform may allow builders to view challenges content currently being created by other builders, and builders may be identified as being members of a group for the express purpose of sharing challenge content, and creating shared experience challenges with other builders within the same group.
It will be appreciated by those skilled in the art that other variations of the embodiments described herein may also be practiced without departing from the scope of the invention. Other modifications are therefore possible.