With Enhanced Real-Time Video

Relationship to Other Application

This application claims the benefit of the filing date of United States Provisional Patent Application Serial Number Serial No. 61/700,324 filed September 12, 2012, Conf. No. 1825 (Foreign Filing License Granted) in the name of the same inventor as herein. The disclosure in the identified United States Provisional Patent Application is incorporated herein by reference.

Background of the Invention

FIELD OF THE INVENTION

This invention relates generally to in-flight entertainment ("IFE") systems, and more particularly, to a video entertainment system the employs enhanced realtime video and is enabled for commercial advertising and transactions, as well as the incorporation of a passenger's personal mobile device.

DESCRIPTION OF THE PRIOR ART

Many passengers of commercial airline flights do not have window seats, and therefore are unable to view the terrain over which the aircraft is flying. In fact, those passengers that are fortunate to have a window seat see obtain a very small field of view of the region over which the aircraft is traveling. In cloudy weather, it is unlikely that there will be any reasonable external view at all.

Therefore, an advantage of this invention to provide a forward view and a downward view to every passenger in a commercial airliner.

It is another advantage of this invention to provide a forward view and a downward view to every passenger in a commercial airliner during inclement weather.

Forward and downward views are attractive to airline passengers, and it is expected that during a flight the passengers will often return to such viewing. Thus, such interest in a displayed view will create an opportunity to present information and advertisements to the passengers. Such information and advertisements, particularly when targeted to the region of destination is additionally attractive to the passengers. An additional advantage of this invention to provide a system by which passengers are enabled to conduct commercial transactions in response to the information and advertisements that are presented to them.

Summary of the Invention

The foregoing and other objects are achieved by this invention which provides, in accordance with an apparatus aspect thereof, an in-flight entertainment and commercial transaction system that is provided with at least one video camera that is arranged on the underside of an aircraft for producing a corresponding video signal. A processor correlates the video signal to GPS data. There is additionally provided an advertiser database for storing advertiser information that includes GPS data that corresponds to the stored advertiser information. A display presents the correlated video signal and the stored advertiser information to a passenger.

In one embodiment, there is further provided a map enhancement database provides map-enhancing data to the processor. In an advantageous embodiment of the invention, the map-enhancing data is responsive to the GPS location of an aircraft. Additionally, in some embodiments, the map-enhancing data is responsive to the altitude of an aircraft.

Preferably, the advertiser data that is presented on the display is responsive to the GPS location of an aircraft. In some embodiments, a portion of the advertiser data that is presented on the display is independent of the GPS location of an aircraft. In an advantageous embodiment, such advertiser data is made available to the passenger on soft buttons distributed illustratively on the periphery of the display.

In some embodiments, there is further provided an airport database for providing airport data to the processor. Such airport data in some embodiments is responsive to the GPS location of the aircraft. In other embodiments, the airport data is responsive to the selection of a destination airport, and to the selection of an arrival gate at the destination airport. This information can, in some embodiments, be entered into the processor by a member of the flight crew. In still further embodiments, the airport data includes airport vendors information, some or all of which are advertisers.

In accordance with a method aspect of the invention, there is provided a method of entertaining airline passengers in an aircraft and enabling commercial transactions. The method includes the steps of: obtaining a first sequence of images external to the aircraft at a first frame time rate;

obtaining a second sequence of images external to the aircraft at a second frame time rate, the second frame time rate being slower than the first frame time rate;

first overlying a GPS coordinate on each image of the second sequence of images;

second overlying map enhancement information on each image of the second sequence of images; and

presenting on a display a selectable combination of the first sequence of images and the second sequence of images to the airline passengers.

In one embodiment of this method aspect of the invention, there is provided the step of second overlying an advertiser coordinate on each image of the second sequence of images.

In a further embodiment there is provided the step of presenting on the display an indication corresponding to the location of an advertiser.

In another embodiment there is provided the step of presenting on the display information corresponding to a map of a destination airport.

In yet another embodiment there is provided the step of presenting, on the display, information corresponding to an airport vendor at the destination airport.

In accordance with a further apparatus aspect of the invention, there is provided an in-flight entertainment and commercial transaction system having a memory for storing GPS-coordinated images, and a processor for correlating the GPS-coordinated images with GPS data corresponding to the location of an aircraft. An advertiser database stores advertiser information that includes GPS data that corresponds to the stored advertiser information. Additionally, a display is provided for presenting to a passenger the GPS-coordinated images and the stored advertiser information in response to the location of the aircraft. The display may be, in some embodiments, a fixed seat back-mounted display. Of course, the images and data can be delivered to a mobile computing device, such as a personal computer, a tablet, or a smart phone, illustratively by wireless technology, for display.

In this embodiment, where there is no camera provided, the views that are provided to the passengers are virtual.

In one embodiment of this further apparatus aspect, there is provided a camera for providing sequential real-time images to said processor. A camera controller controls an optical zoom feature of the camera in response to altitude data. For example, as the aircraft increases its elevation, a longer optical zoom is selected.

In a further embodiment, there is provided a gaming database for providing games data responsive to aircraft location data. Preferably, the games that are made available to the passenger are responsive to any of aircraft type, aircraft location, destination, and the like.

An advertiser accounting system records data responsive to passenger commercial transactions with advertisers.

In accordance with a further method aspect of the invention, there is provided a method of entertaining airline passengers in an aircraft and enabling commercial transactions. The method includes the steps of:

obtaining a sequence of images external to the aircraft, the images being selected in response to aircraft location information;

overlying a GPS coordinate on each obtained image; and

presenting on a display the sequence of images to the airline passengers.

In a further embodiment, there is further provided the step of overlying an advertiser coordinate on each obtained image. Also, there is further provided the step of presenting on the display game information responsive to the aircraft location information.

Brief Description of the Drawing

Comprehension of the invention is facilitated by reading the following detailed description, in conjunction with the annexed drawing, in which :

Fig. 1 is a simplified block and line representation of a specific illustrative embodiment of an advertising/entertaining system for implementing an embodiment the invention;

Fig. 2 is a depiction of a screen shot of a display of an IFE showing an airport layout, a plurality of airport advertisers, a traffic report, and a plurality of advertiser link buttons;

Fig. 3 is a depiction of a screen shot of a display of an IFE showing a real-time video of a forward-looking view during an aircraft landing, and a plurality of advertiser link buttons;

Fig. 4 is a depiction of a screen shot of a display of an IFE showing a real-time video of a forward-looking view during an aircraft landing, an inserted image of an airport layout, and a plurality of advertiser link buttons; Fig . 5 is a depiction of a screen shot of a display of an IFE showing an image of an airport with surroundi ng neighborhoods, and a plurality of advertiser link buttons;

Fig . 6 is a depiction of a screen shot of a display of an IFE showing a representational website of a chamber of commerce, i ll ustratively that of Denver Colorado, and a plurality of advertiser li nk buttons;

Fig . 7 is a depiction of a screen shot of a display of an IFE showi ng a video of a downward view showing a mountain range, and a plurality of advertiser link buttons;

Fig . 8 is a depiction of a screen shot of a display of an IFE showing a video of a downward view showing an approaching city, an enhanced inserted depiction, a local movie schedule, and a pl urality of advertiser link buttons;

Fig . 9 is a depiction of a screen shot of a display of an IFE showi ng a spl it screen with an enhanced street view and a map, and a plurality of advertiser l i nk buttons; and

Fig . 10 is a depiction of a screen shot of a display of an IFE showing a downward view of a point of i nterest, ill ustratively the Grand Canyon, along with an i nsert of related facts, and a plural ity of advertiser l ink buttons.

Detailed Description

Fig . 1 is a simpl ified block and l ine representation of a specific il lustrative embodiment of an advertisi ng/entertaining system 100 for implementing an embodiment of the i nvention. As shown i n this figure, a video camera 110 is i nstalled on an aircraft (not shown) faci ng ill ustratively forward and downward. In some embodiments of the invention, multi ple cameras can be directed in different directions. However, in this specific i llustrative embodiment of the i nvention, only one camera is used to take a relatively wide-angle i mage field, and separation of the respective portions of i nterest are separated electronically, as will be discussed hereinbelow.

In this specific ill ustrative embodiment of the invention, video camera 110 delivers a video signal (not specifically designated) to a video i mage splitter and sequence controller 115. Video i mage splitter and sequence controller 115 in this embodiment splits the video i nto at least two portions, specifically a forward looking real-time video 120, which is a portion that will provide to passengers (not shown) a forward looking view preferably during take-off, landing, and low-level approach. In this embodiment, downward-looki ng portion will, in some embodiments, consist of a lower frame rate image sequence, as will be discussed herein. These images are stored in this embodiment in a downward-looking reduced frame-rate images memory 125. Both of forward looking real-time video 120 and the images in downward-looking reduced frame-rate images memory 125 are delivered, in this specific illustrative embodiment of the invention, to an images processor and server 130.

Images processor and server 130 performs, in this embodiment, multiple functions. First, using global positioning system ("GPS") and elevation information 140, images processor and server 130 will coordinate the image being viewed, particularly the downward-looking images from images processor and server 130, with GPS coordinates. The elevation information that is readily obtainable from GPS and elevation information 140 will facilitate coordination of the field of view of video camera 110 to the GPS coordinates.

In some embodiments of the invention, GPS and elevation information 140 is delivered to video image splitter and sequence controller 115 illustratively to enable discontinuation of forward looking real-time video 120 at high altitudes or at great distances from a destination airport. In this manner, greater video processing power is available for processing the images from downward-looking reduced frame- rate images memory 125, whereby resolution can be enhanced and additional graphical and active content can be added to the video stream that ultimately is delivered to the respective passengers.

Images processor and server 130 provides signals to a camera controller 142 that controls the operation of video camera 110. Some of the features of video camera 110 that are under control of images processor and server 130 and camera controller 142, in some embodiments of the invention, include turning video camera 110 on and off, as well as controlling the optical zoom of the camera. In some embodiments, the optical zoom is controlled in response to GPS position and elevation data that is made available to images processor and server 130 by GPS and elevation information 140.

Further in regard of GPS and elevation information 140, this data additionally enables correlation of the images from downward-looking reduced frame- rate images memory 125 with map enhancement information obtained by images processor and server 130 from map enhancement database 144. In some embodiments of the invention, map enhancement database 144 contains map data that provides greater detail to the images of downward-looking reduced frame-rate images memory 125, and in some situations, such as where weather conditions preclude a clear downward view, the map information from map enhancement database 144 can provide a virtual image. In some embodiments of the invention, map enhancement database 144 contains information of the type that is either proprietary, or commercially available illustratively from Google Earth, for example. At such times when weather or other ambient conditions preclude the formation of a useful video signal from video camera 110, the camera can be shut off by camera controller 142, and the system will rely on the virtual map information to provide a view to the passengers.

In some embodiments of the invention, the perimeter of the image that is presented to the passenger includes a plurality of graphical user buttons (not shown in this figure) that are correlated to respective advertisers that have their information stored in advertiser database 150. This database additionally includes advertiser data that corresponds to advertisers that can, in some embodiments, be identified on the enhanced images obtained from images processor and server 130. In an advantageous embodiment of the invention, such advertiser data includes GPS data that identifies on the image the location of the advertiser, as will be discussed below.

In addition to advertiser data, some embodiments of the invention also deliver to the passengers airport information from an airport services database 152. As will be discussed below, the airport information that is made available to the passengers includes not only a representation of the airport layout, but also the identification of the arrival gate, as well as conveniently located commercial establishments in the airport, which in some embodiments are paying advertisers.

Certain embodiments of the invention provide gaming and entertainment information to the passengers from a games database 149. It is an advantage of this aspect of the invention that, in addition to general games, the games that are delivered by games database 149 can be specific to the particular aircraft, specific to the particular flight, specific to the destination, and/or specific to particular locations and points of interest over or near which the aircraft would be flying at any given moment in time. Of course, plural levels of game play can be offered so as to keep children and adults entertained. In some embodiments, prizes are awarded to winners.

In this specific illustrative embodiment of the invention, map enhancement database 144, advertiser database 150, and airport services database 152 are maintained and updated by an operator control service 155. Operator control service 155 in some embodiments receives instructions and data from a central operator (not specifically designated) that wirelessly uploads flight-specific information to the various databases. In some embodiments, small items of information, such as information corresponding to a mid-flight gate change or airport change can be entered by members of the flight crew.

In this specific illustrative embodiment of the invention, the processed images are delivered to the passengers via the aircraft's IFE, which not only presents the processed images to the respective passengers, but also enables user control over the images and the selected portions of images that are to be displayed, and additionally enables commercial transactions. In some embodiments, the commercial transactions are conducted over the mobile telephone (not shown) or other portable computing device (not shown) of the passenger. In the figure, these facilities and functionalities are included in IFE, user control, and commerce system 160. In some embodiments, the aircraft IFE (not shown) includes a display and a computer processor at each passenger station that enables viewing of the images and affords a measure of passenger control thereover, such as digital zooming, selection of the direction of view, and interaction with advertiser icons.

In still further embodiments, the images are, displayed on, or are otherwise delivered to, the personal computing devices of the passengers. There are, of course, a variety of modalities by which the personal computing devices can be coupled to the aircraft IFE to receive images, games, and advertisements, as well as enabling the personal computing devices to engage in commerce. One method is through the use of blue tooth technology. Another is by presentation on the seat back displays of one or more quick response ("QR") codes that are readily deciphered by smart phones. The QR code will link the personal computing device to an internet web site, or to a local site within the aircraft wherein the personal computing device, via an app, is provided a temporary IP address.

A commerce accounting system 165 maintains an electronic record of passenger transactions with the advertising vendors. In some embodiments, the electronic record includes click counts pursuant to which the advertisers pay royalties to the operator.

Figs. 2-10 are depictions of displays that can, in various embodiments of the invention, be made available to the passengers. Upon selection of an advertiser, irrespective of whether the advertiser is identified along a peripheral soft button portion of the display, or by means of an advertiser icon within a map or view, the advertisement is expanded to i llustrate the selected advertiser's products, and may i n some embodiments incl ude the advertiser's web pages.

Fig . 2 is a depiction of a screen shot of a display of an IFE showing an airport layout, a pl ural ity of airport advertisers, a traffic report, and a pl ural ity of advertiser l ink buttons.

Fig . 3 is a depiction of a screen shot of a display of an IFE showi ng a real-time video of a forward-looki ng view duri ng an aircraft landi ng, and a plurality of advertiser li nk buttons.

Fig . 4 is a depiction of a screen shot of a display of an IFE showi ng a real-time video of a forward-looki ng view during an ai rcraft landi ng, an inserted image of an airport layout, and a plurality of advertiser li nk buttons.

Fig . 5 is a depiction of a screen shot of a display of an IFE showi ng an image of an airport with surrounding neighborhoods, and a plurality of advertiser link buttons.

Fig . 6 is a depiction of a screen shot of a display of an IFE showing a representational website of a chamber of commerce, illustratively that of Denver Colorado, and a plurality of advertiser li nk buttons.

Fig . 7 is a depiction of a screen shot of a display of an IFE showing a video of a downward view showing a mountain range, and a plurality of advertiser link buttons.

Fig . 8 is a depiction of a screen shot of a display of an IFE showing a video of a downward view showing an approaching city, an enhanced inserted depiction, a local movie schedule, and a pl ural ity of advertiser li nk buttons. In addition, this figure shows i l l ustrative advertiser icons (e.g., Target Stores and McDonald's) disposed on the aerial city image in response to GPS advertiser data .

Fig . 9 is a depiction of a screen shot of a display of an IFE showing a spl it screen with an enhanced street view and a map, and a plurality of advertiser l i nk buttons.

Fig . 10 is a depiction of a screen shot of a display of an IFE showing a downward view of a point of i nterest, ill ustratively the Grand Canyon, along with an i nsert of related facts, and a plural ity of advertiser l ink buttons.

Although the invention has been described in terms of specific embodi ments and applications, persons skil led in the art can, in light of this teaching, generate additional embodiments without exceeding the scope or departing from the spirit of the claimed i nvention. Accordi ngly, it is to be understood that the drawi ng and description in this disclosure are proffered to facilitate comprehension of the invention, and should not be construed to limit the scope thereof. Moreover, the technical effects and technical problems in the specification are exemplary and are not limiting. The embodiments described in the specification may have other technical effects and can solve other technical problems.