FIELD OF THE INVENTION

This invention relates to the field of interactive multimedia, and in particular to an apparatus for playing interactive multimedia programs on a television display.

BACKGROUND During the last one or two years, one of the most important trends in the personal computer and consumer electronics industries has been explosive growth in the area of so- called multimedia software titles, which are typically distributed on CD-ROM discs and which emphasize interactive audiovisual content. A critical concern for hardware developers, software developers, and consumers is what platform will eventually emerge as the leading standard for viewing and interacting with multimedia software. Presently, the dominant platform appears to be the desktop multimedia personal computer — typically an IBM- compatible, Windows'-based multimedia computer system — perhaps because so many of these systems have already infiltrated homes and businesses for other purposes. An overwhelming majority of multimedia software titles are therefore published for this platform, and can only be played on compatible systems.

As a result of these trends, consumers will increasingly demand mat the personal computer function as an entertainment system apparatus for playing and interacting with audiovisual compact discs, instead of as a machine for managing documents and performing desk work. However, because of its traditional role as a machine for performing tasks like document editing and spreadsheet calculation, the personal computer has generally been physically designed for desktop work, not for entertainment. Thus, both the hardware chassis as well as the user interface (e.g.. mouse, keyboard, and VGA monitor) are generally built and integrated in a manner well-suited to a user sitting upright in an office chair working at a desk and staring at screens of documentary information at close range. The same is more or less true even for newer, portable "laptop" computers, which are not really comfortable for laps, but are rather suited for smaller desktop settings such as an airline seat and tray table. (Indeed, this very sentence is being written on just such a laptop, aboard an airplane.)

Preferably, consumers should be able to view and interact with multimedia software in the same relaxed comfort and manner in which they enjoy television, videos, and music, e.g., relaxing on a comfortable couch in the living room and watching images on a large

screen television placed at a comfortable distance. Instead, because of the conventional, prior art architecture and design of personal computers, consumers must generally experience their multimedia titles in home office environments better suited for document work than for audiovisual entertainment. Responding to this problem, a number of consumer electronics companies have recently begun selling proprietary multimedia game players, such as Phillips' CD-I player, Atari's Jaguar, and Panasonic's 3DO. However, although these platforms are designed to provide consumers with a more satisfactory entertainment viewing experience than the traditional desktop computer, they have generally been conceived and implemented as juiis gsnsά-.- special-purpose game machines, and have not been architected for compatibility with existing multimedia CD-ROM titles already published for the desktop PC platform. As a result, the limited availability of compatible software for these special-purpose game players is severely hampering the acceptance of such players among consumers.

Another possible response is to take an existing, desktop or laptop personal computer and augment it with bridging technology such as converter cards that can receive video output in standard personal computer format and convert it to television-compatible format (e.g., NTSC video), whereupon the video output may be routed on to a television monitor. A company called Antec apparently offers such a product, called the "TVator." This ad-hoc approach does allow users to view personal computer multimedia software on a television set, but still suffers from important limitations. For example, the ad-hoc bridging approach is unwieldy and cumbersome, because the traditional desktop computer platform is not physically designed for the home entertainment environment, and the computer chassis and cables are not physically designed for easy integration with a television set and other home entertainment components. In addition, the video converter card does not address the user interface problem; namely, a typical personal computer keyboard and mouse are extremely inconvenient, if not totally unworkable, for a home user sitting on a comfortable couch and watching a large screen television several feet away. These drawbacks may be major deterrents for the home consumer.

A related problem and limitation of prior art players for interactive multimedia CD- ROM titles is that the process of initiating the play of such titles is often cumbersome and confusing. Typically, in order to play an interactive multimedia CD-ROM disc using a conventional multimedia PC system, the user places the disc in a compact disc drive, and then commands the computer to "install" the title, which involves copying various files from the compact disc to the computer's hard disk drive, and sating the values of various system parameters. Commercially available titles often include interactive "scripts" and the like to facilitate this process somewhat. Nevertheless, the process of starting up an interactive CD-

ROM title remains less comfortable for consumers than the simple technique of pushing a "play" button on a remote control or on the control panel of a typical home entertainment appliance such as a television set or audio compact disc player.

In view of these numerous limitations and drawbacks, an improved product for playing the existing body of interactive multimedia CD-ROM titles is greatly needed.

SUMMARY OF THE INVENTION

The present invention provides advantageous methods and apparatus for playing the large, existing body of interactive multimedia software programs that have been formatted and published for compatibility with standard personal computer platforms such as the MPC CD-ROM platform, for example.

The invention provides steps and means for conveniently integrating a player apparatus utilized to process and play multimedia software within the home entertainment environment. A processor capable of playing standard desktop computer multimedia software without alteration is housed in a home entertainment system chassis. Means are also provided for generating one or more video output signals and audio output signals in response to the processing of the multimedia software program, and feeding those audio and video output signals to one or more presentation devices integrated within a home entertainment system. The signals are preferably converted to an appropriate format, such as a television signal format, for the desired presentation devices. A further aspect of the invention includes steps and means for responding to generic

"play" commands from users by automatically initiating processing of multimedia software - including the performance of any requisite start-up or installation procedures — without requiring any further interaction or input by the user, thereby providing "drop & play" functionality as is characteristic of the traditional home entertainment environment. In part, this "drop & play" feature is provided by use of a look-up table or database containing installation information for each of numerous multimedia software titles; entries in this table are preferably indexed by an identifier that can uniquely be derived from a given CD-ROM or other multimedia medium.

Preferred features and embodiments of the present invention include providing a data communications link for receiving external data transmissions. In this way, and with the addition of various other steps and means as disclosed herein, the invention preferably provides a convenient access point to the information superhighway. Moreover, the invention offers an attractive platform for advanced capabilities including: interactive television services, video teleconferencing, and instant replay on demand of television transmissions -

all preferably from a platform that is advantageously integrated within a traditional home entertainment center.

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 illustrates the basic architecture of an interactive multimedia player for integration within a home entertainment system.

Figure 2 illustrates a preferred embodiment of a virtual control panel for use with the present invention.

Figure 3 is an illustrative flow chart of a basic method for providing "drop & play" functionality, in accordance with the present invention. Figure 4 illustrates a preferred embodiment of the present invention incorporating an

MPEG video decoder.

Figure 5 illustrates a preferred embodiment of the present invention including a telecommunications link.

Figure 6 illustrates a preferred embodiment of the present invention incorporating various means for providing multi-player games and other real-time interactive services.

Figure 7 illustrates an alternative preferred embodiment of the present invention for providing multi-player games and other real-time interactive services.

Figure 8a illustrates a preferred embodiment of the present invention incorporating various means for providing an "instant replay" feature. Figure 8b illustrates steps preferably performed in accordance with the present invention for providing an "instant replay" feature.

Figure 9 illustrates a preferred embodiment of the present invention for providing video teleconferencing.

Figure 10 illustrates a preferred embodiment of the present invention for remotely controlling other appliances within a home entertainment system.

DETAILED DESCRIPTION OF THE INVENTION

Figure 1 illustrates the basic architecture of an interactive multimedia player in accordance with the present invention. The player is housed in player chassis 10. Unlike a conventional chassis for a prior art desktop computer or laptop computer, player chassis 10 is preferably a home entertainment system chassis, meaning its dimensions will fit atop a typical television set or otherwise fit smoothly into a typical home entertainment center. In other words, player chassis 10 is physically designed more or less like a VCR chassis, for convenient connection to a television set and for integration within a consumer home entertainment system. As shown further in Figure 1, chassis 10 houses hardware and

software sufficient to support MPC-compatible interactive multimedia ("MPC" is a well- known personal computer standard defined by the Multimedia PC Marketing Council). Accordingly, processor 12 preferably includes a CPU of the 25 MHz 486SX class or higher, at least four megabytes of internal RAM storage, 1 megabyte of video RAM storage, and standard I/O ports including ports for mouse input and for VGA video output; mass storage 20 preferably comprises a hard disk drive of at least 160 megabyte capacity; CD-ROM drive 18 preferably supports a sustained transfer rate of at least 300 kb/sec., with a maximum average seek time of 400 ms, is multi-session capable, and provides CD-DA output, such as a Sony double speed CD-ROM XA drive; sound card 14 is preferably a Sound Blaster or compatible card. Mass storage 20 stores various software for controlling the player system, including operating system 24 (preferably the Microsoft Windows* operating system, version 3.11 or greater, including multimedia drivers and extensions). The player of Figure 1 also optionally includes auxiliary storage unit 30, such as a 3.5" diskette drive, for removable, archival storage, although this feature is not needed for MPC compatibility. As shown further in Figure 1, the capabilities of interactive multimedia player are enhanced by including within chassis 10 VGA-to-TV converter 16 (such as the ADS "TV Elite" card) for converting the VGA output signal of processor 12 into television signal 34, suitable for input to a television set (e.g., an NTSC or PAL signal, emitted as composite, S- VHS, or RF signal format). Thus, television signal 34 as well as audio output signals 32 may be connected via standard jacks or by any other suitable means to a desired television and audio amplifier/loudspeaker system, respectively. Alternatively, video output may be provided to a projection television system, for display on a large screen, which may be particularly advantageous in the context of an institutional user needing an interactive multimedia player for purposes of an educational lecture, a product demonstration, or a similar group presentation. In that case, the projector itself may conveniently be integrated with chassis 10, for better portability and compactness.

The present player also features an appropriate user interface so that the consumer who wishes to view and listen to his or her entertainment system from a comfortable distance and in a relaxed position, without having to balance a heavy keyboard on the user's lap. Conventional, corded keyboards and mouse devices are designed with flat-surfaced desktops in mind and are therefore not ideal for this context. Instead, as indicated in Figure 1, user input is preferably entered by means of remote input device 28, such as an infra-red mouse (e.g., Interlink Electronics' RemotePoint) or other hand-held, remote control device that provides cursor control - unlike standard television or VCR remote control devices - in order to support interactivity with MPC multimedia software. In addition, mass storage 20 preferably stores software 22 for implementing a "virtual" on-screen computer keyboard,

whose "keys" are "typed" using the cursor device, when needed for a particular multimedia title. Figure 2 illustrates a preferred embodiment of an on-screen virtual control panel that is preferably provided in addition to a standard computer keyboard. The control panel includes one-touch virtual "buttons" for various playback functions, as will be described further below.

An important feature of the present player enables users to play interactive multimedia titles in the same, simple "drop and play" manner as they are accustomed to playing non-interactive audio compact discs, video discs, cassettes, and the like. Herein, we will refer to the user issuing a generic "play" command as meaning that initiating play of the current title requires only a generic, title-independent request by the user, such as the single- touch of a play button. By "current" title, we mean the title currently identified as the next title to be played, whether because the title currently resides in die system's CD drive, or because it is interactively selected by the user via menus or the like, or because it is identified by the system based on other criteria. The key point is that even though many MPC- compatible titles normally require the user's involvement in initialization and/or installation procedures, ranging from protocols for starting-up execution (such as invoking a particular operating system or program name) to complex installation procedures in accordance with the present invention such procedures (when needed) are performed automatically by the system without user involvement, preferably by "drop & play" software 26 as now described. In a preferred embodiment of the invention, drop & play software 26 is implemented by means of an Installation Status Table database or "1ST." Each row of the 1ST stores installation information for a CD-ROM title recognized by the player. Figure 3 shows a flow chart of steps to be performed by drop & play software 26, using an 1ST, to automate initialization and installation of die current CD-ROM interactive title after a user issues a "play" command. At step 80, a determination is made as to the general type or category of content in the current title to be played - £_£_ _> whether the CD currently placed in CD-ROM drive 18 is an MPC interactive CD-ROM, a (non-interactive) video CD, a PhotoCD, or an audio CD, etc. If the CD is an MPC CD-ROM, then step 82 derives the identifier or "fingerprint" of the CD-ROM, preferably by computing a hash function derived from the file allocation table ("FAT") of the CD-ROM disc, since all MPC-compatible CD-ROM discs contain a unique FAT. Any other technique for uniquely identifying and indexing CD-ROM titles may equivalently be used, as those of ordinary skill in the art will readily appreciate.

At step 84, a determination is made as to whether the identifier derived for the current CD-ROM disc matches a value stored in the 1ST. If so, then the player "recognizes" this particular CD-ROM title, and at step 86, the information stored in the 1ST for the matchi g entry is retrieved and examined further. At step 88, a determination is made as to

whether the matching entry indicates that some initialization procedure is required for this title. If no such initialization is required, then the player immediately begins to play the title at step 92. If the matching entry in the 1ST indicates that some initialization is required, then at step 90 all initialization procedures specified by the matching entry are performed. These procedures may include such tasks as, for example, executing a specified "run" protocol; copying files specified by the matching 1ST entry from the CD-ROM disc to mass storage unit 20 of the player, into directories as specified by the 1ST entry; or running an installation program and providing a script of specific or default responses in response to an installation program. Thereafter, the CD-ROM title begins to play, at step 92. If the CD-ROM title is not stored in the 1ST, then at step 94 the user must manually install the title the first time the title is played, following the title's standard installation instructions. After this manual installation, drop & play software 26 of the present player preferably creates a new 1ST table entry for the title at step 96, including a description of relevant machine and file states affected by the installation procedure, so that the new title can thereafter be played using the fully automated drop and play procedure described above in steps 82-92.

Non-interactive audio CD (or video CD) can also be played on the present player with a simple "play" command, just like on a conventional home entertainment compact disc audio system. If the player recognizes, at step 80, that the compact disc placed in CD-ROM drive 18 contains non-interactive material such as a conventional audio CD, then no installation is necessary, and die player can immediately begin playback of the disc. Moreover, the player preferably provides additional control over playback of non-interactive titles, by means of a virtual control panel such as the control panel illustrated in Figure 2. Referring now to the details of Figure 2, die function of Play Button 62 has already been described. Pause Button 64, Stop Button 66, Fast Forward Button 68, Fast Backward Button 70, Volume Control 72, and Equalizing Sliders 74 are all available when playing audio CD or video CD, and are all self-explanatory for those of ordinary skill and familiarity with conventional, consumer audio/video appliances. Slide Bar 76 shows the current play position of the CD, preferably including a time scale for both audio CD and video CD discs, and a track scale for audio CD. Slide Bar 76 can also readily be used to advance the play position forward or backward along the scale displayed, in well-known "scrolling" manner.

The control panel of Figure 2 also preferably includes Mode Button 78, allowing users to select among various play modes for audio CD and video CD. At least four modes are preferably available for audio CD, and two modes for video CD, as follows: For audio CD die 4 modes are:

Playlist: user selects play order of tracks.

Shuffle: the order of play is random.

Once: the order of play proceeds from the first track on the disc to the last. Loop: the order of play proceeds from the first track on the disc to the last, and then repeats continually. For video CD the 2 modes available are:

Once: the movie is played once, in order. Loop: the movie is repeatedly played in order. As those of ordinary skill in the art will recognize, me virtual control panel described may readily be modified as dictated by the aesthetic or functional needs of particular applications. For example, the control panel can easily be adapted for use with a multi-disc changer, as by altering the behavior of "Playlist" mode to allow users to select a play order among all of the tracks stored on the multiple discs in the changer. Other control panel features could also be modified in similar fashion.

Thus, by means of the multimedia player of the present invention, and as illustrated above by way of example with Figures 1-3, the existing body of interactive multimedia titles written for desktop computer platforms may conveniently and comfortably be played in the preferred environment of a typical home audiovisual entertainment system.

Additional, enhanced embodiments of the invention can be advantageously created, as suggested and illustrated in Figures 4-10. For example, by including MPEG decoder 36 (such as the RealMagic decoder card by Sigma Designs) within the system as in Figure 4, the interactive multimedia player can further be used to play full-length feature films stored as compressed MPEG data on CD-ROM discs, in a true home entertainment environment.

As will be illustrated in connection with Figures 5-7, the present player may also be advantageously enhanced by including a data communications link for receiving external data transmissions. External data transmissions received may then be processed using the computer power of processor 12, and then displayed and viewed in the advantageous context of a home entertainment setting, as described earlier. In this way, the present player effectively turns the home entertainment center into a convenient access point to the information superhighway. For example, in the embodiment of Figure 5, the data communications link is provided by telecommunications link 38, £_&.- a modem connected to a telephone line. In this way, the multimedia player of the present invention can conveniently be interconnected with wide area networks such as the Internet, Prodigy, CompuServe, America Online, etc., allowing the user to view and interact with audiovisual software products distributed through such wide area networks in the same manner as is presently done with personal computers, but with the advantage of utilizing a television and home entertainment system for viewing

and interaction. Control software 40, such as the commercially available, MPC -compatible products provided by vendors like America Online, control such interactions. Similarly, with straightforward control software, die player system of Figure 5 can easily be used to support menu-driven, automatic dialing of telephone numbers in a user's personal directory, and other telephone and facsimile services, but in the advantageous context of a home entertainment system rather than a conventional, desktop personal computer.

Similarly, in the embodiment of Figure 6, the data communications link is augmented with means for receiving television transmissions (e.g.. broadcast, cable, or satellite signals) or radio transmissions by means of tuner 42. This embodiment preferably includes video capture board 44 for "capturing" any received television transmissions mat are to be processed and presenting them to processor 12 in a suitable, digitized format. Telecommunications link 38 allows for transmission of data from the player to external recipients. Again, by further including control software 40 (or, equivalently, logic circuitry) as appropriate to process the television or radio transmissions, the viewer may enjoy the benefits of interactive television from the attractive and appropriate environment of a home entertainment system.

As just one example further illustrating the system of Figure 6, a company called Interactive Network, Inc. broadcasts an FM radio signal simultaneously with many sports contests, game shows, and other real-time events mat contains questions and answers about the event in progress. Interactive Network subscribers typically receive these signals using special-purpose control unit receivers, which process the signals and permit users to, for example, make predictions about the next play to occur in a professional football contest; NTN Communications, Inc. has created a popular interactive football game, "QB1," that has been used for mis purpose. The correct answer to each question is transmitted shortly thereafter, and the control unit can then grade die user's answer and maintain a running score, effectively allowing users to "play along at home" while simultaneously viewing sports or other real-time events on television. For more details, see U.S. Patent 4,592,546, entitled "GAME OF SKILL PLAYABLE BY REMOTE PARTICIPANTS IN CONJUNCTION WITH A LIVE EVENT," dated June 3, 1986, naming Anthony Fascenda and David Lockton as inventors. The interactive player of Figure 7 allows users to enjoy die benefits of interactive broadcasts, such as those provided by Interactive Network, Inc., within the attractive and familiar environment of their existing television and home entertainment system, and without die need for a separate "control unit" or the like. In mis example, control software 40 of die player would contain game playing application software akin to that already provided in Interactive Network control units for interpreting the FM signal, and for generating the screen displays and scores required by games.

Figure 7 illustrates an alternative to the embodiment of Figure 6 for providing interactive television functionality. In the example of Figure 7, the data communications link takes the form of two-way interactive cable video link 46, such as provided NetGame's "MUG" (Multi User Game) technology. Either through this embodiment or through die embodiment of Figure 6, users will be able to fully enjoy interactive television programming — such as videos on demand, multi-user real-time video games, etc. — as such programming becomes more widely available, because the player of die present invention provides the power of a complete, MPC-grade digital computer, integrated widiin a home entertainment system. The player's computer power can be harnessed to render images, handle user interface processing, and perform otiier computations on each user's local player, in parallel, thereby greatly reducing communications traffic, reducing the required bandwidth, and increasing system efficiency, as those of skill in the art will readily appreciate.

Figure 8a shows another enhanced embodiment of the present invention, including video capture board 44, video compression codec 48, as well as tuner 42 for receiving television signals. With this embodiment, the current portion of a televised program is compressed using video codec 48, and cached in storage unit 20; mis process proceeds continually, thus caching the last few minutes of die television program until they are gradually overwritten by more current data. Those of ordinary skill in the art will recognize that the amount of video programming that can be cached in this manner in storage unit 20 depends upon die capacity of die storage unit as well as on the degree of compression achieved by video codec 48; with current, commercially available technologies, storage of roughly the most recent sixty seconds of television programming should be possible.

With this video capture capability, the present player provides a revolutionary and advantageous feature of instant television replay on demand (as well as permanent archival storage thereafter if desired) of a short program highlight, even though the user's VCR was not actively recording at die actual moment the highlight occurred. A method for implementing the instant playback feature is described further in the flow diagram of Figure 8b. At step 100, tuner 42 receives a television signal; at step 102, the signal is presented to processor by video capture board 44 in a suitable digital format. The signal is compressed by video codec 48 at step 104, and cached in storage unit 20 (still in compressed form) at step 106. At decision point 108, if a user requests instant replay, then at step 110 die cached data is decompressed by video codec 48 and is replayed on die television at step 112, preferably in a partitioned on-screen window if die user's television supports multi- window display. Concurrendy, at step 114, the cached data is immediately stored to a protected area of storage unit 20. Preferably, at step 116, if die user requests permanent storage of the highlight _* die cached data is then output to auxiliary storage unit within die

-10-

home entertainment system, such as digital video tape. Meanwhile, whether or not instant replay has been requested, die process of caching the most recent programming continues without significant interruption, as depicted in Figure 8b.

Figure 9 illustrates a further enhanced version of the present invention including video camera 50, so that the present player can be used to provide video teleconferencing services. For example, if two users are both equipped with the system of Figure 9, a teleconference session can be established between die users by using their respective telecommunications links 38. Video camera 50 records input images of each user, and die images are periodically captured and compressed using video capture board 44 and video codec 48, and are transmitted across the telephone network between the respective telecommunications links 38. The images received by each user are decompressed using video codec 48, and displayed on die user's television set by die present player concurrently with the telephone call. The audio portion of die telephone call may be output by the player through the user's home audio system. Figure 10 illustrates a preferred embodiment of the present invention which further includes command output device 54 for controlling other appliances within a home entertainment system. Command output device 54 preferably emits an infra-red signal compatible widi die remote control operation of other appliances within die home entertainment system such as VCR 56. In this way, computer software can be executed on die player providing menu-driven, interactive, remote control of VCR 56 or other entertainment appliances. As an example, die player of Figure 10 can advantageously control a television set and VCR if control software 40 (and associated control logic) of the player is equipped to receive broadcasts of television program guide information such as provided by the "StarSight" system. In the embodiment of Figure 10, control software 40 internally formulates appropriate commands for die desired appliance, depending on die menu-driven input provided by die user. Command output device 54 will then output these commands so as to control die appliance, e.g.. the VCR will automatically be programmed for timed recording as desired by die user. Thus, software can be written with the foil complexity and richness supported by processor 12 and operating system software 24 ( &., preferably the foil potential of MPC- compatible software) so as to facilitate centralized, user-friendly, interactive control of any desired appliance within the user's home entertainment system.

Other embodiments and modifications within the spirit of the present invention will occur to those of ordinary skill in the art in view of these teachings, including but not limited to using additional or alternative system components; providing support for additional or alternative computer entertainment functions; and providing compatibility with additional or

alternative platforms. Such embodiments remain within the scope of the present invention, to the extent they fall within the scope of die following claims.