CONTENT WORKS

RELATED APPLICATIONS

[0001] This application is a NONPRO VISIONAL of, claims priority to and incorporates by reference in it entirety, U.S. Provisional Application 61/763,362 filed February 11, 2013.

COPYRIGHT NOTICE

[0002] A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever. The following notice applies to the software and data as described below and in the drawings that form a part of this document: Copyright Inkling Systems, Inc., All Rights Reserved.

FIELD OF THE INVENTION

[0003] The present invention is directed to systems and methods for creating and editing digital content works.

BACKGROUND

[0004] Development of traditional print media and other rich content (e.g., textbooks, travel books, magazines, cookbooks, how-to books, literature, and the like) involves many tasks, including managing the content creation and editing process. As print media have transitioned to electronic media, content creators and editors have been forced to either develop computer coding skills or rely on others with those skills.

5001 -0042-PCT 1 SUMMARY

[0005] In various embodiments, creating and editing digital content works may include displaying, in a graphical user interface of a computer-based content creation and editing tool and responsive to user-input, icons representing a library of predefined media objects for insertion in a digital content work open for editing within the content creation and editing tool. The content creation and editing tool may include an interface which displays, simultaneously, a presentation view and a code view of content comprising the digital content work, along with icons representing the library of predefined media objects. Embodiments of the invention may further include inserting, within the digital content work at a user-specified location, computer-readable code corresponding to a selected one of the library of predefined media objects, e.g., responsive to user action specifying a desire to so insert the code. Such user action may be a cursor control action initiated when a cursor is positioned at the user-specified location in either of the presentation view or code view of the digital content work. Embodiments of the invention may further include displaying an explanation of a selected one of the media objects of the library, responsive to a user action positioning a cursor with respect to a respective one of the icons of the library. The explanation may be presented in a popup window and may be an example of the selected media object.

BRIEF DESCRIPTION OF THE DRAWINGS

[0006] The present invention is illustrated by way of example, and not limitation, in the figures of the accompanying drawings, in which:

[0007] FIG. 1 illustrates an example of an editing interface for creating, editing and publishing digital content works;

[0008] FIG. 2 illustrates an example of an editing interface for creating, editing and publishing digital content works that includes a pattern library button in accordance with an embodiment of the present invention;

[0009] FIG. 3 illustrates an example of the display of a pattern library panel or pane in the editing interface, resulting from selection of the pattern library button shown in FIG. 2;

[0010] FIG. 4 illustrates user selection of a pattern library element and corresponding changes to a displayed cursor within the editing interface in accordance with an embodiment of the present invention;

[0011] FIG 5, illustrates an example of the display of a selected pattern library element 5001 -0042-PCT 2 within the pattern library pane of the editing interface, in accordance with an embodiment of the present invention.

[0012] FIG. 6 illustrates an example of a content creation and editing tool, which includes user interface tools such as those described with reference to FIGs. 2-5, and

[0013] FIG. 7 illustrates an example of a computer system within which a set of instructions for causing a processor to perform the methods, processes, operations, or methodologies of embodiments of the present invention may be stored and operate.

DETAILED DESCRIPTION

[0014] Disclosed herein are systems and methods for creating and editing content items of digital content works. In particular, the present invention provides a graphical user interface with various options that provide users the ability to quickly review and insert predefined content items in context within new or existing digital content works as part of the content creation or editing process. These systems and methods thus permit users with no or limited knowledge of computer coding techniques or experience with markup languages a convenient way to assess, access and employ the content items as part of a content creation or editing process.

[0015] By "content items" we mean objects that may be formatted according to a variety of computer-readable or interpretable formats, as described more fully below. In some instances, content items may be instantiations of markup language objects, e.g., extensible markup language ("XML") objects, hypertext markup language ("HTML") objects, or the like, which can be inserted directly into containers such as "cards" or "media cards". These cards may be predefined templates for digital content works that include, among other things, one or more text sections, one or more image sections, image captions, and header sections, all arranged in a desired order. A collection of related cards may form a digital content work, for example an electronic book, magazine, article, etc., or a portion thereof, e.g., a section or chapter thereof, etc.

[0016] In U.S. Patent Application 13/711,583, filed 11 December 2012, which application is assigned to the assignee of the present invention and incorporated herein by reference, systems and methods for creating, editing and publishing digital content works are described. Included in the system are WYSIWYG (What You See Is What You Get) editors of the kind illustrated in FIG. 1, which are editing interfaces 100 in which the content displayed on the screen during editing appears in a presentation panel 110 form

5001 -0042-PCT 3 closely corresponding to its appearance in a target rendering environment (e.g., a Web browser, reader application, mobile device web browser, etc.). The content viewing and editing tools are further configured to permit users to edit a digital content work by directly editing the source code thereof in a code panel 120. This may be referred to as "code mode" editing.

[0017] Within this editing tool, as edits are made to the source code in panel 120, the effect of those edits are rendered in real time in the representation of the digital content work shown in panel 110. This form of direct source code editing allows for editing at a very granular level. To assist the user in finding the exact spot which he/she wishes to edit, a focus mode is available: By clicking on an element in the presentation panel 110, a cursor will advance to the relevant position within the code in the code panel 120. Of course, some edits are best performed without code, so the WYSIWYG edit modes for objects such as image figures, slidesliows and video elements are also available.

[0018] While useful for users that understand HTML code and are comfortable working directly on such code, interface 100 may not be suitable for users that have little or no familiarity with HTML code or coding. To address this issue, the present invention provides a predefined library of content elements (such as predefined HTML/CSS elements) that can be inserted directly into media cards that may or may not include existing content. The predefined objects may be system-supplied or customized by expert users. The library is accessible through a graphical user interface 200, examples of which are illustrated in FIGS. 2-5.

[0019] In FIG. 2, a pattern library button 210 has been added to the interface. Selecting the button will result in the display of the pattern library 220 in a pattern library panel 225, as shown in FIG. 3. The pattern library 220 is a list of patterns, each illustrated by a graphical element, available to the user. Each pattern defines a markup language object that may or may not have user-specifiable configuration options. For example, images may be full- or half-width, lists may be indexed numerically or alphabetically, etc. Some (or all) of the markup language objects may include semantic metadata describing respective content included within the objects in terms of its substance rather than its form or appearance. The patterns are thus customizable snippets of HTML/CSS code, useful for quickly defining portions of a digital content work. Examples of patterns include sections, section side notes, block quotes, paragraphs, headings (of various rank), tables, lists (ordered and unordered), figure placeholders (with various sizings and text

5001-0042-PCT 4 flows), image placeholders, callout boxes, etc. The list of available patterns may also be configurable to allow expert users on a team to define patterns for other team members in a custom fashion. Of course, the particular pattern library provided to a user may depend upon the digital content work being edited or created and/or the user's permissions and preferences.

[0020] With the pattern library panel 225 open, a user may explore the pattern library by hovering a cursor over an individual pattern library element. In response, a popup window 230 is displayed. Included within the popup window is an explanation of the corresponding pattern library element.

[0021] As shown in FIG. 4, when the user selects a pattern library element 240, the user's cursor 250 changes so that it is represented by an icon, such as a circle with a plus sign element included therein. Next to the cursor is an icon reminiscent of the selected pattern library element. In the illustrated example, the user has selected an unordered list element from the pattern library, hence, the cursor is now represented as a green circle with a plus sign therein and adjacent to the cursor is provided an icon representing an unordered list element. The selected pattern library element can be placed into the digital content work by positioning the cursor at the desired location within the presentation pane 110 and clicking. Alternatively, a user could position the cursor within the source code of the digital content work displayed in the code pane 120 and perform the insertion action. In either instance, the portion of the digital content work 260, 270 below which the new pattern library element will be inserted is highlighted so that the user can properly locate the insertion point. In other embodiments, the pattern library element may be inserted above the highlighted block. In still further embodiments, drag and drop operations may be supported and the user may simply select a pattern library element from the pattern library pane and drag and drop it into position within the other content of the digital content work.

[0022] After insertion, the added pattern library element may remain highlighted for a time in order to provide the user visual confirmation that the addition of the pattern library element has been completed and the element is in the desired location. If the element needs to be moved to a different location it can be selected (in either the presentation pane or the code pane) and dragged to the new location.

[0023] If the user has selected the wrong pattern library element from the pattern library, clicking again on the pattern library element icon in the pattern library pane will deselect

5001 -0042-PCT 5 it. Further, if multiple instances of a particular pattern library element are to be inserted, the user may double-click the desired pattern library element icon in the pattern library pane and continue to insert instances of such an element into the digital content work in the fashion described above until the pattern library element is deselected.

[0024] For some users, the iconic representation of the pattern library element and/or the brief explanation thereof provided in a popup window may not be sufficient to fully convey the nature of a particular pattern library element. So, selecting a pattern library element may, in some embodiments, result in the display of an example of such an element within the pattern library pane, as shown in FIG. 5. In the illustrated example, the user has selected an icon corresponding to a callout box pattern library element and an example of such a callout box 280 is displayed. The example is complete with all of the attributes of the pattern library element, including a header, a reserved portion for the content to be included in the callout box, one or more captions therefor, and placeholders (e.g., Lorem Ipsum text) for text to describe the material to be included in the callout box. Other pattern library elements have similar examples of their form, function and appearance available for display as part of the pattern library.

[0025] The present invention thus allows for insertion of predefined media objects within digital content works. By using the predefined media objects, commonality of the code describing the media objects is preserved across the digital content work. By precluding direct editing of the library elements within the presentation pane, this good coding practice is preserved. The modality provided by the present invention is one of

WYSIWYM (what you see is what you mean) rather than WYSIWYG (what you see is what you get). That is, by providing the user only limited creative exploitation of the pattern library elements, the present invention ensures that uniformity of coding practices are preserved across the entire digital content work.

[0026] Digital content works such as those described herein may contain one or more text, graphic, audio, visual, and/or audiovisual elements. In some examples, the digital content works may comprise one or more electronic textbooks, electronic pamphlets, electronic workbooks, electronic documents, e-books, and the like. Digital content works may be stored according to any number of or combination of electronic formats including markup language files (e.g., extensible markup language (XML), hypertext markup language (HTML), etc.) Portable Document Format (PDF), ePub (electronic publication - a free and open e-book standard by the International Digital Publishing Forum),

5001 -0042-PCT 6 Cascading Style Sheets (CSS), and the like), graphics interchange format (GIF), portable network graphics (PNG), joint photographic experts group format (JPEG), exchangeable image file format (EXIF), tagged image file format (TIFF), raw format, bitmap (bmp), scalable vector graphics (SVG), postscript (PS), portable document format (PDF), Shockwave flash (SWF), Waveform Audio File Format (WAV) format, Motion Picture Experts Group (MPEG) I, II, III, IV, Apple lossless (m4a), and the like. A digital content work may be one or more pieces, or "portions" of digital content work that may be organized into a coherent whole. The term digital content work may thus be used to refer to both a portion of a digital content work or the entire digital content work.

[0027] In some embodiments, systems configured in accordance with the present invention includes a content creation module that provides content contributors a set of content viewing and editing tools to create a digital content work. These content viewing and editing tools may include tools configured to provide representations of the digital content work to facilitate the content creation and editing operations described herein. The system may also include a publication module for producing a plurality of target platform-dependent representations of the digital content work from a target platform- independent representation of the digital content work. Each target platform-dependent representation may be for display on a respective one of the plurality of target devices or media. To facilitate such publication, the publication module may be provided profiles for each target device or medium, said profiles specifying capabilities of the respective target device or medium. The target platform-dependent representations of the digital content work are created so as to be compliant with profile-specified capabilities of the respective target device or medium. In some instances, the publication process includes altering the behavior or appearance of media objects, changing the layout of the text (e.g., based upon available screen resolution of the target device), selecting or reformatting images, video or audio to work with the target device, etc.

[0028] FIG. 6 illustrates an example of a content creation and editing tool 1000, which may include user interface tools such as those described above. The various components of the system 1000 may be connected to each other directly or through a network. For example, one or more content creators 1010 and one or more content editors 1020 or other contributors may utilize computing devices to interface with the system 1000 through network 1030. Network 1030 may include any electronic network that allows content creators 1010 and content editors 1020 to access the components of the system

5001 -0042-PCT 7 1000. For example, one or more portions of network 1030, or network 1105 (which may be the same or different network as network 1030) may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless WAN (WW AN), a metropolitan area network (MAN), a portion of the Internet, a portion of the Public Switched Telephone Network (PSTN), a cellular telephone network, another type of network, or a combination of two or more such networks, or the like. While certain components of FIG. 6 may be shown as directly connected, they may also be connected through a network, such as a network similar to networks 1030 and 1105. For example, asset management component 1050, content management component 1060, defect tracking component 1070, quality assessment component 1080, project management component 1085, publishing pipeline 1090, electronic store 1100, and integration component 1040 may be connected directly, through a network, or through a combination of direct or network connections.

Furthermore, while each component is logically separated from the other components for convenient description, it should be recognized that some or all of the functionality of one component might be performed by a different component.

[0029] Integration component 1040 may be a network-addressable component, which may provide a user interface that allows contributors, including content creators 1010 and content editors 1020, to interface with the rest of the system. In some examples, the interface may be a graphical user interface (GUI) that may allow content editors 1020 or other contributors to view, edit, and manage various portions of electronic content in the manners described above, e.g., using content tools 1045. Thus, content tools 1045 may include editing interfaces in which the content displayed on the screen includes preview images captured so that the cards, which the previews represent, appear in a form closely corresponding to their appearance in the target rendering environment, and according to user-specified criteria. Integration component 1040 may also facilitate communication between other various components of the system 1000. For example, integration component 1040 may direct one or more of the other components to take some action, communicate with another component, relay information between components, or the like.

[0030] In one example, integration component 1040 may be located on one or more computer systems accessible by content creators 1010 and content editors 1020 through network 1030. In yet other examples, integration component 1040 may be locally

5001 -0042-PCT 8 executable on computer terminals of contributors such as content creators 1010 and editors 1020 and may utilize network 1030 to access the other components of the system 1000. In yet other examples, integration component 1040 may include components executable on both the computer terminals of content creators 1010 and editors 1020 as well as pieces accessible and executing on a remote server accessible over network 1030.

[0031] In some examples, integration component 1040 may interface with asset management component 1050 in order to facilitate the presentation of the electronic content work from a number of content portions. Content portions may be any audio, visual, audiovisual, text, or other content that is intended to be merged with other content portions into an electronic content work. Content portions may also be referred to as "assets." Asset management component 1050 may be a network-addressable component, which, in conjunction with integration component 1040, may allow for the management of the content creation process by managing the submission, modification, and integration of various component portions of the electronic content. This creation management process may include indexing and tracking submitted components, identifying missing content, assigning sections of missing content to one or more contributors, and managing the integration of submitted content into a complete or nearly complete version of the electronic content work. In some examples, the asset management component 1050 may implement version tracking to track changes made to the component content portions.

[0032] Once the contributors are satisfied with the draft of the electronic work, the work may be submitted to the content management component 1060. In some examples, defect tracking through the defect-tracking component 1070 may also begin. Integration component 1040 may then coordinate the delivery of the content from the asset management component 1050 to the content management component 1060 (if necessary), coordinate starting of the version control of the work as a whole (in some examples, versions may be managed on the content portions and the work as a whole

simultaneously), and coordinate starting the defect tracking process. Editors 1020 or other contributors may then begin editing the electronic content, for example using the user interface tools described above.

[0033] Defect tracking component 1070 may be a network-addressable component, which, in conjunction with integration component 1040, may include tools, which allow users to open defects, track defects, fix defects, and close defects found in electronic content. For example, an editor may be reviewing the content through content tools 1045

5001 -0042-PCT 9 and may open defects by selecting or otherwise indicating the defect in the content itself and entering information about what is defective. Content tools 1045 may then pass this information to the defect-tracking component, which may open a defect. In other examples, defects may be opened by the quality assessment (QA) component 1080 as a result of automatic content checks performed by the quality assessment component 1080. The QA component may send a message to the defect-tracking component 1070 with information on the defect, and the defect-tracking component 1070 may open the defect.

[0034] In some examples, user access control may be implemented through various permission-based rules. In one example, users (e.g., contributors) may belong to one or more groups of users and content may be organized into one or more groups. User groups may be given access to one or more content groups. Each user group may have one or more users, and each content group may have one or more content portions. In other examples, each user is individually given access to various portions of content or groups of portions of content. A user or group of users may be granted read, write, delete, or other access types to a portion of the content or a content group.

[0035] In some examples, integration component 1040 also includes a device simulator, which may provide the previews described herein. Since the electronic content may be targeted to multiple and disparate electronic device platforms, and since the content may not be rendered identically across disparate electronic device platforms, integration component 1040 may include a device simulator which allows the contributor to build the content locally (or allows integration component 1040 to interface with the publishing pipeline 1090 to build the content) for the particular desired target electronic device and through an emulator running in the system preview how the content will look and react to input and other stimuli. The emulator emulates the environment of the target electronic device so the contributor will have an accurate representation of how the electronic content performs on the target electronic device.

[0036] Project management component 1085 may be a network-addressable component and may integrate with integration component 1040 or other components of system 1000 to control and store data related to project management of one or more electronic works. Once the content is ready for publication, one or more of the contributors may publish the electronic content work. Publication (or "building" the content) is a process by which a format independent representation of the content is transformed into a format dependent representation of the content. For example, the content may be customized for a particular

5001 -0042-PCT 10 client device (e.g., an iPAD). This process may be done through the integration component 1040, and the publishing pipeline 1090 may build content. Once the electronic content has been built by the publishing pipeline 1090, the publishing pipeline may distribute the published content, for example by interfacing with the electronic store 1100, which may then make the content available for download by an end-user 1110 on an electronic device over a network 1105.

[0037] The various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. An example of a processor based system suitable for such configuration and operation is shown in FIG. 6. In other examples, however, the methods described herein may be at least partially performed by processors deployed across a number of machines, e.g., in a "cloud computing" environment or as "software as a service" (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., Application Program Interfaces (APIs).) [0038] Computer system 10000, shown in FIG. 7, within which a set of instructions for causing the machine to perform any one or more of the methods, processes, operations, or methodologies discussed herein may operate as a stand-alone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in server-client network

environment, or as a peer machine in a peer-to-peer (or distributed) network environment. Various instantiations of computer system 10000 may be servers or clients.

[0039] The example computer system 10000 includes a processor 10002 (e.g., a Central Processing Unit (CPU), a Graphics Processing Unit (GPU) or both), a main memory 10001 and a static memory 10006, which communicate with each other via a bus 10008. The computer system 10000 may further include a video display unit 10010 (e.g., a Liquid Crystal Display (LCD) or a Cathode Ray Tube (CRT)). The computer system 10000 also includes an alphanumeric input device 10012 (e.g., a keyboard), a User Interface (UI) cursor controller 10014 (e.g., a mouse), a disk drive unit 10016, a signal generation device 10018 (e.g., a speaker) and a network interface device 10020 (e.g., a transmitter).

5001 -0042-PCT 11 [0040] The disk drive unit 10016 includes a machine-readable medium 10022 on which is stored one or more sets of instructions 10024 and data structures (e.g., software) embodying or used by any one or more of the methodologies or functions illustrated herein. The software may also reside, completely or at least partially, within the main memory 10001 and/or within the processor 10002 during execution thereof by the computer system 10000, the main memory 10001 and the processor 10002 also constituting machine-readable media.

[0041] The instructions 10024 may further be transmitted or received over a network 10026 via the network interface device 10020 using any one of a number of well-known transfer protocols (e.g., HTTP, Session Initiation Protocol (SIP)).

[0042] The term "machine-readable medium" should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term "machine-readable medium" shall also be taken to include any medium that is capable of storing, encoding, or carrying a set of instructions for execution by the machine and that cause the machine to perform any of the one or more of the methodologies illustrated herein. The term "machine-readable medium" shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic medium.

[0043] Method embodiments illustrated herein may be computer-implemented. Some embodiments may include computer-readable media encoded with a computer program (e.g., software), which includes instructions operable to cause an electronic device to perform methods of various embodiments. A software implementation (or computer- implemented method) may include microcode, assembly language code, or a higher-level language code, which further may include computer readable instructions for performing various methods. The code may form portions of computer program products. Further, the code may be tangibly stored on one or more volatile or non- volatile computer- readable media during execution or at other times. These computer-readable media may include, but are not limited to, hard disks, removable magnetic disks, removable optical disks (e.g., compact disks and digital video disks), magnetic cassettes, memory cards or sticks, Random Access Memories (RAMs), Read Only Memories (ROMs), and the like.

[0044] Thus, systems and methods for creating and editing digital content works have been described.

5001 -0042-PCT 12