FIELD OF THE INVENTION

[0001] The present invention relates to a system and method for facilitating the generation of an audio recording in accordance with professional standards along with an accompanying transcription, for example a manuscript, a playscript or a screenplay. The system and method of the present invention is particularly useful for individuals who prefer to generate and/or publish a literary work including, for example, an audio recording and an accompanying script, and who do not have the resources to quickly create such accompanying works for rapid publication according to currently available facilities.

BACKGROUND OF THE INVENTION

[0002] Traditional methods for generating literary works such as manuscripts, playscripts and screenplays include manually typing such documents using a conventional word processing device. An alternate method for generating literary works includes dictation, in which an author dictates and generates an audio recording of their literary work using a recording device which must then be played back and manually transcribed using a word processing device. Both methods require the transcribed document to be subsequently reviewed, edited and reconfigured in a format that is suitable for publication with respect to a book manuscript, screenplay or playscript.

[0003] The emergence of the internet in combination with recent developments in artificial intelligence and, in particular, automatic dictation software, has resulted in more individuals electing to self-publish their works (either as an audio recording or a written document or both), rather than engaging the services of professional publishing firms. For example, individuals who prefer to self-publish can generate an audio recording and an associated manuscript and publish same on the internet (on a fee-free basis) or alternatively, use a number of available online retail sites to upload their literary work and receive a payment (fee) for access to their work. [0004] Although there are numerous devices capable of generating high quality audio recordings, such devices are unable to generate an associated script or at least script that is of sufficient quality (for example, accuracy) and in a format for publication.

[0005] Furthermore, although there are various automatic dictation software systems available that may generate scripts from audio recordings, such software generally suffers various drawbacks including, but not limited to, low transcription accuracy, limited vocabulary and an inability to adequately transcribe dictation sufficiently quickly. Despite these problems, automatic dictation software continues to be used by individuals particularly in relation to the creation of comparatively short documents such as memorandums, letters and file notes etc. However, the limitations of existing automatic dictation software systems makes their use for self-publication of literary works for manuscripts, screenplays or playscripts by authors impractical.

[0006] Further problems associated with existing automatic dictation software include their inability to cope with background noise (which tends to reduce the quality of the audio recording and ultimately, the resulting transcription) and their limited ability to convert any recorded audio into a format that meets the requirements for a professional publication of a literary work, depending upon whether the literary work is a manuscript (for a book), a screenplay (for a movie) or a playscript (for a play or theatre production). These problems present challenges to authors who self-create or prefer to self-publish their literary works, since existing software dictation and transcribing systems produce literary products that are of a sub-standard quality (from a transcription perspective), or require the author to spend further time and effort converting a transcribed document into the required format for publication.

[0007] Accordingly, there exists a need for a system and method that addresses the above mentioned problems associated with existing automatic dictation systems, or at least provides an alternative to same. In particular, there exists a need for a system and method that enables individuals to readily generate, in real time, an audio recording and associated script with a desired format that are of sufficient quality for sale and/or commercial upload to various retail platforms. [0008] The reference to any prior art in this specification is not, and should not be taken as, an acknowledgement or any suggestion, that the prior art forms part of the common general knowledge.

SUMMARY OF THE INVENTION

[0009] In one aspect, the present invention provides a computer-implemented system for facilitating the generation of an audio recording and transcription of same, the system including at least one audio input peripheral device for receiving and recording a spoken voice of a user, one or more processors operable to process, substantially in real-time, the recorded spoken voice to remove any undesirable background noise, and adjust same to a user required standard, and implement one or more voice recognition techniques to generate, substantially in real-time, at least one script.

[0010] The processing of the spoken voice of a user to adjust the audio prior to using same to generate a script may improve the performance of the script generation process.

[0011] In an embodiment, the system includes a library of audio sounds for selection by the user to accompany the audio recording.

[0012] In an embodiment, the one or more processors further implement one or more voice recognition techniques to process the spoken voice to identify one or more audio sounds recommended to accompany the spoken voice and provide the user with an option to select the one or more recommendations.

[0013] The system may further include a “voice enhancing palette” for the user to adjust the sound of their spoken word. In this regard, it will be appreciated that the user can adjust the tone of their spoken word, the language or their spoken word, the accent of their spoken word or the speed of their spoken word to enhance (i.e., render more professional) their audio recording and also make it more clear thereby increasing the transcription accuracy of the generated script.

[0014] In another aspect, the present invention provides a computer-implemented method for facilitating the generation of an audio recording and transcription of same, the method including receiving and recording, at least with one audio input peripheral device, a spoken voice of a user, processing, by one or more processors, the recorded spoken voice to remove any undesirable background noise, and adjust same to a user required standard, implement, by the one or more processors, one or more voice recognition techniques to generate, substantially in real time, at least one script. [0015] The available scripts are generated in substantially real-time as the user provides spoken word audio input, the format of which may be selected by the user using one or more formats including, for example, PDF file format and Microsoft WORD file format. Alternatively, the user may select the preferred script using and any one or more links associated with online retail platforms including, for example, Amazon, iTunes, Audio Books Online, Google Books or Podcasts.

[0016] In an embodiment, the system further includes a data management tool to provide one or more editing capabilities. In an embodiment, the system may further include an artificial intelligence learning software module to edit, in script form, anticipatory punctuation correction and written inferences thereby providing options to the user regarding how the written text may be displayed.

[0017] In an embodiment, the system provides a user profile page that may be shared on one or more social media platforms or within the computer implemented system.

[0018] In an embodiment, the system is operable to integrate with payment gateways and further includes a facility for the user to promote or sell their content (literary works) in both audio and written script formats.

[0019] In an embodiment, the system includes one or more databases in which audio and written script content from various users (authors) is received, stored and maintained. In an embodiment, the one or more processors of the system are configured to receive one or more search queries from one or more users to search for content (audio or scripts) of interest stored in the one or more databases.

[0020] In an embodiment, the one or more processors are further configured to provide one or more notifications to one or more users regarding content that closely matches the preference of the user with respect to content for which they have an interest.

[0021] In a further aspect, the present invention provides, a computer-readable medium having a plurality of instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of receiving and recording, at least with one audio input peripheral device, a spoken voice of a user, processing, by the one or more processors, the recorded spoken voice to remove any undesirable background noise, and adjust same to a user required standard, implement, by the one or more processors, one or more voice recognition techniques to generate, substantially in real time, at least one script.

BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Embodiments of the invention will now be described in further detail with reference to the accompanying Figures in which:

[0023] Figure 1 provides an overview of a system according to an embodiment of the present invention depicting the interaction between various system components;

[0024] Figure 2 illustrates an exemplary flow diagram of a process that enables a user to download and install a software application, and subsequently access, or register to use, the software application for interaction with the system illustrated in Figure 1 ;

[0025] Figure 3 illustrates functionality provided by the software application and/or an associated computer server with which the software application communicates;

[0026] Figure 4 illustrates an exemplary flow diagram of a process that enables the user to create a new audio recording project using the software application;

[0027] Figure 5 illustrates an exemplary flow diagram of a process that enables the user to subsequently edit the audio recording project;

[0028] Figure 6 illustrates an exemplary flow diagram of a process that enables the user to enhance the audio in the audio recording project;

[0029] Figure 7 illustrates an exemplary flow diagram of a process that enables the user to generate a written transcript associated with the recorded audio; and

[0030] Figure 8 illustrates an exemplary flow diagram of a process that enables the user to export or upload a completed audio recording project.

DETAILED DESCRIPTION OF EMBODIMENT(S) OF THE INVENTION

[0031] For illustrative purposes, the present disclosure is described by referring to embodiment(s) thereof. In the following description, numerous specific details are set forth to provide a better understanding of the present disclosure. It will be readily apparent that the current disclosure can be practiced without limitation to the specific details. In other instances, some methods and structures have not been described in detail to avoid obscuring the present disclosure.

[0032] In one embodiment, the present invention includes at least a computer- implemented system and method for facilitating the generation of a project that includes an audio recording (230) and script (270) relating to same. The system and method provide a platform that hosts a computer executable software application (10), wherein the application (10) is accessible by users (30) who utilize the platform and its functionality to generate the audio recordings and transcriptions relating to same.

[0033] In particular, the user (30) utilizes a computer device (20) (e.g. computer, laptop, mobile phone, tablet or similar) to access the application (10), and whilst not shown, the application (10) may be used in combination with an external server (not shown) with which the computer device (20) associated with the user (30) is configured to communicate. In this regard, steps described herein as performed by the computer device (20) may equally be performed by an external server (not shown) communicating with the device (20). For example, such a server may be programmed to provide all of the functions that cannot be provided locally on the user device (20).

[0034] The application (10) may be programmed to utilize one or more processors and/or databases associated with the computer device (20) for performing functions including interacting with an audio input peripheral device (e.g. an audio recording device) (40) associated with the computer device (20) for the purpose of receiving a recording of a spoken voice of the user (30). The computer device (20) may further be used to process, substantially in real-time, the recorded spoken voice (230) in order to remove any undesirable background noise, and adjust same to a required standard of the user. The device (20) subsequently implements one or more voice recognition techniques to generate, substantially in real-time, at least one script (270) relating to the audio recording (230) thereby completing the project. Since the recording (230) has undergone processing as described above, the resulting script will be a high quality written representation of the spoken voice of the user (30).

[0035] Skilled readers will appreciate that the processing of the spoken voice recording (230) of the user (30) to improve the audio prior to using same to generate the script (270) will improve the performance of the script generation process, and hence result in a script of improved quality (i.e. fewer errors). An example application of the present invention according to an embodiment, is the creation of an audio book (320), and in this regard, it will be appreciated that the present solution provides solution for selfpublishers to create audio books whilst also offering the ability to transcribe the work into a written format. This is achieved by allowing the user (30) to record high quality audio with noise cancelling, with subsequent generation of a script (270) based upon the high- quality audio.

[0036] Figure 1 is divided into segments which are further expanded into Figures 2 to 8. In particular, segment 200 of Figure 1 shows the user (30) downloading and installing the application (10) and subsequently accessing the application (10), as further detailed in Figure 2. Segment 300 of Figure 1 shows the functionality of application (10) operating on user device (20). It will be apparent to skilled readers that the software application (10) may be a mobile application or a web application and that, similarly, the user device (20) utilized by user (30) may be a mobile device or computer device which, as mentioned earlier, is operable to execute software application (10) and provide one or more user interfaces for display and/or interaction.

[0037] Segment 400 of Figure 1 illustrates how user (30) may create a new project, as further detailed in Figure 4. Segment 500 of Figure 1 illustrates how the user (30) may subsequently edit the audio recording (230), as detailed in Figure 5. Segment 600 of Figure 1 illustrates how the user (30) may enhance the audio by the inclusion of additional audio content and voice enhancements, as further detailed in Figure 6. Segment 700 of Figure 1 illustrates the generation of a written script corresponding with the recorded and processed audio, as further detailed in Figure 7. Finally, segment 800 of Figure 1 illustrates how a completed audio book (320) may be exported or uploaded for publication, as detailed in Figure 8.

[0038] As mentioned above, a server component (not shown) may be utilized in combination with the computer device (20) in order to provide the various functionality associated with application (10) and such a server component may be local or cloudbased.

[0039] The functionality and/or storage that is likely to be required by application (10) is shown in Figure 3 and includes:

• Project register (70) storing details associated with new projects created by users (30), which may include details regarding the type of project and a description of same;

• Project structure register (80) storing details relating to the structure of the project (e.g. in the case of an audio book, the chapters, acts or episodes);

• Audio recording repository (90) storing audio content recorded by users (30) when creating a project, each recording relating to a particular project and having a location ace within the project structure (80). This repository (90) may include newly received (non-processed) audio, as well as audio that has been received and subsequently processed (e.g. enhanced using noise cancellation techniques);

• Script database (100) storing text transcripts that are generated based on received and processed audio recording (90);

• Noise cancelling functionality (110) which enables the use of noise cancelling technology to clean the recorded audio, including to remove background noise (e.g. noise associated with non-voice related sound such as vehicle noise, sounds of nature and other unwanted audio);

• Voice recognition functionality (120) utilizing one or more voice recognition techniques to generate a script (such as a transcript, manuscript, playscript or screenplay) associated with the captured and processed audio recording;

• Project editing functionality (130) which enables users (30) to edit projects, as described further below, including to assemble the audio recordings and associated scripts into a complete project;

• Audio enhancement functionality (140) and audio enhancement library (150) which enables users (30) to further enhance audio recordings which have been captured and processed (e.g. adding audio content such as running water, music or other sound effects such as gunshots, and enhancements including voice enhancement) to modify recorded audio (90);

• Project template functionality (160) and associated template library (170) which together enable templates of different written formats to be selected and utilized by users (30) when creating a project (e.g. when a user selects one of a plurality of audio book templates stored in the template library (170) for the creation of an audio book);

• Export/publish (audio) functionality (180) which enables the export of a created audio into one or more other file formats, and the sharing and/or publication of a created audio;

• Export/publish (written) functionality (190) which enables the export of a created script into one or more other file formats, and the sharing and/or publication of a created script.

[0040] Figure 2 shows in greater detail Segment (200) of Figure 1 , and in particular, the steps associated with the user (30) installing the application (10) which may be achieved by downloading the application (10) from an application store. The user (30) may create an account using the application (10) and the account information may be stored in order to enable the application (10) to correctly identify the user (30) upon additional login attempts. Also shown in Figure 2 is an example of an audio recording device (40) which, in the embodiment shown, is a microphone connected to the computer device (20) used for the recording of audio content.

[0041] The process of downloading the application (10) is indicated by arrows (50), and the process of installing the application (10) utilizing a computer device (20) is indicated by arrow (60), which will enable the user (30) to utilize the computer (20) to access the functionality of the application (10) including to create and maintain a user profile and project. Upon uploading sufficient information, the user (30) may be successfully registered such that the user (30) becomes a registered user who may then utilize the functionality of application (10).

[0042] As mentioned above, Figure 4 shows in greater detail segment 400 of Figure 1 , and in particular, the use of the application (10) by the user (30) to create and maintain a new project. In this regard, Figure 4 shows an example interface (210) that allows the user (30) to create and specify a new project (70), such as an audio book for example, utilizing application (10), and subsequently record audio content (230) utilizing an audio recording interface (220) that allows the user (30) to record spoken voice content (230) as an audio recording (90).

[0043] Where the new project relates to the creation of a new audio book, for example, the user (30) may create a new audio book as effectively a container for their work. For example, this may include specifying the format of the book, describing the work and creating the structure of the book such as chapters, acts or episodes. Once the book and structure is specified, the user (30) may then record the audio (230) for the book. As the audio is recorded, it may be processed in real-time to remove any undesirable background noise utilizing one or more noise cancelling techniques, and apply any further adjustments required to ensure that the recording accords with a specified standard of the user. In this regard, the application (10) may further provide the user (30) with preferences in which the user may specify particular standards for the processing of their voice recordings.

[0044] Once the audio content has been recorded, the user (30) will be able to utilize a further interface (240) to edit content, including cutting, pasting and moving selected audio content. Additional examples of edits that may be effected by users include the addition of markers (e.g. paragraph, page, chapter, etc.) and the insertion of other content breaks as required (e.g. footnotes, editing notes, and links to references or other content). Interface (240) may also provide users with the ability to re-record additional audio if required, which will enable the user (30) to effect multiple edits to the captured audio until they are satisfied with the result.

[0045] In addition to editing recorded audio, the user (30) may also be provided an opportunity to enhance the audio by the inclusion of additional audio content and voice enhancements. For example, Figure 6 illustrates a further interface (250) which allows the user (30) to add additional audio content from a library (140) of sounds, including for example, music and sound effects (e.g. running water, vehicles, etc.). Users may also apply voice enhancements to change or modify the recorded audio. For example, the interface (250) may provide a “voice enhancing palette” for the user (30) to adjust the sound of their spoken word. In this regard, it will be appreciated that the user (30) may adjust additional aspects such as the tone of their spoken words, the language of their spoken word, the accent of their spoken words, and/or the speed of their spoken words in order to further enhance the recording, which further enhancements will also contribute to improving the transcription accuracy when subsequent script generation, as described below with reference to Figure 7.

[0046] In addition to allowing the user (30) to select a particular enhancement from library (140), it will be understood that enhancement recommendations may also be provided to the user (30) based upon the captured audio and the voice recognition process which enables particular words, sentences, phrases, etc, to be identified. On that basis, one or more audio sounds recommended to accompany such captured words, sentences, phrases, etc, may be presented as selectable options to the user in interface (250), thereby providing the user (30) with the ability to select and apply the one or more recommendations.

[0047] Figure 7 shows in greater detail segment 700 of Figure 1 and, in particular, the process of generating a written script (270) associated with the captured and processed audio. The written version of the audio may be presented in an interface (260) and, in this way, the user (30) is able to view the transcription during provision of the audio content, as well as save or publish same to a particular file format (270) such as .txt, .pdf or .doc. Once the transcribed audio recordings are in a recognized format, they may be subsequently printed in hard copy (280), shared or published to an external platform. Application (10) may provide the necessary functionality to enable hardware associated with the device (20) to be utilized to print, share or publish the script, e.g. utilizing a printer connected to the device (20) to print the hard copy script.

[0048] It will be appreciated that the scripts generated substantially in real-time (i.e. as the user (30) is providing spoken word audio input) may be captured in a file format that is universally recognized, such as .MP3, .ACC and .AVI, particularly by well-known online publishing platforms such as Amazon, iTunes, audio books online, Google books and podcasts. The publication of such scripts to external platforms is further detailed below with reference to Figure 8.

[0049] Once the script (270) is generated (fully or partially) and displayed in interface (260), the application (10) may also provide a word processing tool that provides the user (30) with the ability to edit the script. For example, the user (30) may prefer to view and edit a written version of their audio content in real time or at particular stages of the creation of the project in order to assist editing and proofing. This also provides users (30) with the ability to correct any transcription errors that they identify during their review.

[0050] The application (10) may provide suggestions to the user for editing the generated script, including in relation to correcting punctuation and generally providing options to the user regarding corrections and different ways in which the text may be displayed. In this regard, the application (10) may also operate an artificial intelligence learning module that is trained according to previous edits and corrections effected by users, and which will thereby improve editing options and recommendations provided to users over time.

[0051] Ultimately the written version of the audio recording will be received by a consumer (290) who may be a person that assists with further editing or proofing of the document, or a publisher, or an end consumer.

[0052] Figure 8 depicts in greater detail segment 800 of Figure 1 and, in particular, the ability of application (10) to be used to export or upload a completed audio book. In particular once the audio book is complete, the application (10) can be used to publish the created audio file(s) to major retail audio book platforms (310) such as those described above and with whom the user (30) may already have an established account (i.e. audio book retailers that either sell or offer a subscription service to audio books).

[0053] The user (30) can also elect to export the book to a different audio book format (320) as compared with the format in which the audio file was captured, which can assist with distributing file(s) to various different external platforms or sharing file(s), e.g. uploading same to other sites. Figure 8 depicts the end consumer (330) of the finalized audio book, who may listen to, or provide, feedback or reviews in relation to same.

[0054] Consumers (330) may also be interested in searching for particular content (audio or script) of interest that may be stored in one or more of the above-described databases. In this regard, the application (10) may also be utilized by such consumers to search for content, including specifying particular filters to apply to refine search results relating to stored audio and/or written content. Such consumers may be notified by application (10) regarding content that closely matches their search preferences. [0055] As used herein, the term “server”, “computer”, “computing system” or the like may include any processor-based or microprocessor-based system including systems using microcontrollers, reduced instruction set computers (RISC), application specific integrated circuits (ASICs), logic circuits, and any other circuit or processor including hardware, software, or a combination thereof capable of executing the functions described herein. Such are exemplary only, and are thus not intended to limit in any way the definition and/or meaning of such terms.

[0056] The one or more processors as described herein are configured to execute a set of instructions that are stored in one or more data storage units or elements (such as one or more memories), in order to process data. For example, the one or more processors may include or be coupled to one or more memories. The data storage units may also store data or other information as desired or needed. The data storage units may be in the form of an information source or a physical memory element within a processing machine.

[0057] The set of instructions may include various commands that instruct the one or more processors to perform specific operations such as the methods and processes of the various embodiments of the subject matter described herein. The set of instructions may be in the form of a software program. The software may be in various forms such as system software or application software. Further, the software may be in the form of a collection of separate programs, a program subset within a larger program or a portion of a program. The software may also include modular programming in the form of object- oriented programming. The processing of input data by the processing machine may be in response to user commands, or in response to results of previous processing, or in response to a request made by another processing machine.

[0058] The diagrams of embodiments herein illustrate one or more control or processing units. It is to be understood that the processing or control units may represent circuits, circuitry, or portions thereof that may be implemented as hardware with associated instructions (e.g., software stored on a tangible and non-transitory computer readable storage medium, such as a computer hard drive, ROM, RAM, or the like) that perform the operations described herein. The hardware may include state machine circuitry hardwired to perform the functions described herein. Optionally, the hardware may include electronic circuits that include and/or are connected to one or more logicbased devices, such as microprocessors, processors, controllers, or the like.

[0059] Optionally, the one or more processors may represent processing circuitry such as one or more of a field programmable gate array (FPGA), application specific integrated circuit (ASIC), microprocessor(s), and/or the like. The circuits in various embodiments may be configured to execute one or more algorithms to perform functions described herein. The one or more algorithms may include aspects of embodiments disclosed herein, whether or not expressly identified in the figures or a described method.

[0060] It will be appreciated by persons skilled in the relevant field of technology that numerous variations and/or modifications may be made to the invention as detailed in the embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all aspects as illustrative and not restrictive.

[0061] Throughout this specification and claims which follow, unless the context requires otherwise, the word “comprise”, and variations such as “comprises” and “comprising”, will be understood to imply the inclusion of a stated feature or step, or group of features or steps, but not the exclusion of any other feature or step or group of features or steps.