OBJECT URLS AT CLIENT

TECHNICAL FIELD OF INVENTION

The present invention relates generally to multimedia. More particularly, the invention relates to a system and a method for streaming multimedia content.

BACKGROUND OF THE INVENTION

Currently, videos are being recorded by content providers and stored on a server. These pre-recorded videos are provided to users from the server based on a request from the users. Along with the pre-recorded videos, the content providers can also provide live streaming of videos to the users through the server. Further, such pre-recoded videos or the live videos can be transmitted from the server to a user dveice where these videos can be rendered/displayed in a browser of the user device.

At present, these videos can be displayed/rendered in the browser through media source extension (MSE) buffer technique, WebRTC protocol, HTTP Live Streaming (HLS) playlist file URL technique, or remote URL for a single video file technique. However, the media source extension (MSE) buffer technique, the WebRTC protocol and the HTTP Live Streaming (HLS) playlist file URL technique are designed only for specific types of browser/s and thus, cannot be implemented on all of the available brwosers available in the market. Further, the remote URLused by the web browsersfor retrieving the video content from the server does not support streaming of live video in real time.

Figure 1 depicts an existing HTTP Live Streaming (HLS) architecture 100 for live video streaming comprising a media source 102, server 104, a distribution unit 106 connected to a network 108, and a user device 110. The media source 102 can be a content provider which provides pre-recorded videos and/or live videos to the server 104. The server 104 receives the pre-recorded and/or live videos from the media source 102 and stores these videos in a server disk. Further, these videos are encoded by a media encoding unit 104A of the server 104 using encoding algorithms. Further, the server 104 has a segmentation and validation unit 104B that divides the encoded videos into multiple video segments. The encoded multiple segments 106B of videos are then transmitted to a distribution unit 106, where a playlist file 106A is created at the server disk, which includes information of the encoded multiple segments 106B. The distribution unit 106 transmits the playlist file 106A and the encoded multiple segments 106B to the user device 110 over the network 108. Then, the user device 110 receives the playlist file 106A and the encoded multiple segments 106B over the network 108 and plays these encoded multiple segments 106B in accordance with the information provided in the playlist file 106A.

The existing architecture 100 requires the creation and storage of physical video segments 106B as well as physical playlist at the server disk. Also, existing architecture 100 requires transmission of the physical video segments 106B and transmission of the physical playlist file 106A to the user device 110. Further, the existing architecture 100 also requires the physical segmentation of the video at the server disk. The creation, storage and segmentation of the physical video at the server disk occupies a lot of space at the server disk. As a result, the the server disk becomes unavailable. In order to make the space available at the server disk, the physical video segments 106B and the physical playlist file 106 A are deleted/removed from the server disk after the video is played at the user device 110. Also, the creation/segmentation as well as the deletion/removal of the physical video segments 106B and the physical playlist file 106A happen periodically and such multiple operations on the server disk consumes a lot of time and therefore, also leads to disk fragmentation on the server 104.

In view of afore-mentioned problems in the existing architecture 100 for video streaming, there is a need of effective systems and methods for streaming video without creating or storing video segments as well as playlist at the server disk. There is also a need of systems and methods for streaming video that eliminates the problem of disk fragmentation on the server 104. In order to solve the problems in the existing solutions, systems and methods are disclosed for video streaming that addresses the afore mentioned problems by avoiding usage of the server disk.

SUMMARY OF THE INVENTION Various embodiments of the invention describe a method and a system for streaming a video. The invention discloses a method for streaming a video comprising the steps of transmitting a request to a server by a user device for streaming the video and receiving, from the server, one or more video segments of the video, the one or more video segments are stored in memory of the user device. The method further discloses the steps of creating object uniform resource locators (URLs) for each of the one or more video segments and transmitting the created object URLs to the server. Further, the server creates an in-memory playlist including the object URLs of the one or more video segments. Then, the user device receives a playlist URL of the in-memory playlist of the playlist from the server and using the playlist URL, the one or more video segments of the video are streamed to the user device.

In an embodiment of the invention, the server is coupled to a distribution unit for creating the playlist and the playlist URL.

In another embodiment of the invention, the object URLs for the one or more video segments in the playlist point to the memory of the user device for streaming the one or more video segments.

In a different embodiment of the invention, the memory on the user device for storing the one or more video segments is a memory space allocated to a web browser application.

In yet another embodiment of the invention, the one or more video segments are streamed in the web browser application and each of the one or more video segments has a specified duration.

In an alternative embodiment of the invention, the video is fetched from a content provider based on the request from the user device.

In a further embodiment of the invention, the video is a HyperText Transfer Protocol (HTTP)-based live streaming (HLS) video.

In another embodiment of the invention, the in-memory playlist is updated by the device based on new video segments received by the user device. In other embodiment of the invention, the in-memory playlist includes one or more bit rates at which the each video segment is played at the user device and/or the in-memory playlist includes a sequence in which the each video segments to be played at the user device.

In yet another embodiment of the invention, a user device is disclosed for streaming a video. The user device comprises a communication unit configured to transmit a request to a server for streaming the video and receive one or more video segments of the video from the server, the one or more video segments are stored in memory of the user device. The user device further comprises an object uniform resource locators (URLs) generation unit configured to create object URLs for each of the one or more video segments. The communication unit is also configured to transmit the created object URLs to the server, wherein an in-memory playlist is created on the server including the object URLs of the one or more video segments and receive a playlist URL of the in-memory playlist from the server. Furthermore, the user device comprises a streaming unit configured to stream the one or more video segments of the video by using the playlist URL.

In another embodiment of the invention, the object URLs for the one or more video segments in the playlist point to the memory of the user device for streaming the one or more video segments.

In a different embodiment of the invention, the memory on the user device for storing the one or more video segments is a memory space allocated to a web browser application.

In yet another embodiment of the invention, the one or more video segments are streamed in the web browser application and each of the one or more video segments has a specified duration.

In another embodiment of the invention, the in-memory playlist is updated by the device based on new video segments received by the user device. In other embodiment of the invention, the in-memory playlist includes one or more bit rates at which the each video segment is played at the user device and/or the in-memory playlist a sequence in which the each video segment to be played at the user device.

In various other embodiments of the invention, a server is disclosed for providing video to a user device. The server comprises a communication module configured to receive a request from the user device for streaming the video, creating one or more video segments of the video in a memory of the server and transmit the one or more video segments of the video to the user device. The communication module is also configured to receive, from the user device, object uniform resource locators (URLs) for each of the one or more video segments of the video. Further, the server comprises a URL generation unit configured to create a playlist URL for an in-memory playlist created by the server, the in-memory playlist including the object URLs of the one or more video segments. The communication module is further configured to transmit the playlist URL to the user device. The server also comprises a streaming unit configured to provide the video to the user device in an event the playlist URL is executed by the user device.

In an embodiment of the invention, the server is coupled with a distribution unit for creating the playlist and the playlist URL.

In another embodiment of the invention, the one or more video segments are in-memory video segments stored by the user device.

In a different embodiment of the invention, the object URLs for the one or more video segments in the playlist point to the memory of the user device for streaming the one or more video segments.

In various other embodiments of the invention, a computer readable medium is disclosed comprising one or more processors and a memory coupled to the one or more processors. The memory stores instructions which are executed by the one or more processors to transmit a request to a server by a user device for streaming a video and to receive one or more video segments of the video from the server, the one or more video segments are stored in memory of the user device. Further, object uniform resource locators (URLs) for each of the one or more video segments is created and transmitted to the server. The server creates an in-memory playlist including the object URLs of the one or more video segments. The user device receives a playlist URL of the in-memory playlist from the server and streams the one or more video segments of the video at the user device by using the playlist URL.

This summary is provided to introduce a selection of concepts in a simplified form from those that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 depicts an existing architecture 100 of video streaming according to prior art systems.

Figure 2 depicts an exemplary architecture 200 of video streaming according to an exemplary embodiment of the invention.

Figure 3 depicts block diagram of different components in a user device according to an exemplary embodiment of the invention.

Figure 4 depicts block diagram of different components in a server according to an exemplary embodiment of the invention.

Figure 5 depicts an exemplary signaling flow diagram according to an exemplary embodiment of the invention.

Corresponding reference numerals indicate corresponding parts throughout the drawings. DETAILED DESCRIPTION OF THE INVENTION

Described herein is the technology for systems and methods for streaming videos by a user device from a server.

As used herein, the videos include any recorded videos and/or a HyperText Transfer Protocol (HTTP)-based live streaming (HLS) videos or any such videos well known in the art and provided by a content provider. Such videos are accessible by a user using a user device. The user device can use any user application or web browser or the like to stream the video on the user device.

As used herein, the user device may be a desktop computer or a hand held device such as a mobile phone with network connectivity. Example of the user equipment includes a desktop, workstation PC, a laptop, a smart phone, a tablet, a wearable device and the like.

As used herein, the server is a remote storage or a cloud storage where the content provider hosts the pre-recorded videos and/or live videos and such storage is accessible by the user of the user device, for example, based on user credentials.

Figure 2 depicts an exemplary architecture 200 of video streaming, according to an exemplary embodiment of the invention. The exemplary architecture 200 comprises a media source 202, a server 204 coupled with a distribution unit 206 and a user device 210 connected to a network 208. The media source 202 can be a content provider, which provides pre-recorded videos and/or HyperText Transfer Protocol (HTTP)-based live streaming (HLS) videos to the server 204. The server 204 receives and stores the pre recorded and/or HyperText Transfer Protocol (HTTP)-based live streaming (HLS) videos (provided by the media source 202) in a memory of the server 204. In addition, the pre-recorded and/or HyperText Transfer Protocol (HTTP)-based live streaming (HLS) video can be fetched from the media source 202 based on a request from the user device 210 through the server 204.

When the user device 210 transmits a request to the server 204 for streaming a video, a media encoding unit 204A of the server 104 encodes the requested video by using encoding algorithms. Further, the server 204 has a segmentation and validation unit 204B that divides the encoded video into multiple video segments for each encoded video. The multiple video segments for each video can be stored in the memory of the server 204 and not at the server disk and therefore, may be called as in-memory video segments. It is be noted here that the pre-recorded and/or HyperText Transfer Protocol (HTTP)-based live streaming (HLS) video are stored in the memory of the server 204 and not stored on a disk of the server 204.

The encoded multiple segments of video are then transmitted to a distribution unit 206 which is coupled to the server 204. The distribution unit 206 then transmits the encoded multiple segments of for each video to the user device 210 through the network 208. Each of the video segment has a specified duration. On receiving the encoded multiple segments of the video, the user device 210 may store and assemble the encoded multiple segments of the video in a memory of the user device 210 and therefore, these encoded multiple segments of video may be called as in-memory video segments at the user device 210. The memory of the user device 210 may be a memory allocated to a web application process, wherein such process may be implemented in a web browser application of the user device 210. In a specific embodiment, the memory on the user device 210 for storing the one or more video segments is a memory space allocated to a web browser application.

After storing the encoded multiple segments of video in the memory of the user device 210, the user device 210 may create object uniform resource locators (URLs) 212 for each of the in-memory video segments. For example, each of the object URL at the user device 210 may have an extension such as“.obj”. In an embodiment, the object URLs for each of the in-memory video segments at the user device 210 may be Javascript object URLs. As used herein, the object URLs may be used by the user device 210 to refer/point and access the in-memory video segments at the user device 210 by using address of the memory of the user device 210 using the object URL where the in memory video segments are stored.

Once the user device 210 creates the object URLs 212 for each of the in-memory video segments, the user device 210 transmits the created object URLs 212 to the distribution unit 206.. The distribution unit 206 then receives the created object URLs 212 of the in-memory video segments and creates a in-memory playlist 206A including each of the object URLs 212 of the in-memory video segments in the in-memory playlist 206A. Further, the in-memory playlist 206A may be stored in the memory of the server 204 and not at the server disk and therefore, called as in-memory playlist. Subsequently, the distribution unit 206 creates a URL for the playlist 206A having the object URLs 212 of the in-memory video segments present at the user devoce 210. Then, the distribution unit 206 transmits the URL of the playlist 206A to the user device 210. Further, the playlist 206A includes information of these encoded multiple video segments. As used herein, the playlist 206A can be a manifest file having metadata relating to the video and the in-memory video segments of the video. The playlist 206 A may include, but is not limited to, bit rate at which the each video segment is played at the user device 210, a sequence or an order in which the each video segments to be played at user device 210, an encoding algorithm being used to encode the segments and such other information well known in the art. As used herein, the URL for the playlist 206A may be used by the user device 210 to refer/point and access the in-memory playlist 206A stored in the memory of the server 204. The user device 210 may use the URL to access an address of the memory of the server 204 where the in-memory playlist is stored.

On receiving the playlist URL from the distribution unit 206, the user device 210 may use the playlist URL for streaming the in-memory video segments of the video as requested. Further, the playlist URL provides access to the in-memory playlist 206A present at the distribution unit 206. The user device 210 reads the in-memory playlist 206A at the distribution unit 206 by accessing the playlist URL and accordingly, streams the in-memory video segments of the video based on the in-memory playlist 206A. It is noted that the playlist includes object URLs which references/points to the in-memory space on the user device (such as web browser application space) to stream each of the video segments in sequence. Although the server 204 and the distribution unit 206 in the invention have been shown and described as two different units/entities; however, it is well understood by any person skilled in the art that the server 204 and the distribution unit 206 can be considered as a single unit/entity which performs the functions/operations as described herein. Further, the terms server and distribution unit can be used interchangeably or in combination.

Table 1 below shows an exemplary in-memory playlist 206A created at the distribution unit 206 and stored at the server 204 which includes the video name, artist of the video, type of the video, video segment identifier, sequence/order in which the video segment is to be played, bitrate at which the each video segment is to be played a, duration of each video segment, object URL of each video segment and encoding being used for of each of the video segments.

Figure 3 depicts block diagram of different components in a user device 210 according to an exemplary embodiment of the invention. The user device 210 comprises a communication unit 302, an object uniform resource locators (URLs) generation unit 304, a streaming unit 306, a processor 308 and a memory 310 among other units. The communication unit 302 of the user device 210 is configured to transmit a request to the server 204 for streaming a video and also configured to receive one or more video segments of the video from the server 204, in response to the request. Once the user device 210 receives the one or more video segments of the video, the user device 210 may store and assemble the encoded multiple segments of video in the memory 310 of the user device 210. These encoded multiple segments of video may be called as in memory video segments at user device 210. The memory 310 of the user device 210 may be a memory allocated to a web application process, wherein such process may be implemented in a web browser of the user device 210.

The object URLs generation unit 304 of the user device 210 is configured to create object uniform resource locators (URLs) 212 for each of the in-memory video segments. Each of the object URL at the user device 210 may have an extension of “.obj”. When the object URLs generation unit 304 creates the object URLs 212 for each of the in-memory video segments, the object URLs generation unit 304 provides the created object URLs 212 to the communication unit 302. The communication unit 302 is configured to transmit the created object URLs 212 to the server 204. The server 204 receives the created object URLs 212 of the video segments and creates a in memory playlist 206A (in the memory of the server 204) including each of the object URLs 212 of the in-memory video segments in the playlist 206A. As used herein, the memory used for storing the playlist can be the in-memory of the server and not the server disk. The server 204 also creates a URL for the in-memory playlist 206A having the object URLs 212 of the in-memory video segments. Then, the server 204 transmits the URL of the in-memory playlist 206A to the communication unit 302 of the user device 210. As used herein, the communication unit 302 may be a transceiver of the user device 210.

The communication unit 302 is configured to receive the playlist URL from the server 204. Lurther, the streaming unit 306 of the user device 210 is configured to stream the in-memory video segments of the video (stored at the user device 210) by using the playlist URL. The streaming unit 306 is also configured to read the in-memory playlist 206A at the server 204 by accessing the playlist URL and accordingly, streams the in memory video segments of the video based on the in-memory playlist 206A. The streaming unit may be a web browser or an application stored in the memory 310 of the user device 210 which is used for streaming the video.

Ligure 4 depicts block diagram of different components on a server 204 according to an exemplary embodiment of the invention. Along with the media encoding unit 204 A and the segmentation and validation unit 204B as described in Ligure 2 above, the server 204 also comprises a communication module 402, a uniform resource locators (URLs) generation unit 404, a streaming unit 406, a processor 408 and a memory 410. The communication module 402 is configured to receive a request from the user device 210 for streaming the video. Upon receiving the request from the user device 210, the server 204 creates one or more video segments of the video in the memory 410 of the server 204. As video segments of the video are stored in the memory 410 of the server 204, these video segments may be called as in-memory video segments at the server 204. It is be noted here that the video segments are stored in the memory 410 of the server 204 and not stored on the disk of the server 204.

The server 204 is also configured to transmit the one or more in-memory video segments of the video to the user device 210, in response to the request. The communication module 402 of the server 204 is further configured to receive, from the user device 210, object uniform resource locators (URLs) 212 for each of the one or more in-memory video segments of the video.

Once the communication module 402 of the server 204 receives URLs 212 from the user device 210, the server 204 creates an in-memory playlist 206A. The URLs generation unit 404 is configured to create a playlist URL for the in-memory playlist 206A, the in-memory playlist 206A includes the object URLs of the one or more video segments. The communication module 402 provides the playlist URL for the in memory playlist 206A to the communication unit 302 of the user device 210. When the user device 210 accesses the playlist URL for the in-memory playlist 206A through the communication unit 302, the streaming unit 406 is configured to provide the video to the user device 210 in the form of continuous video segments.

Figure 5 depicts an exemplary signal flow diagram according to an exemplary embodiment of the invention.

At step 502, a communication between a server 204 and a user device 210 is established when the user device 210 initializes the communication. Such communication can be established by accessing a URL of a website in a web browser or a user application stored in the memory 310 and executed by the user device 210. At step 504, when the communication between the server 204 and the user device 210 is established, the user device 210 transmits a request to the server 204 for streaming a video.

At step 506, when the server 204 receives the request for streaming the video from the user device 210, the server 204 transmits the one or more segments of video to the user device 210 through the network 208 and the user device 210 receives and stores the one or more segments of video in the memory 310 of the user device 210, and may be referred as in-memory video segments.

At step 508, the user device 210 creates the object URLs 212 for each of the in-memory video segments. Each of the object URL at the user device 210 may have an extension of“.obj”.

At step 510, the user device 210 transmits the created object URLs 212 for each of the in-memory video segments to the server 204.

At step 512, the server 204 receives the created object URLs 212 of the in-memory video segments from the user device 210 and the server 204 creates an in-memory playlist 206A including each of the object URLs 212 of the in-memory video segments in the playlist 206A. Also, the server 204 creates a URL for the in-memory playlist 206A having the object URLs 212 of the in-memory video segments.

At step 514, the server 204 transmits the playlist URL for the in-memory playlist 206A to the user device 210.

At step 516, the user device 210 receives the playlist URL and uses the playlist URL for streaming the in-memory video segments of the video as requested. Lurther, the playlist URL provides access to the in-memory playlist 206 A present at the server 204. The user device 210 reads the in-memory playlist 206A at the server 204 by accessing the playlist URL and accordingly, streams the in-memory video segments of the video based on the in-memory playlist 206A.

At step 518, the in-memory playlist 206A is updated periodically at the server 204 based on new in-memory video segments of the video received by the user device 210. As the user device 210 receives new video segments from the server 204, the user device 210 creates object URLs for the new video segments and transmits the object URLs for the new video segments to the server 204. The server 204 updates the playlist 206 A by including the object URLs for the new video segments in the playlist 206A.

The present invention is applicable in various fields such as, but not limited to, online streaming content, HyperText Transfer Protocol (HTTP) streaming, HTTP live streaming, video calling, video recordings, and any such field that is well known in the art.

The present invention provides the following technical advantages over the existing methods and systems: a) elimination of disk fragmentation problem at the server end by sending playlist URL to the user device, where the playlist URL further provides object URLs to the in-memory video segments b) elimination of creating physical files for playlist and the video segments, c) minimizes storage requirement at the server, as the actual video segments are not stored in the form of disk files rather they are in memory objects pointed by object URLs in the user device or a web browser of the user device, the playlist is also created as in-memory object at the server which is nothing but a playlist URL, and d) reduction in disk input/output as both playlist and video segments are not being stored on the disk as physical files, instead they are referred as in memory objects

The embodiments of the invention discussed herein are exemplary and various modification and alterations to a known person skilled in the art are within the scope of the invention.

In one embodiment of the invention, the invention can be operated using the one or more computer readable devices comprising a computer readable medium. The one or more computer readable devices can be associated with the item 100. The computer readable medium of the computer readable devices is configured to transmit a request to a server 204 by a user device 210 for streaming a video and receive one or more video segments of the video from the server 204, the one or more video segments are stored in memory of the user device. Further, object uniform resource locators (URLs) 212 for each of the one or more video segments is created and transmitted to the server 204. The server 204 creates an in-memory playlist 206A including the object URLs of the one or more video segments. The user device 204 receives a playlist URL of the in memory playlist 206A from the server 204 and streams the one or more video segments of the video at the user device 210 by using the playlist URL.

Exemplary computer readable media includes flash memory drives, digital versatile discs (DVDs), compact discs (CDs), floppy disks, and tape cassettes. By way of example and not limitation, computer readable media comprise computer storage media and communication media. Computer storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media are tangible and mutually exclusive to communication media. Computer storage media are implemented in hardware and exclude carrier waves and propagated signals. Computer storage media for purposes of this invention are not signals per se. Exemplary computer storage media include hard disks, flash drives, and other solid-state memory. In contrast, communication media typically embody computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and include any information delivery media.

Although described in connection with an exemplary computing system environment, examples of the invention are capable of implementation with numerous other general purpose or special purpose computing system environments, configurations, or devices.

Examples of the invention may be described in the general context of computer- executable instructions, such as program modules, executed by one or more computers or other devices in software, firmware, hardware, or a combination thereof. The computer-executable instructions may be organized into one or more computer- executable components or modules. Generally, program modules include, but are not limited to, routines, programs, objects, components, and data structures that perform particular tasks or implement particular abstract data types. Aspects of the invention may be implemented with any number and organization of such components or modules. For example, aspects of the invention are not limited to the specific computer- executable instructions or the specific components or modules illustrated in the Figures and described herein. Other examples of the invention may include different computer- executable instructions or components having more or less functionality than illustrated and described herein.

Aspects of the invention transform a general-purpose computer into a special-purpose computing device when configured to execute the instructions described herein.

The order of execution or performance of the operations in examples of the invention illustrated and described herein is not essential, unless otherwise specified. That is, the operations may be performed in any order, unless otherwise specified, and examples of the invention may include additional or fewer operations than those disclosed herein. For example, it is contemplated that executing or performing a particular operation before, contemporaneously with, or after another operation is within the scope of aspects of the invention.

When introducing elements of aspects of the invention or the examples thereof, the articles "a," "an," "the," and "said" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. The term“exemplary” is intended to mean“an example of.” The phrase“one or more of the following: A, B, and C” means“at least one of A and/or at least one of B and/or at least one of C".

Having described aspects of the invention in detail, it will be apparent that modifications and variations are possible without departing from the scope of aspects of the invention as defined in the appended claims. As various changes could be made in the above constructions, products, and methods without departing from the scope of aspects of the invention, it is intended that all matter contained in the above description and shown in the accompanying drawings shall be interpreted as illustrative and not in a limiting sense. Although the subject matter has been described in language specific to structural features and/or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims.