Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
COMPUTER IMPLEMENTED METHOD AND ELECTRONIC DEVICE FOR ADJUSTING A DELIVERY OF AUDIO AND/OR AUDIOVISUAL CONTENT USING A GRAPHICAL USER INTERFACE
Document Type and Number:
WIPO Patent Application WO/2022/161940
Kind Code:
A1
Abstract:
The invention relates to a computer implemented method for adjusting a delivery of audio and/or audiovisual content (10) using a graphical user interface (12) on an electronic device (1) having a touch-sensitive display device (2), comprising providing (S1) a graphical user interface (12) of an electronic device (1) having a touch-sensitive display device (2), wherein the graphical user interface (12) comprises a sliding adjustable mixer (14) configured to combine, during playback of audio and/or audiovisual content (10), a first audio signal (16a)and a second audio signal (16b) to generate a combined audio signal (18), wherein the sliding adjustable mixer (14) is configured to adjust a relative magnitude of the first audio signal (16a) and the second audio signal (16b) in the combined audio signal (18). Moreover, the invention relates to an electronic device (1) configured to adjust a delivery of audio and/or audiovisual content (10) using a graphical user interface (12) for a touch-sensitive display device (2). In addition, the invention relates to a computer program and a computer-readable data carrier.

Inventors:
UPADHYAY ARVIND (DE)
DELISLE STEPHEN (DE)
Application Number:
PCT/EP2022/051605
Publication Date:
August 04, 2022
Filing Date:
January 25, 2022
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
BIOTRONIK SE & CO KG (DE)
International Classes:
G06F3/01; G06F3/0484; G06F3/04847; G06F3/0485; G06F3/04855; G06F3/0488; G11B27/031; G11B27/34
Foreign References:
US20180353855A12018-12-13
US20150268924A12015-09-24
US20170221520A12017-08-03
Attorney, Agent or Firm:
BIOTRONIK CORPORATE SERVICES SE (DE)
Download PDF:
Claims:
Claims

1. Computer implemented method for adjusting a delivery of audio and/or audiovisual content (10) using a graphical user interface (12) on an electronic device (1) having a touch-sensitive display device (2), comprising the steps of: providing (SI) a graphical user interface (12) of an electronic device (1) having a touch-sensitive display device (2), wherein the graphical user interface (12) comprises a sliding adjustable mixer (14) configured to combine, during playback of audio and/or audiovisual content (10), a first audio signal (16a) and a second audio signal (16b) to generate a combined audio signal (18), wherein the sliding adjustable mixer (14) is configured to adjust a relative magnitude of the first audio signal (16a) and the second audio signal (16b) in the combined audio signal (18); detecting (S2) a touch gesture on the touch-sensitive display device (2) and determining (S3) that the detected touch gesture is associated with an actuation of the sliding adjustable mixer (14); and driving (S4) an audio output device (15) of the electronic device (1) in accordance with a position of the sliding adjustable mixer (14) in response to the determining (S3).

2. Computer implemented method of claim 1, wherein a proportion (20a) of the first audio signal (16a) in the combined audio signal (18) and a proportion (20b) of the second audio signal (16b) in the combined audio signal (18) are continuously adjustable from 0% to 100% respectively, wherein a sum of the proportion (20a) of the first audio signal (16a) and the proportion (20b) of the second audio signal (16b) is 100%.

3. Computer implemented method of claim 1 or 2, wherein the first audio signal (16a) is an instructor audio, in particular of a guided mediation or breathwork routine, and wherein the second audio signal (16b) is a music title, in particular a background music. Computer implemented method of any one of the preceding claims, wherein the graphical user interface (12) is configured to change, during playback of audio and/or audiovisual content (10), the second audio signal (16b) to a different audio content, in particular a different music title, in reaction to detecting a substantially horizontal swipe (HS) on the touch-sensitive display device (2), the method further comprising determining that the detected touch gesture is associated with the substantially horizontal swipe (HS) and driving the audio output device (15) and/or the touch- sensitive display device (2) of the electronic device (1) to change the audio and/or audiovisual content (10). Computer implemented method of claim 4, wherein the substantially horizontal swipe (HS) is detectable anywhere on the touch-sensitive display device (2), and wherein the substantially horizontal swipe (HS) is defined as a swipe in a direction that is oriented at an angle (al, a2) of up to plus or minus 30 degrees off a lateral axis (Al) of the touch-sensitive display device (2). Computer implemented method of any one of the preceding claims, wherein the graphical user interface (12) is configured to change, during playback of audio and/or audiovisual content (10), a video content in reaction to detecting a substantially vertical swipe (VS) on the touch-sensitive display device (2), the method further comprising determining that the detected touch gesture is associated with the substantially vertical swipe (VS) and driving the touch-sensitive display device (2) of the electronic device (1) to change the video content. Computer implemented method of any one of claims 1 to 5, wherein the graphical user interface (12) is configured to simultaneously change, during playback of audiovisual content (10), an audio content and a video content in reaction to detecting a substantially vertical swipe (VS) on the touch-sensitive display device (2). Computer implemented method of claim 6 or 7, wherein the substantially vertical swipe (VS) is detectable anywhere on the touch-sensitive display device (2), and wherein the substantially vertical swipe (VS) is defined as a swipe in a direction that - 15 - is oriented at an angle (a3, a4) of up to plus or minus 30 degrees off a longitudinal axis (A2) of the touch-sensitive display device (2). Computer implemented method of claim 8, wherein the substantially horizontal swipe (HS) and/or the substantially vertical swipe (VS) are defined as a swipe that have a degree of curvature (DC) of up to 90 degrees. Computer implemented method of any one of the preceding claims, wherein the graphical user interface (12) comprises a first control element (22) that is configured to adjust a vibration setting of the electronic device (1), wherein the electronic device

(1) during a breathwork routine is configured to vibrate in a first manner to indicate users to breathe in and vibrates in a second manner to indicate users to breathe out, and optionally to vibrate in a third manner to indicate users to hold breath. Computer implemented method of any of the preceding claims, wherein the graphical user interface (12) comprises a second control element (24) that is configured to enable and disable the display of subtitles (26) during playback of audiovisual content (10). Computer implemented method of any one of the preceding claims, wherein the graphical user interface (12) comprises a third control element (28) that is configured to play and pause audio and/or audiovisual content (10) and a progress bar (30) for indicating an elapsed and/or remaining time of the audio and/or audiovisual content (10), and a fourth control element (32) that is configured to forward and rewind the audio and/or audiovisual content (10) by a predetermined time interval. Electronic device (1) configured to adjust a delivery of audio and/or audiovisual content (10) using a graphical user interface (12) for a touch-sensitive display device

(2), comprising: a graphical user interface (12) of an electronic device (1) having a touch-sensitive display device (2), wherein the graphical user interface (12) comprises a sliding adjustable mixer (14) configured to combine, during playback of audio and/or audiovisual content (10), a first audio signal (16a) and a second audio signal (16b) to - 16 - generate a combined audio signal (18), wherein the sliding adjustable mixer (14) is configured to adjust a relative magnitude of the first audio signal (16a) and the second audio signal (16b) in the combined audio signal (18); a touch-sensitive display device (2) for detecting a touch gesture; means (34) for determining that the detected touch gesture is associated with an actuation of the sliding adjustable mixer (14); and means (36) for driving an audio output device (15) of the electronic device (1) in accordance with a position of the sliding adjustable mixer (14) in response to the determining. Computer program with program code to perform the method of any one of claims 1 to 12 when the computer program is executed on a computer. Computer-readable data carrier containing program code of a computer program for performing the method of to any one of claims 1 to 12 when the computer program is executed on a computer.

Description:
Computer implemented method and electronic device for adjusting a delivery of audio and/or audiovisual content using a graphical user interface

The invention relates to a computer implemented method for adjusting a delivery of audio and/or audiovisual content using a graphical user interface on an electronic device. Furthermore, the invention relates to an electronic device configured to adjust a delivery of audio and/or audiovisual content using a graphical user interface for a touch-sensitive display device.

A number of media players exist on the market that offer generic playback and adjustment features. However, none offer a customization of the playback experience in a real-time manner.

US 2017/0221520 Al discloses systems and methods to play secondary media content including responding to a trick mode request (e.g., fast forward, rewind). A system receives a message from a device playing primary media content, and the message includes a first identifier of the primary media content, a secondary identifier of a playback direction, and a third identifier of a playback speed. Next, the system executes an application that results in identification of a media asset based on the first identifier, selection of media frames from the media asset, and generation of secondary media content based on the selected media frames, the second identifier, and the third identifier. Next, the system provides the secondary media content to the device. The provided secondary media content enables the device to play the secondary media content instead of continuing to play the primary media content.

Existing media players thus do not enable the user to choose the way they want to consume content especially in real-time and on a per use basis. It is therefore an objective of the present invention to provide an improved method and device for adjusting a delivery of audio and/or audiovisual content using a graphical user interface.

The objective is solved by a computer implemented method for adjusting a delivery of audio and/or audiovisual content using a graphical user interface having the features of claim 1. The objective is furthermore solved by an electronic device configured to adjust a delivery of audio and/or audiovisual content using a graphical user interface for a touch-sensitive display device having the features of claim 13, a computer program of claim 14 and the computer-readable data carrier of claim 15. Further developments and advantageous embodiments are defined in the dependent claims.

The present invention provides a computer implemented method for adjusting a delivery of audio and/or audiovisual content using a graphical user interface on an electronic device having a touch-sensitive display device.

The method comprises providing a graphical user interface of an electronic device having a touch-sensitive display device, wherein the graphical user interface comprises a sliding adjustable mixer configured to combine, during playback of audio and/or audiovisual content, a first audio signal and a second audio signal to generate a combined audio signal, wherein the sliding adjustable mixer is configured to adjust a relative magnitude of the first audio signal and the second audio signal in the combined audio signal.

Furthermore, the method comprises detecting a touch gesture on the touch-sensitive display device and determining that the detected touch gesture is associated with an actuation of the sliding adjustable mixer.

Moreover, the method comprises driving an audio output device of the electronic device in accordance with a position of the sliding adjustable mixer in response to the determining. In addition, the present invention provides an electronic device configured to adjust a delivery of audio and/or audiovisual content using a graphical user interface for a touch- sensitive display device.

The electronic device comprises a graphical user interface of an electronic device having a touch-sensitive display device, wherein the graphical user interface comprises a sliding adjustable mixer configured to combine, during playback of audio and/or audiovisual content, a first audio signal and a second audio signal to generate a combined audio signal, wherein the sliding adjustable mixer is configured to adjust a relative magnitude of the first audio signal and the second audio signal in the combined audio signal.

Furthermore, the electronic device comprises a touch-sensitive display device for detecting a touch gesture, means for determining that the detected touch gesture is associated with an actuation of the sliding adjustable mixer, and means for driving an audio output device of the electronic device in accordance with a position of the sliding adjustable mixer in response to the determining.

In addition, the present invention provides a computer program comprising program code to perform the method according to the present invention when the computer program is executed on a computer.

Moreover, the present invention provides a computer-readable data carrier containing program code of a computer program for performing the method according to the present invention when the computer program is executed on a computer.

It is an idea of the present invention to enable the end user to choose exactly how they would like to consume the audio and or audiovisual content and do so in real-time to have a completely customized playback experience.

Providing the sliding adjustable mixer is one of the components of customizing the user experience. Being able to customize the experience, i.e. seamlessly changing audio playback between the first audio signal to the second audio signal during playback offers a more user- friendly interface and customization possibilities.

According to an aspect of the invention, a proportion of the first audio signal in the combined audio signal and a proportion of the second audio signal in the combined audio signal are continuously adjustable from 0% to 100% respectively, wherein a sum of the proportion of the first audio signal and the proportion of the second audio signal is 100%. The proportion of the first audio signal is thus automatically adjusted when adjusting the second audio signal and vice versa such that the aggregate audio signal amounts to 100%.

According to a further aspect of the invention, the first audio signal is an instructor audio, in particular of a guided mediation or breathwork routine, and wherein the second audio signal is a music title, in particular a background music. The user is thus awarded the choice of customizing the guided mediation or breathwork routine according to his or her individual preferences.

According to a further aspect of the invention, the graphical user interface is configured to change, during playback of audio and/or audiovisual content, the second audio signal to a different audio content, in particular a different music title, in reaction to detecting a substantially horizontal swipe on the touch-sensitive display device. This advantageously enables an intuitive control of the second audio signal, the method further comprising determining that the detected touch gesture is associated with the substantially horizontal swipe and driving the audio output device and/or the touch-sensitive display device of the electronic device to change the audio and/or audiovisual content.

According to a further aspect of the invention, the substantially horizontal swipe is detectable anywhere on the touch-sensitive display device, and wherein the substantially horizontal swipe is defined as a swipe in a direction that is oriented at an angle of up to plus or minus 30 degrees off a lateral axis of the touch-sensitive display device. The substantially horizontal swipe is hence detected even if it deviates from the lateral axis of the touch- sensitive display device. According to a further aspect of the invention, the graphical user interface is configured to change, during playback of audio and/or audiovisual content, a video content in reaction to detecting a substantially vertical swipe on the touch-sensitive display device, the method further comprising determining that the detected touch gesture is associated with the substantially vertical swipe and driving the touch-sensitive display device of the electronic device to change the video content. This advantageously enables an intuitive control of the video content.

According to a further aspect of the invention, the graphical user interface is configured to simultaneously change, during playback of audiovisual content, an audio content and a video content in reaction to detecting a substantially vertical swipe on the touch-sensitive display device. This enables the user to quickly browse through a number of choices of audiovisual content.

According to a further aspect of the invention, the substantially vertical swipe is detectable anywhere on the touch-sensitive display device, and wherein the substantially vertical swipe is defined as a swipe in a direction that is oriented at an angle of up to plus or minus 30 degrees off a longitudinal axis of the touch-sensitive display device. The substantially vertical swipe is hence detected even if it deviates from the longitudinal axis of the touch- sensitive display device.

According to a further aspect of the invention, the substantially horizontal swipe and/or the substantially vertical swipe are defined as a swipe that have a degree of curvature of up to 90 degrees. Even a curved swipe that extends in a substantially horizontal or vertical direction is thus advantageously detected as such.

According to a further aspect of the invention, the graphical user interface comprises a first control element that is configured to adjust a vibration setting of the electronic device, wherein the electronic device during a breathwork routine is configured to vibrate in a first manner to indicate users to breathe in and vibrates in a second manner to indicate users to breathe out, and optionally to vibrate in a third manner to indicate users to hold breath. The user thus receives haptic feedback that enables him or her to follow the breath work routine eyes closed or without looking at the screen.

According to a further aspect of the invention, the graphical user interface comprises a second control element that is configured to enable and disable the display of subtitles during playback of audiovisual content. The second control element is directly located on the graphical user interface and allows the user to enable and disable subtitles with a single touch activation or deactivation of the control element.

According to a further aspect of the invention, the graphical user interface comprises a third control element that is configured to play and pause audio and/or audiovisual content and a progress bar for indicating an elapsed and/or remaining time of the audio and/or audiovisual content, and a fourth control element that is configured to forward and rewind the audio and/or audiovisual content by a predetermined time interval. By integrating said control elements into the graphical user interface in combination with the afore-mentioned other control elements for mixing and or changing audio and/or video content, and efficient and versatile user interface is advantageously provided.

The herein described features of the computer implemented method for adjusting a delivery of audio and/or audiovisual content using a graphical user interface are also disclosed for the system configured to adjust a delivery of audio and/or audiovisual content using a graphical user interface for a touch-sensitive display device and vice versa.

For a more complete understanding of the present invention and advantages thereof, reference is now made to the following description taken in conjunction with the accompanying drawings. The invention is explained in more detail below using exemplary embodiments, which are specified in the schematic figures of the drawings, in which:

Fig. 1 shows a flowchart of a computer implemented method for adjusting a delivery of audio and/or audiovisual content using a graphical user interface on an electronic device according to a preferred embodiment of the invention; Fig. 2 shows a depiction of a graphical user interface of the electronic device having the touch-sensitive display device according to the preferred embodiment of the invention; and

Fig. 3 shows a schematic illustration of an electronic device configured to adjust a delivery of audio and/or audiovisual content using a graphical user interface for a touch-sensitive display device according to the preferred embodiment of the invention.

The computer implemented method of Fig. 1 serves to adjust a delivery of audio and/or audiovisual content 10 using a graphical user interface 12 on an electronic device 1 having a touch-sensitive display device 2.

The method further comprises providing SI a graphical user interface 12 of an electronic device 1 having a touch-sensitive display device 2 The graphical user interface 12 comprises a sliding adjustable mixer 14 configured to combine, during playback of audio and/or audiovisual content 10, a first audio signal 16a and a second audio signal 16b to generate a combined audio signal 18. The sliding adjustable mixer 14 is configured to adjust a relative magnitude of the first audio signal 16a and the second audio signal 16b in the combined audio signal 18.

In addition, the method comprises detecting S2 a touch gesture on the touch-sensitive display device 2 and determining S3 that the detected touch gesture is associated with an actuation of the sliding adjustable mixer 14, and driving S4 an audio output device 15 of the electronic device 1 in accordance with a position of the sliding adjustable mixer 14 in response to the determining S3.

Fig. 2 shows a depiction of a graphical user interface of the electronic device having the touch-sensitive display device according to the preferred embodiment of the invention.

A proportion 20a of the first audio signal 16a in the combined audio signal 18 and a proportion 20b of the second audio signal 16b in the combined audio signal 18 are continuously adjustable from 0% to 100% respectively. Hence, a sum of the proportion 20a of the first audio signal 16a and the proportion 20b of the second audio signal 16b amounts to 100%.

The first audio signal 16a according to the present embodiment is an instructor audio, in particular of a guided mediation or breathwork routine. Alternatively, the first audio signal may be another audio content such as narrated subtitles. The second audio signal 16b is a music title, in particular a background music.

The graphical user interface 12 is configured to change, during playback of audio and/or audiovisual content 10, the second audio signal 16b to a different audio content, in particular a different music title, in reaction to detecting a substantially horizontal swipe HS on the touch-sensitive display device 2. The method further comprises determining that the detected touch gesture is associated with the substantially horizontal swipe HS and driving the audio output device 15 and/or the touch-sensitive display device 2 of the electronic device 1 to change the audio and/or audiovisual content 10.

The substantially horizontal swipe HS is detectable anywhere on the touch-sensitive display device 2. The substantially horizontal swipe HS is defined as a swipe in a direction that is oriented at an angle al, a2 of up to plus or minus 30 degrees off a lateral axis Al of the touch-sensitive display device 2.

The graphical user interface 12 is configured to change, during playback of audio and/or audiovisual content 10, a video content in reaction to detecting a substantially vertical swipe VS on the touch-sensitive display device 2. The method further comprises determining that the detected touch gesture is associated with the substantially vertical swipe VS and driving the touch-sensitive display device 2 of the electronic device 1 to change the video content.

Alternatively, the graphical user interface 12 can be configured to simultaneously change, during playback of audiovisual content 10, an audio content and a video content in reaction to detecting a substantially vertical swipe VS on the touch-sensitive display device 2. The substantially vertical swipe VS is detectable anywhere on the touch-sensitive display device 2, and wherein the substantially vertical swipe VS is defined as a swipe in a direction that is oriented at an angle a3, a4 of up to plus or minus 30 degrees off a longitudinal axis A2 of the touch-sensitive display device 2.

The substantially horizontal swipe HS and/or the substantially vertical swipe VS are defined as a swipe that have a degree of curvature DC of up to 90 degrees.

The graphical user interface 12 comprises a first control element 22 that is configured to adjust a vibration setting of the electronic device 1. The electronic device 1 during a breathwork routine is configured to vibrate in a first manner to indicate users to breathe in and vibrates in a second manner to indicate users to breathe out, and optionally to vibrate in a third manner to indicate users to hold breath.

In addition, the graphical user interface 12 comprises a second control element 24 that is configured to enable and disable the display of subtitles 26 during playback of audiovisual content 10.

The graphical user interface 12 comprises a third control element 28 that is configured to play and pause audio and/or audiovisual content 10 and a progress bar 30 for indicating an elapsed and/or remaining time of the audio and/or audiovisual content 10.

Moreover, a fourth control element 32 that is configured to forward and rewind the audio and/or audiovisual content 10 by a predetermined time interval. Rewinding or forwarding the first audio signal has no effect on the background music, since the two audio signals / channels are independent of each other. Thus, if the instructor audio is rewound the background music continues to be played.

A predetermined number of background music titles are preloaded in an app. Alternatively the audio and/or video content may be stored in a cloud environment and served to the electronic device by means of a wireless internet connection. A fifth control element 38 allows to close and exit the app. Fig. 3 shows a schematic illustration of an electronic device configured to adjust a delivery of audio and/or audiovisual content using a graphical user interface for a touch-sensitive display device according to the preferred embodiment of the invention.

The electronic device 1 comprises a graphical user interface 12 of an electronic device 1 having a touch-sensitive display device 2, wherein the graphical user interface 12 comprises a sliding adjustable mixer 14 configured to combine, during playback of audio and/or audiovisual content 10, a first audio signal 16a and a second audio signal 16b to generate a combined audio signal 18, wherein the sliding adjustable mixer 14 is configured to adjust a relative magnitude of the first audio signal 16a and the second audio signal 16b in the combined audio signal 18.

Furthermore, the electronic device 1 comprises a touch-sensitive display device 2 for detecting a touch gesture, means 34 for determining that the detected touch gesture is associated with an actuation of the sliding adjustable mixer 14, and means 36 for driving an audio output device 15 of the electronic device 1 in accordance with a position of the sliding adjustable mixer 14 in response to the determining.

Moreover, the electronic device 1 comprises means for determining that a detected touch gesture is associated with a substantially horizontal swipe HS and means for driving the audio output device 15 and/or the touch-sensitive display device 2 of the electronic device 1 to change the audio and/or audiovisual content 10.

In addition, the electronic device 1 comprises means for determining that the detected touch gesture is associated with a substantially vertical swipe VS and means for driving the touch- sensitive display device 2 of the electronic device 1 to change the video content.

Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that a variety of alternate and/or equivalent implementations exist. It should be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability or configuration in any way.

Rather, the foregoing summary and detailed description will provide those skilled in the art with a convenient roadmap for implementing at least one exemplary embodiment, it being understood that various changes may be made in the function and arrangement of elements described in an exemplary embodiment without departing from the scope as set forth in the appended claims and their legal equivalents. Generally, this application is intended to cover any adaptations or variations of the specific embodiments discussed therein. The invention is not limited to a meditation app but can be applied to any app comprising the delivery of audio and video tracks.

Reference Signs

1 electronic device

2 touch-sensitive display device

10 audio / audiovisual content

12 user interface

14 sliding adjustable mixer

15 audio output device

16a first audio signal

16b second audio signal

18 combined audio signal

20a proportion of first audio signal

20b proportion of second audio signal

22 first control element

24 second control element

26 subtitles

28 third control element

30 progress bar

32 fourth control element

34, 36 means

38 fifth control element

Al lateral axis

A2 longitudinal axis

DC degree of curvature

HS horizontal swipe

S1-S4 method steps

VS vertical swipe