BAUM, Peter, Georg (Aschendorfer Str. 25, Hannover, 30539, DE)
ARNOLD, Michael (Eichendorffstr. 1b, Isernhagen, 30916, DE)
VOESSING, Walter (Remarqueweg 23, Hannover, 30455, DE)
GRIES, Ulrich (Friedenauer Str. 20b, Hannover, 30419, DE)
BAUM, Peter, Georg (Aschendorfer Str. 25, Hannover, 30539, DE)
ARNOLD, Michael (Eichendorffstr. 1b, Isernhagen, 30916, DE)
VOESSING, Walter (Remarqueweg 23, Hannover, 30455, DE)
| Claims Method for providing a watermarked decoded audio or video signal (WMDAS) derived from a watermarked audio or video signal (WMAS) that was low bit rate encoded (11) and de¬ coded (13), said method including the steps: encoding (11) said watermarked audio or video signal (WMAS) and retrieving the watermark signal, so as to pro¬ vide an encoded audio or video signal (EAS) ; decoding (12) said retrieved watermark signal so as to provide the included watermark payload data (WMP) ; encoding (14) said watermark payload data (WMP) so as to provide a related watermark signal; decoding (13) said encoded audio or video signal (EAS), thereby embedding said watermark signal, so as to provide a decoded watermarked audio or video signal (WMDAS) . 2. Method for providing a non-watermarked encoded audio or video signal (EAS) derived from a watermarked audio or video signal (WMAS) that was low bit rate encoded (11), said method including the steps: encoding (11) said watermarked audio or video signal (WMAS) and retrieving the watermark signal, so as to pro¬ vide an encoded audio or video signal (EAS) ; - decoding (12) said retrieved watermark signal so as to provide the included watermark payload data (WMP) . 3. Method for providing a watermarked decoded audio or video signal (WMDAS) derived from a watermarked audio or video signal (WMAS) that was encoded (11) and the watermark signal was retrieved and the corresponding watermark pay- load data were provided, said method including the steps: encoding (14) said watermark payload data (WMP) so as to provide a related watermark signal; - decoding (13) said encoded audio or video signal (EAS), thereby embedding said watermark signal, so as to provide a decoded watermarked audio or video signal (WMDAS) . 4. System for providing a watermarked decoded audio or video signal (WMDAS) derived from a watermarked audio or video signal (WMAS) that was low bit rate encoded (11) and de¬ coded (13), said system including: means (11) being adapted for encoding said watermarked audio or video signal (WMAS) and for retrieving the wa¬ termark signal so as to provide an encoded audio or video signal (EAS) ; means (12) being adapted for decoding said watermark signal so as to provide the included watermark payload data (WMP) ; means (14) being adapted for encoding said watermark pay- load data (WMP) so as to provide a related watermark sig¬ nal ; means (13) being adapted for decoding said encoded audio or video signal (EAS) , thereby embedding said watermark signal, so as to provide a decoded watermarked audio or video signal (WMDAS) . Method according to one of claims 1 to 3, or system ac¬ cording to claim 4, wherein said encoding (11) is a low bit rate encoding and in said encoded audio or video sig nal (EAS) said watermark signal is removed, and wherein said decoding (13) is a low bit rate decoding, respecti- evely . Method according to the method of claim 1 or 5, or system according to the system of claim 4 or 5, wherein, together with said low bit rate encoding and said watermark removal (11), said audio or video signal is encrypted so as to provide an encoded encrypted audio or video signal (EAS) without watermarking, and wherein, together with said low bit rate decoding (13) of said encoded encrypted audio or video signal, said audio or video signal is correspondingly decrypted so as to provide said decoded watermarked audio or video signal (WMDAS) . Method according to claim 2 and 5 wherein, together with said low bit rate encoding and said watermark removal (11), said audio or video signal is encrypted so as to provide an encoded encrypted audio or video signal (EAS) without watermarking. Method according to claim 3 and 5 wherein, together with said low bit rate decoding (13) of said encoded encrypted audio or video signal, said audio or video signal is cor¬ respondingly decrypted so as to provide said decoded wa¬ termarked audio or video signal (WMDAS) . Method according to the method of one of claims 1 to 3 and 5 to 8, or system according to the system of one of claims 4 to 6, wherein said audio encoding/decoding is parametric encoding/de-coding. Method according to the method of one of claims 1 to 3 and 5 to 8, or system according to the system of one of claims 4 to 6, wherein said audio encoding/decoding is an AAC+, Unified Speech and Audio coder, CELP, MPEG4 Pa rametric Audio, SBR Parametric Stereo [PS] or mp3PRO en coding/decoding . |
The invention relates to a method and to a system for pro ¬ viding a watermarked decoded audio or video signal derived from a watermarked audio or video signal that was encoded and decoded.
Background
Various audio signal watermarking (WM) systems are known, which are also applied to digitally encoded audio signals
Invention
However, in current audio signal watermarking systems the watermark signal and its watermark payload often do not survive very low bit rate audio coding, in particular parametric encoding. This means that, following compression of a watermarked audio signal by such a coder, the watermark pay- load cannot be retrieved any more at receiver or decoder side.
This causes a problem because parametric audio coding (like AAC+, mp3PRO, unified speech and audio coder) is going to be used more and more in the future. In one usage scenario, a dedicated company performs post production and authoring of pre-release DVDs for a studio. The studio requires that the content is watermarked, so that a leak can be tracked if content is leaked to the internet. Specific-language subtitles for the movie are to be gener- ated by a subcontractor in a country where that specific language is spoken. Therefore the original-language audio content is sent to that subcontractor. Since using high bandwidth is expensive, the audio signal is compressed strongly by a codec using parametric coding. As a conse ¬ quence, the watermark can no more be retrieved from the con- tent the subcontractor has received. The dedicated company can comply with its contract with the studio only by sending high-quality or nearly high-quality (i.e. weak compression) audio content to the subcontractor, which is more expensive and takes more time.
A problem to be solved by the invention is to provide water ¬ marked and - in particular low bit rate - encoded and de ¬ coded audio signals from which the watermark signal and the watermark payload can be detected at decoder side. This problem is solved by the methods disclosed in claims 1 to 3. A corresponding system is disclosed in claim 4.
According to the invention, a watermarked uncompressed audio signal bitstream is - in particular low bit rate - encoded, but the watermarking signal is retrieved (and may be removed in the encoded audio signal) , and the decoded watermark sig ¬ nal payload only is transmitted or transferred together with the encoded audio signal bitstream. At decoder side, the re ¬ ceived audio signal bitstream is de-compressed and water- marked again using the transmitted watermark payload.
The invention combines the advantages of parametric or other low bit rate encoding like small audio signal file size with the advantages of watermarking like traceability of content.
In principle, the inventive method is suited for providing a watermarked decoded audio or video signal derived from a wa ¬ termarked audio or video signal that was low bit rate en ¬ coded and decoded, said method including the steps:
- encoding said watermarked audio or video signal and re ¬ trieving the watermark signal so as to provide an encoded audio or video signal;
decoding said retrieved watermark signal so as to provide the included watermark payload data;
encoding said watermark payload data so as to provide a related watermark signal;
decoding said encoded audio or video signal, thereby em ¬ bedding said watermark signal, so as to provide a decoded watermarked audio or video signal. In principle the inventive system is suited for providing a watermarked decoded audio or video signal derived from a wa ¬ termarked audio or video signal that was low bit rate en ¬ coded and decoded, said system including:
means being adapted for encoding said watermarked audio or video signal and retrieving the watermark signal so as to provide an encoded audio or video signal;
means being adapted for decoding said retrieved watermark signal so as to provide the included watermark payload data; means being adapted for encoding said watermark payload data so as to provide a related watermark signal;
means being adapted for decoding said encoded audio or video signal, thereby embedding said watermark signal, so as to provide a decoded watermarked audio or video signal. Advantageous additional embodiments of the invention are disclosed in the respective dependent claims.
Drawing
Exemplary embodiments of the invention are described with reference to:
Fig. 1 block diagram of a system according to the invention. Exemplary embodiments
In Fig. 1, an original audio signal OAS is watermarked in a known watermarking embedder stage or step 10 and enters a system 1 according to the invention. The watermarked audio signal WMAS is encoded in an audio signal encoder and water ¬ marking detector and remover stage or step 11, wherein the watermarking signal is retrieved for separate use, and can be removed from the audio signal. The retrieved watermarking signal is fed to a watermark decoder stage or step 12. The encoded audio signal EAS is transferred or transmitted to a corresponding audio signal decoder and watermark embedder stage or step 13, which decodes to uncompressed audio and at the same time watermarks with the watermarking signal, and which outputs the decoded and watermarked audio signal
WMDAS . The WM payload data WMP decoded in watermark decoder stage/step 12 are transferred or transmitted (e.g. embedded in the EAS bitstream) to a corresponding watermark encoder stage or step 14 which supplies step/stage 13 with the wa- termarking signal to be embedded.
Preferably, the audio signal encoding and decoding is a low bit rate encoding and decoding. The term "low bit rate" means a bit rate which is so low that an additional water- mark embedded in the code for the encoded audio or video signal, following decoding of the audio or video signal, can no more be detected or evaluated usefully, i.e. an encoded audio signal data rate below a range of e.g. 24kBit/s to 6kBit/s. If any remaining watermark signal parts could dis- turb the watermarking at receiving side, the watermark signal is removed when encoding the audio signal.
As an alternative, the audio signal encoding and decoding is not a low bit rate encoding/decoding in the above meaning. In such case the watermark signal must be removed when en- coding the audio signal. Advantageously, the data rate of the encoded audio signal will not increase significantly from the embedding of the WM payload data because the data rate of the WM payload data WMP is much smaller than the data rate of the audio coding parameters representing the encoded audio signal EAS .
The inventive processing is independent from the specific parametric encoder/decoder used because it is carried out in the uncompressed domain. The uncompressed audio signal is always watermarked. Since it is to be decompressed before it becomes useful (e.g. for listening to it) , there is kind of protection in the non- watermarked compressed domain. The inventive processing operates well under the condition that the communication chain audio encoder/WM detector 11, transmission channel and audio decoder/WM embedder 13 can be controlled completely. In case the transmission channel or line cannot be controlled and a standard audio codec is used, an adversary could read the bitstream and use a stan ¬ dard audio decoder without WM embedder to create a non- watermarked version of the audio signal. Therefore the audio encoder/WM detector can also include a known encryption module, so that the bitstream EAS and possibly the watermark payload WMP is encrypted. The audio decoder/WM embedder 13 includes a corresponding decryption module, so that the encrypted bit stream is decrypted, decoded and watermarked. The watermark is embedded jointly with the deciphering and decompression, such that the watermark embedding during the decoding is rendered mandatory because it is linked to the deciphering. This represents a conversion from parametric data (parametric compressed data, watermark) to an inte ¬ grated multimedia signal (watermarked decoded audio) in a secure way.
The audio encoding/decoding is e.g. an AAC+, Unified Speech and Audio coder, CELP, MPEG4 Parametric Audio, SBR Paramet ¬ ric Stereo (PS), or mp3PRO encoding/decoding.
Instead of an audio signal, the invention can relate to a video signal, wherein the low bit rate audio encoding/de ¬ coding is replaced by a low bit rate video encoding/de ¬ coding .
The audio or video signal can be encoded/decoded frame-wise, wherein the watermark signal sections are assigned to these frames .
Next Patent: METHOD AND APPARATUS FOR PERFORMING EXTENDED SEARCH