Background Art Conventionally, among digital cameras in which picture signals of a subject picked up by a solid-state image pickup element such as a CCD are converted into digital signals and the resulting picture data are recorded on recording media, some have a moving picture pickup function in addition to the normal still picture pickup function, while some have a function to pickup pictures with voices that simultaneously records voices and still pictures or moving pictures.

In such digital cameras, a still picture pickup mode, in which still pictures are picked up, and a moving picture pickup mode, in which moving pictures are picked up, are independently provided as image pickup modes and the modes are switched one from the other through user operation such as a key operation.

In Patent Document 1 (Laid-open Japanese Patent Application HEI 11-55617) and Patent Document 2

(Laid-open Japanese Patent Application 2001-111934), methods for picking up a still picture during picking up a moving picture using a digital camera are disclosed. In the method according to Patent Document 1, while performing an operation to pickup moving picture frames in moving picture frame cycles and to store the moving picture frames in a buffer memory, in response to a user operation to pickup a still picture during taking a moving picture, a still picture is picked up and recorded while the next moving picture frame is recorded; in effect, a moving picture pickup processing and a still picture pickup processing take place in parallel.

In the method according to Patent Document 2, when there is a user operation to pickup a still picture while picking up a moving picture, the operation to image and store moving picture frames is interrupted temporarily, a still picture is picked up and recorded during the interruption, and imaging and storing of moving picture frames are subsequently resumed; in other words, a still picture pickup operation is conducted through an interrupt processing. When the moving picture pickup operation is finished, frames for interpolation purposes that correspond to moving picture frames during the interrupted period, which is a period during which moving picture frames could not be picked up due to a still picture pickup processing,

are separately created and stored ; and when the moving picture is reproduced, interpolation frames are displayed in the interrupted period; in this way, a still picture pickup operation during a moving picture pickup operation is made possible.

However, when a still picture is picked up during a moving picture pickup operation with a digital camera having a still picture pickup mode and a moving picture pickup mode independently provided, as described earlier, a moving picture compression data file (a moving picture file) resulting from the moving picture pickup operation that was interrupted by the still picture pickup operation is divided in two parts by the still picture pickup operation in between. This makes the management of files recoded through the moving picture pickup operation more complicated ; furthermore, there is a problem in that an operation to consecutively reproduce two moving picture files that form a pair has to be conducted when reproducing the moving pictures picked up. Also, these problems could not be solved using the technologies disclosed in Patent Documents 1 and 2.

The present invention has been conceived in view of the problems in the conventional art, and its purpose is to provide an image pickup device and an image pickup method that would not sacrifice the convenience entailed in moving picture data obtained

from moving picture pickup operation, even if a still picture were to be photographed during a moving picture pickup operation.

Disclosure of Invention In accordance with one embodiment, an image pickup device with a function to pickup still pictures during a moving picture pickup operation is structured to be equipped with: imaging means for executing a moving picture pickup processing and a still picture pickup processing; interrupt processing means for sequentially executing, during the moving picture pickup processing by the imaging means, a processing to suspend the moving picture pickup processing by the imaging means, a processing to pickup a still picture by the imaging means, and a processing to resume the moving picture pickup processing by the imaging means; and moving picture file creation means for creating one moving picture file that includes moving picture frames obtained through the moving picture pickup processing executed before the still picture pickup processing by the imaging means, and moving picture frames obtained through the moving picture pickup processing resumed after the still picture pickup processing.

In accordance with another embodiment, there is provided an image pickup method for an image pickup device with a function to pickup still pictures during a moving picture pickup operation, the image pickup

method comprising a step of sequentially executing, during a moving picture pickup processing by imaging means, a processing to suspend the moving picture pickup processing by the imaging means, a processing to pickup a still picture by the imaging means, and a processing to resume the moving picture pickup processing by the imaging means; and a step of creating one moving picture file that includes moving picture frames obtained through the moving picture pickup processing executed before the still picture pickup processing by the imaging means, and moving picture frames obtained through the moving picture pickup processing resumed after the still picture pickup processing.

In accordance with another embodiment, there is provided a program that renders a computer of an image pickup device with a function to pickup still pictures during a moving picture pickup operation to execute an interrupt processing to sequentially execute, during a moving picture pickup processing by imaging means, a processing to suspend the moving picture image pickup processing by the imaging means, a processing to pickup a still picture by the imaging means, and a processing to resume the moving picture pickup processing by the imaging means; and a processing to create one moving picture file that includes moving picture frames obtained through the moving picture pickup processing

executed before the still picture pickup processing by the imaging means, and moving picture frames obtained through the moving picture pickup processing resumed after the still picture pickup processing.

Brief Description of Drawings FIG. 1 is a block diagram of a digital camera in accordance with a first embodiment of the present invention.

FIG. 2 is a flowchart of an operation in an image pickup mode of the digital camera.

FIG. 3 is a flowchart continuing from the flowchart in FIG. 2.

FIG. 4 is a flowchart continuing from the flowchart in FIG. 2.

FIG. 5 is a timing chart when a moving picture is picked up by the digital camera.

FIG. 6 is a timing chart when a moving picture is picked up in accordance with a second embodiment of the present invention.

FIG. 7 is a flowchart of an operation in an image pickup mode in accordance with a third embodiment of the present invention.

FIG. 8 is a flowchart continuing from the flowchart in FIG. 7.

FIG. 9 is a flowchart continuing from the flowchart in FIG. 7.

FIG. 10 is a flowchart of an operation in an image

pickup mode in accordance with a fourth embodiment of the present invention.

FIG. 11 is a flowchart continuing from the flowchart in FIG. 10.

Best Mode for Carrying Out the Invention In the following, an embodiment of the present invention will be described with reference to the drawings.

(First Embodiment) FIG. 1 is a block diagram of an overall configuration of a digital camera 1, which has a moving picture pickup function and a moving picture pickup function with voices, in addition to a normal still picture pickup function. The digital camera 1 comprises a CCD 2 and a DSP/CPU 3. The DSP/CPU 3 is a single-chip microcomputer that has various digital signal processing functions, including compression/ decompression of picture data and processing of voice data, and that controls various sections of the digital camera 1.

To the DSP/CPU 3 is connected a TG (time generator) 4 that drives the CCD 2; and to the TG 4 is connected a unit circuit 5, to which is inputted analog imaging signals that are outputted from the CCD 2 and that correspond to optical pictures of subjects. The unit circuit 5 comprises a CDS (Correlated Double Sampling) circuit that performs correlated double

sampling on imaging signals outputted from the CCD 2 and retains them, a gain adjustment amplifier (AGC) that amplifies the imaging signals, and an A/D converter (AD) that converts imaging signals that have been amplified into digital signals ; output signals from the CCD 2 are sent as digital signals to the DSP/CPU 3 via the unit circuit 5.

To the DSP/CPU 3 are connected a display device 6, a key input section 7 and a voice processing section 8, as well as a DRAM 10, a built-in flash memory 11 and a card interface 12 via an address data bus 9; to the. card interface 12 is connected a memory card 13, which is mounted in a freely detachable manner on a slot, not shown, of the main body of the digital camera 1.

The display device 6 includes a color LCD and its drive circuit; the display device 6 displays a subject picture imaged with the CCD 2 as a through picture in an image pickup standby state, while displaying recorded pictures (still pictures or moving pictures) that have been read from the memory card 13, which is a storage memory, and decompressed when reproducing recorded pictures. The key input section 7 includes a plurality of user operation keys such as a shutter button, picture recording start/end buttons used in picking up moving pictures, a power on/off key and a menu key; the key input section 7 outputs to the DSP/CPU 3 key input signals corresponding to key

operations by the user. It is noted that the shutter button is a two-stage switch that outputs different output signals in a half-depressed state and a fully depressed state.

The voice processing section 8 includes a built-in microphone, an amplifier, an A/D converter, a built-in speaker, and a D/A converter; when picking up still pictures or moving pictures with voices, the voice processing section 8 converts voices inputted into the built-in microphone into digital signals and sends them to the DSP/CPU 3. The voice data sent to the DSP/CPU 3 are sequentially accumulated and ultimately recorded in the memory card 13 along with picture data created by the DSP/CPU 3. Furthermore, when still pictures or moving pictures with voices are reproduced, the voice processing section 8 reproduces voices based on voice data appended to each picture and outputs the voices through the built-in speaker. In addition, the voice processing section 8 outputs various notice tones through the built-in speaker as necessary.

The DRAM 10 is a buffer memory that temporarily stores picture data of subjects that have been digitalized after being imaged with the CCD 2, but also functions as a working memory for the DSP/CPU 3. The built-in flash memory 11 stores programs required for various controls, including control programs required for the control of various sections by the DSP/CPU 3,

i. e. , AF (auto focus control) and AE (auto exposure control), as well as data required for various controls; by operating according to such programs, the DSP/CPU 3 functions as a control means, a moving picture file creation means, a timer means, an informing sound control means, and a predetermined operation control means of the present invention.

Next, an operation that takes place in the digital camera 1 having the configuration described above will be described. FIGS. 2 through 4 are flowcharts of a processing procedure by the DSP/CPU 3 when the user sets a specified image pickup mode by operating the menu key.

When the image pickup mode is set, the DSP/CPU 3 begins imaging with the CCD 2 and displays a through picture of a subject on the display device 6 (step S1) ; the DSP/CPU 3 repeats a display processing of the through picture until there is a user operation of the picture recording start button or a half depression of the shutter button (NO in both steps S2 and S3). Then, when the picture recording start button is subsequently operated (YES in step S2), the process shifts to a processing to pickup a moving picture with voices, which begins with step S14 ; when the shutter button is half-depressed (YES in step S3), the processing shifts to a still picture pickup processing shown in steps S4-S13 in FIG. 3.

First, the still picture pickup processing will be described. In response to a half depression operation of the shutter button (YES in step S3), the DSP/CPU 3 sets image pickup conditions through an AF processing and an AE processing (step S4). When this is completed (YES in step S5), the DSP/CPU 3 provides a notice tone through the speaker of the voice processing section 8 and displays a notice such as a message on the display device 6 in order to notify the user that the setting has been completed (step S6), begins imaging with the CCD 2 using the image pickup conditions set, and displays a through picture on the display device 6 (step S7). As long as there is no full depression operation of the shutter button, and the half depression operation of the shutter button continues, the DSP/CPU 3 returns to step S7 and continues to display the through picture (NO in step S8, YES in step S9).

When there is subsequently a full depression operation of the shutter button while the through picture is being displayed (YES in step S8), the DSP/CPU 3 outputs through the speaker of the voice processing section 8 a shutter-like sound stored in advance in the flash memory 11 (step S10), and begins the still picture pickup processing, such as imaging for recording purposes the subject picture with the CCD 2 and creating the picture data of the subject picture

(step S11). More specifically, the CCD 2 is caused to successively output pixel signals of even-numbered lines and pixel signals of odd-numbered lines for one screen in a relatively long output imaging timing, data of all the pixels is transferred into the buffer memory (the DRAM 10), and a processing to compress the picture data transferred is started. Once this is completed (YES in step S12), a still picture file (i. e. , a file in JPEG format) is created based on the compressed picture data and stored in the memory card 13 (step S13). This concludes the still picture pickup processing, and the process returns to step S1. In other words, a still picture is picked up and stored according to a quite common processing, similar to the processing in the normal still picture pickup mode. If the half depression of the shutter button is released while the through picture is being displayed (NO in step S9), the still picture pickup processing is terminated immediately at that point and the process returns to step S1.

Next, a moving picture pickup processing with voices will be described (see FIGS. 2 and 4). When the user operates the picture recording start button while the through picture is being displayed and immediately after the image pickup mode described above is set (YES in step S2), the DSP/CPU 3 begins a moving picture recording processing, in which pictures (moving picture

frames) are picked up in a predetermined frame rate (a fixed cycle of 1/30 seconds) and stored in the buffer memory, and a voice recording processing, in which voices inputted into the built-in microphone of the voice processing section 8 are converted into voice data and stored in the buffer memory (step S14). When picking up the moving picture frames in the moving picture recording processing, the CCD 2 is caused to output pixel signals of only the odd-numbered lines of each screen in a relatively short output timing; the pixel data of the odd-numbered lines is transferred to the buffer memory (the DRAM 10) and a processing to thin out the picture data transferred into a predeter- mined number of pixels is conducted.

Subsequently, the through picture display processing (step S15), the moving picture recording processing and the voice recording processing are continued until the shutter button is half-depressed or the picture recording end button is operated (NO in both steps S16 and S17). When the picture recording end button is operated (YES in step S17), the moving picture data which have been developed in the buffer memory until then, i. e. , a plurality of frame pictures that were imaged cyclically, and voice data are used to create a moving picture file with voices (e. g. , a file in motion-JPEG format), which is stored in the memory card 13 (step S18). This concludes the moving picture

pickup processing with voices for now, and the process returns to step S1. In other words, the moving pictures are recorded using the same processing as the processing in normal moving picture pickup mode with voices. When creating the moving picture file with voices, the voice data is divided in the direction of time axis in units of frames (i. e. , in frame cycles) for filing or packetization, and at the same time synchronized with frame pictures according to timing information in the moving picture file header. Alter- natively, voice files can be created independently from the moving picture files and the two can be correlated and stored.

On the other hand, if the shutter button is half- depressed while the through picture display processing, the moving picture recording processing and the voice recording processing are continuing (YES in step S16), the DSP/CPU 3 executes the following processing.

FIG. 5 is a timing chart of the operation of the digital camera 1 that corresponds to the following processing.

First, the DSP/CPU 3 begins to measure the time elapsed and at the same time resets the value n of a counter for counting the number of pictures picked up to zero (step S19); when the moving picture frame cycle that is current then, i. e. , at the time the shutter<BR> button is half-depressed (i. e. , at the time the AF is

triggered in FIG. 5), ends, the moving picture recording processing that began in step S14 is switched to a processing to repeatedly use frame data obtained immediately before the shutter button is half depressed ("Image Pickup Device Output Frames"in FIG. 5) (step S20).

In other words, the frame data, which are accumulated in the buffer memory in moving picture frame cycles while the still picture pickup processing is performed through an interrupt described later, are switched from frame data obtained through the image pickup operation to a copy of frame data obtained immediately preceding the half depression of the shutter button (hereinafter called'substitute frames"). However, the voice recording processing continues. Subsequently, the still picture pickup processing through an interrupt described in steps S21-S30 in FIG. 4 is executed.

First, an AF processing and an AE processing for picking up a still picture is executed based on image pickup signals outputted from the CCD 2, and image pickup conditions are set (step S21 ;"AF operation"in FIG. 5). Next, once the image pickup conditions are set (YES in step S22), imaging with the CCD 2 begins under the image pickup conditions set and a through picture is displayed, without outputting a notice tone or displaying a notice as in step S6 of the normal

still picture pickup processing (step S23 ;"Still Picture Monitoring Operation"in FIG. 5). The notice display can be performed, however, since it does not affect the voice recording processing. Then, if there is subsequently a full depression operation of the shutter button (YES in step S24), a still picture pickup processing including picking up a subject picture with the CCD 2 for recording purposes and creating the picture data of the subject picture begins as in step S11 described above, but without performing an output processing of the shutter-like sound as in step S10 of the normal still picture pickup processing (step S25 ; "Still Picture Image Pickup Operation"in FIG. 5); when this is finished (YES in step S26), a still picture file (i. e. , a file in JPEG format) is created on the buffer memory based on the picture data, and stored in the memory card 13 (step S27), and the value of the counter indicating the number of pictures picked up is increased by one ("+1") to count up (step 4S31). This concludes the still picture pickup processing using an interrupt.

After the through picture is displayed in step S23 and until the shutter button is fully depressed (NO in step S24), if the half depression operation of the shutter button continues and if the elapsed time that began to be measured in step S19 has not reached a predetermined length of time, the process returns to

step S23 and continues the through picture display processing (YES in step S28, NO in step S29). However, if the half depression operation of the shutter button is released during this time (NO in step S28), the still picture pickup processing through an interrupt is immediately terminated at this point. Further, if the elapsed time being measured reaches the predetermined length of time (e. g. , 10 seconds) (YES in step S29), a message is displayed over the through picture that there will be a forced return to the moving picture recording processing (step S30) and the still picture pickup processing through an interrupt is terminated.

Next, if the shutter button is not half-depressed when the still picture image pickup operation is terminated (NO in step S32), the next moving picture frame cycle is awaited to arrive (a"dummy"period in FIG. 5); when the next moving picture frame cycle arrives (YES in step S34), the normal moving picture recording processing is resumed in a timing that matches the moving picture frame cycle preceding, i. e., synchronized with the moving picture frame cycle preceding (in step S35 ;"Moving Picture Pickup Operation"in FIG. 5). Subsequently, the process returns to step S15 in FIG. 2 described above and continues the through picture display processing, the moving picture recording processing and the voice recording processing until the picture recording end

button is operated (NO in both steps S16 and S17); when the picture recording end button is operated (YES in step S17), the moving picture data, including the substitute frames, and voice data, both of which have been accumulated in the buffer memory until then, are used to create a moving picture file with voices, which is then stored in the memory card 13 (step S18).

This concludes the moving picture pickup processing with voices for now, and the process returns to step S1 and subsequently repeats the same operation until the image pickup mode is released. However, if the shutter button is half-depressed when the still picture pickup operation is concluded in step S27 (YES in step S32), whether the value of the counter indicating the number of pictures taken has reached"3" is determined in the subsequent step S33 ; if the value of the counter has not reached"3,"the process shifts to a preparation processing that begins with step S21 for the still picture pickup processing, without resuming the moving picture recording processing.

On the other hand, if the value of the counter that indicates the number of pictures taken is determined to have reached"3"in step S33, the process shifts to step S30, where a message that there will be a forced return to the moving picture recording processing is displayed over the through picture and the still picture pickup processing through an

interrupt is terminated.

As described above, according to the present embodiment, even when a still picture is recorded by performing a still picture pickup processing through an interrupt during a moving picture pickup operation, the moving pictures picked up are recorded as a single moving picture file as in the normal moving picture pickup operation. As a result, the moving picture file (or a moving picture file with voices) that has been recorded can be reproduced on other cameras or personal computers like ordinary moving picture files. In other words, the moving picture file according to the present embodiment is not onerous in use, nor its usage environment limited.

Furthermore, since a copy of frame data immediately preceding the interruption (substitute frames) is recorded even in a period during which the moving picture frame pickup operation is interrupted by the still picture pickup processing, and since the normal moving picture pickup processing is resumed in synchronization with the moving picture frame cycle preceding when the still picture pickup processing through an interrupt is finished, the reproduction time of the moving pictures recorded can be perfectly matched to the actual image pickup time, which makes it easy to use. In particular, a more natural moving picture can be recorded when the interrupted time for a

still picture image pickup operation is short.

In addition, since the voice recording processing continues even while the moving picture frame pickup operation is interrupted, when the moving pictures picked up are reproduced, actual voices can be heard in periods during which substitute frames are reproduced.

Consequently, more natural moving pictures with voices can be picked up. Furthermore, due to the fact that outputs of notice tones or shutter-like sounds that are outputted in normal still picture pickup processing are prohibited in still picture pickup processing through an interrupt, the notice tones and shutter-like sounds would not be mixed in the recorded voices. As a result, moving pictures with high-quality voices can be recorded.

In the event the predetermined length of time has elapsed or the predetermined number of still pictures has been picked up from the time the moving picture pickup processing was suspended to the time the moving picture pickup processing was resumed, a forced return to the moving picture pickup processing is performed with a display of a message to that effect; consequently, the time the moving picture frame pickup operation (the moving picture pickup processing) is interrupted can be prevented with certainty from lengthening. As a result, even if the moving picture pickup operation is temporarily interrupted by the

still picture pickup operation, more natural moving pictures with voices can be recorded, in which a substitute frame insert period, i. e. a period during which a picture is suspended at some point in the moving pictures, is not long and the user is hardly aware of it.

Although according to the present embodiment, the process is forcibly returned to the normal moving picture pickup processing with a message display when the predetermined length of time has elapsed or when the image pickup operation of a predetermined number of still pictures has been completed (steps S29, S30, S33, S34 and S35 in FIG. 4), a message display (or a notice tone such as an alarm) can be performed by itself to urge the user to perform a still picture pickup operation or an operation to return to the moving picture pickup operation, or the moving picture pickup processing can be resumed without any message displays.

Alternatively, a message can be displayed first, followed by a forced return to the normal moving picture pickup processing when a certain length of time has elapsed.

Moreover, when a still picture pickup operation is performed during a moving picture pickup operation and if the shutter button is half-depressed at the end of the still picture pickup operation (YES in step S32, NO in step S33), the still picture pickup operation is

repeated (i. e. , performed consecutively) without resuming the moving picture pickup processing; this further contributes to the ease of use.

Although, in the present embodiment, the present invention is applied to a mode of picking up moving pictures with voices, the present invention can also be applied to a mode of picking up moving picture without voices, as in a second embodiment to be described below.

(Second Embodiment) Next, a second embodiment of the present invention is described. The present embodiment relates to a situation in which the present invention is applied to picking up a moving picture without voices.

Below, referring to a timing chart in FIG. 6, an operation in a moving picture pickup mode of a digital camera having the same configuration as that shown in FIG. 1 will be described. In the present embodiment, there is provided a moving picture pickup mode, in which still picture pickup operations can be performed consecutively only twice in one interrupt processing during a moving picture pickup operation, and a program required for this operation is stored in a built-in flash memory 11.

When the user presses a predetermined button of a key input section 7 during a moving picture pickup processing, a digital camera 1 considers it a moving

picture/still picture common trigger and switches from the (normal) moving picture pickup processing that had been taking place up to that point to a processing to repeatedly use frame data immediately preceding ("Image Pickup Device Output Frames"in FIG. 6); subsequently, substitute frames, which are a copy of moving picture frame data immediately preceding the pressing of the predetermined button, are accumulated in moving picture frame cycles in a buffer memory. Then, the process shifts to a still picture pickup mode through an interrupt, where a still picture monitoring operation is performed and a through picture is displayed on a display device 6.

If there is subsequently a half depression of the shutter button in this state, it is determined as an AF trigger that leads to an AF processing and an AE processing for the still picture pickup operation ("AF operation"in FIG. 6); if there is subsequently a full depression operation of the shutter button, it is determined as a shutter trigger that leads to a normal still picture pickup processing, in which a still picture file is created in the buffer memory and stored in a memory card 13. Also, at this point, moving picture frame data is created from the still picture data in the buffer memory, and a processing to use the moving picture frame data obtained immediately preceding the suspension of the moving picture pickup

processing is switched to a processing to use the frame data created as the new substitute frames. Next, the still picture monitoring operation is resumed; after the second still picture pickup operation using the same procedure is performed, the still picture pickup processing through one interrupt is ended.

When the still picture pickup processing through an interrupt is ended, the arrival of the moving picture pickup frame cycle is awaited (a"dummy"period in FIG. 6) and the normal moving picture pickup processing is resumed when it arrives. However, instead of waiting for new moving picture frames to be obtained through the moving picture pickup operations by a CCD 2 to use as moving picture frames immediately following the resumption, frame data created from the picture data in the buffer memory that was obtained in the second still picture pickup operation is used.

After the normal moving picture pickup processing is resumed and when the picture recording end button is pressed, frame data that contain the two types of substitute frames and that are accumulated in the buffer memory up to that point are used to create a moving picture file, which is stored in the memory card 13.

As a result, even if still pictures are recorded by performing a still picture pickup processing through an interrupt during a moving picture pickup operation,

the moving pictures picked up are recorded as a single moving picture file as in normal moving picture pickup operation, also according to the present embodiment.

Consequently, the moving picture file (i. e. , a moving picture file without voices) that has been recorded can be reproduced on other cameras or personal computers like normal moving picture files. Therefore, an effect similar to the effect in the first embodiment can be obtained.

In accordance with the present embodiment, unlike the first embodiment, the substitute frames, which are stored in a period during which the moving picture frame pickup operation is interrupted by the still picture pickup processing, consist of a copy of frame data obtained immediately preceding the interruption of the moving picture frame pickup operation before the still picture pickup processing is ended, and of frame data created from the still pictures picked up after the still picture pickup operation is ended. Even in this case, the reproduction time of the moving pictures recorded can be perfectly matched to the actual photographing time, which makes it easy to use. In particular, this makes it possible to record more natural moving pictures when the interrupted time for the still picture photographing is short. Alter- natively, substitute frames used in the period during which the moving picture pickup processing is

interrupted can consist only of substitute frames created from still picture data obtained through the still picture pickup processing, or consist only of moving picture frame data obtained immediately preceding the suspension of the moving picture pickup processing.

The present embodiment indicates a situation in which a moving picture pickup mode, which allows still picture pickup operations consecutively only twice in one interrupt processing during a moving picture pickup operation, is provided. However, frame data that contain two types of substitute frames as in the present embodiment can be used to create a moving picture file, which is then stored, even in a mode in which still picture pickup operations can be performed consecutively unlimited number of times in one interrupt processing, as in the first embodiment. In such a case, even if the period during which the moving picture frame pickup operation is interrupted is long, because a plurality of still picture pickup operations take place consecutively in one interrupt processing during a moving picture pickup operation, the movement of the subject can be expressed using a plurality of types of substitute frames, which have different contents created from still pictures, when the moving pictures picked up are reproduced. As a result, even more natural moving pictures can be recorded.

Furthermore, also in the present embodiment, if the predetermined length of time has elapsed after shifting to the still picture pickup processing through an interrupt and before resuming the normal moving picture pickup processing, a forced return to the normal moving picture pickup processing can be performed along with a message to that effect.

(Third Embodiment) Next, a third embodiment of the present invention will be described. The present embodiment relates to a situation in which the present invention is applied to a digital camera having a consecutive picture pickup function.

The following is a description of an operation in a predetermined image pickup mode of a digital camera having the same configuration as the one shown in FIG. 1. In the present embodiment, there is provided a moving picture pickup mode, in which consecutive pictures can be picked up in one interrupt processing during a moving picture pickup operation, and a program required for this operation is stored in a built-in flash memory 11.

FIGS. 7 through 9 are flowcharts of a processing procedure by a DSP/CPU 3 that takes place when a user operates a menu key and sets a predetermined image pickup mode.

When the image pickup mode is set, the DSP/CPU 3

begins picking up pictures with a CCD 2 and displays a through picture of a subject on a display device 6 (step Al) ; and repeats a display processing of the through picture until there is a user operation of a picture recording start button or a half depression of the shutter button (NO in both steps A2 and A3). When the picture recording start button is subsequently operated (YES in step A2), the process shifts to a moving picture with voices pickup processing that begins with step All ; when the shutter button is fully depressed (YES in step A3), the process shifts to a still picture pickup processing shown in steps A4-A10 in FIG. 8.

The still picture pickup processing will be described. In response to the full depression of the shutter button (YES in step A3), the DSP/CPU 3 first resets the value of a counter for counting the number of pictures to zero (step A4), then begins the still picture pickup processing, such as imaging for recording purposes the subject picture with the CCD 2 and creating the picture data of the subject picture (step A5). More specifically, the CCD 2 is caused to alternately output pixel signals of even-numbered lines and pixel signals of odd-numbered lines for one screen in a relatively long output imaging timing, data of all pixels is transferred to a buffer memory (a DRAM 10), and a processing to compress the picture data

transferred is started. Once this is completed (YES in step. A6), a still picture file (e. g. , a file in JPEG format) is created based on the compressed picture data, and stored in the memory card 13 (step A7).

After the still picture pickup processing is concluded, the value of the counter indicating the number of pictures picked up is increased by one ("+1") to count up (step A8), and a determination is made in a succeeding step A9 as to whether the counter value indicating the number of pictures has reached"10," i. e. , whether the number of consecutive pictures has reached 10. If it is determined that the counter value has reached"10,"a forced ending of the consecutive picture pickup processing is immediately performed at that point and the process returns to the through picture display processing in step Al.

If it is determined in step A9 that the counter value has not reached 10, the process proceeds to step A10 and a determination is made as to whether or not the full depression of the shutter button is continuing; if it is determined that the full depression of the shutter button has been released (NO in step A10), the consecutive picture pickup processing is immediately ended at that point and the process returns to the through picture display processing in step Al.

On the other hand, if it is determined in step A10

that the full depression of the shutter button is continuing (YES in step A10), the process returns to step A5 and begins the still picture pickup processing; the consecutive picture pickup processing is continued by repeating the processing in steps A5-A8 until it is determined in step A9 that the counter value has reached"10"or until it is determined in step A10 that the full depression of the shutter button has been released. However, if the time between the time the shutter button is fully depressed and the time the full depression is released is extremely short, the still picture pickup processing is executed only once (i. e., a single picture pickup processing), instead of consecutive picture pickup processing.

Next, a moving picture pickup processing with voices (see FIGS. 7 and 9) will be described. When the user operates the picture recording start button while the through picture is being displayed and immediately after the image pickup mode is set (YES in step A2), the DSP/CPU 3 begins a moving picture recording processing, in which pictures (moving picture frames) are imaged at a predetermined frame rate (a fixed cycle of 1/30 seconds) and stored in the buffer memory, and a voice recording processing, in which voices inputted into a built-in microphone of an voice processing section 8 is converted into voice data and stored in the buffer memory (step A11). To pickup the moving

picture frames in the moving picture recording processing, the CCD 2 is caused to output pixel signals of only the odd-numbered lines of each screen in a relatively short output timing; the pixel data of the odd-numbered lines is transferred to the buffer memory (the DRAM 10), and a processing to thin out the transferred picture data into a predetermined number of pixels is performed.

Subsequently, the DSP/CPU 3 continues the through picture display processing (step A12), the moving picture recording processing and the voice recording processing, until the shutter button is fully depressed or the picture recording end button is operated (NO in both steps A13 and A14). When the picture recording end button is operated (YES in step A14), the DSP/CPU 3 uses the moving picture data, i. e. , a plurality of frame pictures that were picked up cyclically, which have been developed on the buffer memory until then, and voice data, to create a moving picture file with voices (e. g. , a file in motion-JPEG format), and stores it in the memory card 13 (step A15). This concludes the moving picture pickup processing with voices for now, and the process returns to step Al. In other words, the moving picture is recorded using the same processing as the processing in a normal moving picture pickup mode with voices. When creating the moving picture file with voices, the voice data is divided in

the direction of time axis in units of frames (i. e. , in frame cycles) for filing or packetization, and at the same time the voice data is synchronized with frame pictures according to timing information in the moving picture file header. Alternatively, voice files can be created independently from the moving picture files and the two can be correlated and stored.

On the other hand, if the shutter button is fully depressed while the through picture display processing, the moving picture recording processing and the voice recording processing are continuing (YES in step A13), the DSP/CPU 3 executes the following processing.

First, the DSP/CPU 3 begins to measure the time elapsed and at the same time resets the value n of the counter for counting the number of pictures to zero (step A16); when the moving picture frame cycle that is current then, i. e. , at the time the shutter button is fully depressed, ends, the DSP/CPU 3 switches from the moving picture recording processing that began in step All to a processing to repeatedly use frame data obtained immediately preceding the full depression of the shutter button (step A17). In other words, the frame data, which are accumulated in the buffer memory in moving picture frame cycles while the still picture pickup processing through an interrupt (i. e., consecutive picture pickup processing) to be described below is performed, are switched from frame data

obtained through the image pickup operation to a copy of frame data obtained immediately preceding the full depression of the shutter button (hereinafter called "substitute frames"). However, the voice recording processing continues. Subsequently, the still picture pickup processing through an interrupt (i. e. , the consecutive picture pickup processing) described in steps A18-A27 in FIG. 9 is executed.

First, as in step A5 described above, the still picture pickup processing such as imaging a subject picture for recording purposes with the CCD 2 is started and the picture data of the subject picture (step A18) is created ; when this is finished (YES in step A19), a still picture file (e. g. , a file in JPEG format) is created on the buffer memory based on the picture data and stored in the memory card 13 (step A20), and the value of the counter indicating the number of photographs is increased by one ("+1") to count up (step A21). In the next step A22, a determination is made as to whether or not the counter value indicating the number of pictures picked up has reached"3,"i. e. , whether or not the number of consecutive pictures has reached 3; if it is determined that the counter value has reached"3,"a message is displayed over the through picture, indicating that there will be a forced return to the moving picture recording processing (step A23), and the consecutive

picture pickup processing through an interrupt processing is ended. The maximum number of consecutive pictures in the consecutive picture pickup processing through an interrupt processing is set to three pictures, which is less than the maximum 10 consecutive pictures in the normal consecutive picture pickup processing, in order to shorten the length of interrupted time in the moving picture pickup processing as much as possible.

On the other hand, if it is determined in step A22 that the number of consecutive pictures has not reached "3,"the process proceeds to step A24, where a determination is made as to whether or not the elapsed time whose measurement began in step A16 has reached the predetermined length of time. If it is determined that the elapsed time has reached the predetermined length of time (for example, 10 seconds) (YES in step A24), a message is displayed over the through picture indicating that there will be a forced return to the moving picture recording processing (step A23) and the consecutive picture pickup processing through an interrupt processing is ended.

If it is determined in step A24 that the elapsed time has not reached the predetermined length of time, the process proceeds to step A25, where it is determined whether not the full depression operation of the shutter button is continuing; if it is determined

that the full depression of the shutter button has been released (NO in step A25), the consecutive picture pickup processing through an interrupt processing is immediately terminated at that point.

If it is determined in step A25 that the full depression operation of the shutter button is continuing (YES in step A25), the process returns to step A18 and begins the still picture pickup processing ; subsequently, the consecutive picture pickup processing is continued by repeating the processing in steps A18-A21 until it is determined in step A22 that the counter value has reached"3,"it is determined in step A24 that the elapsed time has reached the predetermined length of time, or it is determined in step A25 that the full depression of the shutter button has been released. However, if the time between the time the shutter button is fully depressed and the time the full depression is released is extremely short, the still picture pickup processing is executed only once (i. e. , a single pickup processing) instead of consecutive picture pickup processing.

If it is determined in step A22 that the counter value has reached"3,"or if it is determined in step A24 that the elapsed time has reached the predetermined length of time, or if it is determined in step A25 that the full depression of the shutter button has been released, the process proceeds to step A26 and waits

for the next moving picture frame cycle to arrive; when the next moving picture frame cycle arrives (YES in step A26), the normal moving picture recording processing is resumed in a timing that matches the moving picture frame cycle preceding, i. e., synchronized with the moving picture frame cycle preceding (step A27). Subsequently, the process returns to step A12 in FIG. 7 and continues the through picture display processing, the moving picture recording processing and the voice recording processing until the picture recording end button is operated (NO in both steps A13 and A14); when the picture recording end button is operated (YES in step A14), a moving picture file with voices is created, using the moving picture data, including the substitute frames, and voice data, both of which have been accumulated in the buffer memory until then, and stores the same in the memory card 13 (step A15).

This concludes the moving picture pickup processing with voices for now and the process returns to step Al and subsequently repeats the same operation until the image pickup mode is released.

As described above, in accordance with the present embodiment, since the still picture pickup processings can be consecutively executed, i. e. , since the consecutive picture pickup processing can be executed, by continuing the full depression operation of the

shutter button, an effect of drastically shortening the interrupted time during a moving picture pickup processing can be obtained, when the user wants to perform a plurality of still picture pickup operations through an interrupt processing.

(Fourth Embodiment) Next, a fourth embodiment of the present invention will be described. According to the present embodiment, a moving picture pickup processing continues even after AF and AE processing are started with a half depression operation of a shutter button, and the moving picture pickup processing is suspended when an operation to pickup a still picture is instructed with a full depression operation of the shutter button.

The following is a description of an operation in a predetermined image pickup mode of a digital camera having the same configuration as the one shown in FIG. 1.

FIGS. 10 and 11 are a flowchart of a processing procedure by a DSP/CPU 3 that takes place when the user operates a menu key and sets a predetermined image pickup mode.

When the image pickup mode is set, the DSP/CPU 3 begins imaging with a CCD 2 and displays a through picture of a subject on a display device 6 (step B1) ; and repeats a display processing of the through picture

until there is an operation of a picture recording start button or a half depression operation of a shutter button (NO in both steps B2 and B3). When the picture recording start button is subsequently operated (YES in step B2), the process shifts to a moving picture pickup processing with voices that begins with step B4; when the shutter button (YES in step B3) is half-depressed, the process shifts to a still picture pickup processing shown in steps S4-S13 in FIG. 3.

When the user operates the picture recording start button while the through picture is being displayed and immediately after the image pickup mode is set (YES in step B2), the DSP/CPU 3 begins a moving picture recording processing, in which pictures (moving picture frames) are picked up at a predetermined frame rate (a fixed cycle of 1/30 seconds) and stored in a buffer memory, and a voice recording processing, in which voices inputted into a built-in microphone of an voice processing section 8 is converted into voice data and stored in the buffer memory (step B4). To pickup the moving picture frames in the moving picture recording processing, the CCD 2 is caused to output pixel signals of only the odd-numbered lines of each screen in a relatively short output timing ; the pixel data of the odd-numbered lines is transferred into the buffer memory (a DRAM 10) and a processing to thin out the picture data transferred into a predetermined number of

pixels is performed.

Subsequently, the DSP/CPU 3 continues the through picture display processing (step B5), the moving picture recording processing and the voice recording processing until the shutter button is half-depressed or the picture recording end button is operated by the user (NO in both steps B6 and B7). When the picture recording end button is operated (YES in step B7), a moving picture file with voices (i. e. , a file in motion-JPEG format) is created, using the moving picture data, i. e. , a plurality of frame pictures that were picked up cyclically, and voice data, both of which have been developed in the buffer memory until then, and stored in a memory card 13 (step B8). This concludes the moving picture pickup processing with voices for now, and the process returns to step B1. In other words, the moving picture is recorded using the same processing as the processing in the normal moving picture image pickup mode with voices. When the moving picture file with voices is created, the voice data is divided in the direction of time axis in units of frames (i. e. , in frame cycles) for filing or packetization, and at the same time the voice data is synchronized with frame pictures according to timing information in the moving picture file header.

Alternatively, voice files can be created independently from the moving picture files and the two can be

correlated and stored.

On the other hand, if there is a half-depression operation of the shutter button while the through picture display processing, the moving picture recording processing and the voice recording processing are continuing (YES in step B6), the DSP/CPU 3 shifts the process to step B9 in FIG. 11 without suspending the through picture display processing, the moving picture pickup processing and the voice recording processing, and executes the following processing.

First, the DSP/CPU 3 executes an AF processing and an AE processing for a still picture pickup operation based on imaging signals outputted from the CCD 2 and sets image pickup conditions (step B9). Next, once setting of the image pickup conditions (YES in step B10) is completed, the DSP/CPU 3 begins imaging with the CCD 2 under the image pickup conditions set and displays a through picture, without sounding a notice tone or displaying a notice as in step S6 of the normal still picture pickup processing (step B11). The notice display may be performed, however, since it does not affect the voice recording processing. As long as there is no full depression operation of the shutter button and the half depression operation of the shutter button continues, the process returns to step B11 and continues the through picture display processing (NO in step B12, YES in step B13). When it is determined in

step B13 that the half depression operation of the shutter button has been released, the process returns to step B5 in FIG. 10 and continues the through picture display processing, the moving picture recording processing and the voice recording processing until the picture recording end button is operated.

If there is a full depression operation of the shutter button while the through picture is being displayed (YES in step B12), when the moving picture frame cycle that is current then, i. e. , at the time the shutter button is fully depressed, ends, the moving picture recording processing that began in step B4 is switched to a processing to repeatedly use frame data obtained immediately preceding the full depression of the shutter button, without performing a processing to output a shutter-like sound in step S10 in the normal still picture pickup processing (step B14). In other words, the frame data, which are accumulated in the buffer memory in moving picture frame cycles while the still picture pickup processing through an interrupt to be described later is performed, are switched from frame data obtained through imaging to a copy of frame data obtained immediately preceding the full depression of the shutter button (hereinafter called"substitute frames"). However, the voice recording processing continues. Subsequently, as in step S11 described above, the DSP/CPU 3 begins the still picture pickup

processing, such as imaging for recording purposes the subject picture with the CCD 2 and creating the picture data of the subject picture, (step B15); when this is finished (YES in step B16), the DSP/CPU 3 creates in the buffer memory a still picture file (i. e. , a file in JPEG format) based on the picture data and stores it in the memory card 13 (step B17). This concludes the still picture pickup processing through an interrupt.

Next, the process waits for the next moving picture frame cycle to arrive; when the next moving picture frame cycle arrives (YES in step B18), the normal moving picture recording processing (the moving picture pickup processing) is resumed in a timing that matches the moving picture frame cycle preceding, i. e., synchronized with the moving picture frame cycle preceding (step B19).

If the shutter button is half-depressed when the moving picture recording processing is resumed in step B19 (YES in step B20), the process returns to step B9 to execute the AF and AE processing and repeats the processing in steps B9-B20 described earlier.

If it is determined in step B20 that the shutter button has not been half-depressed, the process returns to step B5 in FIG. 10 and continues the through picture display processing, the moving picture recording processing and the voice recording processing until the picture recording end button is operated (NO in both

steps B6 and B7); when the picture recording end button is operated (YES in step B7), a moving picture file with voices is created, using the moving picture data, including the substitute frames, and voice data, both of which have been accumulated in the buffer memory until then, and stored in the memory card 13 (step B8).

This concludes the moving picture pickup processing with voices for now, and the process returns to step B1 and subsequently repeats the same operation until the image pickup mode is released.

As described above, according to the present embodiment, due to the fact that the moving picture pickup processing can be continued without being suspended even after the AF and AE processing are executed through a half depression operation of the shutter button and until imaging of a still picture is instructed through a full depression operation of the shutter button, the interrupted time in the moving picture pickup processing can be drastically shortened.

Although the present embodiment is configured such that the AF and AE processing are executed when the shutter button is half-depressed during a moving picture pickup operation, and a still picture pickup processing through an interrupt is executed when the shutter button is subsequently fully depressed, the configuration may be such that the half depression operation of the shutter button (i. e. , the AF trigger)

is not detected and only the full depression operation thereof (i. e. , the shutter trigger) is detected to execute the AF and AE processing and the still picture pickup processing simply when the shutter button is pressed during the moving picture pickup operation.

Furthermore, in the first through fourth embodiments, frame data immediately preceding a shift to a still picture pickup operation or frame data (substitute frames) obtained from the still picture pickup operation are repeatedly used (i. e. , copied) in moving picture pickup frame cycles in order to continue recording moving picture data in the buffer memory while a moving picture pickup processing is suspended.

However, the processing related to the moving picture pickup operation may be completely suspended while the moving picture pickup processing is suspended, and the substitute frames can be inserted after the moving picture pickup operation is ended into parts where the moving picture pickup processing was suspended.

In addition, although in the first through fourth embodiments, substitute frames are inserted into missing parts resulting from the interruption of the moving picture pickup operation, moving picture data before and after a still picture pickup processing can be directly connected to each other instead of inserting the substitute frames in between in order to create one moving picture file.

In the first through fourth embodiments, frame data immediately preceding the suspension of the moving picture pickup processing or substitute frames obtained from the still picture pickup operation are inserted into missing parts of moving picture data. Instead, however, frame data immediately following the resumption of the moving picture pickup processing can be inserted into the missing parts, or frame data created by composting a plurality of frame data in a predetermined ratio can be inserted into missing parts of moving picture data, or frame data to be inserted into missing parts can be changed in stages with other different frame data.

In the first through fourth embodiments, a dummy period is provided to delay the timing to resume the moving picture pickup processing in order to synchronize the timing to resume the moving picture pickup processing with moving picture pickup cycle; however, a moving picture pickup processing can be started without delay and immediately after ending a still picture pickup processing.

Although the present invention is applied to an electronic still camera with moving picture pickup function in the first through fourth embodiments, the present invention can also be applied to a movie camera with still picture pickup function, a portable telephone with camera, a PDA with camera or a personal computer with camera ; in other words, the present invention can be applied to any equipment as long as it has both a moving picture pickup function and a still picture pickup function.