DISPLAY DEVICE, IMAGE DISPLAY SYSTEM AND CONTROL PROGRAM

FOR IMAGE DISPLAY SYSTEM TECHNICAL FIELD

|1| The present invention relates to a display device on which a list of images which are based on medical data of a patient is displayed, an image display system and a control program for image display system,

BACKGROUND ART

[2] A display device which is connected with a server over a network and displays images which are based on medical data stored in this server is described, for example, in Patent

Document 1.

PI The medical data which is stored in the aforementioned server is data on medical use images such as, for example, X~ray CT images which have been imaged by an X-ray CT

(Computed Tomography) device, MRI images which have been imaged by an MRI (Magnetic Resonance Imaging) device and so forth. Other than the above, the one that a paper document which is used in a hospital such as a patient referral document or the like has been scanned and data-organized and others are also included in the aforementioned medical data.

[4] Prior Art Document: Japanese Patent Application Laid-Qpen No. 2010- 182018

SUMMARY OF THE INVENTION

Problems to be Solved by the Invention

[5J Incidentally, there are cases when enormous medical use images and documents are prepared and data thereof is saved for a patient who visits in hospital. In a case where a diagnosis is to be made, it is necessary for an operator to find out related medical use images and documents from within them in accordance with object. Thus, the inventors of the present patent application propose a display device for displaying a list that medical use images and documents are arranged in a matrix so as to make it possible to effectively find out required medical use images and documents. In this list, thumbnails of medical use images and documents of even date are arranged, for example, in a row direction (a lateral direction) and th umbnails of the same kind of documents are arranged in a column direction (a longitudinal direction).

[6] incidentally, when the number of medical use images and documents is large, there are cases when all the thumbnails cannot be displayed on one screen, in this case, the operator will move the screen to confirm necessary thumbnails.

[7J Accordingly, it was necessary for the operator to move the screen, in order to confirm whether tiiumbnails are present in an area which is not displayed on the screen, and it was troublesome.

Means for Solving the Problem

|S] The invention of one viewpoint which has been made in order to solve the aforementioned problem is a display device and an image display system characterized by including a display unit on which a list that images which are based on medical data are arranged in a matrix is partially displayed, the display unit on which an indicator indicating

presence/absence of images which are nor displayed on the aforementioned display unit, and indicating presence/absence of the aforementioned images on at least one of the upper side, the lower side, the right side and the left side of a displayed part of the aforementioned list in the images configuring the aforementioned list.

Advantage of the invention

[9] According to the invention of the aforementioned viewpoint, since the indicator indi cating presence/absence of the images which are not displayed on the aforementioned display unit, and indicating presence/absence of the aforementioned images on at least one of the upper side, the lower side, the right side and the left side of the displayed part of the aforementioned list is displayed, whether there exist the images which are not displayed on the aforementioned display unit can be grasped without moving the screen.

BRIEF DESCRIPTION OF THE DRAWINGS

[1©] Figure 1 is a block diagram of an image display system pertaining to an embodiment.

[Ill Figure 2 is a diagram showing a display screen of a display unit on which a list is displayed.

[12] Figure 3 is flowchart showing an operation of the image display system. f 13] Figure 4 is a diagram explaining counting of simple images by a counting unit.

[14] Figure 5 is a diagram explaining a dragging operation.

j 151 Figure 6 is a diagram showing the display screen of the display unit on which the list is displayed and the diagram showing a state that a displayed part of the list has been moved downward from the state shown in Fig. 2 and Fig. 5.

[16] Figure 7 is diagram showing the display screen of the display unit on which the list is displayed and the diagram showing a state that the displayed part of the list has been moved further in a downward direction from the state shown in Fig. 6.

[17] Figure 8 is a diagram showing the display screen of the display unit on which the list is displayed.

[18] Figure 9 is a diagram showing the display screen of the display unit on which the list is displayed and the diagram showing a state that tlie displayed part of the list has been moved in a rightward direction from tlie state shown in Fig, 8.

[19] Figure 10 is a diagram showing the display screen of the display unit on which the list is displayed and the diagram showing a state that tlie displayed part of tlie list has been moved further in the rightward direction from the state shown in Fig. 9.

[20] Figure 1 1 is a diagram explaining a numerical value displaying method.

[21] Figure 12 is a diagram showing a state that a display area has been moved downward from the state shown in Fig. 1 1.

[22] Figure 13 is a diagram showing a state that tl e display area has been moved rightward from tlie state shown in Fig. 11.

[23] Figure 14 is a diagram showmg a state that the display area has been moved downward from the state shown in Fig. 1 1 in a first modified example,

[24] Figure 15 is a diagram showing a state that the display area has been moved rightward from the state shown in Fig. 11 in the first modified example.

[25] Figure 16 is a diagram showing a display screen of a display unit when an indicator has been clicked in a second modified example.

[26] Figure 17 is a diagram explaining movement of the display area when tl e indicator has been clicked.

[27] Figure i 8 is a diagram explaining movement of the display area when the indicator has been clicked and the diagram showing a state that the display area has been moved from the state shown in Fig. 17.

[28] Figure 19 is a diagram explaining movement of the display area when the indicator has been clicked and the diagram showing a state that the display area has been moved from the state shown in Fig. 17.

[29] Figure 20 is a diagram showing a display screen of a display unit on which a list is displayed in a third modified example.

[301 Figure 21 is a diagram explaining a numerical value displaying method in the third modified example.

[31] Figure 22 is a diagram explaining the numerical value displaying method in the third modified example.

[32] Figure 23 is a diagram explaining the numerical value displaying method in the third modified example,

[33] Figure 24 is a diagram showing a display screen on which an indicator is displayed in a fourth modified example.

[34] Figure 25 is a diagram showing the display screen on which another example of the indicator is displayed.

[35J Figure 26 is a block diagram showing another example of the image display system pertaining to the embodiment.

EMBODIMENTS OF THE INVENTION

[36] In the following, embodiments of the present invention will be described in detail on the basis of the drawings. An image display system 1 shown in Fig. 1 has a server 2 and a display terminal 3 which are connected together over a network N. A plurality of department systems 4 are connected to the aforementioned server 2 over the network N. The

aforementioned image display system 1 is one example of an embodiment of an image display system pertaining to the present invention. In addition, the aforementioned display terminal 3 is an example of an embodiment of a display device pertaining to the present invention.

[37] The aforementioned server 2 has a storage unit 21 , a list preparation unit 22, a counting unit 23 and a data output unit 24, The aforementioned storage unit 21 is, for example, an HDD (Hard Disk Drive) or the like. Medical data or the like which has been input from each of the aforementioned department systems 4 into the aforementioned server 2 over the aforementioned network N is stored in the aforementioned storage unit 21. The aforementioned server 21 is one example of an embodiment of a server in the present invention, and the aforementioned storage unit 21 is one example of an embodiment of a storage unit in the present invention.

|38] The medical data which is stored in the aforementioned storage unit 2 ί is data on a patient which is prepared by a health care providing facility, a test facility that in vitro medical tests are made or the like, and is medical use image data, document data, numerical value data and so forth. The medical use image data is data which has been acquired by a modality or the like of the aforementioned department system 4, and is image data such as, for example, X-ray CT images, Ri images, ultrasound images and so forth. The document data is data on such as, for example, medical image interpretation reports, patient referral documents, consent forms such as a surgery consent form, a test consent form and so forth, medical questionnaires, written applications, test results and so forth. In the document data, PDF (Portable Document Format) data or the like which has been data-organized by scanning paper documents is also included. In addition, the numerical value data is data on numerical values pertaining to a patient, for example, data on numerical values indicating a resul of a test such as, for example, a blood test or the like, [39] in the aforementioned medical data, data on progress note of bio-information of the patient such as an electrocardiogram or the like and on other records relating to the patient are also included, in addition to the aforementioned medical use image data, the aforementioned document data and the aforementioned numerical value data which have been listed hereinabove.

|40] The medical use data includes metadata in addition to the data body. The metadata is constituted of incidental information of a plurality of attributes such as, for example, the name of the patient, a date, a document kind, document classification, an ordering provider department and so forth. Here, the term "incidental information" means the definite name, date, document kind, document classification and ordering provider department, and the attributes mean attributes of these pieces of incidental information. For example, the incidental information of the attribute called "Document Kind" is "CP', "MRi" and so forth. The incidental information of the attribute called "Ordering Provider Department" is "Radiography Department", "Cardiology Department" and so forth. The metadata is a concept which includes the attribute information (for example, the information called "Document Kind") and the concrete information on that attribute (that is, the incidental information, for example, the information called "CT").

[41] The one which is automatically imparted in the aforementioned department system 4 such as, for example, the modality or the like of the X-ray CT device or the like, and the one which is imparted by inputting from the operator are included in the aforementioned metadata.

[42] The date in the metadata is, for example, a medical data preparation day. Not only the day but also a year, a time and so forth may be included in the date in the metadata. For medical image data, an imaging day may be the preparation day. In addition, for document data, a day that a document has been prepared may be the preparation day or a day that the document has been scanned and data-organized may be the preparation day.

[431 The document kind in the aforementioned metadata is information indicating the kind of maiical data, for example, information indicting the kind of medical use images such as MRI (Magnetic Resonance Imaging) one, US (Ultrasound) ones and so forth and the kind of documents such as a hospitalization consent form, a hospitalization written application, a hospitalization questionnaire, a test consent form, a surgery consent form and so forth. In addition, the document classification in the metadata is information indicating the superordinate concept of the document kind such as, for example, the consent forms and so forth.

[44] In addition, the ordering provider department in the aforementioned metadata is information indicating the department that the preparation of the medical data has been ordered such as, for example, the department of radiology, the department of cardiology and so forth.

[45] The attributes in the aforementioned metadata may be determined in advance. In addition, even when they are determined in advance, the attributes may be made to be added and deleted.

{46] The aforementioned list preparation unit 22 prepares (a list preparation function) data for a list X of the simple images M of the same patient which is based on the medical data stored in the aforementioned storage unit 21. As described later, the aforementioned list X is displayed on the aforementioned display terminal 3 (see Fig. 2). The aforementioned list preparation unit 22 is one example of an embodiment of a list preparation unit in the present invention, in addition, the list preparation function is one example of an embodiment of a list preparation function in the present invention.

[47J The aforementioned counting unit 23 counts the simple images M in the row direction and the column direction of the aforementioned list X to obtain numerical value data for making a numerical value n which mdicates die number of single images M which are not displayai on the aforementioned display terminal 3 to be displayai. Details will be described later. The aforementioned counting unit 23 is one example of an embodiment of a counting unit in the present invention.

|48J The aforementioned data output unit 24 outputs the data for the list X prepared by the aforementioned list preparation unit 22 to the aforementioned display terminal 3 in accordance with a request from the aforementioned display terminal 3.

|49] Although in Fig. 1 , the aforementioned list preparation unit 22, the aforementioned counting unit 23 and the aforementioned data output unit 24 are disposed in the same server as that of the storage unit 21 that the aforementioned medical data is stored, the aforementioned list preparation unit 22, the aforementioned iunting unit 23 and the aforementioned data output unit 24 may be disposed in a server different from that of the aforementioned storage unit 21.

{50 j The aforementioned display terminal 3 is, for example, a mainframe personal computer. In addition, the aforemen ioned display terminal 3 may be a tablet-type computer. The aforementioned display terminal 3 has a display unit 31 , a control unit 32, an input unit 33 arid a storage unit 34.

[511 The aforementioned display unit 31 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) or the like. The aforementioned display unit 31 is one example of an embodiment of a display unit in the present invention.

[52] The aforementioned control unit 32 has a data request unit 321 and a display control unit 322. The aforementioned data request unit 321 outputs a signal for requesting the medical data to the aforementioned server 2 on the basis of input from the operator in the aforementioned input unit 33.

[53] As shown in Fig. 2, the aforementioned display control unit 322 makes the list X of the simple images M of the same patient which are based on the medical data stored in the aforementioned storage unit 21 to be displayed on a display screen 31a of the aforementioned display unit 31. The data for the aforementioned list X is prepared by the aforementioned list preparation unit 22. in Fig. 2, the list X displayed on d e aforementioned display unit 31 is a part of the list X prepared by the aforementioned list preparation unit 22. The aforementioned display control unit 322 is one example of an embodiment of a display control unit in the present invention,

[54] The aforementioned list X includes display columns CI and C2 for the incidental information, and a display column C3 for the simple images. These display columns C 1 and C2 for the incidental information and the display column C3 for the simple images are each configured by a plurality of cells CE. In the aforementioned list X, the display column CI tor the aforementioned incidental information is configured by the cells CE arrayed in the row direction (the lateral direction) and configuring the uppermost row. In addition, in the aforementioned list X, the display column C2 for the aforementioned incidental information is configured by the cells CE arrayed in the column direction (the longitudinal direction) and o>nfiguring the leftmost column.

[55] The aforementioned display control unit 322 makes the incidental information of the same attribute to be displayed on the display column CI for the aforementioned incidental information. In addition, the aforementioned display control part 322 makes the incidental information of the same attribute to be displayed also on the display column C2 for the aforementioned incidental information. Then, the incidental information of different attributes is displayed on the display column CI for the aforementioned incidental information and the display column C2 for the aforementioned incidental information. In Fig. 2, the document kind is displayed on the display column CI for the aforementioned incidental information and the date (the year, the month and the day) is displayed on the display column C2 for the aforementioned incidental information. The incidental information to be displayed on the display column C 1 for the aforementioned incidental information is one example of an embodiment of incidental infomiation of one attribute in the present invention, in addition, the incidental information to be displayed on the display column C2 for the aforementioned incidental information is one example of an embodiment of incidental information of another attribute in the present invention.

[561 The attributes of the display columns C 1 and C2 for the aforementioned incidental information may be made changeable by performing an inputting operation by the operator using the aforementioned input unit 33.

[57) in addition, the simple images based on the medical data are displayed on the display column C3 for the aforementioned simple images. The simple images M are thumbnail images and so forth. The data of the aforementioned simple images M is prepared by the list preparation unit 22 of the aforementioned server 2. The aforementioned simple image M is one example of an embodiment of an image in the present invention.

[58] Here, preparation of the aforementioned simple image M will be described. The aforementioned simple image M is prepared by the aforementioned list preparation unit 22. in a case where the simple image M displayed on the display column C3 for the aforementioned simple images is a medical use image which is based on the aforementioned medical use image data, one piece of medical use image data which has been selected from within a plurality of pieces of medical use image data generated in one test. Within the plurality of pieces of medical use image data generated in one test, the first data or intermediate data may be automatically selected. Then, the selected one piece of medical use image data is converted into a size which is appropriate to be displayed on the list X. This size is a size of an extent that it can be arranged on the display screen 31 a while maintaining perspicuity (for example, 64 x 64 pixels, 96 x 96 pixels or the like). The simple image M which is based on the medical use image data so converted as mentioned above is displayed in the cell CE configuring the display column C3 for the aforementioned simple images.

[59J addition, in a case where the aforementioned simple image M is an image which is based on the document data, if the document data is the pl urality of pieces of document data, for example, first document data will be selected and the data so selected will be converted into an appropriate size in the same manner as the above. Then, the image data M which is based on the converted data is displayed on the display column C3 for the aforementioned simple images, [60] in addition, in a case where the medical data which is displayed as the simple image

M is numerical value data, an image indicating the contents of this numerical value data is prepared and this image is displayed as the simple image M. For example, the image indicating the contents of the numerical value data is an image consisting of characters indicating the contents of the numerical value data. To take an example, with regard to numerical value data for a blood test, an image consisting of the characters of "Blood Test" is displayed as the aforemen ioned simple image M.

[61] The aforementioned display control unit 322 may display an enlarged simple image M by clicking the simple image M displayed on the display column C3 for the aforementioned simple images by the operator using the aforementioned input unit 33.

[62] The incidental information in the longitudinal direction (the column direction) of the display column C3 for the aforementioned simple images is displayed in the cell CE configuring the display column CI for the aforementioned incidental information. In addition, the incidental information in the lateral direction (the row direction) of the display column C3 for the aforementioned simple images is displayed in the cell CE configurixig the display column C2 for the aforementioned incidental information. In the display column C3 for the aforementioned simple images, the simple images M are arranged in a matrix (Matrix). In the display column C3 for the aforementioned simple images, the simple images M having the incidental information displayed in the cells CE configuring the display column CI for the aforementioned incidental information are arranged in the column direction, and the simple images M having the incidental information displayed in the cells CE configuring the display column C2 for the aforementioned incidental information are arranged in the row direction, hi the display column C3 for the aforementioned simple images, the aforementioned simple images M are arranged at positions specified from two pieces of incidental information on the display column CI for the

aforementioned incidental information and the display column C2 for the aforementioned incidental information.

[631 Specifically, in Fig. 2, the list X that the simple images M of each document kind are arrayed in the column direction and the simple images of each date are arrayed in the row direction is displayed. Explaining by taking one example, in the display column C3 for the simple images, the aforementioned display control unit 322 makes the simple images M (the thumbnail images indicating scanned images of an in-vitro medical test) which are basal on the medical data having information indicating the in-vitro malical test as the incidental information to be displayed in the column of the cells CE displayal as "In-vitro Medical Test" in the display column CI for the aforementioned incidental information, hi addition, in the display column C3 for the simple images, the aforementioned display control unit 322 makes the simple images M based on the medical data having the dale information of October 7, 2005 as the incidental information to be displayed, for example, in the row of the cells CE displayed as "2005/10/07" in the display column C2 for the aforementioned incidental information. As described above, the aforementioned display control unit 322 makes the aforementioned list X that the aforementioned simple images M are arranged in the row direction for every incidental information of one attribute and are arranged in the column direction for every incidental information of another attribute to be displayed.

[64 J In a ease where the attributes of the display columns CI and C2 for the

aforementioned incidental information have been changed, the aforementioned display control unit 322 rearranges the aforementioned simple images M accordingly.

[65] The operator performs a dragging operation by the aforementioned input unit 33, thereby making it. possible to move a part (a displayed part of the list X) which is displayal on the aforementioned display screen 31a in the aforementioned list X in the longitudinal direction, the lateral direction and an oblique direction. In a case where the aforementioned display unit 31 is a touch panel type display, the operator can move the displayed part of the aforementioned list X in the longitudinal direction, the lateral direction and the oblique direction by performing the dragging operation or a flicking operation with fingers. When the inputting operation such as the aforementioned dragging operation, the flicking operation or the like is performed by the aforementioned input unit 33, the aforementioned display control unit 322 makes the displayed part of the aforementioned list X move in the direction according to that inputting operation. Since the operator can move the displayed part of the aforementioned list X in a desired direction as mentioned above, the operability is favorable.

[66] In addition, the aforementioned display control unit 322 makes an indicator

(indicator) in to be displayed on the list X displayed on the aforementioned display unit 31. This indicator In indicates presence of the simple images M which are not displayed on the

aforementioned display unit 31 in the simple images M configuring the list X which has been prepared by the aforementioned list preparation unit 22, and indicates presence absence of the aforementioned simple images M at least on either the lower side or the right side of the displayed part of the aforementioned list X. The aforementioned indicator In includes a numerical value n indicating the number of simple images M which are not displayed on the aforementioned display unit 31. Details will be described later. The aforementioned indicator In is one example of an embodiment of an indicator in the present invention. A display control function for the aforementioned indicator to by the display control unit 322 is one example of an embodiment of a display control function in the present invention.

[67] The aforementioned input unit 33 is configured by a keyboard, a mouse and so forth. The aforementioned input unit 33 is one example of an embodiment of an input unit in the present invention.

|68] The aforementioned storage unit 34 is, for example, an HDD or a semiconductor memory such as a RAM (Random Access memory), a ROM (Read Only Memory) or the like.

[69] The aforementioned department system 4 is a department system in a hospital such as, for example, a radiology information system (RIS) including the modalities of the X-ray CT device, the MRI device and so forth, a laboratory testing system or the like.

[70] Next, the operation of the image display system 1 in this example will be explained on the basis of a flowchart in Fig, 3, First, in step S 1 , the aforementioned list preparation unit 22 prepares the data for the list X. Specifically, first the operator inputs specific information on a patient P such as his name, his ID and so forth by the input unit 33 of the aforementioned display terminal 3. Next, the aforementioned data request unit 321 makes a request for the data for the list X relating to the aforementioned patient P whose specific information has been input to the aforementioned server 2. In this request, the specific information of the patient P is included.

[71j When the request for the data for the aforementioned list X is made from the aforementioned data request unit 321 , the list preparation unit 22 of the aforementioned server 2 prepares the data for the list X. Describing in detail, first, the aforementioned list preparation unit 22 specifies the medical data on the patient P which is stored in the aforementioned storage unit 21 on the basis of the specific information of the patient P which has been input from the aforementioned data request unit 321. Then, the aforementioned list preparation unit 22 prepares the data for the list X consisting of the simple images M about the aforementioned patient P on the basis of the specified medical data on the patient P.

[72] Next, in step S2, the aforementioned counting unit 23 counts the simple images M in the row direction and the column direction of the aforementioned list X to obtain the numerical value data for displaying the numerical value n configuring the aforementioned indicator In. The aforementioned counting unit 23 obtains the aforementioned numerical value data for the aforementioned every cell CE. The aforementioned aiunting unit 23 obtains the aforementioned numerical value data in the row direction and the aforementioned numerical value data in the column direction with regard to the aforementioned each cell CE.

[73] Specifically explaining, in Fig. 4, the cells CE on the display column C3 for the aforementioned simple images are shown in the list X prepared by the aforementioned list preparation unit 22. Here, an example of obtaining the aforementioned numerical value data for a shaded cell CE1 will be described.

[74] A. circle shown in the cell CE indicates that the simple image M is present. The aforementioned counting unit 23 counts the number of the simple images M which are present on the right side of the cell CE1 in the row that, the aforementioned cell CE1 belongs. In Fig. 4, the number of the simple images M which are present on the right side of the aforementioned cell CE! is "3". Thus, "3" is obtained as the numerical value data in the row direction with regard to the aforementioned cell CE1. The numerical valise data in the row direction is stored in the aforementioned storage unit 21.

[75] In addition, the aforementioned counting unit 23 counts the number of the simple images M which are present under the aforementioned cell CEI in the column that the aforementioned cell CEI belongs. In Fig. 4, the number of the simple images M which are present under the aforementioned cell CEI is "2". Thus, "2" is obtained as the numerical value data in the column direction with regard to the aforementioned cell CEI . This numerical value data in the column direction is also stored in the aforementioned storage unit 21.

[76] The aforementioned counting unit 23 performs the above-mentioned counting with regard to all the cells CE to obtain the numerical value data in the row direction and the numerical value data in the column direction. Then, the numerical value data in the row direction and the numerical valued data in the column direction are stored in the aforementioned storage part 21 with regard to each cell CE.

[77] The numerical value data in the row direction to be stored with regard to the aforementioned each cell CE is data on a numerical value indicating how many simple images M are present on the right side of that cell in the row that that cell CE belongs. In addition, the numerical value data in the column direction to be stored with regard to the aforementioned each cell CE is data on a numerical value indicating how many simple images M are present under that cell CE in the column that that cell CE belongs.

[7S] Ne t, in step S3, the aforementioned data output unit 24 outputs the data for the aforementioned list X prepared in the aforementioned step SI and the aforementioned numerical data obtained in the aforementioned step 82 to the aforementioned display terminal 3. Then, the aforementioned display control unit 322 makes the list X to be displayed on the aforementioned display unit 31 on the basis of the data for the aforementioned list X and the aforementioned numerical value data. A part of the list X which has been prepared by the aforementioned list preparation unit 22 is displayed on this display unit 31. The aforementioned display control unit 322 makes the aforementioned indicators in to be displayed on a right end and a lower end of the display column C3 for the simples images on the aforementioned list X.

[79] The aforementioned indicators In are displayed per row and per column on the basis of the aforementioned numerical value data. The aforementioned indicator In which has been displayed on the right end of the display col umn C3 for the aforementioned simple images indicates that simple images M which are not displayed are present on the right side of the cell CE which is displayed in that row. In addition, the aforementioned indicator in which has been displayed on the lower end of the display column C for the aforementioned simple images indicates that simple images M which are not displayed are present on the lower side of the cell CE which is displayed in that column. Thus, in a row and a column that the aforementioned indictors In are not displayai, the simple images M are not present on the right side and the lower side of the cell CE which is being displayed.

[80J The aforementioned display control unit 322 makes the numerical value n indicating the number of simple images M which are not displayed on the aforementioned display screen 31 a to be displayed as a part of the aforementioned indicator In. The aforementioned numerical value n which has been displayed on the right end of the display column C3 for the

aforementioned simple images indicates how many simple images M which are not displayed are present on the right side of the cell CE which is being displayed in that row. In addition, the aforementioned numerical value n which has been displayed on the lower end of the display column C3 for the aforementioned simple images indicates how many simple images M which are not displayed are present on the lower side of the cell CE which is being displayed in that column.

[SI] The operator can move the displayed part of the aforementioned list X by performing the dragging operation by placing a cursor CU on the display column C3 for the aforementioned simple images as shown in Fig. 5. By this dragging operation, he cars move the displayed part of the aforementioned list X in any of the longitudinal direction, the lateral direction and the oblique direction.

[82J The aforementioned display control unit 322 changes the numerical value n of the aforementioned indicator in when the number of the simple images M which are not displayed on the aforementioned display screen 3 la is changed with movement of the displayed part of the aforementioned list X. For example, when the displayed part of the aforementioned list X is moved in a downward direction from the state shown in Fig, 2 and Fig. 5 and the number of the simple images M which are not displayed on the aforementioned display screen 31a is reduced, the aforementioned numerical value n displayed on the lower end of the display column C3 for the aforementioned simple images becomes small as shown in Fig, 6. The operator can grasp how many simple images M which are not displayed on the aforementioned display screen 31 a are still present on the lower side from the aforementioned numerical value n.

[831 When the displayed part of the aforementioned list X is forther moved in the downward direction and the simple images M which are not displayed on the aforementioned display screen 31a come not to be present in all the columns, the aforementioned display control unit 322 does not display the aforeinentioned indicator In on the lower end of the display column C3 for the aforementioned simple images as shown in Fig. 7. The operator can grasp that the simple images M are not present under a currently displayed position and there is no need to move the displayed part of the list X further downward by ceasing to display the indicator In as mentioned above.

[84] in addition, when the displayed part of the list X displayed on the aforementioned display screen 31 a is moved in the rightward direction from the state shown in Fig. 8 and the number of the simple images M which are not displayed on the aforementioned display screen 3 la is reduced, the aforementioned numerical value n displayed on the right end of the display column C3 for the aforementioned simple images becomes smaller as shown in Fig. 9. The operator can grasp how many simple images M which are not displayed on the aforementioned display screen 31a are still present on the right side from the aforementioned numerical value n.

[85] When the displayed part of the aforementioned list X is former moved in the rightward direction and the simple images M which are not displayed on the aforementioned display screen 31 a come not to be present in all the rows, the aforementioned display control unit 322 does not display the aforementioned indicator in on the right end of the aforementioned simple image display column C3 as shown in Fig. 10. The operator can grasp that the simple images M are not present on the right side of the currently displayed position and there is no need to move the displayed part of the list X further downward by ceasing to display the indicator in as mentioned above.

[86] A method of displaying the aforementioned numerical value n configuring the aforementioned indicator In will be described. The aforementioned display control unit 322 displays a numerical value of numerical value data which is stored for cells in the rightmost column and the lowermost row in the cells whose entire areas are being displayed on the aforementioned display screen 31 a as the aforementioned numerical value n. However, in a case where the numerical value of the aforementioned numerical value data is zero, the aforementioned display control unit 322 makes the aforementioned indicator in not to be displayed.

[87] A description will be made specifically on the basis of Fig. 11. The display column C3 for the simple images in the list X is displayed in Fig. 11. However, it is simplified and only the cells CE are displayed. In Fig. 1 1 , a dotted part to which a symbol S is assigned is a display area (the displayed part of the list X) which is displayed on the aforementioned display screen 31a. in addition, a circle indicates that the simple image M is present. However, regardless of presence of the simple image M in the cell CE within the aforementioned display area S, illustration of the circle is omitted.

[88] in Fig. 1 1 , in the cells CE which are included in the aforementioned display area S and all the areas of which are included in the aforementioned display area S, numerals indicated to cells CEr in the rightmost column and cells CEb in the lowermost row indicate the numerical value data in the row direction and the column direction which has been stored for the respective cells CE. For the aforementioned cells CEr, the numerical value data of "1 ", "2", "1" and "3" is stored in order from the top as the numerical value data in the row direction, in addition, for tlie aforementioned cells CEb, the numerical value data of "1", "0", "1", "1", "2" and "3" is stored in order from the left as the numerical value data in the column direction.

[89] The aforementioned display control unit 322 makes the numerical value to be displayed on the right end of the display column C3 for the aforementioned simple images on the basis of the numerical val ue data which has been stored tor the aforementioned cells CEr.

Specifically, though not shown in the drawing in particular, "1", "2", "1" and "3" are displayed in order from the top as the aforementioned numerical value n on the right end of the display column C3 for the aforementioned simple images, in addition, the aforementioned display control unit 322 makes the numerical value n to be displayed on the lower end of the display column C3 for tlie aforementioned simple images on the basis of tlie numerical value data which has been stored for the aforementioned cells CEb. That is, though not shown in the drawing in particular, "1", "1", "1 ", "2" and "3" are displayed as the numerical value n on the lower end of the display column C3 for die aforementioned simple images. However, the aforementioned indicator In is not displayed for the column (the second column from the leftmost side) that the numerical value of the numerical value data is "0".

[90] Incidentally, the positions of tlie numerals shown in Fig. 11 are different from the position of the aforementioned numerical value n which is to be displayed on the aforementioned display screen 31 a.

[91] A case that the aforementioned display area S has moved downward from the position in Fig. 11 and has moved down to the position shown in Fig. 12 will be described. An area 8' surrounded with a two-dot chain line in Fig. 12 is the display area shown in Fig. 11.

[92] The lower end of the display area S in Fig. 12 reaches the lower end of the cell configuring the row which is one under the row which has been the lowest in Fig. 1 1. When the lower end of the aforementioned display area S reaches this position, the numerical value n ("1", "1", "2" and "2") which is based on tl e numerical value data stored for the cells CEb which have newly been in the lowest row in the aforementioned display area S is displayed on the lower end of the display column C3 for the aforementioned simple images. However, in the column (the fourth column from the leftmost side) of the cell CEb that the numerical value of the numerical value data has been newly reduced to "0", display of the aforementioned indicator in disappears.

[93] In addition, when the lower end of the aforementioned display area S reaches the position in Fig. 12, the indicator In including tl e numerical value n ("1") is newly displayed on the right end of the display column C3 for the aforementioned simple images on the basis of the numerical value data in the row direction which has been stored for a cell CErb which is in the rightmost column and has newly been in the lowermost row in the aforementioned display area S.

[94] On the other hand, for the row (the uppermost row in Fig. 12) that all areas of the cells CE have come not to be displayed by downward movement of the aforementioned display ai'ea S, the aforementioned display control unit 322 makes the aforementioned indicator In not to be displayed,

[95] Next, a case that the aforementioned display area S has moved rightward from the position in Fig. 11 and moved to the position shown in Fig. 13 will be described. An area which is surrounded with a two-dot chain line and is designated by a symbol 8' in Fig. 13 is the display area shown in Fig. 11.

[96] The right end of the display area S in Fig. 13 reaches the right end of the cell configuring the column which is one on the right side of the column which has been the rightmost one in Fig. 1 1. When the right end of the aforementioned display area S reaches this position, the numerical value n ("1", "1" and "2") which is based on the numerical value data which has been stored for the cells CEr which have newly been in the rightmost column in the

aforementioned display area S is displayed on the right end of the display column C3 for the aforementioned simple images. However, in the row (the third column from the uppermost side) of the cell CEb that the numer cal value of the numerical value data has newly been reduced to "0", display of the aforementioned indicator In disappears.

[97] In addition, when the right end of the aforementioned display area S reaches the position in Fig. 13, the indicator In including the numerical value n ("1") is newly displayed on the lower end of the display column C3 for the aforementioned simple images on the basis of the numerical value data in the column direction which has been stored for the ceil CErb which is in the lowermost row and has newl been in the rightmost column in the aforementioned display area S.

[98] On the other hand, for the column (the leftmost column in Fig. 13) that all areas of the cells CE have come not to be displayed by rightward movement of the aforementioned display area S, the aforementioned display control unit 322 does not make the aforementioned indicator in display.

[99] The list X is displayed by the processing in steps SI to S3 which have been described hereinabove, in this list X, in a case where the attributes of the display columns CI and C2 for the incidental information have been changed, the aforementioned processing in steps SI to S3 is again performed. That is, the data for the list X is again prepared in the aforementioned step S 1 and counting by the aforementioned counting unit 23 is again performed in the aforementioned step 82 in accordance with the changed attributes, by which the numerical value data is obtained. Then, the aforementioned list X is displayed on the basis of the data for the list X and the numerical value data which have been again obtained.

[100] Next, modified examples will be described. First, a first modified example will be described. In this modified example, the numerical value of the numerical value data which is stored for a cell CE which is in the rightmost column and die lowermost row in die cells CE whose over 1/2 parts in a left/right direction or an up/down direction are displayed on the aforementioned display screen 3 la is displayed as the aforementioned numerical value n. Thus, a timing that the aforementioned numerical value n changes when the displayed part of the aforementioned list X has moved becomes different from that in the above-mentioned

embodiment.

[101] A description will be made specifically first on the basis of Fig. 14. Fig. 14 shows a state that the display area S has moved downward from the position in Fig. 1 1. It is assumed that the lower end of the aforementioned display area S is at a 1/2 position of the cell CEb in the up/down direction, in this example, this cell CEb is the cell in the lowermost row in the cells whose over 1/2 parts in the up/down direction are displayed on the aforementioned display screen 31a. The numerals "1 ", "0", "1", "0", "2" and "2" indicated in the aforementioned cells CEb are numerical values of the numerical value data in the column direction which has been stored for the aforementioned cells CEb.

[102] In Fig. 14, the cells CEr in the column that the numerals "1", "2", "1", "3" and "1" are indicated are the cells in the riglitmost column in the cells whose over 1/2 parts in the left right. direction are displayed on the aforementioned display screen 31a. The aforementioned numerals "1", "2", "1", "3" and "1" are numerical values of the numerical value data in the column direction which has been stored for the aforementioned cells CEr.

[103] When the lower end of the aforementioned display area S reaches the position in Fig. 14, the aforementioned display control unit 322 makes the numerical value n (" 1 ", " 1 ", "2" and "2") which is based on the numerical value data in the column direction which has been stored for the aforementioned cells CEb in Fig. 14 to be displayed on the lower end of the display column C3 for the aforementioned simple images. In addition, in the column (the fourth column from the leftmost side) of the cell CEb that the numerical value of the numerical value data has been newly reduced to "()", display of the aforementioned indicator In disappears,

[104] In addition, when the lower end of the aforementioned display area S reaches the position in Fig. 14 as described above, die indicator in including the numerical value n ("1 ") is newly displayed on the right end of the display column C3 for the aforementioned simple images on the basis of the numerical value data in the row direction which has been stored for the cell CErb which is in the rightmost column and has newly been in the lowermost row in the aforementioned display area S.

[105] Next, a case where the display area of the aforementioned list X has moved rightward will be described on the basis of Fig. 15. Fig, 15 shows a state that the display area S has moved rightward from the position in Fig. 1 1, It is assumed that the right end of the aforementioned display area S is at a 1/2 position of the cell CEr in the left/right direction, in this example, this cell CEr is the cell in the rightmost column in the cells whose over 112 parts in the left/right direction are displayed. The numerals "0", "0", "0", and "1" indicated in the aforementioned cells CEr are numerical values of the numerical value data in the row direction which has been stored for the aforementioned cells CEr.

[106] in Fig. 15, the cells CEb in the row that the numerals "0", "1 ", "1", "2", "3", "1" and "1 " are indicated are the cells in the lowermost row in the cells whose over 1/2 parts in the up/down direction are displayed on the aforementioned display screen 31 a. The aforementioned numerals "0", "1", "1", "2", "3", "1" and "1" are numerical values of the numerical value data in the row direction which has been stored for the aforementioned cells CEr.

[107] When the right end of the aforementioned display area S reaches the position in Fig. 15, the aforementioned display control unit 322 makes the numerical value n ("1") which is based on the numerical value data in the row direction which has been stored for the aforementioned cells CEr in Fig. 15 to be displayed on the right end of the display column C3 for the

aforementioned simple images, in addition, in the row of the cells CEr that the numerical value of the numerical value data has been newly reduced to "0", display of the aforementioned indicator In disappears.

[108J hi addition, when the right end of the aforementioned display area S reaches the position in Fig. 15 as described above, the indicator In including the numerical value n ("]") is newly displayed on the lower end of the display column C3 for the aforementioned simple images on the basis of the numerical value data in the column direction which has been stored for the cell CErb which is in the lowermost row and has newly been in the rightmost, column in the aforementioned display area S.

[109] Next, a second modified example will be described. When the operator clicks the aforementioned indicator In by the cursor CU using the aforementioned input unit 33 as shown in Fig. 16, the displayed part of the list X moves such that the simple images M which are not displayed on the aforementioned display screen 31 a are displayed. When the indicator In displayed on the Sower end of the display column C3 for the aforementioned simple images is clicked, the aforementioned display control unit 322 makes the displayed part of the

aforementioned list X move downward. On the other hand, when the indicator In displayed on the right end of the display column C3 for the aforementioned simple images is clicked, the aforementioned display control unit 322 makes the displayed part of the list X move rightward.

[110] Movement of the displayed part of the list X in this example will be described in detail on the basis of Fig. 17 to Fig. 19. In Fig. 17 to Fig. 19, a list which is different from that in Fig. 16 is shown. Here, a case that the indicator In which is displayed on the lower end of the display column C3 for the aforementioned simple images has been clicked will be described by way of example. The numerals indicated in Fig. 17 to Fig. 19 indicate the numerical values of the numerical value data in the column direction which has been stored for the cells CE.

[ί ί ί I The aforementioned display control milt 322 makes the displayed part of the aforementioned list X move such that the simple image M in the cell CE that the numerical value of the aforementioned numerical value data becomes smaller than the currently displayed numerical value n is displayed in the column of the clicked indicator In. For example, when the indicator In in the column of a cell CE-A. is clicked, the aforementioned display control unit 322 makes the aforementioned display area S move such that a cell CE-a for which the numerical value data "1" which is smaller than the numerical "2" of the numerical value data which has been stored for the aforementioned cell CE~A has been stored becomes a cell in the lowermost row in the display area S as shown in Fig. 18 (the area which is surrounded with the two-dot chain line and is designated by the symbol S' is the display area before movement).

[112] In addition, when the indicator in of a cell CE-B is clicked, for example, in the state in Fig. 17, the aforementioned display control unit 322 makes the aforementioned display area S move such that a cell CE-b for which the numerical value data "0" which is smaller than the numerical value data "1" which has been stored for the aforementioned cell CE-B has been stored becomes a cell in the lowermost row of the display area S as shown in Fig. 19.

[113] Next, a third modified example will be described. As shown in Fig. 20, the aforementioned indicators In may be displayed not only on the right end and the lower end but also on the left end and the upper end of the display column C3 for the aforementioned simple images. In this example, the aforementioned indicators in indicate presence/absence of the simple images M and their numbers not only on the lower side and the right side but also on the upper side and the left side of the displayed part of the aforementioned list X.

[114] The numerical value n displayed on the left end of the aforementioned simple image display column C3 is displayed on the basis of the numerical value data (the numerical value data for displaying the numerical value n on the left end of the display column C3 for the

aforementioned simple images) in the row direction which has been stored for the aforementioned respective cells CE. in addition, the numerical value n displayed on the upper end of the display column C3 for the aforementioned simple images is displayed on the basis of the numerical value data (the numerical value data for displaying the numerical value n on the upper end of the display column C3 for the aforementioned simple images) in the column direction which is stored for the aforementioned respective cells CE.

f 115] First, a method of displaying the aforementioned numerical value n on the upper end of the display column C3 for the aforementioned simple images will he described on the basis of Fig. 21 and Fig. 22. Here, in Fig. 21 and Fig. 22, a description will be made paying attention to one column (ceils CE1 to CE7) that numerals are shown. The numerals shown in Fig. 21 and Fig. 22 indicate the numerical value of the numerical value data in the column direction which has been stored for the cells CE, The numerical value of this numerical value data is displayed as the numerical value n on the lower end of the display column C3 for the aforementioned simple images.

[116] The aforementioned counting unit 23 subtracts the numerical value of the cell which is one above the cell CE in the uppermost row of the display area S from the numerical value of the cell CE in the uppermost row in the display column C3 for the the aforementioned simple images to obtain the numerical value data of the numerical value n to be displayed on the upper end of the display column C3 for the aforementioned simple images. Specifically, in a case where the position of the display area S is the position shown in Fig. 21 , the cell in the uppermost row of the aforementioned display area S is the cell CE3 and the cell which is one above it is the cell CE2. Therefore, the aforementioned counting unit 23 subtracts the numerical value "3" of the aforementioned cell CE2 from the numerical value "4" of the cell CE1 in the uppermost row of the display column C3 for the aforementioned simple images. Thus, the data of the numerical value "Γ' is obtained as the numerical val ue data of the numerical value n to he displayed on the upper end in the display column C3 for the aforementioned simple images. Therefore, the aforementioned display control unit 322 makes "1" to be displayed on the upper end of the display column C3 for the aforementioned simple images as the aforementioned numerical value n in the column of the aforementioned cells CE! to CE7.

[117] in addition, in a case where the position of the display area S is the position shown in Fig. 22, the cell in the uppermost row of the aforementioned display area S is the cell CE4 and the cell which is one above it is the cell CE3. Therefore, the aforementioned counting unit 23 subtracts the numerical value "2" of the aforementioned cell CE3 from the numerical value "4" of the cell CE1 in the uppermost row in the display column C for the aforementioned simple images. Thus, the data of the numerical value "2" is obtained as the numerical value data of the numerical value n to be displayed on the upper end of the display column C3 for the aforementioned simple images. Therefore, the aforementioned display control unit 322 makes "2" to be displayed on the upper end of the display column C3 for the aforementioned simple images as the

aforementioned numerical value n in the column of the aforementioned cells CE 1 to CE7.

[118J Next, a method of displaying the aforementioned numerical value n on the left end of the display column C3 for the aforementioned simple images C3 will be described on the basis of Fig, 23. Here, in Fig. 23, a description will be made paying attention to one row (cells CE1 1 to CE19) that numerals are shown. The numerals shown in Fig. 23 indicate the numerical value of the numerical value data in the row direction which has been stored for tile cell CE. The numerical value of this numerical value data is displayed as the numerical value n on the left end of the display column C3 for the aforementioned simple images.

[1191 The aforementioned counting unit 23 subtracts the numerical value of the cell which is one on the left side of the cel l CE in the leftmost column in the display area S from the numerical value of the cell CE in the leftmost column in the display column C for the

aforementioned simple images to obtain the numerical value data of the numerical value n to be displayed on the left end of the display column C for the aforementioned simple images, in Fig. 23, the cell in the leftmost column in the aforementioned display area S is the cell CE13 and the cell which is one on the left side thereof is the cell CE12. Therefore, the aforementioned counting unit 23 subtracts the numerical value "4" of the aforementioned cell CE12 from the numerical value "5" of the cell CE11 in the leftmost column in the display column C3 for the aforementioned simple images. Thus, the data of the numerical value "1" is obtained as the numerical value data of the numerical value n to be displayed on the left end of the display column C for the aforementioned simple images. Therefore, the aforementioned display control unit 322 makes "1" to be displayed on the left end of the display column C for the aforementioned simple images as the aforementioned numerical value n in the row of the aforementioned cells CE1 1 to CE19.

[120] incidentally, the method of displaying the aforementioned numerical value n is not limited to the above-mentioned methods. For example, numerical value data for displaying the numerical value n on the left end and the upper end of the display column C3 for the

aforementioned simple images may be stored for each cell CE, That is, in order to display the numerical value n on the left end of the display column C3 for the aforem entioned simple images, in a column that a certain cell CE belongs, data of the numerical value indicating how many simple images M are present on the left side of that cell CE may be stored for each cell CE. In addition, in order to display the numerical value n on the upper end of the display column C3 for the aforementioned simple images, in a column that a certain cell CE belongs, data of the numerical value indicating how many simple images M are present above that cell CE may be stored for each cell CE.

[121] Next, a fourt!i modified example will be described on the basis of Fig. 24. As shown in Fig. 24, the aforementioned indicator In may not include the aforementioned numerical value n.

[122] Although the present invention has been described by the aforementioned

embodiments, it goes without saying that the present invention can be embodied by modifying it in a variety of ways within a range not. departing from the gist thereof. For example, as shown in Fig. 25, an indicator In' indicating that simple images which are not displayed on the

aforementioned display screen 31 a are not present may be displayed together with the

aforementioned indicator In. In addition, though not shown in the drawing in particular, the aforementioned indicator fa may not be displayed and only the aforementioned indicator In' may be displayed.

[123] In addition, the aforementioned list preparation unit 22 of the aforementioned server 2 may change and may not display the numerical value n of the aforementioned indicator In.

[124] In addition, as sho wn in Fig. 26, the control unit 23 of the aforementioned display terminal 3 may have a list preparation unit 323 and a counting unit 324, in place of the aforementioned list preparation unit 22 and the aforementioned counting unit 23 of the aforementioned server 2.

DESCRIPTION OF REFERENCE NUMERALS OR SYMBOLS

1 image display system

2 server

3 display terminal (display device)

21 storage unit

23, 324 counting unit

31 display unit

33 input unit

322 display control unit

X !ist

M simple image